David S. Linthicum: Is SOA Quality a Priority?

By David S. Linthicum

October 1, 2007 —

SOA testing is in the media a bit these days as those who implement SOA have to make sure those new services, abstraction layers and orchestrations are ready for prime time. However, the common approach to SOA deployment is: development now, requirements maybe, and testing if we have the time. You can’t afford to make that mistake; there is too much on the line with this stuff.

Indeed, a recent study by Nucleus Research discovered that existing SOA implementations achieved limited success when considering ROI. Only 37 percent of enterprises have achieved a positive return on their investments from SOA deployments. While the root cause of these low ROI numbers can be attributed to many factors, the key issues relate to a lack of planning and a lack of testing.

Central to this problem is the fact that quality assurance, in general, is an often overlooked concept to most developers and designers. I mean, you’re admitting that your code and resulting services need to be tested. How can that be?

Moreover, those who run SOA projects don’t allocate a lot of time for testing, and typically when projects are behind, testing is sacrificed. But the complex nature of SOA means that testing is that much more important, considering that mistakes and bad services can ripple throughout the architecture.

There are many dimensions to SOA testing. They include services, processes, performance, and holistic or system testing.

Service-level testing is the most important, since core services are the foundation of the SOA. However, services are written very differently, depending upon the developer. Services may also be built on top of existing interfaces and APIs, and thus are even more complex and more in need of quality assurance testing, since you’re placing an interface layer on top of an interface layer. It’s a matter of validating the services for their intended use, verifying that the interfaces function correctly, and validating both WSDL and schema. Also, you need to consider diagnostics for design time and runtime, and make sure to address those older but important notions of unit, functional and regression testing.

In addition to service-level testing, we have to test the way services are abstracted into processes and composites. Since these are typically exposed as services themselves, it’s just a matter of testing another level up from the core services, as units, and regressing down through the services that they leverage (unit and system). This is very much like testing object-oriented systems, but these guys have binary interfaces and heterogeneous development and run-time platforms, thus the complexity is much higher.

Performance testing is perhaps just as critical, considering that most of the quality problems I run into when deploying SOA relate back to performance. Here is where you test against the SLAs established within the project, and learn how to spot bottlenecks, such as slow services, that can bring your SOA down to a crawl. Performance testing in the world of SOA is a matter of testing at the service, composite, process and system levels. You look at overall performance first, then decompose the architecture down to functional primitives to isolate the system’s problem components. You need to create an ongoing performance testing approach since so many performance issues develop over time as message and data traffic increases or changes.

Testing services, however, requires testing tools, unless you plan to write your own, which I don’t recommend. While there are a few players in the services/SOA testing game, Mindreef’s SOAPscope Server is one of the few that I keep seeing in use. Mindreef provides tools for automated testing and debugging of Web services and SOA projects, from validation of the service, testing to form and function, and performance testing. There are other tools as well, each taking a different approach to SOA quality, so do your research. I would recommend only using tools that have well-defined approaches to testing, or step-by-step procedures for leveraging their testing tools for your SOA.

What’s key here is to remember that you’re testing an architecture, and not an application. Thus, the complexity of the system, and the approaches and tools used for testing, goes way up. It’s important that you have a solid test plan, an arsenal of testing tools and techniques, and the time needed to test the architecture and correct any problems before they are found by the end user. Consider the systemic and business critical nature of the architecture.

Just to be very clear: Don’t skimp on testing!

David S. Linthicum is a managing partner with Zapthink. Reach him at david@zapthink.com.

Share this link: http://www.sdtimes.com/link/31175

SOA Software releases project-planning suite for SOA transition Portfolio Manager provides a framework for SOA planning, helping developers prioritize services, understand dependencies, and plan architecture and governance processes, the company says. The product is marketed as being essential for creating road maps for transitioning to SOA.

SOA’s dead; long live SOA While software tool providers can no longer pin their products to the term, its best practices live on inside the cloud

SOA Watch: Best of times for SOA architects Even though economic times are tough right now, organizations are increasingly looking for SOA architects. Businesses looking to hire SOA architects should look for certain traits so that they pick someone actually proficient in the technology.

Add comment

Name*
Email*
Country

Comment
Preview

News on Monday
more>>
SharePoint Tech Report
more>>

Download Current Issue
ISSUE 3/15/2010 PDF

Need Back Issues?
DOWNLOAD HERE

Receive the print Edition?

Google Code turns 5
Google Code Turns 5, and adds a Paxos Algorithm to make the system more stable and reliable.
03/17/2010 11:16 AM EST

Test your Visual Studio 2010 know-how
Microsoft is offering free beta certification exams for Visual Studio 2010.
03/17/2010 11:08 AM EST

Microsoft lifts the hood on IE9
Microsoft is previewing IE9.
03/16/2010 01:10 PM EST