2010 Edition
Software quality assurance testing involves the entire software development process
- monitoring and improving the process, making sure that any agreed-upon standards
and procedures are followed, and ensuring that problems are found and dealt with. It’s
clearly oriented to “prevention.”
Organizations vary considerably in how they assign responsibility for quality assurance
and testing. Sometimes they’re the combined responsibility of one group or individual
within the company. Also common are project teams that include a mix of testers and
developers who work closely together, with overall QA processes monitored by project
managers. It will depend on what best fits an organization’s size and business structure.
What are some recent major computer system failures caused by software bugs?
* In August of 2008 it was reported that more than 600 U.S. airline flights were
significantly delayed due to a software glitch in the U.S. FAA air traffic control system.
The problem was claimed to be a ‘packet switch’ that ‘failed due to a database
mismatch’, and occurred in the part of the system that handles required flight plans.
* Software system problems at a large health insurance company in August 2008 were
the cause of a privacy breach of personal health information for several hundred
thousand customers, according to news reports. It was claimed that the problem was
due to software that ‘was not comprehensively tested’.
* A major clothing retailer was reportedly hit with significant software and system
problems when attempting to upgrade their online retailing systems in June 2008.
Problems remained ongoing for some time. When the company made their public
quarterly financial report, the software and system problems were claimed as the
cause of the poor financial results.
* Software problems in the automated baggage sorting system of a major airport in
February 2008 prevented thousands of passengers from checking baggage for their
flights. It was reported that the breakdown occurred during a software upgrade,
despite pre-testing of the software. The system continued to have problems in
subsequent months.
In some cases an IT organization may be too small or new to have its own in-house
testing staff even if the situation calls for it. In these circumstances it may be appropriate
to instead use contractors or outsourcing, or adjust the project management and
development approach (by switching to a licensed or hosted QA/testing solution).
Highlights
Founded:
1995, California
Customer Focus:
TechExcel software is targeted to mid-size and large teams (20-1000+) of developers.
Select Customers:
Sony, Activision, Electronic Arts.
Traditional approaches to ALM stipulate that every phase of software development, from
product concept to strategy, planning to implementation, and finally to verification and
delivery, relies on separate tools and processes. TechExcel DevSuite is built around the
best-practices insight that knowledge is central to any product development initiative.
By eliminating the silos of knowledge that exist between different teams and in different
locales, DevSuite helps enterprises dramatically transform their development processes,
increasing efficiency and the overall quality of their end products. This strategy helps
teams communicate better and reduce their cycle times, allowing the right products for
the right markets to be developed in the shortest possible time.
TechExcel Technology
Client:
* Windows 2000, Windows XP, or Windows NT 4.0 or above
* Pentium PC with 256MB memory and 200MB free disk space
* Microsoft .NET framework 2.0
Server:
* Windows 2000, Windows NT 4.0 Server or above
* Pentium PC with 512MB memory and 500MB free disk space
* Microsoft Internet Information Server (IIS) 5.0 and above
* Microsoft .NET Framework 2.0
Supported Web browsers:
* Microsoft Internet Explorer 6.0 and above
* Netscape 6.0 and above
* FireFox 1.0 and above
Highlights
* Integrated cross-platform application lifecycle management (ALM) solutions
for high traceability
* High scalability and configurability with low administrative overhead
* Extensible with flexible workflow engines, industry standard databases, and
open programming interfaces
* Company focus on helping development organizations improve software
development efficiency and quality
Founded:
1995, Ohio
Customer Focus:
Customers of all sizes and in all industries use Seapine ALM solutions. Companies in
industries where software quality is critical are particularly heavy users of Seapine’s
solutions.
Select Customers:
American Stock Exchange, CIGNA, FEMA, Department of Defense, US Air Force, NBC
Universal, Bausch & Lomb, Cisco – WebEx, Nokia, Lockheed Martin, SEGA, Novartis
Pharmaceuticals.
* Use one tool to test multiple technologies and applications, including Web, Windows,
and Java applications.
* Support both novice and experienced testers with QA Wizard Pro’s powerful, easy-to-
use scripting language. Grid View provides a point-and-click interface while Text View
provides direct access to the scripting language.
* Automate complex test scenarios with a comprehensive library of built-in functions and
statements.
* Significantly reduce maintenance time when an application changes with QA Wizard
Pro’s object-based record and playback engine, smart matching, and ability to identify
objects by unique properties.
* Store application object information in the global application repository and quickly
propagate application object changes to all team members from a central location.
* Use checkpoints to validate both visible and non-visible information by comparing the
expected value of window or control properties with the run-time value.
* Verify the text in charts, graphs, Web graphics, Flash-based applications, Java
applets, and more with optical character recognition (OCR) checkpoints.
* Easily create data-driven test scripts to more efficiently boundary test applications and
to quickly populate applications with large data sets for stress testing.
* Distribute automated testing and more quickly run through test suites with remote
script execution.
* Create batch script files and schedule groups of test scripts to run 24 hours a day, 7
days a week for a shorter, more thorough testing cycle.
Highlights
* TSelect Awards: 2008 Testers Choice Winner – Best Commercial/Test
Performance Solution, 2008 Jolt Finalist – Best Project Management Tool, 2007
SD Times Top 100 - Top Software Innovators.
* Over 70,000 Customers in over 24 different countries.
* Free Trial and Demos Available.
* Flexible Pricing and Deployment Options - SaaS or Enterprise versions available.
* SaaS pricing starts at $30 per month and Enterprise pricing starts at $1000 per
seat.
Founded:
1992
Customer Focus:
Pragmatic Software offers two versions, the SaaS version is an economical version
dedicated to small and mid-sized enterprises while the enterprise edition provides more
comprehensive features for larger companies.
Select Customers:
Alliance Data, Acer Computers, Star-QA, Precision Craft, Department of State Health
Services, Giorgio Armani Corp., Quest Diagnostics, Procter and Gamble, RNL Design,
TravelEx.
By offering comprehensive and flexible products that are fully web-based and providing
top notch customer support, Pragmatic Software was able to gradually grow its customer
base into the large number they currently have today. Pragmatic Software provides
clients with access to online support tickets as well as phone support. Pragmatic takes
pride in being able to back its top notch ALM tools with unparalleled customer support,
helping them to maintain a large, loyal customer base.
ALM Features:
* Requirements
* Test Case Management
* Defect and Issue Management
* Support Ticket Management
* Project Management
Collaborative Features:
* Shared Documents
* Contact Management (CRM)
* Calendar (Appointments, To Do)
* List Manager (Custom Lists)
* Discussion Forums
Highlights
* Large market share & large base of developers familiar with IBM solutions.
* Supports a wide variety of testing scenarios - manual to complex automated
paradigms.
* Open APIs deliver customizable test management.
Founded:
1910, New York
Customer Focus:
IBM’s clients include many different kinds of enterprises, from sole proprietorships to the
world’s largest organizations, governments and companies representing every major
industry and endeavor.
Select Customers:
1-800-FLOWERS.COM, uBee, Bank of Russia, Geisinger Health System, Servimatica
S.A., Trustmarque Solutions.
IBM’s Software segment primarily offers middleware and operating systems software
comprising information management software for database, content management,
and information integration; lotus software for collaboration, messaging, and social
networking; rational software, a process automation tool; Tivoli software for infrastructure
management, including security and storage management; Websphere software for
Web-enabled applications; and product lifecycle management software. The company’s
Global Financing segment provides commercial financing to dealers and remarketers of
IT products; lease and loan financing to external and internal clients; and sale and lease
of used equipment.
IBM Technology
Rational TestManager, through a unique integration with VMware server virtualization
software, simplifies and automates one of the true headaches for QA teams -
configuration testing.
The entire process is automated. Once configuration images are created and stored in
the GSX Server library, no manual work is ever required. Testing can be done serially or
in parallel.
Highlights
* Enterprise-level J2EE platform.
* Includes requirements management, release and cycle management, test
plan, test lab, defect management, and dashboard modules.
* Out-of-the box capabilities for SAP, SOA Oracle, and Web application security
quality management.
* HP has a 60% market share in distributed automated software quality (IDC).
Customer Focus:
HP focuses on simplifying technology experiences for all of its customers - from
individual consumers to the largest businesses in virtually all industry sectors.
Select Customers:
Orange County Choppers, Western Australia Department of Education and Training,
MICROS-Fidelio EMEA, University of Central Florida, France Telecom, Nies/Artcraft,
Houston Trust Company, Austin County, HOPS, Chemtronics.
The company’s corporate headquarters are located in Palo Alto, California; but it is truly
a global interest, with 311,000 employees doing business in more than 170 countries
around the world, and 69% of its revenue coming from outside the United States. Mark
Hurd is currently company chairman, chief executive officer, and president.
HP Key Strengths
* With the HP Quality Center solution, you can more effectively govern your software
quality processes and automate QA testing across your IT and application
environments designed to address the wide-ranging challenges that your quality
assurance professionals face.
* By leveraging consistent, repeatable and standardized software quality processes,
HP Quality Center helps your quality assurance teams turn quality into a competitive
advantage.
* HP Quality Center offers a single, web-based application that supports all essential
aspects of test management. It provides a consistent, repeatable process for gathering
requirements, planning and scheduling tests, analyzing results and managing defects
and issues. This software enables your organization to digitize specific quality
processes and procedures within the larger application lifecycle.
HP Technology
The HP Quality Center foundation is an enterprise-level J2EE platform that serves as a
central repository for all quality assets, houses centralized workflow rules, and facilitates
collaboration among all parties involved in the quality process. In addition, HP Quality
Center includes fully integrated dashboard technology that provides an executive-level
view of the entire quality process across multiple QA initiatives.
HP Software Highlights
HP Center Management for Quality Center Software
* Lets you effectively manage requirements throughout the application lifecycle.
* Provides leading-edge capability to prioritize testing priorities based on business risk.
* Gives you the capability to access testing assets anytime, anywhere via a browser
interface.
* Provides the ability to create an end-to-end quality management infrastructure.
* Gives your professional team the ability to manage manual and automated tests.
* Lets you perform accelerate testing cycles by scheduling and running tests
automatically, unattended, 24x7.
* Offers the capability to manage multiple versions of requirements, tests, test scripts
and business components.
* Gives you the power to enforce standardized processes and best practices.
* Lets you analyze application readiness at any point in the testing process with
integrated graphs and reports.
Highlights
* Free 30 day product trials of SilkCentral Test Manager, SilkTest, and
SilkPerformer
* Recent acquisitions of Borland Software and Compuware ASQ catapult Micro
Focus into a leadership position in the Testing and ASQ market, particularly as
Micro Focus combines the “best of breed” features from both product lines
* Strong integration between tools – in house, third-party and open source
* Strong support for Web 2.0 and rich internet applications testing
Customer Focus:
Micro Focus offers innovative solutions to help organizations better control, measure
and manage application delivery, by automating testing and quality processes across
every phase of the software delivery lifecycle
Select Customers:
JDA. Blackboard, Intuit, Wells Fargo, eBay, Bundesagentur fuer Arbeit (German
unemployment agency), and Trend Micro
Micro Focus’ strategy combines organic development with selective acquisitions. Since
2006 the company had made seven acquisitions that have allowed it to extend into
logically adjacent market
segments in order to further develop its customer proposition and extend its product
portfolio.
The recent acquisitions of Borland Software Corporation and the Testing and ASQ
business of Compuware Corporation give Micro Focus a leading market position in the
highly complementary Application Testing / ASQ market.
SilkTest
* Offers visual test creation, test execution, test analysis, and extensibility
* Offers strong capabilities with regards to testing AJAX and other rich internet
applications
* Provides recovery system for 24/7 unattended testing
* Provides basic workflow for instant productivity and data driven workflow for testing
business logic functionality using externally stored data
* Enables code completion for rapid test customization and automation infrastructure
development
* Offers project workspaces for organizing and sharing test information
* Provides a GUI abstraction layer for easy-to-maintain reusable tests and scripts
* Offers an extensible and easy-to-maintain scripting language
* Provides agent technology for enabling individual tests to span distributed machines
* Provides truelog-technology for visual front-end diagnostics of script actions from the
end-user perspective
* Integrates with SilkCentral Test Manager for advanced, process-oriented test
management and issue tracking
* Provides new, next generation open agent providing support for Flex/AMF3 and
Windows-based applications
* Offers built-in support for testing Adobe Flex applications using Internet Explorer,
Firefox, and the Standalone Flex Player Adobe AIR
* Offers an improved User Interface
* Provides animated Run Mode to provide ‘slow motion’ playback of test scripts
* Offers an Eclipse plug-in Silk4J with Java as a scripting language
* Provides dynamic resolving which enables an object to be located without reference
to a windows hierarchy
Highlights
* Provides the fastest and easiest software testing suite available in the
marketplace
* Rapidly growing company
* Offers 4-5x better Time to Quality rating than competitors (per customer
feedback)
* High Return on Investment
Select Customers:
BP, American Airlines, Frost Bank, Spectra Energy, Clearwire, Dresser, Emerson,
DirecTV, NASA, US Strategic Command, FEMA, State of Washington, State of Indiana
SmarteSoft was founded by a group of test automation and performance test experts to
advance process of comprehensive software testing. They developed very easy to use,
fast to learn, and fast to implement and maintain test automation software tools. The
result is an integrated suite of software test products that can quickly be adopted by
novice users, but also offer powerful functionality and automation to experienced testers.
To further enhance its offerings, SmarteSoft provides consulting services via a global
team and a network of partners with deep expertise in every aspect of manual and
automated testing. Customers include companies of every size -from Fortune 100
to mid-sized to small startups - and from almost every industry. Any company that
develops, deploys and/or manages software applications can benefit from SmarteSoft’s
products and services.
SmartSoft Technology
* Environments: Web, Desktop, Mobile, Point-of-Sale, Embedded, Mainframe
* Application Platforms: All Microsoft .NET compliers, Microsoft Visual C++, Intel C++,
Microsoft Visual Basic, Java, Flash, Flex, Microsoft Silverlight*, Microsoft Access*,
Microsoft InfoPath, AJAX, IE, VB6, Console
* limited support
SmarteStudio
* Designed for developers, Smarte Studio is an Integrated Development Environment
(IDE) for creating automated unit and system tests, and is user extensible
* Merges innovations in record and editing technology with a dynamic debugger,
Microsoft’s JScript interpreter, and powerful automated reporting
* Offers its users the ability to record their interactions with an application, save them
as a script, and edit them as needs change
* Prevents developers from having to re-write scripts for each individual test—a next-
step move which will save users on both time and effort
* Can be extended by the user to automatically recognize objects which Studio does
not recognize out of the box. This enables extension for custom or non-standard
environments, and emerging technologies. Any extensions made by one user can be
shared with any other users via common libraries.
SmarteLoad
* A load test tool that offers automatic load test script generation, data-driven
automation, multi-level grid driven automation, simulated load synopsis, and more
* Can leverage existing automated functional tests to give users a jump start on
performance testing projects
* Automates the entire process of parameterization, correlation, and load testing to
deliver comprehensive, reliable results
SmarteQM
* Integrated QA Test Management System that allows users to take control of the
project lifecycle and synchronize the previously separate worlds of development and
testing
SmarteX
* A cost-effective solution for performing functional and regression testing to
workgroups and test labs
* Key features include the Grid Visualization Engine, automatic test measurements,
automated window/object image capture, a scalable regression manager, and an
automated report writer
SmarteTime
* The SmarteSoft scheduling tool that is network- and storage-aware
* Users can set tests to occur overnight or to avoid planned maintenance
* Cuts staffing costs by automatically scheduling test executions to start each time a
software build is done
SmartePak
* Extends testing capabilities with a selection of four prepackaged options:
SmartePak2, SmatrePak5, SmartePak10, SmartePak25
* SmartePak2 includes: 1 license of SmarteScript, 1 license of SmarteX, 2 licenses of
SmarteQM, a free training session
* SmartePak5 includes: 2 licenses of SmarteScript, 3 licenses of SmarteX, 1 license of
SmarteTime, 5 licenses of SmarteQM, and 2 free training sessions
* SmartePak10 includes: 5 licenses of SmarteScript, 5 licenses of SmarteX, 1 license of
SmarteTime, 10 licenses of SmarteQM, and 5 free training sessions
* SmartePak25 includes: 10 licenses of SmarteScript, 10 licenses of SmarteX, 2
licenses of SmarteTime, 25 licenses of SmarteQM, and 10 free training sessions