Features Comparision

Sl No EggPlant

1 2 3 4 5 6

Native OS Supported OS Native Browser Supported Browsers Learning curve for 'first script' (Ie creating a simple script to fill out a form and click submit) Learning curve for complicated scripts (sending an email, completing a survey, checking results in report) Maintaining scripts if names of back-end objects change Maintaining scripts if UI will change Tech Support from company Tech Support from users of the software Plugins needed Plugins available Browser Portability (ease of using same scripts for different browsers OS portability (running Host & SUT on different OS) Programming Languages supported Ease of reading script reports Ease of catching errors during run-time

7 8 9 10 11 12 13 14 15 16 17

mac All with suport VNC safari All through VNC Pretty easy to record the first script / clicks and make it into a script. Medium difficulty in learning how some of the nonobvious functions that are needed to perform the test successfully are used. Testing tool not dependant on names of back end Significant - if a color changes the image might not be recognized Response sometimes takes a few hours Very low, software not widely used. Will be hard to depend on user base for support none (Text Image Generator is part of the program) none Medium - would have to re-take snaps of images on each browser, scripts themselves should work Shouldn't matter too much as long as Text Image Generator is running on SUT SenseTalk (Eggplant's language) Very easy to read very hard - all it will say without special code is 'Image not found'. Need to create exception handling code. Easy way to write the output to a file (can make it comma delimited) Very easy to explain to new users of the program what it does and how it does it. Have not delved deep enough to find all the options. Without special error handling programmed there is no automatic 'if this script failed proceed to next' unknown untested Yes None Eggplant for Windows seems to be coded in VB6. The original platform for it was Mac, so might behave differently there. With that said, on Windows it crashed constantly. Saw repeated evidence of problems that are persistent with VB6 (a language that has not been supported for over 10 years). Stability is a major issue - With different browsers will need to re-take snapshots of the fields. - If a font is not found on the system scripts will fail - If a color of the font is different, you will not get a match unless you have a high tolerance (for different colored pixels) which will in turn make the tests less reliable.

18 19 20

Ability to format the test results (low) Easy to understand how the program works in theory If an exception comes up will the script just stop, or is there an ability to skip to the next script Ability to restart a system Performs the same with different screen resolutions Are there timers to detect how long does it take to perform an action Any type of load testing? Notes about software

21 22 23 24 25

Issues with IBT (image based testing)

Issues with OOT (object oriented testing)

- Does not mimic the user's behavior. - If a button is obscured it might still be clicked by OOT. - More details needed to write a test script (more programmatic knowledge)