Looking for feedback and further sugestions on Automated testing Tools

Hi,

The company I work for is looking to start using Automated Testing Tools and we are presently investingating the market on several products.

The testing we undertake includes:

-Link testing/navigation.
-Field valididation (i.e. Application forms and DDLB's).
-Calculator testing (for calculating savings balances over x years at various rates and for mortgage calculators, including base rate amends).
-Spell checking on web pages and PDF's.

We also carry out regular regression of our Internet Banking service after each functional release we do. We would like the abilitly to set up a series of test scripts which could run simultaneously. The tool would ideally be be compatible with XP IE6, IE7, & IE8, Vista IE7, XP Firefox 3, Mac Safari 3 and Mac Firefox 3. It would also need to run on 'non networked' kit.

We are presently looking at Automation Anywhere, Silktest and Test Partner and would welcome anyfeed back on the above products or other sugestions.

▶ Reply to This

Replies to This Discussion

Permalink Reply by Benjamin on June 8, 2009 at 7:54am: You said besides
-Link testing/navigation
-Field valididation (i.e. Application forms and DDLB's).
-Calculator testing (for calculating savings balances over x years at various rates and for mortgage calculators, including base rate amends).
-Spell checking on web pages and PDF's.
your also planning on doing regression tests on XP IE6, IE7, & IE8, Vista IE7, XP Firefox 3, Mac Safari 3 and Mac Firefox 3. Are you sure these 3 tools support the named platform/browser combinations? Im not sure but according to the silktest data sheet e.g. they only support IE 6 and 7 and Firefox 2.

You asked for other suggestions: Our web GUI testing tool web2test might be also worth looking at:
IE 6,7,8 ;FF 2,3; Mozilla 1.8, Seamonkey 2,3 is supported under Windows (2k, XP, Vista)
FF 2,3; Mozilla 1.8, Seamonkey 2,3 also under Linux
But we do not (yet) support Mac environment

We do also support the testing tasks you named (as probably any web GUI testing tool with a component based approach) except for spell checking.

In case you want to have a closer look at web2test: On the web2test web site (web2test - web testing tool) we provide a free demo (limited functionality) or a free evaluation (full functionality but you will have to leave your contact details)

(just as a side information: I'm also unsure which way Compuware (Testpartner) and Borland (Silktest) are going in the future since they were both recently bought by Micro Focus see also micro focus buys Borland. But as I said I'm not sure whether this will have an effect on their further product strategy. ); ▶ Reply to This

Permalink Reply by Benjamin on June 8, 2009 at 8:12am: I made a mistake in the above statement: web2test supports Seamonkey 1 and 2 not 2 and 3 (there is no version 3) . Sorry for that.; ▶ Reply to This

Permalink Reply by yohannes alazar on June 9, 2009 at 2:08pm: Selenium will be good; ▶ Reply to This

Permalink Reply by Allen Fisher on June 12, 2009 at 5:08pm: I would like to humbly suggest Eggplant by my employer, TestPlant. It has a very intuitive workflow and scripting language, and can really test any application on any platform. It uses VNC and a TCP/IP connection and needs no knowledge of your application. You can check us out at www.testplant.com.

If this is an inappropriate use of the forum, please let me know.; ▶ Reply to This

Permalink Reply by Trish Khoo on June 14, 2009 at 11:25pm: Test Partner is pretty powerful in terms of automating just about anything, but when I last used it a few years ago, it had a few issues which made it difficult to use for anything beyond record and playback.; ▶ Reply to This

Permalink Reply by Tom Lo on June 15, 2009 at 12:07am: Selenium would be good, except that it uses JavaScript injection, and as you are talking about a Banking site, you probably want your pages to be secure and reject that sort of vulnerability.

We are able to test most of what you list above with a new tool called LiquidTest. Calculator testing you can do with data driven tests, as you should know the input, and the expected output. We saved a lot on licence and support fees compared to the Borland and HP tools you mentioned which we also investigated. We also saved a lot of time as the need for test script edits was less than any other tool we tested.

The Spell checking you will need an additional tool to do. We have done this in the past with an in-house script that ran each page/file through 3rd party software with spell checking capabilities. It works for us, so we have stayed with it. I am sure there are free tools out there that can do spell checking for you.; ▶ Reply to This

Permalink Reply by KT on July 17, 2009 at 9:23am: I'm a bit biased, but take a look at TestDrive by Original Software - www.origsoft.com, it's getting glowing reviews from customers and the leading analyst groups - it's not just me!; ▶ Reply to This

Permalink Reply by Albert Gareev on July 17, 2009 at 12:22pm: So why don't you consider QTP?
It has max of coverage on supported software, and where it doesn't support something with wrapping objects you can always address the native object directly or customize QTP using extensibility kits. Some money that you may save buying less powerful tools will be lost on maintenance anyway.
If you're looking for a full cycle solution you could use QC-QTP-BPT products. Or you can keep using your existing test management tool, and develop your own framework comparable to BPT or exceeding it.

Finally, If you are looking for record/playback only, you may consider WorkCertify or TestComplete. Those are not as good but still OK.

:PS. How critical is your PDF spell-checking requirement? None of web-test-only tools would be able to deal with it...; ▶ Reply to This

Permalink Reply by Yaxiong Lin on July 22, 2009 at 12:58am: Check out TestOptimal, a Model-Based Testing tool for web applications. It supports cross browsers and is capable of running the tesing script for load and stress testing.; ▶ Reply to This