automated-tests

Is there a right way to implement a continuous improvement (AKA software hardening) process?

Each release it seems that our customers find a few old issues with our software. It makes it look like every release has multiple bugs, when in reality our new code is generally solid. We have tried to implement some additional testing where we have testers do several hours of monthly regression testing on a single app each month in an...

What are good test automation frameworks?

I am looking for a tool to integrate many different types of automation and test frameworks in order to automate fully end-to-end scenarios for testing. For example, a typical workflow might be: Install an Operating System (Ghost, etc..) Configure the operating system (open firewall exceptions, setup users, etc..) Install Software (Vis...

Any good resource (non-people) management libraries?

As our automated test infrastructure grows, we have a need to automatically manage the test resources (servers, etc). Not manage updates to the systems but have an automatic (programmatic) way to reserve resources for use in the automated test runs and release resources when finished. I need to be able to to add items to the system, stor...

Automated Interface testing on iPhone

I like using the UI Recorder in Xcode for testing a UI in the simulator. However, that I know of, UI Recorder doesn't work on the device. Is there a similar tool for automating UI testing on the device? ...

In functional testing, should I compare all tabular data rendered in the browser with the one coming from the DB?

I'm working on a test plan for a website where some tests are taking the following path: Hit the requested URI and get the data rendered inside some table(20 rows per page). Make a database query to get the data that is supposed to be rendered in that table. Compare the 2 data row by row, they should match. Is that a correct way of d...

Hudson and rational functional tester

I've just installed Hudson and it is running beautifully. It builds, runs JUnit-tests and also CheckStyle analysis. Next step for us would be to create an installation, install it and then run automated tests on the actual installation. I would then like to fail the build if the tests fail or at least publish the results somehow. I thin...

How do you write your QTP Tests?

I am experimenting with using QTP for some webapp ui automation testing and I was wondering how people usually write their QTP tests. Do you use the object map, descriptive programming, a combination or some other way all together? Any little code example would be appreciated, Thank you ...

Functional PDF Testing (Automate Testing of PDF Content)

I am working on an application where I am writing some automation framework for testing a web application. I am using Watij / Watin for the framework, but have run into a problem with verifying the PDFs generated have the correct content. I know I can use IText or a native PDF library to load up the PDF, but I am wondering if there is ...

Wait for an iframe to open and load with Selenium

Hello. I have an app in which the user clicks a button, triggering an iFrame to open. I'm having real trouble waiting for this frame to open an load before continuing. I can't use: wait_for_page_to_load because the it's not the page that loads, it's the iframe. I can't use: select_frame because the frame hasn't loaded yet so I'...

Is it possible to automate Siebel testing behind the GUI?

My test team currently uses QTP to test through the GUI, but like any automated test suite that relies on the interface, it is more fragile than automating tests that directly interact with the code. I am attempting to learn more about Siebel and Siebel Tools to better understand how we might be able to test below the GUI, but would like...

Automated regression tests for java applets?

We're working on a project with a number of applets that has to work across a large range of OS (WIndows, Mac, Linux), browsers (IE, FF, Safari, etc) and Java versions (1.5+), and it often happens that a fix we apply will cause some sort of security exception an another platform or some other error. Is there any way for us to prepare au...

NetBeans Platform Application: How to create test environment for first automated end-to-end test through GUI?

How to write first end-to-end automated test for NetBeans Platform Application on Java (not just capture & replay) which suppose run the application and test if click on the Main Menu -> File -> Exit menu item will close it? Given: installed jdk1.6.0_17 and apache-maven-2.2.1 Then: mvn archetype:generate -DarchetypeGroupId=org.codehau...

Web application: Acceptance testing: Initial state for a test and test isolation?

Greetings, I am currently exploring some extreme programming and try to stick as much to it as possible. This means, I will need to turn my (by now, unexpectedly thick stack of) user stories into acceptance tests once I begin an iteration (after planning the release, of course). I am not entirely sure about the implementation language...

"pause" being ignored

I read that I must be able to run all unit tests in my site with a single command, so I created a bat file to do it. Even with pause before the end, after the phpunit command, the result of the unit tests flashes in the screen. @echo off cd c:\ cd xampp cd htdocs cd light cd myworks echo on set /p site=The site: set /p version=The vers...

Should I write integration test or unit test?

Hi, I have a function which saves photos(stored in database,app gives user option to save in a directory) to a given directory.Now, this was not working correctly.I just fixed it.Now, should I write unit test or integration test for the function? ...

invoking pylint programmatically

I'd like to invoke the pylint checker, limited to the Error signalling part, as part of my unit testing. so I checked the pylint executable script, got to the pylint.lint.Run helper class and there I got lost in a quite long __init__ function, ending with a call to sys.exit(). anybody ever tried and managed to do so? the dream-plan wo...

Flex automated acceptance testing tools

I am looking for recommendations for tools for automated testing of a web application with some flex components. To provide some background we have a web application that was entirely developed in AJAX+HTML and we were somewhat successful in using Selenium for testing that application end to end. We recently added some flex components i...

Don't stop on Rails TestTask failure

I'm adding a test task in my Rakefile, similar to this: namespace :test do desc "Test lib source" Rake::TestTask.new(:lib) do |t| t.libs << "test" t.pattern = 'test/lib/*/_test.rb' t.verbose = true end end and then adding (have also done using "enhance" with the same result: task :test => [ 'test:lib' ] My problem is...

Cucumber Error: Socket Error for Test Environment Host in REST API

I posted this to the Cucumber group with no replies, which makes me wonder if this is actually a cucumber issue or not. I'm pretty new to cucumber, and there are a number of things I really don't quite understand about how the cucumber environment is set up and executed within the test environment. I have a REST API rails app I'm testin...

How to design Automation framework for a database

Recently I faced an interview question, "If there is a database having many stored procedures and functions, then how would you design and develop a framework for automation testing?" How would you answer that question? ...