Which is the best tool for automatic GUI performance testing?

Question

We are currently testing a Java Swing application for it's performance. I wonder if there is a good tool to automate this?

Answer 1

A few years ago I used JMeter for such a task. I generally enjoyed using it, though I never did much research on what else is available and I don't know if it's still actively developed.

Answer 2

Have a listen to the Pragmatic Programmers's podcast on using Ruby for GUI testing.

Answer 3

The Pragmatic Programmers also came out with a book on using Ruby to do GUI testing.

In particular, they give extensive examples using JRuby to test a swing app.

The testing they are doing is mostly to test functionality, but I think it would not be hard to add in some performance measures.

The benefit of doing it this way is that you get lots of flexibility, but it is not a packaged tool.

Answer 4

You can try to use Cucumber and Swinger for writing functional acceptance tests in plain english for Swing GUI applications. Cucumber has an output formatter that includes profiling information.

Cucumber allows you to write tests like this:

 Scenario: Dialog manipulation
    Given the frame "SwingSet" is visible
      And the frame "SwingSet" is the container
    When I click the menu "File/About"
    Then I should see the dialog "About Swing!"
    Given the dialog "About Swing!" is the container
    When I click the button "OK"
    Then I should not see the dialog "About Swing!"

Take a look at this Swinger video demo to see it in action.