tags:

views:

122

answers:

1
Q: 

Setting up a Proxy to record Firefox requests

I'm using Ruby+Watir to request pages through Firefox.

I would like to record the headers and content of every http request made through the browser.

Would it be possible to configure a proxy solution to store this information, either in a file or pipe it straight into an application? Could I use something such as squid or nginx to record header/content information?

PS: Running Ubuntu x64.

A: 

For Windows there is a program called Fiddler that does exactly what you need, so I did a Google search for "Fiddler for Linux" and came up with Charles. Looks pretty strong.

I didn't notice the price tag for the non-trial version of Charles. Another app worth looking into is Poster, an add-on for Firefox. It is not clear to me whether it captures all traffic or only returns response for directly input requests, but still could help you with your project.

Anthony  2010-02-05 08:52:46
I'm actually using Charles for testing, and although I love its export->XML feature, I can't automate it because it doesn't allow that. It also has memory limitations, because it stores all of the information in memory (according to the docs).Thanks for the suggestion though.
Marco  2010-02-05 08:55:25
Oh that's lame. 50 bucks for something that can't write to disk. I wish the Firebug history tool would be updated already.
Anthony  2010-02-05 09:04:24

related questions

Best place to get Ruby on Vista up and running as dev environment
How can I encode xml files to xfdl (base64-gzip)?
What is the best way to learn Ruby?
Learning Ruby on Rails any good for Grails?
How to sell Python to a client/boss/person with lots of cash
How do I create a Class using the Singleton Design Pattern in Ruby?
How do I update Ruby Gems from behind a Proxy (ISA-NTLM)
Why Should I Learn Ruby?
How do I create a new Ruby on Rails application using MySQL instead of SQLite?
How do I rake tasks within a ruby script?
Ruby On Rails with Windows Vista - Best Setup?
Mapping values from two array in Ruby
Reverse DNS in Ruby?
Text Editor For Linux (Besides Vi)?
What is good forum software to add to an existing Rails application?
Calling Bash Commands From Ruby
How can I modify .xfdl files? (Update #1)
How do I use (n)curses in Ruby?
Open Source Ruby Projects
How do I fix 'Unprocessed view path found' error with ExceptionNotifier plugin in rails 2.1?
When to use lambda, when to use Proc.new?
Frequent SystemExit in Ruby when making HTTP calls
Implementation of "Remember me" in a Rails application.
.NET Migrations Engine
How do I add existing comments to RDoc in Ruby?