tags:

views:

154

answers:

1
Q: 

crawler get external website search result

  1. What is the best practice and library I can use to key in search textbox on external website and collect the search result?
  2. How do tackle website with different search box and checkbox and collect the result?
  3. Can Selenium be used to automate this?
  4. Should I use Heritrix or nutch? Which one is better? I heard nutch comes with plugins. Which one has a bigger community?
+1  A: 

you can use:

  • The Selenium API
  • HtmlUnit
  • Htmlparser

etc.

Bozho  2009-12-16 06:58:18
any reference articles... how to get the result from selenium and pass to htmlparser. i though selenium can automate testing and cant get result...
cometta  2009-12-16 07:14:30
it's API can. You can open the pages for those three technologies and see the 'Getting started' or the user manual - it is a good reference
Bozho  2009-12-16 07:18:35

related questions

Java Time Zone is messed up
Eclipse on win64
Automate builds for Java RCP for deployment with JNLP
Why are professors or schools picking Java over C++ to teach to students?
Is there a real benefit of using J#?
Public/Popular Websites using JavaServer Faces
Why can't I use a try block around my super() call?
Accessing post variables using Java Servlets
Personal Linux web server
Is this really widening vs autoboxing?
How can I Java webstart multiple, dependent, native libraries?
Why can't I call toString() on a Java primitive?
How do I use Java to read from a file that is actively being written?
What code analysis tools do you use for your Java projects?
IllegalArgumentException or NullPointerException for a null parameter?
How do I configure and communicate with a serial port?
What is the best way to parse strings in Java
Getting started with a custom JXTA PeerGroup
Creating a custom button in Java
How to get started "writing" a code coverage tool?
Which Build-/Configuration Management Tool?
What is the difference between an int and an Integer in Java/C#?
What is the meaning of the type safety warning in certain Java generics casts?
How would you access Object properties from within an object method?
Converting CSV File to XML in Java