Number of connections to the host at the same time

Question

How can I handle this?

Answer 1

From nutch-default.xml:

<property>
  <name>fetcher.threads.fetch</name>
  <value>10</value>
  <description>The number of FetcherThreads the fetcher should use.
    This is also determines the maximum number of requests that are 
    made at once (each FetcherThread handles one connection).</description>
</property>

<property>
  <name>fetcher.threads.per.host</name>
  <value>1</value>
  <description>This number is the maximum number of threads that
    should be allowed to access a host at one time.</description>
</property>

As noted above, the number of connections is at most equal to the number of threads. The first property controls the overall number of connections and the second the number of connections per host - this is the one you need to set.