tags:

views:

14

answers:

1
Q: 

In robots.txt, what will Disallow: /?s block?

What will this line block when the search engine crawls the website?

Disallow: /?s

+1  A: 

It will block robots from crawling any URLs (in the root (?)) that they stumble upon that contain s in their query strings.

BoltClock  2010-09-06 03:19:24
Thanks for the answer!
Giljed Jowes  2010-09-06 03:20:43

related questions

How can I get a history of the number of pages in Google's index for a particular site?
How can I get a history of a website's PageRank?
Integrating with Google Docs
Tool/framework for automated web app testing in Google Chrome browser?
Google Authentication API: How to get the user's gmail address
How to Crack Google?
How can I get Google Charts to display multiple colors in a scatter chart?
Best way to implement Google Custom Search on an aspx page
How to compile a java application which uses Google webdriver from comand line without ant
Biggest differences of Thrift vs Protocol Buffers?
Google maps style scrolling anyone?
How to make Flex RIA contents accessible to search engines like Google?
Blocking part of a website
Getting Good Google PageRank
How does google make make those awesome PDF reports in Analytics and when you print a Google Doc etc?
How do you implement a "Did you mean"?
Google using non-alphanumeric characters
how to get the googlebot to get the correct GEOIPed content!?
Using VLOOKUP in an array formula on Google Spreadsheets
The Google Calculator Glitch, could float vs. double be a possible reason?
Google Analytics Access with C#
Picasa Plugin
Java code for WGS84 to Google map position and back
Stand alone charts in GWT
Options for Google Maps over SSL