hi i want to disallow all files and folders on my site from SE bots,except a special folder and files in it. can i use these lines at robots.txt file?
User-agent: *
Disallow: /
Allow: /thatfolder
is it right?
hi i want to disallow all files and folders on my site from SE bots,except a special folder and files in it. can i use these lines at robots.txt file?
User-agent: *
Disallow: /
Allow: /thatfolder
is it right?
User-agent:*
Allow: /thatfolder
Disallow: /
This should do. (just changed the order)