tags:

views:

34

answers:

1
+3  Q: 

Robots.txt, disallow multilanguage URL

I have a public page that is not supposed be possible for users to sign into. So I have a url that there is no link to and you have to enter manually and then sign in.

The url is multilanguage however, so it can be "/SV/Account/Logon" or "/EN/Account/Logon" etc etc. Can I disable this url to be indexed for all languages?

+1  A: 

This url might help you http://www.robotstxt.org/robotstxt.html. There will be no wildcard exclusion in your case you will have to add all the language specific login urls in robot.txt

Update

you can put Disallow: /folder/subfolder/ or Disallow: /folder/ in your robots.txt file

ajay_whiz  2010-09-03 08:32:17
Thanks for answering. I read that and do not wan't to do this. For example other users might add more languages using the admin interface and they do not know how to edit the robots.txt. Perhaps I can edit it from my code when adding more languages
Oskar Kjellin  2010-09-03 08:36:35
@Oskar you can also consider moving such pages under a single folder and just add that folder in the exceptions list in robots.txt
ajay_whiz  2010-09-03 09:43:29
@ajay_whiz They are all under the same folder. But can I write folders? I thought the URLs where the only thing affecting this
Oskar Kjellin  2010-09-03 09:55:34
@Oskar yes, you can put as `Disallow: /folder/subfolder/` or `Disallow: /folder/`
ajay_whiz  2010-09-03 10:13:58
@ajay_whiz Thanks, please post an answer so I can accept it :)
Oskar Kjellin  2010-09-03 10:47:37
@Oskar I have updated by answer
ajay_whiz  2010-09-03 12:39:29

related questions

What's the best way to implement field validation using ASP.NET MVC?
How do I handle page flow in MVC (particularly asp.net)
Entity diagrams in ASP.NET MVC
How do I get rid of Home in ASP.Net MVC?
Can I generate ASP.NET MVC routes from a Sitemap?
ASP.NET Model-view-controller (MVC) - where do I start from?
user controls and asp.net mvc
ASP.Net MVC route mapping
RSS Feeds in ASP.NET MVC
Open Source Licensing Options for ASP.NET MVC Application?
Does the OutputCacheFilter in the Microsoft MVC Preview 4 actually save on action invocations?
MVC Learning Resources
Validating posted form data in the ASP.NET MVC framework
Best mock framework that can do both WebForms and MVC?
Use the routing engine for form submissions in ASP.NET MVC Preview 4
How do you get a custom id to render using HtmlHelper in MVC
MVC Preview 4 - No route in the route table matches the supplied values.
Is there a way to include a fragment identifier when using Asp.Net MVC ActionLink, RedirectToAction, etc. ?
In ASP.NET MVC I encounter an incorrect type error when rendering a user control with the correct typed object
ASP.NET MVC - Is it worth it yet?
Multiple languages in an ASP.NET MVC application?
Is it better to create Model classes, or just stick with generic database utility class?
ASP.NET MVC Without Visual Studio
ASP.NET MVC "CRUD" Database Sample
How to RedirectToAction in ASP.NET MVC without losing request data