tags:

views:

18

answers:

1
Q: 

Web crawlers and non-ASCII characters in sitemap.xml

Hi!

One of our sites has non-ASCII (non-english) characters in URLs:

http://example.com/kb/начало-работы/оплата

I wonder how do web crawlers (particularly Googlebot) handle these situations? Do these URLs have to be encoded or otherwise processed?

+1  A: 

I think it is best url-encoded. This is the standard.

Nat  2010-08-04 12:00:51

related questions

First Google Search Result (SEO?)
Google Page Rank - New Domain / Link Structure Migration
Getting paid for SEO optimization
What are the limitations of Loose XAML?
Googlebot + IFrames ?
Multiple domains for one site: alias or redirect?
What are the differences between SEO and SEM ?
Supporting URLs like /similar-to-:product in Ruby on Rails?
Dash vs. Underscore
SEO and hard links with dynamic URLs
How can I perform a Google search on different Google datacentres?
How can I get a history of the number of pages in Google's index for a particular site?
How can I get a history of a website's PageRank?
How much tolerance does google have for large site maps...
Best Permalinking for Rails
Getting Good Google PageRank
HTML meta keyword/description element, useful or not?
SEO Superstitions: Are <script> tags really bad?
HTML Compression and SEO?
Why do some websites add "Slugs" to the end of URLs?
Dynamic robots.txt
How do I generate a friendly URL in Symfony PHP?
how to get the googlebot to get the correct GEOIPed content!?
Associating source and search keywords with account creation
mod_rewrite to alias one file suffix type to another