This is actually just a standard web convention and works independently of Silverlight.
Begin by generating your icon file (you can use a site like this as a shortcut) and upload the icon file to your site root- giving it the name favicon.ico
Refresh the page (might need to + F5 to clear cache) and your icon should appear as desired.