If you try to access a website/url that differs from the url your silverlight application is run under you will need to set up a cross site policy file or access a site that has one allowing access.
[edit added Tim Heuer's links]
Aaron Fischer
2009-01-30 15:27:24