I think you need to use only Silverlight enabled service. Silverlight works only with *.svc services, so you can not use *.asmx service in Silverlight project.
I have solved it actually, I just made them all https.