Is it possible to get (scrape) data from a site that requires logging in using YQL? If yes, please tell the procedure.
views:
47answers:
2
+1
A:
You'll need the user to authorize your access via OAuth, as YQL's docs mention. In addition to the docs pointed to by links from the URL I just mentioned, you can learn all about OAuth here, then get libraries to help you use OAuth, depending of course on the programming language you want to use, from the links listed here.
Alex Martelli
2010-04-04 00:00:57
what about the cookies?? where are the cookies going to be saved??
Nok Imchen
2010-04-04 00:08:34
You need OAuth to _sign_ YQL requests, no cookies needed -- see e.g. the all-Javascript example at http://kentbrewster.com/oauth-baby-steps/ , if you're comfortable with Javascript.
Alex Martelli
2010-04-04 00:17:23
+1
A:
Depending on how the remote site is set up, you could use a simple POST (there is an open data table for that1) or you could create your own small, custom data table and use <execute>2 to send whatever headers (including Cookie:) you need over one or more GET/POST requests.
salathe
2010-04-06 08:46:18