Get a particular text from website

Question

I'm looking for a way if you know the location where to read the text for example say, under a particular category, how would you connect to a website and search & read the text from it? what steps do i need to follow to learn about that?

Answer 1

You're probably looking for a web crawler.

Here's an example of a simple crawler written in C++.

Moreover, you might want to have a look to wget, a software to retrieve files via HTTP, HTTPS and FTP.

Answer 2

you could use libcurl/cURL for your HTML retrival

Answer 3

if you are looking at a specific web-page, you could try retrieving the page and parsing it to get to the exact location you want. e.g. specific div, etc.

since you are using c++, you could try reading up on using libcurl to retrieve the information you need from the URL.

Answer 4

You can download an html file with WinHTTP(working example) and then search the file. There's some find algos in the std::string class for searching if your needs are relatively basic.