Get websites title and description, save to utf8 table, php/mysql

Question

Hi guys,

I've been trying today all day to figure this out and I have no idea.

What I want: Get the title and meta description of any kind of website.

Save this info to utf table in mysql.

What the problem is? Different sites have different charsets which results in that some have chinese, some contain umlauts (german), then we have russian and so on..

I've tried preg_match which works for some while not for others, i've tried DOMdocument which is the same as preg_match.

Is there any class available that will do this?

Hope someone can help, thanks.

Answer 1

$data = file_get_contents( $url );
if( preg_match( '#title>([^<]+?)</title#', $data, $match ) ) {
    $result['title'] = $match[1];
}
if( preg_match( '#name="description"[^>]+?content=('|")([^"']+?)#i', $data, $match ) ) {
    $result['description'] = $match[2];
}

not tested! just wrote it down quickly - print_r the match's to see what exactly they match etc.

set your mysql table to latin1 - that should be fine with all kinds of languages. - i never took care of it because it works 99% of the time.

Answer 2

Use Curl and explode function and you will be able to do it easily.