PHP Word Crawler

Question

Hi,

How to get all unique words from a webpage in an array? (without all attributes and javascript etc.)?

Could anybody help me with this?

Answer 1

try this get_text this one will help you: http://mel.melaxis.com/devblog/2005/08/06/localizing-php-web-sites-using-gettext/

Answer 2

Have a look at http://simplehtmldom.sourceforge.net/

Then do something like:

<?php

include_once('simplehtmldom/simple_html_dom.php');

$string = file_get_html('http://www.google.com')-&gt;plaintext;
$words = preg_split('/[\s,.]+/', $string, null, PREG_SPLIT_NO_EMPTY);

var_dump(array_unique($words));

?>