Hi, is there a way to batch copy certain wikipedia articles(about 10,000) to my own mediawiki site?
EDIT: How do I do this without overwriting similarly named articles/pages? Also I don't plan on using illegal means (crawlers etc)
+1
A:
If you're looking to obtain a specific set of articles, then you may be able to use the Export page (http://en.wikipedia.org/wiki/Special:Export) to obtain an XML dump of the pages involved; you can export multiple pages at once, although you may wish to space out your requests.
You can import the XML dumps into MediaWiki using Special:Import or one of the import scripts in maintenance/.
Rob
2009-05-26 03:53:36
Does this include images? If not is there an automatic method to obtain images as well?
2009-06-19 18:33:07
It doesn't include images because of the copyright.
l2mt
2009-08-23 21:49:24
It doesn't include images because it's a straight XML dump of the page information, revision metadata and text, and the format hasn't been expanded to include the binary image data. Strictly speaking, it's a technical limitation. In theory, you could import copyright-infringing text and the software wouldn't stop that.
Rob
2009-08-27 14:14:52
A:
Here's a guide to import a Wikipedia database dump into MediaWiki.
BTW, fetching a large number of articles from Wikipedia using your own code (using a web crawler, for instance) is forbidden, if you're asking about that.
Moayad Mardini
2009-05-26 03:56:46