Direct Download Guide for French Wikipedia Database Dumps
Direct Download Guide for French Wikipedia Database Dumps
For researchers, developers, and digital archivers needing offline access or raw data from French Wikipedia (Wikipédia en français), the Wikimedia Foundation provides official, up-to-date database snapshots and pre-packaged archives free of charge.
1. Official Wikimedia Directory
All raw database dumps for French Wikipedia are hosted on the official Wikimedia dump server.
- Main Directory Link: https://dumps.wikimedia.org/frwiki/latest/
- This URL automatically points to the most recent completed snapshot directory.
2. Choosing the Right Dump File
Inside the main directory, files are compressed in .bz2 format. Depending on your software, parser, or research needs, choose from the following primary files:
Complete Articles with Index (Multistream)
- File Name: frwiki-latest-pages-articles-multistream.xml.bz2
- File Size: Approximately 6.5 GB to 7 GB (compressed)
- Best Used For: Most offline readers, search engines, and natural language processing (NLP) applications. It includes a companion index file (frwiki-latest-pages-articles-multistream-index.txt.bz2), allowing tools to quickly search and jump to specific articles without decompressing the entire multi-gigabyte archive.
Complete Articles (Standard Sequential Stream)
- File Name: frwiki-latest-pages-articles.xml.bz2
- File Size: Approximately 6 GB to 6.5 GB (compressed)
- Best Used For: Sequential data parsing where a custom script or database import script processes the entire XML payload line-by-line in a single pass.
Full Current Snapshot (Articles, Talk Pages, and User Pages)
- File Name: frwiki-latest-pages-meta-current.xml.bz2
- File Size: Approximately 9 GB (compressed)
- Best Used For: Analyzing community discussions, project governance, talk pages, and administrative metadata alongside the main article content.
3. Alternative Pre-Packaged ZIM Archives
If you are looking for ready-to-read offline files formatted as .zim archives (compatible with offline readers like Kiwix, XOWA, or WikiTaxi) rather than raw XML database dumps, you can download them directly from the Wikimedia Kiwix directory:
- Kiwix ZIM Directory: https://dumps.wikimedia.org/other/kiwix/zim/wikipedia/
- Full Edition (With Images): Search for files beginning with wikipedia_fr_all_maxi_ (approximately 35 GB to 40 GB).
- Text-Only Edition (No Images): Search for files beginning with wikipedia_fr_all_nopic_ (approximately 12 GB to 15 GB).
4. Download Tips
- Use a Download Manager: Because these multi-gigabyte files can take significant time to download, using a download manager or command-line utility (such as wget or curl -C -) allows you to resume interrupted downloads without starting over.
- Flash Drive Storage: If saving these files directly to a USB drive, ensure the drive is formatted as exFAT or NTFS. The older FAT32 file system cannot accept files larger than 4 GB.
Comments
Post a Comment