Difference between revisions of "WikiData Import 2020-08-15"
Jump to navigation
Jump to search
| Line 14: | Line 14: | ||
= Summary = | = Summary = | ||
= Download and unpack = | = Download and unpack = | ||
| − | <source lang='bash' highlight='1'> | + | <source lang='bash' highlight='1,14'> |
date;wget https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.bz2;date | date;wget https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.bz2;date | ||
Sat Aug 15 17:47:23 CEST 2020 | Sat Aug 15 17:47:23 CEST 2020 | ||
| Line 28: | Line 28: | ||
2020-08-16 00:37:06 (4.64 MB/s) - ‘latest-all.nt.bz2’ saved [119725690213/119725690213] | 2020-08-16 00:37:06 (4.64 MB/s) - ‘latest-all.nt.bz2’ saved [119725690213/119725690213] | ||
Sun Aug 16 00:37:06 CEST 2020 | Sun Aug 16 00:37:06 CEST 2020 | ||
| + | date;bzip2 -dk latest-all.nt.bz2;date | ||
| + | Sun Aug 16 07:02:30 CEST 2020 | ||
</source> | </source> | ||
[[Category:WikiData]] | [[Category:WikiData]] | ||
Revision as of 06:02, 16 August 2020
Environment
- Mac Pro Mid 2010
- 12 core 3.46 GHz
- 64 GB RAM
- macOS High Sierra 10.13.6
- Source Disk: 4 TB 7200 rpm hard disk WD Gold WDC WD4002FYYZ Blackmagic speed rating: 175 MB/s write 175 MB/s read
- Target Disk: 4 TB SSD Samsung 860 EVO Blackmagic speed rating: 257 MB/s write 270 MB/s read
java -version openjdk version "11.0.5" 2019-10-15 OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.5+10) OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.5+10, mixed mode)
Summary
Download and unpack
date;wget https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.bz2;date
Sat Aug 15 17:47:23 CEST 2020
--2020-08-15 17:47:24-- https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.bz2
Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 2620::861:1:208:80:154:7, 208.80.154.7
Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|2620::861:1:208:80:154:7|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 119725690213 (112G) [application/octet-stream]
Saving to: ‘latest-all.nt.bz2’
latest-all.nt.bz2 0%[ ] 34.15M 4.61MB/s eta 6h 58m
...
latest-all.nt.bz2 100%[===================================>] 111.50G 4.88MB/s in 6h 49m
2020-08-16 00:37:06 (4.64 MB/s) - ‘latest-all.nt.bz2’ saved [119725690213/119725690213]
Sun Aug 16 00:37:06 CEST 2020
date;bzip2 -dk latest-all.nt.bz2;date
Sun Aug 16 07:02:30 CEST 2020