Difference between revisions of "WikiData Import 2022-05-22"
Jump to navigation
Jump to search
Line 46: | Line 46: | ||
= Wikidata indexing = | = Wikidata indexing = | ||
− | <source lang='bash'> | + | <source lang='bash' highlight='1'> |
nohup ./qleverauto -wi& | nohup ./qleverauto -wi& | ||
</source> | </source> |
Revision as of 07:15, 23 May 2022
see QLever/script as discussed in QLever Issue #562 for the script which makes reproducing this attempt easier. since the https://github.com/ad-freiburg/qlever-control now has an official "qlever" script we have rename the script that has the purpose to make the import attempts reproducible qleverauto
qleverauto environment checks
./qleverauto -v
qleverauto version : 1.28 $ : 2022/05/23 05:59:46 $
./qleverauto -e
needed software
docker → /usr/bin/docker ✅
top → /usr/bin/top ✅
df → /usr/bin/df ✅
jq → /usr/bin/jq ✅
lsb_release → /usr/bin/lsb_release ✅
free → /usr/bin/free ✅
operating system
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 20.04.4 LTS
Release: 20.04
Codename: focal
docker version
Docker version 20.10.16, build aa7e414
memory
total used free shared buff/cache available
Mem: 125Gi 5,3Gi 22Gi 43Mi 98Gi 119Gi
Swap: 2,0Gi 8,0Mi 2,0Gi
diskspace
/dev/sdb5 116G 25G 86G 23% /
tmpfs 63G 16K 63G 1% /dev/shm
/dev/sda1 3,6T 2,3T 1,2T 66% /hd/seel
/dev/sdb1 511M 4,0K 511M 1% /boot/efi
soft ulimit for files
1048576
Wikidata dump download
Dump is still quite recent from latest attempt
./qleverauto -wd
wikidata lexemes:latest-lexemes.ttl.bz2 already downloaded
wikidata dump:latest-all.ttl.bz2 already downloaded
Wikidata indexing
nohup ./qleverauto -wi&