Wikidata Import 2025-06-02

From BITPlan Wiki
Jump to navigation Jump to search
Import
edit
state  
url  https://wiki.bitplan.com/index.php/Wikidata_Import_2025-06-02
target  QLever
start  2025-06-02
end  
days  
os  Ubuntu 22.04.3 LTS
cpu  Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (16 cores)
ram  512
triples  
comment  


qlv based

pull latest Docker images

Pulling QLever Docker images...
Using default tag: latest
latest: Pulling from adfreiburg/qlever
0622fac788ed: Pull complete 
5ecf46f9ed5f: Pull complete 
81911f9a15cc: Pull complete 
13922ade7d52: Pull complete 
98cb903d5420: Pull complete 
58c22a7c7996: Pull complete 
08b905f7b11a: Pull complete 
525888185aaf: Pull complete 
2a6e1b89724d: Pull complete 
e07d9f262751: Pull complete 
3da908146d10: Pull complete 
cc857dadc1af: Pull complete 
444901cf084d: Pull complete 
d8dcb623df60: Pull complete 
99eb9bd74591: Pull complete 
4ccfc7d479bc: Pull complete 
dbcf8df25a39: Pull complete 
Digest: sha256:c03ea7ee903e92f64fb998526d015223dfba1d7156afd01d082ee3e4f523795a
Status: Downloaded newer image for adfreiburg/qlever:latest
docker.io/adfreiburg/qlever:latest
✅:Successfully pulled adfreiburg/qlever
Using default tag: latest
latest: Pulling from adfreiburg/qlever-ui
c6a83fedfae6: Already exists 
d7c82518a7cd: Already exists 
14d88fabbbe9: Already exists 
5a3d34767148: Already exists 
a241ded2a651: Already exists 
0ecf97186d1c: Pull complete 
4f4fb700ef54: Pull complete 
f0d18f32e930: Pull complete 
4f53168bf389: Pull complete 
c1c2e0b245d0: Pull complete 
b08d5a18cc8a: Pull complete 
bfa899f30b96: Pull complete 
Digest: sha256:6992d93cc7dc84b796685faacf357747a3b52692933ce9e503ac40a5166090ea
Status: Downloaded newer image for adfreiburg/qlever-ui:latest
docker.io/adfreiburg/qlever-ui:latest
✅:Successfully pulled adfreiburg/qlever-ui

check disk space

qlv -l
/hd/alpha/qlever/wikidata_20241123/
/hd/alpha/qlever/wikidata_20250503/
qlv -s
Directory  Device           Available      Total Type
alpha      /dev/sdb1             1.5T       3.5T  SSD
beta       /dev/sdc1             2.2T       3.5T  SSD
delta      /dev/sde1             2.0T       3.5T  SSD
eneco      /dev/sda1             5.4T        11T  HDD
gamma      /dev/sdd1             173G       3.5T  SSD
mantax     /dev/nvme0n1p1        840G       5.8T  SSD

start import and index

sudo chmod 755 /run/screen
wf@wikidata:/hd/gamma$ qlv --disk beta -ir
✅:Created directory /hd/beta/qlever/wikidata_20250602
✅:Started screen session qlever_wikidata_20250602.
✅:Logging to /hd/beta/qlever/wikidata_20250602/screen.log

Fix failed start of server and ui

tail screen.log 
eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: start

docker run -d --restart=unless-stopped -u $(id -u):$(id -g) -v /etc/localtime:/etc/localtime:ro -v $(pwd):/index -p 7001:7001 -w /index --init --entrypoint bash --name qlever.server.wikidata adfreiburg/qlever -c 'ServerMain -i wikidata -j 8 -p 7001 -m 20G -c 15G -e 5G -k 200 -s 600s -a wikidata_2gqav83nPICG > wikidata.server-log.txt 2>&1'

Starting the QLever server failed (docker: Error response from daemon: Conflict. The container name "/qlever.server.wikidata" is already in use by container "0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af". You have to remove (or rename) that container to be able to reuse that name.  Run 'docker run --help' for more information)

QLever indexing process completed at Tue Jun  3 12:46:39 AM CEST 2025
wf@wikidata:/hd/beta/qlever/wikidata_20250602$ docker stop 0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
wf@wikidata:/hd/beta/qlever/wikidata_20250602$ docker rm 0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af

qlever start
qlever ui
Retrieved from "https://wiki.bitplan.com/index.php?title=Wikidata_Import_2025-06-02&oldid=19803"