Difference between revisions of "Wikidata Import 2025-06-02"

From BITPlan Wiki
Jump to navigation Jump to search
(Created page with "{{PageSequence|prev=Wikidata Import 2025-05-03|next=|category=Wikidata|categoryIcon=cloud-download}} {{Import |state= |url=https://wiki.bitplan.com/index.php/Wikidata_Import_2...")
 
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
{{PageSequence|prev=Wikidata Import 2025-05-03|next=|category=Wikidata|categoryIcon=cloud-download}}
+
{{PageSequence|prev=Wikidata Import 2025-05-03|next=Wikidata Import 2025-06-06|category=Wikidata|categoryIcon=cloud-download}}
 
{{Import
 
{{Import
−
|state=
+
|state=✅
 
|url=https://wiki.bitplan.com/index.php/Wikidata_Import_2025-06-02
 
|url=https://wiki.bitplan.com/index.php/Wikidata_Import_2025-06-02
 
|target=QLever
 
|target=QLever
 
|start=2025-06-02
 
|start=2025-06-02
−
|end=
+
|end=2025-06-03
−
|days=
+
|days=~0,6
 
|os=Ubuntu 22.04.3 LTS
 
|os=Ubuntu 22.04.3 LTS
 
|cpu=Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (16 cores)
 
|cpu=Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (16 cores)
 
|ram=512
 
|ram=512
−
|triples=
+
|triples=20,484,725,007
 
|storemode=property
 
|storemode=property
 
}}
 
}}
Line 81: Line 81:
 
✅:Started screen session qlever_wikidata_20250602.
 
✅:Started screen session qlever_wikidata_20250602.
 
✅:Logging to /hd/beta/qlever/wikidata_20250602/screen.log
 
✅:Logging to /hd/beta/qlever/wikidata_20250602/screen.log
 +
</source>
 +
= Fix failed start of server and ui =
 +
<source lang='bash' highlight='1'>
 +
tail screen.log
 +
eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1
 +
 +
 +
Command: start
 +
 +
docker run -d --restart=unless-stopped -u $(id -u):$(id -g) -v /etc/localtime:/etc/localtime:ro -v $(pwd):/index -p 7001:7001 -w /index --init --entrypoint bash --name qlever.server.wikidata adfreiburg/qlever -c 'ServerMain -i wikidata -j 8 -p 7001 -m 20G -c 15G -e 5G -k 200 -s 600s -a wikidata_2gqav83nPICG > wikidata.server-log.txt 2>&1'
 +
 +
Starting the QLever server failed (docker: Error response from daemon: Conflict. The container name "/qlever.server.wikidata" is already in use by container "0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af". You have to remove (or rename) that container to be able to reuse that name.  Run 'docker run --help' for more information)
 +
 +
QLever indexing process completed at Tue Jun  3 12:46:39 AM CEST 2025
 +
wf@wikidata:/hd/beta/qlever/wikidata_20250602$ docker stop 0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
 +
0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
 +
wf@wikidata:/hd/beta/qlever/wikidata_20250602$ docker rm 0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
 +
0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
 +
 +
qlever start
 +
qlever ui
 +
rcsdiff ./Qleverfile-ui.yml
 +
===================================================================
 +
RCS file: ./RCS/Qleverfile-ui.yml,v
 +
retrieving revision 1.1
 +
diff -r1.1 ./Qleverfile-ui.yml
 +
6c6
 +
<    baseUrl: http://wikidata:7001
 +
---
 +
>    baseUrl: https://qlever-api.wikidata.dbis.rwth-aachen.de/
 +
docker stop qlever.ui.wikidata
 +
docker rm qlever.ui.wikidata
 +
qlever ui
 
</source>
 
</source>

Latest revision as of 08:12, 6 June 2025

"~" can not be assigned to a declared number type with value 0.

Import
edit
state  ✅
url  https://wiki.bitplan.com/index.php/Wikidata_Import_2025-06-02
target  QLever
start  2025-06-02
end  2025-06-03
days  ~0,6
os  Ubuntu 22.04.3 LTS
cpu  Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (16 cores)
ram  512
triples  20,484,725,007
comment  


qlv based

pull latest Docker images

Pulling QLever Docker images...
Using default tag: latest
latest: Pulling from adfreiburg/qlever
0622fac788ed: Pull complete 
5ecf46f9ed5f: Pull complete 
81911f9a15cc: Pull complete 
13922ade7d52: Pull complete 
98cb903d5420: Pull complete 
58c22a7c7996: Pull complete 
08b905f7b11a: Pull complete 
525888185aaf: Pull complete 
2a6e1b89724d: Pull complete 
e07d9f262751: Pull complete 
3da908146d10: Pull complete 
cc857dadc1af: Pull complete 
444901cf084d: Pull complete 
d8dcb623df60: Pull complete 
99eb9bd74591: Pull complete 
4ccfc7d479bc: Pull complete 
dbcf8df25a39: Pull complete 
Digest: sha256:c03ea7ee903e92f64fb998526d015223dfba1d7156afd01d082ee3e4f523795a
Status: Downloaded newer image for adfreiburg/qlever:latest
docker.io/adfreiburg/qlever:latest
✅:Successfully pulled adfreiburg/qlever
Using default tag: latest
latest: Pulling from adfreiburg/qlever-ui
c6a83fedfae6: Already exists 
d7c82518a7cd: Already exists 
14d88fabbbe9: Already exists 
5a3d34767148: Already exists 
a241ded2a651: Already exists 
0ecf97186d1c: Pull complete 
4f4fb700ef54: Pull complete 
f0d18f32e930: Pull complete 
4f53168bf389: Pull complete 
c1c2e0b245d0: Pull complete 
b08d5a18cc8a: Pull complete 
bfa899f30b96: Pull complete 
Digest: sha256:6992d93cc7dc84b796685faacf357747a3b52692933ce9e503ac40a5166090ea
Status: Downloaded newer image for adfreiburg/qlever-ui:latest
docker.io/adfreiburg/qlever-ui:latest
✅:Successfully pulled adfreiburg/qlever-ui

check disk space

qlv -l
/hd/alpha/qlever/wikidata_20241123/
/hd/alpha/qlever/wikidata_20250503/
qlv -s
Directory  Device           Available      Total Type
alpha      /dev/sdb1             1.5T       3.5T  SSD
beta       /dev/sdc1             2.2T       3.5T  SSD
delta      /dev/sde1             2.0T       3.5T  SSD
eneco      /dev/sda1             5.4T        11T  HDD
gamma      /dev/sdd1             173G       3.5T  SSD
mantax     /dev/nvme0n1p1        840G       5.8T  SSD

start import and index

sudo chmod 755 /run/screen
wf@wikidata:/hd/gamma$ qlv --disk beta -ir
✅:Created directory /hd/beta/qlever/wikidata_20250602
✅:Started screen session qlever_wikidata_20250602.
✅:Logging to /hd/beta/qlever/wikidata_20250602/screen.log

Fix failed start of server and ui

tail screen.log 
eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: start

docker run -d --restart=unless-stopped -u $(id -u):$(id -g) -v /etc/localtime:/etc/localtime:ro -v $(pwd):/index -p 7001:7001 -w /index --init --entrypoint bash --name qlever.server.wikidata adfreiburg/qlever -c 'ServerMain -i wikidata -j 8 -p 7001 -m 20G -c 15G -e 5G -k 200 -s 600s -a wikidata_2gqav83nPICG > wikidata.server-log.txt 2>&1'

Starting the QLever server failed (docker: Error response from daemon: Conflict. The container name "/qlever.server.wikidata" is already in use by container "0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af". You have to remove (or rename) that container to be able to reuse that name.  Run 'docker run --help' for more information)

QLever indexing process completed at Tue Jun  3 12:46:39 AM CEST 2025
wf@wikidata:/hd/beta/qlever/wikidata_20250602$ docker stop 0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
wf@wikidata:/hd/beta/qlever/wikidata_20250602$ docker rm 0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af
0b3acc696bbc591c13ed3139325aa5b936722ef6a04a1bda5cc0976b133601af

qlever start
qlever ui
 rcsdiff ./Qleverfile-ui.yml 
===================================================================
RCS file: ./RCS/Qleverfile-ui.yml,v
retrieving revision 1.1
diff -r1.1 ./Qleverfile-ui.yml
6c6
<     baseUrl: http://wikidata:7001
---
>     baseUrl: https://qlever-api.wikidata.dbis.rwth-aachen.de/
docker stop qlever.ui.wikidata
docker rm qlever.ui.wikidata
qlever ui
Retrieved from "https://wiki.bitplan.com/index.php?title=Wikidata_Import_2025-06-02&oldid=19830"