Wikidata Import 2025-05-03

Import
edit
state	✅
url	https://wiki.bitplan.com/index.php/Wikidata_Import_2025-05-03
target	QLever
start	2025-05-03
end	2025-05-04
days	0.6
os	Ubuntu 22.04.3 LTS
cpu	Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (16 cores)
ram	512
triples	20,096,524,609
comment

qlv based

qlv -p
Pulling QLever Docker images...
Using default tag: latest
latest: Pulling from adfreiburg/qlever
2726e237d1a3: Pull complete 
ea93dc18f0db: Pull complete 
f1904153c7ac: Pull complete 
6061abc97766: Pull complete 
1c0fec0307e6: Pull complete 
8bcf711dbb5e: Pull complete 
f3abdc7f6425: Pull complete 
05a611db26e1: Pull complete 
debfe0f3b97c: Pull complete 
67e63b8d8c88: Pull complete 
6371cb68ae88: Pull complete 
3566cf3e11c2: Pull complete 
e7a0a0660e65: Pull complete 
9c5e3f7a1133: Pull complete 
4c9e92f95d96: Pull complete 
52d7c0a7b78f: Pull complete 
662cc29364a2: Pull complete 
Digest: sha256:09a0eeb54c345d2dd76e9a840371827ea8c5428cc5ddd771f0fd28f4ee444a19
Status: Downloaded newer image for adfreiburg/qlever:latest
docker.io/adfreiburg/qlever:latest
✅:Successfully pulled adfreiburg/qlever
Using default tag: latest
latest: Pulling from adfreiburg/qlever-ui
c6a83fedfae6: Already exists 
d7c82518a7cd: Already exists 
14d88fabbbe9: Already exists 
5a3d34767148: Already exists 
a241ded2a651: Already exists 
666991a9b0b6: Pull complete 
4f4fb700ef54: Pull complete 
8f54b19a47e6: Pull complete 
c05e3fc205d6: Pull complete 
5d24c91adc74: Pull complete 
3d34549ec26b: Pull complete 
afb77aa08be2: Pull complete 
Digest: sha256:a51cbe816415194e98df92fc59cf2f5a157e53de4c8d845720a509c81ab28a93
Status: Downloaded newer image for adfreiburg/qlever-ui:latest
docker.io/adfreiburg/qlever-ui:latest
✅:Successfully pulled adfreiburg/qlever-ui

qlv -l
/hd/alpha/qlever/wikidata_20241123/
/hd/beta/qlever/wikidata_20250331/
/hd/delta/qlever/wikidata_20250213/
rm -rf /hd/alpha/qlever/wikidata_20241123/
qlv -l
/hd/beta/qlever/wikidata_20250331/
/hd/delta/qlever/wikidata_20250213/

qlv --disk alpha -ir
✅:Created directory /hd/alpha/qlever/wikidata_20250503
✅:Started screen session qlever_wikidata_20250503.
✅:Logging to /hd/alpha/qlever/wikidata_20250503/screen.log

qlever UI configuration

wf account

qlever ui

To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:

eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: ui

Stop running containers
docker pull -q docker.io/adfreiburg/qlever-ui
docker run -d --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -it qlever.ui.wikidata bash -c "python manage.py configure wikidata http://localhost:7001"

The QLever UI should now be up at http://localhost:8176 ...You can log in as QLever UI admin with username and password "demo"

https://qlever.wikidata.dbis.rwth-aachen.de/wikidata starts but does not connect to the local backend ... see https://github.com/ad-freiburg/qlever-ui/issues/125

jh account

pip install qlever
Defaulting to user installation because normal site-packages is not writeable
Collecting qlever
  Downloading qlever-0.5.23-py3-none-any.whl (82 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.6/82.6 KB 3.8 MB/s eta 0:00:00
Collecting argcomplete
  Downloading argcomplete-3.6.2-py3-none-any.whl (43 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.7/43.7 KB 13.4 MB/s eta 0:00:00
Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from qlever) (5.4.1)
Collecting psutil
  Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.0/278.0 KB 13.2 MB/s eta 0:00:00
Collecting termcolor
  Downloading termcolor-3.1.0-py3-none-any.whl (7.7 kB)
Installing collected packages: termcolor, psutil, argcomplete, qlever
  WARNING: The scripts activate-global-python-argcomplete, python-argcomplete-check-easy-install-script and register-python-argcomplete are installed in '/home/jh/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: The script qlever is installed in '/home/jh/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed argcomplete-3.6.2 psutil-7.0.0 qlever-0.5.23 termcolor-3.1.0
# logout and relogin to pickup PATH changes
which qlever
/home/jh/.local/bin/qlever
qlever ui

To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:

eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: ui

docker pull -q docker.io/adfreiburg/qlever-ui
docker create --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui && docker cp qlever.ui.wikidata:/app/db/qleverui.sqlite3 wikidata.ui-db.sqlite3 && docker rm -f qlever.ui.wikidata
docker run -d --volume $(pwd):/app/db --env QLEVERUI_DATABASE_URL=sqlite:////app/db/wikidata.ui-db.sqlite3 --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -i qlever.ui.wikidata bash -c "python manage.py config wikidata"

Failed to get wikidata.ui-db.sqlite3 from docker.io/adfreiburg/qlever-ui (open /hd/alpha/qlever/wikidata_20250503/wikidata.ui-db.sqlite3: permission denied)

qlever ui

To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:

eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: ui

docker pull -q docker.io/adfreiburg/qlever-ui
docker create --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui && docker cp qlever.ui.wikidata:/app/db/qleverui.sqlite3 wikidata.ui-db.sqlite3 && docker rm -f qlever.ui.wikidata
docker run -d --volume $(pwd):/app/db --env QLEVERUI_DATABASE_URL=sqlite:////app/db/wikidata.ui-db.sqlite3 --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -i qlever.ui.wikidata bash -c "python manage.py config wikidata"

Get default config file `Qleverfile-ui.yml` from image `docker.io/adfreiburg/qlever-ui` and set endpoint to `http://wikidata:7001`

The QLever UI should now be up at http://wikidata:8176/wikidata

You can modify the config file at `Qleverfile-ui.yml` and then just run `qlever ui` again

change Qleverfile-ui.yml

mkdir RCS
jh@wikidata:/hd/alpha/qlever/wikidata_20250503$ ci -l Qleverfile-ui.yml 
RCS/Qleverfile-ui.yml,v  <--  Qleverfile-ui.yml
enter description, terminated with single '.' or end of file:
NOTE: This is NOT the log message!
>> .
initial revision: 1.1
done
rcsdiff ./Qleverfile-ui.yml 
===================================================================
RCS file: ./RCS/Qleverfile-ui.yml,v
retrieving revision 1.1
diff -r1.1 ./Qleverfile-ui.yml
6c6
<     baseUrl: http://wikidata:7001
---
>     baseUrl:  https://qlever-api.wikidata.dbis.rwth-aachen.de/
qlever ui