Wikidata Import 2025-05-03: Difference between revisions

From BITPlan Wiki
Jump to navigation Jump to search
No edit summary
 
(12 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{PageSequence|prev=Wikidata Import 2025-05-02|next=category=Wikidata|categoryIcon=cloud-download}}
{{PageSequence|prev=Wikidata Import 2025-05-02|next=Wikidata Import 2025-06-02|category=Wikidata|categoryIcon=cloud-download}}
{{Import
|state=✅
|url=https://wiki.bitplan.com/index.php/Wikidata_Import_2025-05-03
|target=QLever
|start=2025-05-03
|end=2025-05-04
|days=0.6
|os=Ubuntu 22.04.3 LTS
|cpu=Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (16 cores)
|ram=512
|triples=20,096,524,609
|storemode=property
}}
 
= qlv based =
= qlv based =
<source lang='bash' highlight='1'>
<source lang='bash' highlight='1'>
Line 61: Line 75:
✅:Started screen session qlever_wikidata_20250503.
✅:Started screen session qlever_wikidata_20250503.
✅:Logging to /hd/alpha/qlever/wikidata_20250503/screen.log
✅:Logging to /hd/alpha/qlever/wikidata_20250503/screen.log
</source>
= qlever UI configuration =
== wf account ==
<source lang='bash'>
qlever ui
To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:
eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1
Command: ui
Stop running containers
docker pull -q docker.io/adfreiburg/qlever-ui
docker run -d --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -it qlever.ui.wikidata bash -c "python manage.py configure wikidata http://localhost:7001"
The QLever UI should now be up at http://localhost:8176 ...You can log in as QLever UI admin with username and password "demo"
</source>
https://qlever.wikidata.dbis.rwth-aachen.de/wikidata starts but does not connect to the local backend ...
see https://github.com/ad-freiburg/qlever-ui/issues/125
== jh account ==
<source lang='bash' highlight='1'>
pip install qlever
Defaulting to user installation because normal site-packages is not writeable
Collecting qlever
  Downloading qlever-0.5.23-py3-none-any.whl (82 kB)
    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.6/82.6 KB 3.8 MB/s eta 0:00:00
Collecting argcomplete
  Downloading argcomplete-3.6.2-py3-none-any.whl (43 kB)
    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.7/43.7 KB 13.4 MB/s eta 0:00:00
Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from qlever) (5.4.1)
Collecting psutil
  Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB)
    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.0/278.0 KB 13.2 MB/s eta 0:00:00
Collecting termcolor
  Downloading termcolor-3.1.0-py3-none-any.whl (7.7 kB)
Installing collected packages: termcolor, psutil, argcomplete, qlever
  WARNING: The scripts activate-global-python-argcomplete, python-argcomplete-check-easy-install-script and register-python-argcomplete are installed in '/home/jh/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: The script qlever is installed in '/home/jh/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed argcomplete-3.6.2 psutil-7.0.0 qlever-0.5.23 termcolor-3.1.0
# logout and relogin to pickup PATH changes
which qlever
/home/jh/.local/bin/qlever
qlever ui
To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:
eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1
Command: ui
docker pull -q docker.io/adfreiburg/qlever-ui
docker create --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui && docker cp qlever.ui.wikidata:/app/db/qleverui.sqlite3 wikidata.ui-db.sqlite3 && docker rm -f qlever.ui.wikidata
docker run -d --volume $(pwd):/app/db --env QLEVERUI_DATABASE_URL=sqlite:////app/db/wikidata.ui-db.sqlite3 --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -i qlever.ui.wikidata bash -c "python manage.py config wikidata"
Failed to get wikidata.ui-db.sqlite3 from docker.io/adfreiburg/qlever-ui (open /hd/alpha/qlever/wikidata_20250503/wikidata.ui-db.sqlite3: permission denied)
</source>
<source lang='bash' highlight='1'>
qlever ui
To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:
eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1
Command: ui
docker pull -q docker.io/adfreiburg/qlever-ui
docker create --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui && docker cp qlever.ui.wikidata:/app/db/qleverui.sqlite3 wikidata.ui-db.sqlite3 && docker rm -f qlever.ui.wikidata
docker run -d --volume $(pwd):/app/db --env QLEVERUI_DATABASE_URL=sqlite:////app/db/wikidata.ui-db.sqlite3 --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -i qlever.ui.wikidata bash -c "python manage.py config wikidata"
Get default config file `Qleverfile-ui.yml` from image `docker.io/adfreiburg/qlever-ui` and set endpoint to `http://wikidata:7001`
The QLever UI should now be up at http://wikidata:8176/wikidata
You can modify the config file at `Qleverfile-ui.yml` and then just run `qlever ui` again
</source>
=== change Qleverfile-ui.yml  ===
<source lang='bash' highlight='1,2,9,18'>
mkdir RCS
jh@wikidata:/hd/alpha/qlever/wikidata_20250503$ ci -l Qleverfile-ui.yml
RCS/Qleverfile-ui.yml,v  <--  Qleverfile-ui.yml
enter description, terminated with single '.' or end of file:
NOTE: This is NOT the log message!
>> .
initial revision: 1.1
done
rcsdiff ./Qleverfile-ui.yml
===================================================================
RCS file: ./RCS/Qleverfile-ui.yml,v
retrieving revision 1.1
diff -r1.1 ./Qleverfile-ui.yml
6c6
<    baseUrl: http://wikidata:7001
---
>    baseUrl:  https://qlever-api.wikidata.dbis.rwth-aachen.de/
qlever ui
</source>
</source>

Latest revision as of 05:31, 2 June 2025

Import
edit
state  ✅
url  https://wiki.bitplan.com/index.php/Wikidata_Import_2025-05-03
target  QLever
start  2025-05-03
end  2025-05-04
days  0.6
os  Ubuntu 22.04.3 LTS
cpu  Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (16 cores)
ram  512
triples  20,096,524,609
comment  


qlv based

qlv -p
Pulling QLever Docker images...
Using default tag: latest
latest: Pulling from adfreiburg/qlever
2726e237d1a3: Pull complete 
ea93dc18f0db: Pull complete 
f1904153c7ac: Pull complete 
6061abc97766: Pull complete 
1c0fec0307e6: Pull complete 
8bcf711dbb5e: Pull complete 
f3abdc7f6425: Pull complete 
05a611db26e1: Pull complete 
debfe0f3b97c: Pull complete 
67e63b8d8c88: Pull complete 
6371cb68ae88: Pull complete 
3566cf3e11c2: Pull complete 
e7a0a0660e65: Pull complete 
9c5e3f7a1133: Pull complete 
4c9e92f95d96: Pull complete 
52d7c0a7b78f: Pull complete 
662cc29364a2: Pull complete 
Digest: sha256:09a0eeb54c345d2dd76e9a840371827ea8c5428cc5ddd771f0fd28f4ee444a19
Status: Downloaded newer image for adfreiburg/qlever:latest
docker.io/adfreiburg/qlever:latest
✅:Successfully pulled adfreiburg/qlever
Using default tag: latest
latest: Pulling from adfreiburg/qlever-ui
c6a83fedfae6: Already exists 
d7c82518a7cd: Already exists 
14d88fabbbe9: Already exists 
5a3d34767148: Already exists 
a241ded2a651: Already exists 
666991a9b0b6: Pull complete 
4f4fb700ef54: Pull complete 
8f54b19a47e6: Pull complete 
c05e3fc205d6: Pull complete 
5d24c91adc74: Pull complete 
3d34549ec26b: Pull complete 
afb77aa08be2: Pull complete 
Digest: sha256:a51cbe816415194e98df92fc59cf2f5a157e53de4c8d845720a509c81ab28a93
Status: Downloaded newer image for adfreiburg/qlever-ui:latest
docker.io/adfreiburg/qlever-ui:latest
✅:Successfully pulled adfreiburg/qlever-ui

qlv -l
/hd/alpha/qlever/wikidata_20241123/
/hd/beta/qlever/wikidata_20250331/
/hd/delta/qlever/wikidata_20250213/
rm -rf /hd/alpha/qlever/wikidata_20241123/
qlv -l
/hd/beta/qlever/wikidata_20250331/
/hd/delta/qlever/wikidata_20250213/

qlv --disk alpha -ir
✅:Created directory /hd/alpha/qlever/wikidata_20250503
✅:Started screen session qlever_wikidata_20250503.
✅:Logging to /hd/alpha/qlever/wikidata_20250503/screen.log

qlever UI configuration

wf account

qlever ui

To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:

eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: ui

Stop running containers
docker pull -q docker.io/adfreiburg/qlever-ui
docker run -d --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -it qlever.ui.wikidata bash -c "python manage.py configure wikidata http://localhost:7001"

The QLever UI should now be up at http://localhost:8176 ...You can log in as QLever UI admin with username and password "demo"

https://qlever.wikidata.dbis.rwth-aachen.de/wikidata starts but does not connect to the local backend ... see https://github.com/ad-freiburg/qlever-ui/issues/125

jh account

pip install qlever
Defaulting to user installation because normal site-packages is not writeable
Collecting qlever
  Downloading qlever-0.5.23-py3-none-any.whl (82 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.6/82.6 KB 3.8 MB/s eta 0:00:00
Collecting argcomplete
  Downloading argcomplete-3.6.2-py3-none-any.whl (43 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.7/43.7 KB 13.4 MB/s eta 0:00:00
Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from qlever) (5.4.1)
Collecting psutil
  Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.0/278.0 KB 13.2 MB/s eta 0:00:00
Collecting termcolor
  Downloading termcolor-3.1.0-py3-none-any.whl (7.7 kB)
Installing collected packages: termcolor, psutil, argcomplete, qlever
  WARNING: The scripts activate-global-python-argcomplete, python-argcomplete-check-easy-install-script and register-python-argcomplete are installed in '/home/jh/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: The script qlever is installed in '/home/jh/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed argcomplete-3.6.2 psutil-7.0.0 qlever-0.5.23 termcolor-3.1.0
# logout and relogin to pickup PATH changes
which qlever
/home/jh/.local/bin/qlever
qlever ui

To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:

eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: ui

docker pull -q docker.io/adfreiburg/qlever-ui
docker create --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui && docker cp qlever.ui.wikidata:/app/db/qleverui.sqlite3 wikidata.ui-db.sqlite3 && docker rm -f qlever.ui.wikidata
docker run -d --volume $(pwd):/app/db --env QLEVERUI_DATABASE_URL=sqlite:////app/db/wikidata.ui-db.sqlite3 --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -i qlever.ui.wikidata bash -c "python manage.py config wikidata"

Failed to get wikidata.ui-db.sqlite3 from docker.io/adfreiburg/qlever-ui (open /hd/alpha/qlever/wikidata_20250503/wikidata.ui-db.sqlite3: permission denied)

qlever ui

To enable autocompletion, run the following command, and consider adding it to your `.bashrc` or `.zshrc`:

eval "$(register-python-argcomplete qlever)" && export QLEVER_ARGCOMPLETE_ENABLED=1


Command: ui

docker pull -q docker.io/adfreiburg/qlever-ui
docker create --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui && docker cp qlever.ui.wikidata:/app/db/qleverui.sqlite3 wikidata.ui-db.sqlite3 && docker rm -f qlever.ui.wikidata
docker run -d --volume $(pwd):/app/db --env QLEVERUI_DATABASE_URL=sqlite:////app/db/wikidata.ui-db.sqlite3 --publish 8176:7000 --name qlever.ui.wikidata docker.io/adfreiburg/qlever-ui
docker exec -i qlever.ui.wikidata bash -c "python manage.py config wikidata"

Get default config file `Qleverfile-ui.yml` from image `docker.io/adfreiburg/qlever-ui` and set endpoint to `http://wikidata:7001`

The QLever UI should now be up at http://wikidata:8176/wikidata

You can modify the config file at `Qleverfile-ui.yml` and then just run `qlever ui` again

change Qleverfile-ui.yml

mkdir RCS
jh@wikidata:/hd/alpha/qlever/wikidata_20250503$ ci -l Qleverfile-ui.yml 
RCS/Qleverfile-ui.yml,v  <--  Qleverfile-ui.yml
enter description, terminated with single '.' or end of file:
NOTE: This is NOT the log message!
>> .
initial revision: 1.1
done
rcsdiff ./Qleverfile-ui.yml 
===================================================================
RCS file: ./RCS/Qleverfile-ui.yml,v
retrieving revision 1.1
diff -r1.1 ./Qleverfile-ui.yml
6c6
<     baseUrl: http://wikidata:7001
---
>     baseUrl:  https://qlever-api.wikidata.dbis.rwth-aachen.de/
qlever ui
Retrieved from "https://wiki.bitplan.com/index.php?title=Wikidata_Import_2025-05-03&oldid=19794"