reveal.js

Import
edit
state
url	https://wiki.bitplan.com/index.php/Wikidata_Import_2023-01-24
target	QLever
start	2023-01-24
end
days
os
cpu
ram
triples
comment

setup wikidata[edit]

mkdir wikidata
cd wikidata/
. ../qlever-control/qlever wikidata

QLEVER CONFIG

Checking your PATH ...
The directory "/hd/eneco/qlever/qlever-control" is already contained in your PATH

Setting up bash autocompletion ...
Done, number of completions: 35

Creating new Qleverfile ...
Copied pre-configured Qleverfile for "wikidata" into current directory.

Setup is complete
Type qlever and use autocompletion to see which actions are available. Add a
"show" in the end to see what an action does without executing it (for example,
qlever index show). Edit your local Qleverfile to change settings. A typical
sequence of actions if you have used a preconfigured Qleverfile is:

qlever get-data
qlever index
qlever start
qlever example-query

start download[edit]

qlever get-data
executing "get-data":

wget -nc https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.bz2 https://dumps.wikimedia.org/wikidatawiki/entities/latest-lexemes.ttl.bz2

Getting data using GET_DATA_CMD from Qleverfile ...

--2023-01-25 16:58:18--  https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.bz2
Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.142, 2620:0:861:2:208:80:154:142
Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|208.80.154.142|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 99583991786 (93G) [application/octet-stream]
Saving to: ‘latest-all.ttl.bz2’

     0K .......... .......... .......... .......... ..........  0%  309K 3d15h
    50K .......... .......... .......... .......... ..........  0%  246K 4d2h
   100K .......... .......... .......... .......... ..........  0%  416K 3d15h
   150K .......... .......... .......... .......... ..........  0% 1.14M 2d23h
   200K .......... .......... .......... .......... ..........  0%  617K 2d17h
   250K .......... .......... .......... .......... ..........  0% 1.23M 2d10h
   300K .......... .......... .......... .......... ..........  0%  647K 2d8h
   350K .......... .......... .......... .......... ..........  0% 1.12M 2d3h
   400K .......... .......... .......... .......... ..........  0% 78.4M 46h13m
   450K .......... .......... .......... .......... ..........  0%  550K 46h31m
   500K .......... .......... .......... .......... ..........  0% 12.5M 42h28m
...
97249700K .......... .......... .......... .......... .......... 99% 2.98M 0s
97249750K .......... .......... .......... .......... .......... 99% 2.90M 0s
97249800K .......... .......... .......... .......... .......... 99%  116M 0s
97249850K .......... .......... .......... .......... .......... 99% 2.95M 0s
97249900K .......... .......... .......... .......... .......... 99% 3.28M 0s
97249950K .......... .......... .......... .......... .         100% 2.87M=6h47m

2023-01-25 23:45:44 (3.89 MB/s) - ‘latest-all.ttl.bz2’ saved [99583991786/99583991786]

2023-01-25 23:47:18 (4.08 MB/s) - ‘latest-lexemes.ttl.bz2’ saved [402494804/402494804]

FINISHED --2023-01-25 23:47:18--
Total wall clock time: 6h 49m 0s
Downloaded: 2 files, 93G in 6h 48m 59s (3.89 MB/s)

start indexing[edit]

qlever index
Executing "index":

for F in latest-lexemes.ttl.bz2 latest-all.ttl.bz2; do bzcat $F | head -1000 | \grep ^@prefix; done | sort -u > wikidata-latest.prefix-definitions
docker run -it --rm -u 0:0 -v /hd/eneco/qlever/wikidata:/index -w /index --entrypoint bash --name qlever.wikidata-latest.index-build adfreiburg/qlever -c "ulimit -Sn 1048576; bzcat -f wikidata-latest.prefix-definitions latest-lexemes.ttl.bz2 latest-all.ttl.bz2 | IndexBuilderMain -F ttl -f - -i wikidata-latest -s wikidata-latest.settings.json --stxxl-memory-gb 10 | tee wikidata-latest.index-log.txt"

2023-01-26 05:16:33.718	- INFO:  QLever IndexBuilder, compiled on Mon Jan 16 11:34:10 UTC 2023 using git hash d7f662
2023-01-26 05:16:33.718	- INFO:  You specified the input format: TTL
2023-01-26 05:16:33.719	- INFO:  You specified "locale = en_US" and "ignore-punctuation = 1"
2023-01-26 05:16:33.719	- INFO:  You specified "num-triples-per-batch = 5,000,000", choose a lower value if the index builder runs out of memory
2023-01-26 05:16:33.719	- INFO:  Integers that cannot be represented by QLever will throw an exception (this is the default behavior)
2023-01-26 05:16:33.719	- INFO:  Processing input triples from /dev/stdin ...
2023-01-26 05:18:07.861	- INFO:  Input triples processed: 100,000,000
2023-01-26 05:19:34.947	- INFO:  Input triples processed: 200,000,000
2023-01-26 05:21:34.689	- INFO:  Input triples processed: 300,000,000
2023-01-26 05:23:22.200	- INFO:  Input triples processed: 400,000,000
2023-01-26 05:25:04.958	- INFO:  Input triples processed: 500,000,000
2023-01-26 05:26:58.391	- INFO:  Input triples processed: 600,000,000
2023-01-26 05:28:47.123	- INFO:  Input triples processed: 700,000,000
2023-01-26 05:30:46.063	- INFO:  Input triples processed: 800,000,000
2023-01-26 05:32:48.481	- INFO:  Input triples processed: 900,000,000
2023-01-26 05:34:42.104	- INFO:  Input triples processed: 1,000,000,000
2023-01-26 05:36:44.675	- INFO:  Input triples processed: 1,100,000,000
2023-01-26 05:38:44.383	- INFO:  Input triples processed: 1,200,000,000
2023-01-26 05:40:45.943	- INFO:  Input triples processed: 1,300,000,000
2023-01-26 05:42:44.600	- INFO:  Input triples processed: 1,400,000,000
2023-01-26 05:44:47.785	- INFO:  Input triples processed: 1,500,000,000
2023-01-26 05:46:42.162	- INFO:  Input triples processed: 1,600,000,000
2023-01-26 05:48:49.327	- INFO:  Input triples processed: 1,700,000,000
2023-01-26 05:50:52.782	- INFO:  Input triples processed: 1,800,000,000
2023-01-26 05:52:58.496	- INFO:  Input triples processed: 1,900,000,000
2023-01-26 05:54:55.954	- INFO:  Input triples processed: 2,000,000,000
2023-01-26 05:57:02.082	- INFO:  Input triples processed: 2,100,000,000
2023-01-26 05:59:02.568	- INFO:  Input triples processed: 2,200,000,000
2023-01-26 06:00:53.919	- INFO:  Input triples processed: 2,300,000,000
2023-01-26 06:02:34.666	- INFO:  Input triples processed: 2,400,000,000
2023-01-26 06:04:36.250	- INFO:  Input triples processed: 2,500,000,000
2023-01-26 06:06:35.608	- INFO:  Input triples processed: 2,600,000,000
2023-01-26 06:08:24.385	- INFO:  Input triples processed: 2,700,000,000
2023-01-26 06:10:08.552	- INFO:  Input triples processed: 2,800,000,000
2023-01-26 06:11:55.843	- INFO:  Input triples processed: 2,900,000,000
2023-01-26 06:13:52.627	- INFO:  Input triples processed: 3,000,000,000
2023-01-26 06:15:51.538	- INFO:  Input triples processed: 3,100,000,000
2023-01-26 06:17:49.776	- INFO:  Input triples processed: 3,200,000,000
2023-01-26 06:19:46.480	- INFO:  Input triples processed: 3,300,000,000
2023-01-26 06:21:47.048	- INFO:  Input triples processed: 3,400,000,000
2023-01-26 06:23:50.830	- INFO:  Input triples processed: 3,500,000,000
2023-01-26 06:25:53.657	- INFO:  Input triples processed: 3,600,000,000
2023-01-26 06:27:53.816	- INFO:  Input triples processed: 3,700,000,000
2023-01-26 06:29:52.634	- INFO:  Input triples processed: 3,800,000,000
2023-01-26 06:31:52.583	- INFO:  Input triples processed: 3,900,000,000
2023-01-26 06:34:00.858	- INFO:  Input triples processed: 4,000,000,000
2023-01-26 06:36:06.334	- INFO:  Input triples processed: 4,100,000,000
2023-01-26 06:38:09.870	- INFO:  Input triples processed: 4,200,000,000
2023-01-26 06:40:07.809	- INFO:  Input triples processed: 4,300,000,000
ls2023-01-26 06:42:13.419	- INFO:  Input triples processed: 4,400,000,000
2023-01-26 06:44:15.087	- INFO:  Input triples processed: 4,500,000,000
rm 2023-01-26 06:46:00.162	- INFO:  Input triples processed: 4,600,000,000
2023-01-26 06:47:46.673	- INFO:  Input triples processed: 4,700,000,000
2023-01-26 06:49:47.976	- INFO:  Input triples processed: 4,800,000,000
ls2023-01-26 06:51:45.487	- INFO:  Input triples processed: 4,900,000,000
2023-01-26 06:53:29.397	- INFO:  Input triples processed: 5,000,000,000
2023-01-26 06:55:20.155	- INFO:  Input triples processed: 5,100,000,000
2023-01-26 06:57:12.614	- INFO:  Input triples processed: 5,200,000,000
2023-01-26 06:59:05.885	- INFO:  Input triples processed: 5,300,000,000
2023-01-26 07:01:08.246	- INFO:  Input triples processed: 5,400,000,000
cd 2023-01-26 07:02:57.451	- INFO:  Input triples processed: 5,500,000,000
2023-01-26 07:05:01.126	- INFO:  Input triples processed: 5,600,000,000
2023-01-26 07:07:07.807	- INFO:  Input triples processed: 5,700,000,000
2023-01-26 07:09:06.932	- INFO:  Input triples processed: 5,800,000,000
2023-01-26 07:11:06.763	- INFO:  Input triples processed: 5,900,000,000
2023-01-26 07:13:10.718	- INFO:  Input triples processed: 6,000,000,000
2023-01-26 07:15:05.605	- INFO:  Input triples processed: 6,100,000,000
2023-01-26 07:17:09.011	- INFO:  Input triples processed: 6,200,000,000
2023-01-26 07:19:17.461	- INFO:  Input triples processed: 6,300,000,000
2023-01-26 07:21:21.925	- INFO:  Input triples processed: 6,400,000,000
2023-01-26 07:23:23.265	- INFO:  Input triples processed: 6,500,000,000
2023-01-26 07:25:22.931	- INFO:  Input triples processed: 6,600,000,000
2023-01-26 07:27:28.524	- INFO:  Input triples processed: 6,700,000,000
2023-01-26 07:29:22.427	- INFO:  Input triples processed: 6,800,000,000
2023-01-26 07:30:57.331	- INFO:  Input triples processed: 6,900,000,000
2023-01-26 07:32:58.674	- INFO:  Input triples processed: 7,000,000,000
2023-01-26 07:34:58.452	- INFO:  Input triples processed: 7,100,000,000
2023-01-26 07:36:49.475	- INFO:  Input triples processed: 7,200,000,000
2023-01-26 07:38:31.371	- INFO:  Input triples processed: 7,300,000,000
2023-01-26 07:40:22.535	- INFO:  Input triples processed: 7,400,000,000
2023-01-26 07:42:14.190	- INFO:  Input triples processed: 7,500,000,000
2023-01-26 07:44:13.892	- INFO:  Input triples processed: 7,600,000,000
2023-01-26 07:46:19.561	- INFO:  Input triples processed: 7,700,000,000
2023-01-26 07:48:12.281	- INFO:  Input triples processed: 7,800,000,000
2023-01-26 07:50:14.397	- INFO:  Input triples processed: 7,900,000,000
2023-01-26 07:52:13.940	- INFO:  Input triples processed: 8,000,000,000
2023-01-26 07:54:13.358	- INFO:  Input triples processed: 8,100,000,000
2023-01-26 07:56:14.083	- INFO:  Input triples processed: 8,200,000,000
2023-01-26 07:58:15.789	- INFO:  Input triples processed: 8,300,000,000
2023-01-26 08:00:10.450	- INFO:  Input triples processed: 8,400,000,000
2023-01-26 08:02:19.918	- INFO:  Input triples processed: 8,500,000,000
2023-01-26 08:04:28.895	- INFO:  Input triples processed: 8,600,000,000
2023-01-26 08:06:37.060	- INFO:  Input triples processed: 8,700,000,000
2023-01-26 08:08:34.788	- INFO:  Input triples processed: 8,800,000,000
2023-01-26 08:10:42.708	- INFO:  Input triples processed: 8,900,000,000
2023-01-26 08:12:44.749	- INFO:  Input triples processed: 9,000,000,000
2023-01-26 08:14:35.747	- INFO:  Input triples processed: 9,100,000,000
2023-01-26 08:16:13.683	- INFO:  Input triples processed: 9,200,000,000
2023-01-26 08:18:16.651	- INFO:  Input triples processed: 9,300,000,000
2023-01-26 08:20:15.302	- INFO:  Input triples processed: 9,400,000,000
2023-01-26 08:22:03.596	- INFO:  Input triples processed: 9,500,000,000
2023-01-26 08:23:47.888	- INFO:  Input triples processed: 9,600,000,000
2023-01-26 08:25:36.139	- INFO:  Input triples processed: 9,700,000,000
2023-01-26 08:27:30.755	- INFO:  Input triples processed: 9,800,000,000
2023-01-26 08:29:29.784	- INFO:  Input triples processed: 9,900,000,000
2023-01-26 08:31:28.243	- INFO:  Input triples processed: 10,000,000,000
2023-01-26 08:33:24.632	- INFO:  Input triples processed: 10,100,000,000
2023-01-26 08:35:26.919	- INFO:  Input triples processed: 10,200,000,000
2023-01-26 08:37:27.175	- INFO:  Input triples processed: 10,300,000,000
2023-01-26 08:39:28.675	- INFO:  Input triples processed: 10,400,000,000
2023-01-26 08:41:31.819	- INFO:  Input triples processed: 10,500,000,000
2023-01-26 08:43:34.663	- INFO:  Input triples processed: 10,600,000,000
2023-01-26 08:45:33.127	- INFO:  Input triples processed: 10,700,000,000
2023-01-26 08:47:41.322	- INFO:  Input triples processed: 10,800,000,000
2023-01-26 08:49:45.182	- INFO:  Input triples processed: 10,900,000,000
2023-01-26 08:51:48.460	- INFO:  Input triples processed: 11,000,000,000
2023-01-26 08:53:47.386	- INFO:  Input triples processed: 11,100,000,000
2023-01-26 08:55:51.621	- INFO:  Input triples processed: 11,200,000,000
2023-01-26 08:57:52.044	- INFO:  Input triples processed: 11,300,000,000
2023-01-26 08:59:33.215	- INFO:  Input triples processed: 11,400,000,000
^[2023-01-26 09:01:19.647	- INFO:  Input triples processed: 11,500,000,000
2023-01-26 09:03:19.692	- INFO:  Input triples processed: 11,600,000,000
2023-01-26 09:05:13.948	- INFO:  Input triples processed: 11,700,000,000
2023-01-26 09:06:55.375	- INFO:  Input triples processed: 11,800,000,000
2023-01-26 09:08:43.137	- INFO:  Input triples processed: 11,900,000,000
2023-01-26 09:10:40.207	- INFO:  Input triples processed: 12,000,000,000
2023-01-26 09:12:40.065	- INFO:  Input triples processed: 12,100,000,000
2023-01-26 09:14:42.086	- INFO:  Input triples processed: 12,200,000,000
2023-01-26 09:16:35.068	- INFO:  Input triples processed: 12,300,000,000
2023-01-26 09:18:36.960	- INFO:  Input triples processed: 12,400,000,000
2023-01-26 09:20:35.936	- INFO:  Input triples processed: 12,500,000,000
2023-01-26 09:22:34.170	- INFO:  Input triples processed: 12,600,000,000
2023-01-26 09:24:34.545	- INFO:  Input triples processed: 12,700,000,000
2023-01-26 09:26:38.144	- INFO:  Input triples processed: 12,800,000,000
2023-01-26 09:28:33.378	- INFO:  Input triples processed: 12,900,000,000
2023-01-26 09:30:37.120	- INFO:  Input triples processed: 13,000,000,000
2023-01-26 09:32:46.897	- INFO:  Input triples processed: 13,100,000,000
2023-01-26 09:34:51.441	- INFO:  Input triples processed: 13,200,000,000
2023-01-26 09:36:55.949	- INFO:  Input triples processed: 13,300,000,000
2023-01-26 09:38:53.834	- INFO:  Input triples processed: 13,400,000,000
2023-01-26 09:40:58.775	- INFO:  Input triples processed: 13,500,000,000
2023-01-26 09:42:52.097	- INFO:  Input triples processed: 13,600,000,000
2023-01-26 09:44:25.177	- INFO:  Input triples processed: 13,700,000,000
2023-01-26 09:46:25.624	- INFO:  Input triples processed: 13,800,000,000
2023-01-26 09:48:29.002	- INFO:  Input triples processed: 13,900,000,000
2023-01-26 09:50:16.720	- INFO:  Input triples processed: 14,000,000,000
2023-01-26 09:52:01.637	- INFO:  Input triples processed: 14,100,000,000
2023-01-26 09:53:50.640	- INFO:  Input triples processed: 14,200,000,000
2023-01-26 09:55:43.511	- INFO:  Input triples processed: 14,300,000,000
2023-01-26 09:57:45.175	- INFO:  Input triples processed: 14,400,000,000
2023-01-26 09:59:47.889	- INFO:  Input triples processed: 14,500,000,000
2023-01-26 10:01:38.884	- INFO:  Input triples processed: 14,600,000,000
2023-01-26 10:03:40.778	- INFO:  Input triples processed: 14,700,000,000
2023-01-26 10:05:40.581	- INFO:  Input triples processed: 14,800,000,000
2023-01-26 10:07:42.708	- INFO:  Input triples processed: 14,900,000,000
2023-01-26 10:09:39.348	- INFO:  Input triples processed: 15,000,000,000
2023-01-26 10:11:41.802	- INFO:  Input triples processed: 15,100,000,000
2023-01-26 10:13:37.216	- INFO:  Input triples processed: 15,200,000,000
2023-01-26 10:15:44.672	- INFO:  Input triples processed: 15,300,000,000
2023-01-26 10:17:50.554	- INFO:  Input triples processed: 15,400,000,000
2023-01-26 10:19:53.603	- INFO:  Input triples processed: 15,500,000,000
2023-01-26 10:21:51.809	- INFO:  Input triples processed: 15,600,000,000
2023-01-26 10:24:00.502	- INFO:  Input triples processed: 15,700,000,000
2023-01-26 10:25:58.271	- INFO:  Input triples processed: 15,800,000,000
2023-01-26 10:27:50.433	- INFO:  Input triples processed: 15,900,000,000
2023-01-26 10:29:28.458	- INFO:  Input triples processed: 16,000,000,000
2023-01-26 10:31:30.013	- INFO:  Input triples processed: 16,100,000,000
2023-01-26 10:33:30.705	- INFO:  Input triples processed: 16,200,000,000
2023-01-26 10:35:17.514	- INFO:  Input triples processed: 16,300,000,000
2023-01-26 10:37:05.943	- INFO:  Input triples processed: 16,400,000,000
2023-01-26 10:39:00.154	- INFO:  Input triples processed: 16,500,000,000
2023-01-26 10:40:52.181	- INFO:  Input triples processed: 16,600,000,000
2023-01-26 10:42:57.392	- INFO:  Input triples processed: 16,700,000,000
2023-01-26 10:44:52.878	- INFO:  Input triples processed: 16,800,000,000
2023-01-26 10:46:56.645	- INFO:  Input triples processed: 16,900,000,000
2023-01-26 10:48:59.091	- INFO:  Input triples processed: 17,000,000,000
2023-01-26 10:51:01.627	- INFO:  Input triples processed: 17,100,000,000
2023-01-26 10:53:05.212	- INFO:  Input triples processed: 17,200,000,000
2023-01-26 10:55:06.194	- INFO:  Input triples processed: 17,300,000,000
2023-01-26 10:57:11.064	- INFO:  Input triples processed: 17,400,000,000
2023-01-26 10:59:12.624	- INFO:  Input triples processed: 17,500,000,000
2023-01-26 11:01:19.077	- INFO:  Input triples processed: 17,600,000,000
2023-01-26 11:03:27.752	- INFO:  Input triples processed: 17,700,000,000
2023-01-26 11:05:29.852	- INFO:  Input triples processed: 17,800,000,000
2023-01-26 11:07:30.529	- INFO:  Input triples processed: 17,900,000,000
2023-01-26 11:09:35.060	- INFO:  Input triples processed: 18,000,000,000
2023-01-26 11:11:35.276	- INFO:  Input triples processed: 18,100,000,000
2023-01-26 11:13:13.285	- INFO:  Input triples processed: 18,200,000,000
2023-01-26 11:14:28.030	- INFO:  Done, total number of triples read: 18,269,041,339 [may contain duplicates]
2023-01-26 11:14:28.030	- INFO:  Number of QLever-internal triples created: 11,199,643,964 [may contain duplicates]
2023-01-26 11:14:28.031	- INFO:  Merging partial vocabularies in byte order (internal only) ...
2023-01-26 11:15:52.572	- INFO:  Words merged: 100,000,000
2023-01-26 11:17:40.531	- INFO:  Words merged: 200,000,000
2023-01-26 11:19:33.582	- INFO:  Words merged: 300,000,000
2023-01-26 11:21:33.599	- INFO:  Words merged: 400,000,000
2023-01-26 11:22:48.470	- INFO:  Words merged: 500,000,000
2023-01-26 11:27:52.771	- INFO:  Words merged: 600,000,000
2023-01-26 11:29:11.434	- INFO:  Words merged: 700,000,000
2023-01-26 11:30:29.556	- INFO:  Words merged: 800,000,000
2023-01-26 11:30:59.717	- INFO:  Number of words in internal vocabulary: 844,220,117
2023-01-26 11:30:59.718	- INFO:  Merging partial vocabularies in Unicode order (internal and external) ...
2023-01-26 11:34:50.872	- INFO:  Words merged: 100,000,000
2023-01-26 11:39:07.568	- INFO:  Words merged: 200,000,000
2023-01-26 11:43:55.875	- INFO:  Words merged: 300,000,000
2023-01-26 11:48:47.018	- INFO:  Words merged: 400,000,000
2023-01-26 11:51:47.729	- INFO:  Words merged: 500,000,000
2023-01-26 11:55:16.803	- INFO:  Words merged: 600,000,000
2023-01-26 11:58:03.884	- INFO:  Words merged: 700,000,000
2023-01-26 12:06:59.804	- INFO:  Words merged: 800,000,000
2023-01-26 12:11:57.866	- INFO:  Words merged: 900,000,000
2023-01-26 12:14:52.840	- INFO:  Words merged: 1,000,000,000
2023-01-26 12:17:31.490	- INFO:  Words merged: 1,100,000,000
2023-01-26 12:19:56.044	- INFO:  Words merged: 1,200,000,000
2023-01-26 12:22:34.874	- INFO:  Words merged: 1,300,000,000
2023-01-26 12:25:29.545	- INFO:  Words merged: 1,400,000,000
2023-01-26 12:27:50.378	- INFO:  Words merged: 1,500,000,000
2023-01-26 12:30:39.919	- INFO:  Words merged: 1,600,000,000
2023-01-26 12:34:51.566	- INFO:  Words merged: 1,700,000,000
2023-01-26 12:37:54.204	- INFO:  Words merged: 1,800,000,000
2023-01-26 12:40:52.096	- INFO:  Words merged: 1,900,000,000
2023-01-26 12:43:50.561	- INFO:  Words merged: 2,000,000,000
2023-01-26 12:46:50.962	- INFO:  Words merged: 2,100,000,000
2023-01-26 12:49:50.704	- INFO:  Words merged: 2,200,000,000
2023-01-26 12:52:50.248	- INFO:  Words merged: 2,300,000,000
2023-01-26 12:55:48.682	- INFO:  Words merged: 2,400,000,000
2023-01-26 12:58:45.489	- INFO:  Words merged: 2,500,000,000
2023-01-26 13:01:41.381	- INFO:  Words merged: 2,600,000,000
2023-01-26 13:04:37.889	- INFO:  Words merged: 2,700,000,000
2023-01-26 13:07:32.355	- INFO:  Words merged: 2,800,000,000
2023-01-26 13:10:28.887	- INFO:  Words merged: 2,900,000,000
2023-01-26 13:13:25.954	- INFO:  Words merged: 3,000,000,000
2023-01-26 13:16:23.360	- INFO:  Words merged: 3,100,000,000
2023-01-26 13:19:28.552	- INFO:  Words merged: 3,200,000,000
2023-01-26 13:22:49.034	- INFO:  Words merged: 3,300,000,000
2023-01-26 13:24:24.295	- INFO:  Number of words in external vocabulary: 2,490,647,411
2023-01-26 13:24:24.295	- INFO:  Removing temporary files ...
2023-01-26 13:24:53.326	- INFO:  Converting external vocabulary to binary format ...
2023-01-26 13:48:30.196	- INFO:  Converting triples from local IDs to global IDs ...
2023-01-26 13:48:37.994	- INFO:  Triples converted: 100,000,000
2023-01-26 13:48:51.859	- INFO:  Triples converted: 200,000,000
2023-01-26 13:49:04.823	- INFO:  Triples converted: 300,000,000
2023-01-26 13:49:19.072	- INFO:  Triples converted: 400,000,000
2023-01-26 13:49:37.766	- INFO:  Triples converted: 500,000,000
2023-01-26 13:49:50.483	- INFO:  Triples converted: 600,000,000
2023-01-26 13:50:04.304	- INFO:  Triples converted: 700,000,000
2023-01-26 13:50:19.220	- INFO:  Triples converted: 800,000,000
2023-01-26 13:50:36.343	- INFO:  Triples converted: 900,000,000
2023-01-26 13:50:48.680	- INFO:  Triples converted: 1,000,000,000
2023-01-26 13:51:02.459	- INFO:  Triples converted: 1,100,000,000
2023-01-26 13:51:18.771	- INFO:  Triples converted: 1,200,000,000
2023-01-26 13:51:33.646	- INFO:  Triples converted: 1,300,000,000
2023-01-26 13:51:46.807	- INFO:  Triples converted: 1,400,000,000
2023-01-26 13:51:59.314	- INFO:  Triples converted: 1,500,000,000
2023-01-26 13:52:13.300	- INFO:  Triples converted: 1,600,000,000
2023-01-26 13:52:27.462	- INFO:  Triples converted: 1,700,000,000
2023-01-26 13:52:43.081	- INFO:  Triples converted: 1,800,000,000
2023-01-26 13:52:56.752	- INFO:  Triples converted: 1,900,000,000
2023-01-26 13:53:09.839	- INFO:  Triples converted: 2,000,000,000
2023-01-26 13:53:23.570	- INFO:  Triples converted: 2,100,000,000
2023-01-26 13:53:40.963	- INFO:  Triples converted: 2,200,000,000
2023-01-26 13:53:53.708	- INFO:  Triples converted: 2,300,000,000
2023-01-26 13:54:07.695	- INFO:  Triples converted: 2,400,000,000
2023-01-26 13:54:21.281	- INFO:  Triples converted: 2,500,000,000
2023-01-26 13:54:38.959	- INFO:  Triples converted: 2,600,000,000
2023-01-26 13:54:52.498	- INFO:  Triples converted: 2,700,000,000
2023-01-26 13:55:08.551	- INFO:  Triples converted: 2,800,000,000
2023-01-26 13:55:20.434	- INFO:  Triples converted: 2,900,000,000
2023-01-26 13:55:37.792	- INFO:  Triples converted: 3,000,000,000
2023-01-26 13:55:51.756	- INFO:  Triples converted: 3,100,000,000
2023-01-26 13:56:07.916	- INFO:  Triples converted: 3,200,000,000
2023-01-26 13:56:19.503	- INFO:  Triples converted: 3,300,000,000
2023-01-26 13:56:35.460	- INFO:  Triples converted: 3,400,000,000
2023-01-26 13:56:51.969	- INFO:  Triples converted: 3,500,000,000
2023-01-26 13:57:05.022	- INFO:  Triples converted: 3,600,000,000
2023-01-26 13:57:19.590	- INFO:  Triples converted: 3,700,000,000
2023-01-26 13:57:36.020	- INFO:  Triples converted: 3,800,000,000
2023-01-26 13:57:50.883	- INFO:  Triples converted: 3,900,000,000
2023-01-26 13:58:04.333	- INFO:  Triples converted: 4,000,000,000
2023-01-26 13:58:19.345	- INFO:  Triples converted: 4,100,000,000
2023-01-26 13:58:32.818	- INFO:  Triples converted: 4,200,000,000
2023-01-26 13:58:50.225	- INFO:  Triples converted: 4,300,000,000
2023-01-26 13:59:03.815	- INFO:  Triples converted: 4,400,000,000
2023-01-26 13:59:17.652	- INFO:  Triples converted: 4,500,000,000
2023-01-26 13:59:32.493	- INFO:  Triples converted: 4,600,000,000
2023-01-26 13:59:49.559	- INFO:  Triples converted: 4,700,000,000
2023-01-26 14:00:03.311	- INFO:  Triples converted: 4,800,000,000
2023-01-26 14:00:19.036	- INFO:  Triples converted: 4,900,000,000
2023-01-26 14:00:31.285	- INFO:  Triples converted: 5,000,000,000
2023-01-26 14:00:44.273	- INFO:  Triples converted: 5,100,000,000
2023-01-26 14:01:00.828	- INFO:  Triples converted: 5,200,000,000
2023-01-26 14:01:14.570	- INFO:  Triples converted: 5,300,000,000
2023-01-26 14:01:27.936	- INFO:  Triples converted: 5,400,000,000
2023-01-26 14:01:41.336	- INFO:  Triples converted: 5,500,000,000
2023-01-26 14:01:57.703	- INFO:  Triples converted: 5,600,000,000
2023-01-26 14:02:11.399	- INFO:  Triples converted: 5,700,000,000
2023-01-26 14:02:24.759	- INFO:  Triples converted: 5,800,000,000
2023-01-26 14:02:38.255	- INFO:  Triples converted: 5,900,000,000
2023-01-26 14:02:57.404	- INFO:  Triples converted: 6,000,000,000
2023-01-26 14:03:09.006	- INFO:  Triples converted: 6,100,000,000
2023-01-26 14:03:22.461	- INFO:  Triples converted: 6,200,000,000
2023-01-26 14:03:38.627	- INFO:  Triples converted: 6,300,000,000
2023-01-26 14:03:53.499	- INFO:  Triples converted: 6,400,000,000
2023-01-26 14:04:08.018	- INFO:  Triples converted: 6,500,000,000
2023-01-26 14:04:21.722	- INFO:  Triples converted: 6,600,000,000
2023-01-26 14:04:35.321	- INFO:  Triples converted: 6,700,000,000
2023-01-26 14:04:49.217	- INFO:  Triples converted: 6,800,000,000
2023-01-26 14:05:07.244	- INFO:  Triples converted: 6,900,000,000
2023-01-26 14:05:21.867	- INFO:  Triples converted: 7,000,000,000
2023-01-26 14:05:34.830	- INFO:  Triples converted: 7,100,000,000
2023-01-26 14:05:50.788	- INFO:  Triples converted: 7,200,000,000
2023-01-26 14:06:05.946	- INFO:  Triples converted: 7,300,000,000
2023-01-26 14:06:21.507	- INFO:  Triples converted: 7,400,000,000
2023-01-26 14:06:33.009	- INFO:  Triples converted: 7,500,000,000
2023-01-26 14:06:51.012	- INFO:  Triples converted: 7,600,000,000
2023-01-26 14:07:05.695	- INFO:  Triples converted: 7,700,000,000
2023-01-26 14:07:19.927	- INFO:  Triples converted: 7,800,000,000
2023-01-26 14:07:32.888	- INFO:  Triples converted: 7,900,000,000
2023-01-26 14:07:49.000	- INFO:  Triples converted: 8,000,000,000
2023-01-26 14:08:04.061	- INFO:  Triples converted: 8,100,000,000
2023-01-26 14:08:20.453	- INFO:  Triples converted: 8,200,000,000
2023-01-26 14:08:31.964	- INFO:  Triples converted: 8,300,000,000
2023-01-26 14:08:47.183	- INFO:  Triples converted: 8,400,000,000
2023-01-26 14:08:59.556	- INFO:  Triples converted: 8,500,000,000
2023-01-26 14:09:17.276	- INFO:  Triples converted: 8,600,000,000
2023-01-26 14:09:31.519	- INFO:  Triples converted: 8,700,000,000
2023-01-26 14:09:44.078	- INFO:  Triples converted: 8,800,000,000
2023-01-26 14:09:58.406	- INFO:  Triples converted: 8,900,000,000
2023-01-26 14:10:14.170	- INFO:  Triples converted: 9,000,000,000
2023-01-26 14:10:27.932	- INFO:  Triples converted: 9,100,000,000
2023-01-26 14:10:41.893	- INFO:  Triples converted: 9,200,000,000
2023-01-26 14:10:54.388	- INFO:  Triples converted: 9,300,000,000
2023-01-26 14:11:13.099	- INFO:  Triples converted: 9,400,000,000
2023-01-26 14:11:24.332	- INFO:  Triples converted: 9,500,000,000
2023-01-26 14:11:39.661	- INFO:  Triples converted: 9,600,000,000
2023-01-26 14:11:51.577	- INFO:  Triples converted: 9,700,000,000
2023-01-26 14:12:08.644	- INFO:  Triples converted: 9,800,000,000
2023-01-26 14:12:22.247	- INFO:  Triples converted: 9,900,000,000
2023-01-26 14:12:37.136	- INFO:  Triples converted: 10,000,000,000
2023-01-26 14:12:49.532	- INFO:  Triples converted: 10,100,000,000
2023-01-26 14:13:03.926	- INFO:  Triples converted: 10,200,000,000
2023-01-26 14:13:23.891	- INFO:  Triples converted: 10,300,000,000
2023-01-26 14:13:35.861	- INFO:  Triples converted: 10,400,000,000
2023-01-26 14:13:49.245	- INFO:  Triples converted: 10,500,000,000
2023-01-26 14:14:05.117	- INFO:  Triples converted: 10,600,000,000
2023-01-26 14:14:20.903	- INFO:  Triples converted: 10,700,000,000
2023-01-26 14:14:34.404	- INFO:  Triples converted: 10,800,000,000
2023-01-26 14:14:48.493	- INFO:  Triples converted: 10,900,000,000
2023-01-26 14:15:01.966	- INFO:  Triples converted: 11,000,000,000
2023-01-26 14:15:21.114	- INFO:  Triples converted: 11,100,000,000
2023-01-26 14:15:32.865	- INFO:  Triples converted: 11,200,000,000
2023-01-26 14:15:47.239	- INFO:  Triples converted: 11,300,000,000
2023-01-26 14:16:00.554	- INFO:  Triples converted: 11,400,000,000
2023-01-26 14:16:18.578	- INFO:  Triples converted: 11,500,000,000
2023-01-26 14:16:32.286	- INFO:  Triples converted: 11,600,000,000
2023-01-26 14:16:46.238	- INFO:  Triples converted: 11,700,000,000
2023-01-26 14:16:58.656	- INFO:  Triples converted: 11,800,000,000
2023-01-26 14:17:13.507	- INFO:  Triples converted: 11,900,000,000
2023-01-26 14:17:32.551	- INFO:  Triples converted: 12,000,000,000
2023-01-26 14:17:43.666	- INFO:  Triples converted: 12,100,000,000
2023-01-26 14:17:56.986	- INFO:  Triples converted: 12,200,000,000
2023-01-26 14:18:09.713	- INFO:  Triples converted: 12,300,000,000
2023-01-26 14:18:27.891	- INFO:  Triples converted: 12,400,000,000
2023-01-26 14:18:42.187	- INFO:  Triples converted: 12,500,000,000
2023-01-26 14:18:54.370	- INFO:  Triples converted: 12,600,000,000
2023-01-26 14:19:07.798	- INFO:  Triples converted: 12,700,000,000
2023-01-26 14:19:25.428	- INFO:  Triples converted: 12,800,000,000
2023-01-26 14:19:37.757	- INFO:  Triples converted: 12,900,000,000
2023-01-26 14:19:51.492	- INFO:  Triples converted: 13,000,000,000
2023-01-26 14:20:04.312	- INFO:  Triples converted: 13,100,000,000
2023-01-26 14:20:22.136	- INFO:  Triples converted: 13,200,000,000
2023-01-26 14:20:34.853	- INFO:  Triples converted: 13,300,000,000
2023-01-26 14:20:47.739	- INFO:  Triples converted: 13,400,000,000
2023-01-26 14:21:03.913	- INFO:  Triples converted: 13,500,000,000
2023-01-26 14:21:15.793	- INFO:  Triples converted: 13,600,000,000
2023-01-26 14:21:33.299	- INFO:  Triples converted: 13,700,000,000
2023-01-26 14:21:46.522	- INFO:  Triples converted: 13,800,000,000
2023-01-26 14:22:01.095	- INFO:  Triples converted: 13,900,000,000
2023-01-26 14:22:14.325	- INFO:  Triples converted: 14,000,000,000
2023-01-26 14:22:31.601	- INFO:  Triples converted: 14,100,000,000
2023-01-26 14:22:46.023	- INFO:  Triples converted: 14,200,000,000
2023-01-26 14:22:59.547	- INFO:  Triples converted: 14,300,000,000
2023-01-26 14:23:13.377	- INFO:  Triples converted: 14,400,000,000
2023-01-26 14:23:30.937	- INFO:  Triples converted: 14,500,000,000
2023-01-26 14:23:45.768	- INFO:  Triples converted: 14,600,000,000
2023-01-26 14:23:59.094	- INFO:  Triples converted: 14,700,000,000
2023-01-26 14:24:12.783	- INFO:  Triples converted: 14,800,000,000
2023-01-26 14:24:30.244	- INFO:  Triples converted: 14,900,000,000
2023-01-26 14:24:42.409	- INFO:  Triples converted: 15,000,000,000
2023-01-26 14:24:59.588	- INFO:  Triples converted: 15,100,000,000
2023-01-26 14:25:10.706	- INFO:  Triples converted: 15,200,000,000
2023-01-26 14:25:23.869	- INFO:  Triples converted: 15,300,000,000
2023-01-26 14:25:41.583	- INFO:  Triples converted: 15,400,000,000
2023-01-26 14:25:55.266	- INFO:  Triples converted: 15,500,000,000
2023-01-26 14:26:10.925	- INFO:  Triples converted: 15,600,000,000
2023-01-26 14:26:22.500	- INFO:  Triples converted: 15,700,000,000
2023-01-26 14:26:40.868	- INFO:  Triples converted: 15,800,000,000
2023-01-26 14:26:53.483	- INFO:  Triples converted: 15,900,000,000
2023-01-26 14:27:07.466	- INFO:  Triples converted: 16,000,000,000
2023-01-26 14:27:20.028	- INFO:  Triples converted: 16,100,000,000
2023-01-26 14:27:36.860	- INFO:  Triples converted: 16,200,000,000
2023-01-26 14:27:50.226	- INFO:  Triples converted: 16,300,000,000
2023-01-26 14:28:03.942	- INFO:  Triples converted: 16,400,000,000
2023-01-26 14:28:16.622	- INFO:  Triples converted: 16,500,000,000
2023-01-26 14:28:33.242	- INFO:  Triples converted: 16,600,000,000
2023-01-26 14:28:46.682	- INFO:  Triples converted: 16,700,000,000
2023-01-26 14:29:00.157	- INFO:  Triples converted: 16,800,000,000
2023-01-26 14:29:13.430	- INFO:  Triples converted: 16,900,000,000
2023-01-26 14:29:26.598	- INFO:  Triples converted: 17,000,000,000
2023-01-26 14:29:43.336	- INFO:  Triples converted: 17,100,000,000
2023-01-26 14:29:59.458	- INFO:  Triples converted: 17,200,000,000
2023-01-26 14:30:10.956	- INFO:  Triples converted: 17,300,000,000
2023-01-26 14:30:26.949	- INFO:  Triples converted: 17,400,000,000
2023-01-26 14:30:42.343	- INFO:  Triples converted: 17,500,000,000
2023-01-26 14:30:58.315	- INFO:  Triples converted: 17,600,000,000
2023-01-26 14:31:11.154	- INFO:  Triples converted: 17,700,000,000
2023-01-26 14:31:24.168	- INFO:  Triples converted: 17,800,000,000
2023-01-26 14:31:41.399	- INFO:  Triples converted: 17,900,000,000
2023-01-26 14:31:56.375	- INFO:  Triples converted: 18,000,000,000
2023-01-26 14:32:08.863	- INFO:  Triples converted: 18,100,000,000
2023-01-26 14:32:23.064	- INFO:  Triples converted: 18,200,000,000
2023-01-26 14:32:40.446	- INFO:  Triples converted: 18,300,000,000
2023-01-26 14:32:53.843	- INFO:  Triples converted: 18,400,000,000
2023-01-26 14:33:06.921	- INFO:  Triples converted: 18,500,000,000
2023-01-26 14:33:20.851	- INFO:  Triples converted: 18,600,000,000
2023-01-26 14:33:35.571	- INFO:  Triples converted: 18,700,000,000
2023-01-26 14:33:52.427	- INFO:  Triples converted: 18,800,000,000
2023-01-26 14:34:07.142	- INFO:  Triples converted: 18,900,000,000
2023-01-26 14:34:21.239	- INFO:  Triples converted: 19,000,000,000
2023-01-26 14:34:33.996	- INFO:  Triples converted: 19,100,000,000
2023-01-26 14:34:52.253	- INFO:  Triples converted: 19,200,000,000
2023-01-26 14:35:05.405	- INFO:  Triples converted: 19,300,000,000
2023-01-26 14:35:19.490	- INFO:  Triples converted: 19,400,000,000
2023-01-26 14:35:32.875	- INFO:  Triples converted: 19,500,000,000
2023-01-26 14:35:50.832	- INFO:  Triples converted: 19,600,000,000
2023-01-26 14:36:03.687	- INFO:  Triples converted: 19,700,000,000
2023-01-26 14:36:17.561	- INFO:  Triples converted: 19,800,000,000
2023-01-26 14:36:30.735	- INFO:  Triples converted: 19,900,000,000
2023-01-26 14:36:47.849	- INFO:  Triples converted: 20,000,000,000
2023-01-26 14:37:00.459	- INFO:  Triples converted: 20,100,000,000
2023-01-26 14:37:14.191	- INFO:  Triples converted: 20,200,000,000
2023-01-26 14:37:27.233	- INFO:  Triples converted: 20,300,000,000
2023-01-26 14:37:40.650	- INFO:  Triples converted: 20,400,000,000
2023-01-26 14:37:57.859	- INFO:  Triples converted: 20,500,000,000
2023-01-26 14:38:11.324	- INFO:  Triples converted: 20,600,000,000
2023-01-26 14:38:24.517	- INFO:  Triples converted: 20,700,000,000
2023-01-26 14:38:40.292	- INFO:  Triples converted: 20,800,000,000
2023-01-26 14:38:55.491	- INFO:  Triples converted: 20,900,000,000
2023-01-26 14:39:08.824	- INFO:  Triples converted: 21,000,000,000
2023-01-26 14:39:23.033	- INFO:  Triples converted: 21,100,000,000
2023-01-26 14:39:36.939	- INFO:  Triples converted: 21,200,000,000
2023-01-26 14:39:55.836	- INFO:  Triples converted: 21,300,000,000
2023-01-26 14:40:08.143	- INFO:  Triples converted: 21,400,000,000
2023-01-26 14:40:23.151	- INFO:  Triples converted: 21,500,000,000
2023-01-26 14:40:37.102	- INFO:  Triples converted: 21,600,000,000
2023-01-26 14:40:53.539	- INFO:  Triples converted: 21,700,000,000
2023-01-26 14:41:07.890	- INFO:  Triples converted: 21,800,000,000
2023-01-26 14:41:21.307	- INFO:  Triples converted: 21,900,000,000
2023-01-26 14:41:35.914	- INFO:  Triples converted: 22,000,000,000
2023-01-26 14:41:48.909	- INFO:  Triples converted: 22,100,000,000
2023-01-26 14:42:07.735	- INFO:  Triples converted: 22,200,000,000
2023-01-26 14:42:19.392	- INFO:  Triples converted: 22,300,000,000
2023-01-26 14:42:33.674	- INFO:  Triples converted: 22,400,000,000
2023-01-26 14:42:48.846	- INFO:  Triples converted: 22,500,000,000
2023-01-26 14:43:07.098	- INFO:  Triples converted: 22,600,000,000
2023-01-26 14:43:18.488	- INFO:  Triples converted: 22,700,000,000
2023-01-26 14:43:32.734	- INFO:  Triples converted: 22,800,000,000
2023-01-26 14:43:48.581	- INFO:  Triples converted: 22,900,000,000
2023-01-26 14:44:03.625	- INFO:  Triples converted: 23,000,000,000
2023-01-26 14:44:18.150	- INFO:  Triples converted: 23,100,000,000
2023-01-26 14:44:31.001	- INFO:  Triples converted: 23,200,000,000
2023-01-26 14:44:44.914	- INFO:  Triples converted: 23,300,000,000
2023-01-26 14:45:02.958	- INFO:  Triples converted: 23,400,000,000
2023-01-26 14:45:14.731	- INFO:  Triples converted: 23,500,000,000
2023-01-26 14:45:29.989	- INFO:  Triples converted: 23,600,000,000
2023-01-26 14:45:42.140	- INFO:  Triples converted: 23,700,000,000
2023-01-26 14:45:54.254	- INFO:  Triples converted: 23,800,000,000
2023-01-26 14:46:11.904	- INFO:  Triples converted: 23,900,000,000
2023-01-26 14:46:24.444	- INFO:  Triples converted: 24,000,000,000

Wikidata Import 2023-01-24

Contents

Download latest wikidata Dump ~10 hours

Contents

Download latest wikidata Dump ~10 hours[edit]

unzip[edit]

Contents

unzip[edit]

bunzip2 with nohup does not work properly without being careful in its use![edit]

redirect bunzip output and show progress[edit]

progress script[edit]

uncompress[edit]

Contents

QLever control[edit]

setup wikidata[edit]

setup wikidata[edit]

start download[edit]

start indexing[edit]