Difference between revisions of "Wikidata Import 2023-05-03"

From BITPlan Wiki
Jump to navigation Jump to search
 
(13 intermediate revisions by the same user not shown)
Line 4: Line 4:
  
 
{{Import
 
{{Import
 +
|state=✅
 
|url=https://wiki.bitplan.com/index.php/Wikidata_Import_2023-05-03
 
|url=https://wiki.bitplan.com/index.php/Wikidata_Import_2023-05-03
 
|target=blazegraph
 
|target=blazegraph
 
|start=2023-05-03
 
|start=2023-05-03
 +
|end=2023-06-26
 +
|days=23
 +
|os=Ubuntu 20.04.6 LTS
 
|cpu=Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
 
|cpu=Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
 +
|ram=128
 
|triples=14.7
 
|triples=14.7
 
|storemode=property
 
|storemode=property
 
}}
 
}}
 +
 +
 +
 +
= Setup =
 +
Same as for
 +
{{Link|target=Wikidata_Import_2023-04-26}}
 +
 +
 +
=== progress on sun ===
 +
<pre>
 +
1.161.686.984 Triples 2023-05-03T09:37:00Z
 +
1.323.000.000 Triples 2023-05-03T10:53:07Z
 +
1.837.000.000 Triples 2023-05-03T16:15:56Z
 +
2.789.000.000 Triples 2023-05-04T05:48:24Z
 +
2023-05-05T04:44:32Z: 3934000000
 +
2023-05-06T05:16:44Z: 4857000000
 +
2023-05-07T05:49:52Z: 5554000000
 +
2023-05-08T03:18:15Z: 6164000000
 +
2023-05-09T04:05:46Z: 6808000000
 +
2023-05-11T03:54:34Z: 7890000000
 +
2023-05-12T05:13:27Z: 8434000000
 +
2023-05-13T05:42:54Z: 8876000000
 +
2023-05-14T07:07:21Z: 9417148900
 +
2023-05-15T05:31:51Z: 9864790434
 +
2023-05-16T04:52:30Z:10322580267
 +
2023-05-20T09:28:44Z:12159025485
 +
1058:    314  2022249  1911      0.0
 +
14.574 bill triples  7207 triples/s
 +
23 days
 +
</pre>
 +
==== stats ====
 +
<source lang='bash'>
 +
./stats
 +
  #: load s  total s  avg s  ETA h
 +
  2:    415      415    208    61.0
 +
...
 +
100:    548    38774    388    103.2
 +
...
 +
200:    718  109303    547    130.3
 +
...
 +
300:  1151  202650    676    142.2
 +
...
 +
400:  2676  362219    906    165.5
 +
...
 +
500:  3059  559655  1119    173.5
 +
...
 +
600:  1879  790443  1317    167.6
 +
...
 +
700:  5353  1012090  1446    143.8
 +
...
 +
800:  2866  1294602  1618    116.0
 +
...
 +
873:  1534  1496315  1714    88.1
 +
...
 +
1058:    314  2022249  1911      0.0
 +
</source>

Latest revision as of 06:34, 19 February 2024

Import

Import
edit
state  ✅
url  https://wiki.bitplan.com/index.php/Wikidata_Import_2023-05-03
target  blazegraph
start  2023-05-03
end  2023-06-26
days  23
os  Ubuntu 20.04.6 LTS
cpu  Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
ram  128
triples  14.7
comment  



Setup

Same as for Wikidata_Import_2023-04-26


progress on sun

1.161.686.984 Triples 2023-05-03T09:37:00Z
1.323.000.000 Triples 2023-05-03T10:53:07Z
1.837.000.000 Triples 2023-05-03T16:15:56Z
2.789.000.000 Triples 2023-05-04T05:48:24Z
2023-05-05T04:44:32Z: 3934000000
2023-05-06T05:16:44Z: 4857000000 
2023-05-07T05:49:52Z: 5554000000
2023-05-08T03:18:15Z: 6164000000
2023-05-09T04:05:46Z: 6808000000
2023-05-11T03:54:34Z: 7890000000
2023-05-12T05:13:27Z: 8434000000
2023-05-13T05:42:54Z: 8876000000
2023-05-14T07:07:21Z: 9417148900 
2023-05-15T05:31:51Z: 9864790434
2023-05-16T04:52:30Z:10322580267
2023-05-20T09:28:44Z:12159025485
1058:    314  2022249   1911      0.0
14.574 bill triples   7207 triples/s
23 days

stats

./stats 
   #: load s  total s  avg s   ETA h
   2:    415      415    208     61.0
...
 100:    548    38774    388    103.2
...
 200:    718   109303    547    130.3
...
 300:   1151   202650    676    142.2
...
 400:   2676   362219    906    165.5
...
 500:   3059   559655   1119    173.5
...
 600:   1879   790443   1317    167.6
...
 700:   5353  1012090   1446    143.8
...
 800:   2866  1294602   1618    116.0
...
 873:   1534  1496315   1714     88.1
...
1058:    314  2022249   1911      0.0