Difference between revisions of "Wikidata on Allegrograph"

From BITPlan Wiki
Jump to navigation Jump to search
Line 1: Line 1:
 +
{{Import
 +
|target=Allegrograph
 +
|ram=256
 +
|os=CentOS Linux release 7.9.2009
 +
|triples=16882554798
 +
|start=2022-04-15
 +
|days=0,3
 +
}}
 
[https://www.linkedin.com/in/craignorvell Craig Norvell] wrote on 2022-07-25:
 
[https://www.linkedin.com/in/craignorvell Craig Norvell] wrote on 2022-07-25:
 
<pre>
 
<pre>

Revision as of 08:22, 16 May 2023

",3" can not be assigned to a declared number type with value 0.

Import
state  
url  
target  Allegrograph
start  2022-04-15
end  
days  0,3
os  CentOS Linux release 7.9.2009
cpu  
ram  256
triples  16882554798
comment  

Craig Norvell wrote on 2022-07-25:

We loaded

https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.gz  (Probably from mid-April 2022 time frame)

Machine - 32core (2x16 AMD EPYC 7302, 3.0GHz), 256GB RAM, CentOS Linux release 7.9.2009 with SSDs.  Load using only 16 cores took <6 hours. 

Triple count - 16,882,554,798

Size on Disk - 1,486GB

For faster queries we optimized the indices (Oscore to 1.0) and that took <6 hours.

74% of the queries took <100 milliseconds.

98.5% finished in <1sec

There was a single query that took 7.19 seconds and we might have a look to see if adding an index might change that result.

We have not investigated different hardware configs (<RAM, Spinning Disks, <Cores, etc).