Wikidata on Allegrograph

From BITPlan Wiki
Revision as of 11:47, 4 August 2022 by Wf (talk | contribs) (Created page with "Craig Norvell wrote on 2022-07-25: <pre> We loaded https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.gz (Probably from mid-April 2022 time frame) Machine - 32...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Craig Norvell wrote on 2022-07-25:

We loaded

https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.gz  (Probably from mid-April 2022 time frame)

Machine - 32core (2x16 AMD EPYC 7302, 3.0GHz), 256GB RAM, CentOS Linux release 7.9.2009 with SSDs.  Load using only 16 cores took <6 hours. 

Triple count - 16,882,554,798

Size on Disk - 1,486GB

For faster queries we optimized the indices (Oscore to 1.0) and that took <6 hours.

74% of the queries took <100 milliseconds.

98.5% finished in <1sec

There was a single query that took 7.19 seconds and we might have a look to see if adding an index might change that result.

We have not investigated different hardware configs (<RAM, Spinning Disks, <Cores, etc).