ConferenceCorpus

OsProject

OsProject
edit
id	ConferenceCorpus
state	active
owner	WolfgangFahl
title	Scientific Event Corpus
url	https://github.com/WolfgangFahl/ConferenceCorpus
version	0.1.0
description
date	2022-11-20
since	2021-07-26
until

Installation

via pip

pip install ConferenceCorpus
# alternatively if your pip is not a python3 pip
pip3 install ConferenceCorpus

upgrade

pip install ConferenceCorpus -U
# alternatively if your pip is not a python3 pip
pip3 install ConferenceCorpus -U

Usage

RESTFul API

Examples

• https://conferencecorpus.bitplan.com/eventseries/WEBIST?format=json
• https://conferencecorpus.bitplan.com/eventseries/WEBIST?format=html
• https://conferencecorpus.bitplan.com/eventseries/ISWC?format=json
• https://conferencecorpus.bitplan.com/eventseries/ISWC?format=html

Database View with Sqlite

The EventCorpus.db is in Sqlite format.

using sqlite-web

pip install sqlite-web
sqlite_web $HOME/.conferencecorpus/EventCorpus.db

There is convenience script ccsqliteweb available in the scripts directory which will also kill an existing sqlite_web EventCorpus.db process and run the server in background using nohup.

Command Line

aelookup -h
usage: aelookup [-h] [-d] [-e ENDPOINT] [-v] [-u] [-f]
                [--datasources DATASOURCES]

Scientific Event Corpus and Lookup

  Created by Wolfgang Fahl on 2020-06-22.
  Copyright 2020-2021 Wolfgang Fahl. All rights reserved.

  Licensed under the Apache License 2.0
  http://www.apache.org/licenses/LICENSE-2.0

  Distributed on an "AS IS" basis without warranties
  or conditions of any kind, either express or implied.

USAGE

optional arguments:
  -h, --help            show this help message and exit
  -d, --debug           show debug info
  -e ENDPOINT, --endpoint ENDPOINT
                        SPARQL endpoint to use for wikidata queries
  -v, --version         show program's version number and exit
  -u, --uml             output plantuml diagram markup
  -f, --force           force Update - may take quite a time
  --datasources DATASOURCES
                        , delimited list of datasource lookup ids

Overview

Datasources

You might want to open the diagrams in a new tab to be able to click the links depicted.

Event

EventSeries

Updating the database

Openresearch

scripts/getbackup

gets a copy of the nightly OpenResearch backups

Issues

1. Issue 33 - Event series completion
2. Issue 32 - regression TemplateNotFound: fb4common/base.html
3. Issue 31 - Provide RDF export of the data
4. Issue 30 - add ordinal distribution query✓
5. Issue 29 - add scholar RESTFul API
6. Issue 28 - add generic search for scholarly items
7. Issue 27 - openresearch results missing in multiquery
8. Issue 26 - add bib file import
9. Issue 25 - make multiquery result available via webapi with content negotiation✓
10. Issue 24 - allow updating the database via webserver
11. Issue 23 - dictOfLod Lookup result via commandline
12. Issue 22 - add multi query option✓
13. Issue 21 - add Webserver✓
14. Issue 20 - Work around upstream Nominatim OSM Pythontools issue✓
15. Issue 19 - Update Openresearch Samples✓
16. Issue 18 - Update requirements.txt✓
17. Issue 17 - include ACM digital library as a source
18. Issue 16 - Steps towards csv upload✓
19. Issue 15 - Filter obviously invalid Series and Event entries✓
20. Issue 14 - wikiCFP 500 Internal Server and TimeOut Error Handling✓
21. Issue 12 - Relevant FTX fields
22. Issue 11 - Locality fixes
23. Issue 10 - OpenResearch export option
24. Issue 9 - offline access to EventCorpus.db
25. Issue 8 - migrate confref data from Proceedings Title Parser here✓
26. Issue 7 - migrate crossref data from proceedings title parser here✓
27. Issue 6 - migrate dblp data source here from ptp and dblpconf✓
28. Issue 5 - dblp xml parser skips some proceedings titles
29. Issue 4 - add commandline interface to CorpusLookup✓
30. Issue 3 - add python api doc✓
31. Issue 2 - Cache all SQL tables in the same SQLite database in a ".conferencecorpus" directory✓
32. Issue 1 - There should be a common set of attributes for Event and EventSeries from different datasources