View source for EMWConTalk2023-04

{{PageSequence|prev=SMWConTalk2022-10|next=|category=talk|categoryIcon=picture-o}}{{ShowSlides}}
== Wolfgang Fahl ==
[[File:WolfgangFahl.png|200px|left|link=https://www.semantic-mediawiki.org/wiki/User:WolfgangFahl|left]]
* Computer Scientist
* Expert
* Trainer for Software Architecture and Requirements Engineering
* PhD Candidate at RWTH Aachen i5

== BITPlan GmbH ==
[[File:BITPlanLogoFontLessTransparent.png|240px|link=http://www.bitplan.com|BITPlan]]
* Inception: 1999  
* Focus on Software-Engineering   Training, Consulting, Projects …
*   Switch from Lotus Notes to  Semantic Mediawiki in 2013  
* ProfiWiki since 2015

== Agenda ==
* [[File:Wikidata-logo-en.svg|128px]] Wikidata
* [[File:20210702 Semantic MediaWiki logo with wordmark.png|128px]]
* [[File:Octicons-sync.svg|128px]] Synchronization

== SMW and Wikidata storage ==
* Both systems use triples: subject, predicate and object
* It's a girl revisited: [[File:Royalbaby.png|right|frame|It's a girl!]]
<pre>
The princess of cambridge was born on [[is born::2015-05-03]] 
Her rank inline to the throne is [[throne rank is::4]].
Her mother is [[mother is::Duchess Kate]].
</pre>
* http://royal-family.bitplan.com/index.php/Princess_Charlotte_of_Cambridge
* http://family.bitplan.com/index.php/Princess_Charlotte_of_Cambridge

== SMW as a database? ==
Compare to a relational database:

* Tables are dynamically created via ask-queries e.g.[http://family.bitplan.com/index.php/List_of_Persons List of Persons]
* A page corresponds to a row in a table

== SMW relational operations ==
'''Row and Column definition operations'''

{| class="wikitable"
|+ Caption text
|-
! Operation !! Manually !! Via Api !! Via Wikipush
|-
| Create || create page and use markup to set property {{Done}} || edit {{Done}} || wikipush, wikiupload, wikirestore {{Done}}
|-
| Read || visit link of page {{Done}} || read html or markup {Done}} || wikibackup, wikipush, wikiedit {{Done}}
|-
| Update || modify page via edit|| [https://www.mediawiki.org/wiki/API:Edit edit] {{Done}} || wikiedit, wikirestore, wikipush {{Done}}
|-
| Delete || delete page {{Done}} || delete {Done}}  || wikinuke {{Done}}
|}
'''Column value operations'''
{| class="wikitable"
|+ Caption text
|-
! Operation !! Manually !! Via Api !! Via Wikipush
|-
| Create || add property value manually on a page {{Done}} || {{UtfIcon|utf=❌|size=24|color=red}} || {{UtfIcon|utf=❌|size=24|color=red}} -> {{Done}}
|-
| Read || use ask queries to retrieve property values {{Done}} || edit {{Done}} || wikiquery {{Done}}
|-
| Update || modify property value manually on a page {{Done}} || {{UtfIcon|utf=❌|size=24|color=red}} || {{UtfIcon|utf=❌|size=24|color=red}} -> {{Done}}
|-
| Delete || remove property value manually on a page {{Done}} ||  {{UtfIcon|utf=❌|size=24|color=red}} || {{UtfIcon|utf=❌|size=24|color=red}}
|}

== Modifying a Single triple ==
* [https://github.com/WolfgangFahl/py-3rdparty-mediawiki/issues/91 py-3rdparty-mediawiki issue #91 wikiedit allow to modify single parameter of a macro WikiSon ] see [[WikiSon]]
* http://family.bitplan.com/index.php/Alexandra_of_Denmark

<source lang='bash' highlight='1,9'>
wikiedit -t family --template Person --property label --value "Alexandra of Denmark" -p Alexandra_of_Denmark 
editing 1 pages in family (dry run)
1/1 (100.00%): editing Alexandra_of_Denmark ...👍 |childOf=F74
 |parentOf=F2
 |spouse=Q20875
+|label=Alexandra of Denmark
 }}
 [[Category:frontend]]
wikiedit -t family --template Person --property label --value "Alexandra of Denmark" -p Alexandra_of_Denmark -f
editing 1 pages in family (forced)
1/1 (100.00%): editing Alexandra_of_Denmark ...✅
</source>

== Example Usecases ==
* Royal Family
* Scholary communication
== Example Royal Family ==

== Example: Scholary communication ==

http://diagrams.bitplan.com/render/png/0x1a095a5a.png
* https://cr.bitplan.com
* https://ceur-ws.bitplan.com/index.php/List_of_Institutions

== Sync Institutions ==
<source lang='bash' highlight='1'>
smwsync -u -t cr --topic EventSeries -p desc title home --progress
updating cache for CrSchema:EventSeries from wiki cr ...
stored 10 EventSeries items to /Users/wf/.smwsync/cr/CrSchema/EventSeries.json
10 EventSeries items to sync ...
SGAI→homepage: 100%|██████████████████████████████████| 30/30 [00:28<00:00,  1.05it/s]
</source>

== How SMWSync works ==
* Self describing Properties 
* Mapping SMW Properties to Wikidata properties
* Command Line Tool
== Self describing Properties ==

* [https://www.semantic-mediawiki.org/wiki/Metadata_management#Pierre_Racine 2013: Pierr Racine]
* [https://www.semantic-mediawiki.org/wiki/Metadata_management#ProfiWiki 2015: BITPlan ProfiWiki]
* [http://family.bitplan.com/index.php/Property:Person_label Person Label (to be synced with wikidata)]

== MetaModel, SiDIF, LinkML ==
[[File:YpgenScreenShotFamilyContext2023-04-19.png]]
<source lang='bash'>
ypgen --wikiId family --context FamilyContext --serve --host localhost
</source>

[http://family.bitplan.com/index.php/FamilyContext#tab=sidif FamilyContext SiDIF] is in legacy [[SiDIF]] triple format.

[https://github.com/WolfgangFahl/pyMetaModel pyMetaModel mm_cmd command line tool] will generate LinkML yaml markup and other target formats.
LinkML can then generate even form format see:

[https://github.com/WolfgangFahl/pyMetaModel/tree/main/examples/family pyMetaModel family example files]

== Mapping SMW Properties to Wikidata properties ==
== Todo ==

== Command Line Tool ==
* https://wiki.bitplan.com/index.php/PySMWSync#Command_line
<source lang='bash'>
usage: smwsync [-h] [-a] [--context CONTEXT] [-cpm CREATEPROPERTYMAP] [-d] [--dry]
               [-e ENDPOINT] [--progress] [-p PROPS [PROPS ...]] [--proplist]
               [-pm PROPERTYMAP] [-pk PRIMARYKEY]
               [-pkv PRIMARYKEYVALUES [PRIMARYKEYVALUES ...]] [-t TARGET] [-u]
               [--topic TOPIC] [--verbose] [-V]
</source>

== Links ==
* https://www.semantic-mediawiki.org/wiki/Semantic_MediaWiki
* https://www.wikidata.org/wiki/Wikidata:Main_Page
* https://wiki.bitplan.com/index.php/Py-3rdparty-mediawiki
* https://wiki.bitplan.com/index.php/PySMWSync
* https://wiki.bitplan.com/index.php/PyMetaModel
* https://wiki.bitplan.com/index.php/Py-yprinciple-gen
* https://linkml.io/

== Questions / Discussion ==
[[File:Bitplanpartner.png]]