SimpleGraph-Tutorial/Geo

OsProject
id	com.bitplan.simplegraph-tutorial-geo
state
owner	BITPlan
title	SimpleGraph Geo Tutorial
url	https://github.com/BITPlan/com.bitplan.simplegraph-tutorial-geo
version	0.0.1
description
date
since
until

SimpleGraph Geo Showcase

Openly available Geographic data from different APIs seems to be a good basis for showcasing the SimpleGraph approach.

Charging Stations example

We'd like to gather data on Charging stations from different sources:

1. Bundesnetzagentur (Excel File)
2. Openstreetmap (API)
3. OpenchargeMap (API)

First step: Loading data from Bundesnetzagentur

The ChargingStation Map of Bundesnetzagentur is based on the Date from the Excel file Download

Let's read it with our SimpleGraph-Excel Module.

package com.bitplan.simplegraph.geotutorial;

import static org.junit.Assert.assertEquals;

import java.io.File;

import org.junit.Test;

import com.bitplan.simplegraph.core.SimpleNode;
import com.bitplan.simplegraph.excel.ExcelSystem;

public class TestChargingStations {

  boolean debug = true;

  /**
   * test reading the list of registered german charging stations from
   * Bundesnetzagentur
   * 
   * @throws Exception
   */
  @Test
  public void testBundesnetzagentur() throws Exception {
    // The original file has some superfluous sheets and the title row is not
    // in the first line so we downloaded and adapted it a bit to avoid to do this in software e.g.
    // as outlined in https://stackoverflow.com/questions/1834971/removing-a-row-from-an-excel-sheet-with-apache-poi-hssf
    // String url = "https://www.bundesnetzagentur.de/SharedDocs/Downloads/DE/Sachgebiete/Energie/Unternehmen_Institutionen/HandelundVertrieb/Ladesaeulen/Ladesaeulenkarte_Datenbankauszug20.xlsx?__blob=publicationFile&v=2";
    File excelFile = new File(
        "src/test/data/Bundesnetzagentur/Ladesaeulenkarte_Datenbankauszug20.xlsx");
    ExcelSystem es = new ExcelSystem();
    es.connect();
    es.moveTo(excelFile.toURI().toString());
    long count = es.g().V().count().next().longValue();
    assertEquals(7733, count);
    if (debug)
      SimpleNode.dumpGraph(es.graph());
      //es.g().V().has("sheetname").out("rows").forEachRemaining(v -> {
      //  SimpleNode.printDebug.accept(v);
      // });
  }

}

Second step: check data agains OpenChargeMap API

Let's check the result comparing to the entries in the OpenchargeMap API. The URL for the API is explained by the following example:

http://api.openchargemap.io/v2/poi/?output=json&latitude=50.598&longitude=7.434&maxresults=10

JUnit Testcase to check the first 20 stations against the API

 @Test
  public void testOpenChargeMapApi() throws Exception {
    ExcelSystem es=this.getBundesnetzAgenturChargingStations();
    // number of stations to check
    int limit=20;
    // number of stations nearby to get from open chargemap api
    int maxresults = 3;
    es.g().V().has("row").limit(limit).forEachRemaining(v -> {
      if (debug)
        SimpleNode.printDebug.accept(v);
      String address = v.property("Adresse").value().toString();
      String ziploc = v.property("Postleitzahl Ort").value().toString();
      double lat = Double
          .parseDouble(v.property("Breitengrad [DG]").value().toString());
      double lon = Double
          .parseDouble(v.property("Längengrad [DG]").value().toString());
      System.out.println(
          String.format("%30s %30s %.4f %.4f", ziploc, address, lat, lon));
     
      String apiUrl = String.format(Locale.ENGLISH,
          "http://api.openchargemap.io/v2/poi/?output=json&latitude=%.4f8&longitude=%.4f&maxresults=10",
          lat, lon, maxresults);
      JsonSystem js = new JsonSystem();
      try {
        js.connect();
      } catch (Exception e) {
        fail(e.getMessage());
      }
      js.moveTo(apiUrl);

      GraphTraversal<Vertex, Vertex> addressesByDistance = js.g().V()
          .hasLabel("AddressInfo").order().by("Distance");
      assertTrue(addressesByDistance.hasNext());
      Vertex av = addressesByDistance.next();
      double maxDist = 1.0;
      Number adistance = (Number) av.property("Distance").value();
      Number alat = (Number) av.property("Latitude").value();
      Number alon = (Number) av.property("Longitude").value();
      // assertTrue(adistance.doubleValue()<maxDist);
      String azip = av.property("Postcode").value().toString();
      String acity = av.property("Town").value().toString();
      String aadr = av.property("AddressLine1").value().toString();

      System.out.println(String.format("%30s %30s %.4f %.4f: %.3f km",
          azip + " " + acity, aadr, alat.doubleValue(), alon.doubleValue(),
          adistance.doubleValue()));

      if (debug) {
        SimpleNode.printDebug.accept(av);
        SimpleNode.dumpGraph(js.graph());
      }

    });

  }

Result

                   71732 Tamm             Frankfurter Str. 8 48,9255 9,1507
                    71732 Tamm          Frankfurter Straße 10 48,9257 9,1498: 0,043 km
                  12103 Berlin               Ringbahnstr. 131 52,4686 13,3753
                  12103 Berlin                 Alboinstraße 5 52,4695 13,3713: 0,177 km
               64295 Darmstadt         Bessunger Str. 127     49,8588 8,6418
               64295 Darmstadt                     Am Pelz 75 49,8520 8,6340: 0,586 km
                 01067 Dresden            Hamburger Straße 30 51,0599 13,6989
                 01139 Dresden       Scharfenberger Straße 66 51,0725 13,6880: 0,988 km
              53340 Meckenheim                   Hauptstr. 79 50,6214 7,0223
              53340 Meckenheim           Siebengebirgsring 6A 50,6253 7,0438: 0,981 km
           97769 Bad Brückenau                     Gänsrain 2 50,3085 9,7904
           97769 Bad Brückenau                Buchwaldstrasse 50,3066 9,7859: 0,241 km
           92355 Stadt Velburg                   Stadtplatz 3 49,2328 11,6713
                 92355 Velburg                   Stadtplatz 3 49,2328 11,6712: 0,009 km
          45661 Recklinghausen                Dieselstrasse 8 51,5700 7,1999
          45661 Recklinghausen                 Dieselstraße 8 51,5699 7,1996: 0,017 km
              86720 Nördlingen                 Bleichgraben 3 48,8555 10,4924
              86720 Nördlingen                 Bleichgraben 3 48,8555 10,4919: 0,022 km
                 36093 Künzell           Unterer Ortesweg 19  50,5425 9,7093
                 36093 Künzell            Unterer Ortesweg 19 50,5425 9,7093: 0,008 km
             78601 Mahlstetten            Lippachtalstraße 30 48,0751 8,8441
                78589 Dürbheim                   Jahnstraße 8 48,0562 8,7897: 2,834 km
             26655 Westerstede                   Burgstraße 6 53,2656 7,9350
             26655 Westerstede                Zum Stadtpark 2 53,2564 7,9259: 0,746 km
                    71732 Tamm                Asperger Str. 4 48,9195 9,1278
    74321 Bietigheim-Bissingen                 Borsigstraße 6 48,9479 9,1352: 1,986 km
               21640 Horneburg                 Am Poggenphl 2 53,5041 9,5901
               21640 Horneburg                Am Poggenpohl 2 53,5041 9,5901: 0,003 km
                  12103 Berlin               Ringbahnstr. 131 52,4686 13,3753
                  12103 Berlin                 Alboinstraße 5 52,4695 13,3713: 0,177 km
               64295 Darmstadt               Holzhofallee 33b 49,8646 8,6379
               64283 Darmstadt             Hindenburgstraße 1 49,8712 8,6416: 0,479 km
                 01069 Dresden                  Lennéstraße 1 51,0437 13,7542
                 01069 Dresden                Prager Straße 2 51,0422 13,7352: 0,833 km
              53340 Meckenheim            Siebengebirgsring 4 50,6250 7,0433
              53340 Meckenheim           Siebengebirgsring 6A 50,6253 7,0438: 0,029 km
          45661 Recklinghausen                Dieselstrasse 8 51,5700 7,1999
          45661 Recklinghausen                 Dieselstraße 8 51,5699 7,1996: 0,017 km
           97769 Bad Brückenau      Ernst Putz Str. Parkplatz 50,3086 9,7860
           97769 Bad Brückenau                Buchwaldstrasse 50,3066 9,7859: 0,144 km

Step 3 - use a Rule Engine to check results

We'd now like to rate the results for precision and errors. We'll use The Java Rulebook library for this purpose.