Cases¶
This chapter lists various cases/projects where Stetl is used.
NLExtract¶
NLExtract http://nlextract.nl is a development project that aims to provide ETL-tooling for all Dutch Open Geo-Datasets, in particular the country wide “Key Registries” (Dutch: Basisregistraties) like Cadastral Parcels (BRK), Topography (BRT+BGT) and Buildings and Addresses (BAG). These datasets are provided as XML/GML. The ETL mostly provides a transformation to PostGIS. For all Key Registries, except for the BAG, Stetl is used, basically as-is, without extra (Python) programming. See also the NLExtract GitHub: https://github.com/nlextract/NLExtract
Topography (BRT/Top10NL)¶
See https://github.com/nlextract/NLExtract/tree/master/top10nl/etl and the Stetl conf at https://github.com/nlextract/NLExtract/tree/master/top10nl/etl/conf/
Detailed Topography (BGT)¶
See https://github.com/nlextract/NLExtract/tree/master/bgt and the Stetl conf at https://github.com/nlextract/NLExtract/blob/master/bgt/etl/conf/
Cadastral Parcels (BRK)¶
See https://github.com/nlextract/NLExtract/tree/master/brk/etl and the Stetl conf at https://github.com/nlextract/NLExtract/tree/master/brk/etl/conf
INSPIRE¶
These were the origins of Stetl. This project was sponsored by Kadaster. See https://github.com/justb4/inspire-foss. The ETL involved the transformation of Dutch Key Registries (see above) to harmonized INSPIRE GML according to the Annexes.
Addresses¶
BAG to INSPIRE Addresses Annex II Theme.
See https://github.com/justb4/inspire-foss/blob/master/etl/NL.Kadaster/Addresses/
Ordnance Survey¶
A successful Proof-of-Concept to convert Ordnance Survey Mastermap GML to PostGIS:
https://github.com/geopython/stetl/tree/master/examples/ordnancesurvey
SOSPilot¶
A SensorWeb project by Geonovum, see http://sensors.geonovum.nl.
Dutch AQ to WFS/WMS(-Time) and SOS¶
Stetl was used for ETL from Dutch Air Quality Data from RIVM (XML) to WMS(-Time), WFS and SOS. The latter was effected by SOS-Transactional publication. Documentation at http://sospilot.readthedocs.org and ETL on GitHub at https://github.com/Geonovum/sospilot/tree/master/src/rivm-lml
Dutch AQ to EAI Reporting¶
Stetl was used to generate XML-based reports for the EU EAI:
https://github.com/Geonovum/sospilot/tree/master/src/aq-report
This involved the first use of Jinja2 templating for complex XML/GML generation.
Smart Emission¶
Sensors for air quality, meteo and audio at civilians. Project by University of Nijmegen/Gemeente Nijmegen with participation by Geonovum. Stetl is used to transform a low-level sensor API to PostGIS and later on WMS/WFS/SOS and the SensorThings API. Also InfluxDB output is developed here.
This is also an example how to use a Stetl Docker image:
See https://github.com/Geonovum/smartemission/tree/master/etl