Devoxx UK 2019
from Wednesday 8 May to Friday 10 May 2019.
BigData Hacker The world of BigData analysis and processing is an exciting one. The more I do with it the more energy I receive from it. Through my participation in a large variety of projects, Voice systems, fraud detection, and b2b, I have a broad experience and as being a dyslexic I tend to think outside the box and see connections that a lot of people do not sees
Currently active at the Port of Rotterdam and enabling them to become the smartest harbor in the world.
See also https://www.elucidator.nl
Imagine that you need to create an environmental and statistical view of the largest port of Europe, Rotterdam. At your disposal is a variety of (real time) data sources.
This presentation is a walk-through on how we as a team of engineers and scientists combined the different data formats its attributes and infrastructure to create the required views. This resulted in an architecture based on Apache Kafka Stream processing and utilising Time-series and Document stores incorporated in a Kubernetes cluster.
Harbourmaster data (Cargo, docks, etc.) and Radar, AIS (GPS, Ship information) are the main sources. They are processed in realtime so we can present (near real time) dashboards about Co2 emissions, ship movements, passages and visits.
The efforts from the Port Of Rotterdam are a part of their ambition to become the smartest, efficient and most environmental friendly port of the world.