JDJ-3290 Data and the Environment @ Port Of Rotterdam | Devoxx

Devoxx UK 2019
from Wednesday 8 May to Friday 10 May 2019.

   Data and the Environment @ Port Of Rotterdam


Big Data & AI
Big Data & AI
Intermediate level
Room B Friday from 11:15 til 12:05

Imagine that you need to create an environmental and statistical view of the largest port of Europe, Rotterdam. At your disposal is a variety of (real time) data sources.

This presentation is a walk-through on how we as a team of engineers and scientists combined the different data formats its attributes and infrastructure to create the required views. This resulted in an architecture based on Apache Kafka Stream processing and utilising Time-series and Document stores incorporated in a Kubernetes cluster.

Harbourmaster data (Cargo, docks, etc.) and Radar, AIS (GPS, Ship information) are the main sources. They are processed in realtime so we can present (near real time) dashboards about Co2 emissions, ship movements, passages and visits.

The efforts from the Port Of Rotterdam are a part of their ambition to become the smartest, efficient and most environmental friendly port of the world.

Apache Kafka Streams   Kubernetes   RiakTS   Kotlin  
Subscribe to Devoxx on YouTube
Pieter Van Der Meer
Pieter Van Der Meer
From Dataworkz

BigData Hacker The world of BigData analysis and processing is an exciting one. The more I do with it the more energy I receive from it. Through my participation in a large variety of projects, Voice systems, fraud detection, and b2b, I have a broad experience and as being a dyslexic I tend to think outside the box and see connections that a lot of people do not sees

Currently active at the Port of Rotterdam and enabling them to become the smartest harbor in the world.

Make sure to download the Android or iOS mobile schedule.