Hybrid cloud data streaming architecture
Delivery Hero is a food delivery company running in 40+ countries in which several entities use their own systems and storages around the world. Building new global micro-services with real-time reporting gets complicated in such an environment. Therefore, creating a global data pipeline which will provide data normalization and data validation to downstream consumers becomes a complex task. In this session, it will be covered how Delivery Hero has built such data pipeline using services from both AWS and GCP cloud platforms. It will be described in detail why these services were chosen and what challenges and limitations they have so far.