All Posts

Beam Pattern: Calling External Services Using Retrofit For Data Enrichment

Background For the past two months, my team and I had deployed pipeline using Apache Beam in a production environment. The pipeline step is very simple just filter data by event, enrich data by user id, then insert to BigQuery.