“A GCP data analytics pipeline: application events publish to Pub/Sub, Dataflow transforms the stream into BigQuery, and a Looker dashboard queries BigQuery.”
Read the decisions behind it.
Pub/Sub decouples producers from processing.
Dataflow processes the stream.
BigQuery stores analytics-ready data.
Use this to explain a simple event-to-dashboard path on Google Cloud.
Other examples in this family.
Common questions
What does Pub/Sub do?
Pub/Sub receives and distributes messages between event producers and consumers.
Where does Dataflow fit?
Dataflow transforms or processes data between ingestion and its destination.
Why use BigQuery in the diagram?
BigQuery is the warehouse that the dashboard queries in this example.