Data Analytics Dashboard

A real-time analytics workspace that ingests millions of events per day and visualizes them with rich storytelling components.

Capabilities

• Streaming ingestion built on Kafka with Airflow-scheduled batch enrichments.
• Multi-tenant workspaces and row-level security with ClickHouse.
• Interactive dashboards featuring drill-downs, cohort analysis, and anomaly overlays.
• Export pipelines for PDF, CSV, and Excel deliverables.

Engineering Highlights

• Materialized views power near real-time updates with low-latency queries.
• Metadata-driven chart configuration keeps visualization authoring code-light.
• Automated regression tests ensure chart accuracy against fixture datasets.

Development Flow

1. Run
   terminal

   Copy

   docker compose up
   to start Kafka, ClickHouse, and the web app.
2. Start the ETL schedulers using
   terminal

   Copy

   pnpm workflow dev
   .
3. Access the UI at
   terminal

   Copy

   http://localhost:3000
   and log in with the seeded tenant credentials.

Operations

• Observability via OpenTelemetry exports to Grafana and Loki.
• Alerting configured for ingestion lag, query performance, and dashboard SLA breaches.