Data warehouse: Online Analytical Reporting Realtime Dashboards: High data recency Logging & Metrics Store, Time series data

Data Warehouse: Online Analytical Reporting (OLAP)

• Daily, Weekly, Monthly, Quarterly, Annual Reporting.

1. List your Primary / Secondary KPIs and what reports are critical to track metrics. Determine what frequency each report must be updated from data sources. Use Airbyte ETL to centralize and batch update data (CRM, application metrics, billing, marketing clicks, etc) into the data warehouse.
2. Denormalize and clean data
3. Connect BI tool like Metabase to warehouse, Create planned reports from step 1.

Example use-case: “Which of our tutorials / blogposts lead to biggest increase in company discord / slack members and/or most positive sentiment?”

Realtime Dashboards, High data recency

• Customer-facing analytics dashboards often require sub-second response times.

1. Create a row table (heap) in your Hydra database.

You can explicitly create either a row-based or columnar table by adding the USING keyword:

CREATE TABLE heap_table (...) USING heap;

1. INSERT to row table normally from application
2. Use Hydra Scheduler to asynchronously update columnar table with recent inserts as needed, e.g. every 30 minutes.
3. Records queried less than 30 min timestamp execute on row table, after 30 min execute on columnar table. Row table is small and will perform efficiently.

Example use-case: Analytics dashboard that shows recent equities / bond trades with realtime updated trend charts across industry and market segment.

Logging & Metrics Store, Time series data