CU Çağrı Unku Data Engineering Portfolio
Connecting to pipeline
← Back to Portfolio
EVENT-DRIVEN FLIGHT MONITORING

Flight Price Intelligence

An event-driven data engineering platform that continuously monitors flight prices, publishes immutable events through Redpanda, stores historical observations in PostgreSQL, and exposes analytical insights through FastAPI.

Designed to demonstrate scalable streaming architecture rather than simply displaying airline prices.

WHY I BUILT THIS

Building a Production-Style Streaming Pipeline

This project demonstrates how a modern event-driven data engineering architecture can monitor airline prices automatically instead of relying on manual searches.

Problem

Monitoring multiple travel windows manually quickly becomes repetitive and inefficient.

Solution

Every scheduled search becomes an immutable event streamed through Redpanda and stored inside PostgreSQL.

Goal

Build a scalable streaming architecture capable of monitoring hundreds of routes and generating future fare-drop alerts.

Windows with data

Loading monitoring coverage

Total observations

Waiting for pipeline event

All-time lowest

Lowest stored fare across all windows

MULTI-WINDOW MONITORING

Tracked travel windows

Select a travel window to inspect its historical fare movement and current itinerary.

Loading travel windows...
SELECTED WINDOW

Price history

Select a window to inspect its history.

Window low
More observations are required to display a price trend.
EVENT LOG

Recent observations

REDPANDA STREAM
Observed Travel window Route Price Airline Kafka offset
Loading observations...
SYSTEM DESIGN

From scheduled search to live insight

Each scheduled query becomes an immutable event, passes through a Kafka-compatible broker and is independently consumed into analytical storage.

01 SerpAPI Flight search source
02 Python Producer Event creation
03 Redpanda Event streaming
04 Python Consumer Validation and loading
05 PostgreSQL Historical storage
06 FastAPI Analytics delivery