Orell Garten
Software and data engineering consultant. I build data systems that help businesses to answer questions about their business. I like solving problems in a pragmatic way.
Session
09-02
16:00
45min
Forget the Cloud: Building Lean Batch Pipelines from TCP Streams with Python and DuckDB
Orell Garten
Many industrial and legacy systems still push critical data over TCP streams. Instead of reaching for heavyweight cloud platforms, you can build fast, lean batch pipelines on-prem using Python and DuckDB.
In this talk, you'll learn how to turn raw TCP streams into structured data sets, ready for analysis, all running on-premise. We'll cover key patterns for batch processing, practical architecture examples, and real-world lessons from industrial projects.
If you work with sensor data, logs, or telemetry, and you value simplicity, speed, and control this talk is for you.
Data Handling & Engineering
B09