Tagged with

2 articles found

Parquet for Images: When Architectural Purity Meets Pipeline Collapse

A data engineer’s real-world postmortem on storing terabytes of hourly image data in Parquet files, and why the lakehouse dream becomes a performance nightmare

#data-lake#flink#image-storage

data-architecture

The Postgres Betrayal: When Your Database Becomes a Data Lakehouse

Snowflake just open-sourced pg_lake, letting Postgres talk directly to Iceberg tables. The SQL you know now touches petabytes.

#data-architecture#data-lake#postgres...