Category:

Showing page 5 of 6

The Unkillable Giant: Why B-Trees Still Run Your Databases

How a 1970s data structure continues to dominate MySQL, PostgreSQL, and SQLite despite newer alternatives, and why LSM-trees haven’t killed them.

#data-structures#databases#storage-engines

azure-sql

Python Meets SQL Server: Microsoft Finally Gets Modern

Microsoft’s new native Python driver promises to eliminate dependency hell and supercharge data workflows

#azure-sql#database-drivers#microsoft...

analytics

One Big Table: Data Modeling Heresy or the Only Thing That Actually Works?

The heated OBT debate between Kimball purists and modern pragmatists reveals a fundamental shift in data modeling philosophy, one that’s tearing data engineering teams apart.

#analytics#data-modeling#data-warehouse...

benchmark

Iceberg vs Delta Lake: Your Open Source Bet Might Be Cheaper Than You Think

When Apache Iceberg finished 18% faster and 61% cheaper than Databricks in our TPC-H benchmark, we realized the open core dilemma isn’t just philosophical, it’s financial.

#benchmark#data-engineering#lakehouse...

data-governance

Data Governance Is Broken, Here’s a Federated Model That Might Work

Why traditional data governance creates bureaucracy bottlenecks and how active, federated models embed compliance directly into daily workflows.

#data-governance#data-mesh#data-quality...

data-engineering

Data Quality Responsibility Is a Product Problem, Not an Engineering Failure

Why engineering teams are tired of cleaning up upstream messes that product managers should own from day one.

#data-engineering#data-governance#data-quality...

data-architecture

The Medallion Architecture Debate: Why Nobody Agrees on Silver vs. Gold

Exploring the hidden inconsistencies in how teams implement raw-silver-gold layering models, from transformation logic disagreements to the platinum layer controversy.

#data-architecture#data-engineering#databricks...

data-architecture

The Postgres Betrayal: When Your Database Becomes a Data Lakehouse

Snowflake just open-sourced pg_lake, letting Postgres talk directly to Iceberg tables. The SQL you know now touches petabytes.

#data-architecture#data-lake#postgres...

cloud-storage

Enterprise Cloud Storage Showdown: Why Your ‘Strategic’ S3 Decision Is Just the Beginning of Your Problems

Analyzing enterprise cloud storage decisions through practitioner experiences, including trade-offs between performance, cost, and integration within data ecosystems.

#cloud-storage#cost-optimization#data-lakes...

artificial-intelligence

The Data Scientist’s Job Isn’t Disappearing, But 80% of Your Work Is

AI agents are transforming data workflows, but human expertise remains crucial for strategy, interpretation, and ethical leadership.

#artificial-intelligence#automation#career-development...

data-engineering

JSON in PySpark: The Performance Trap You’re Probably Falling For

Why writing large PySpark DataFrames as JSON to S3 is fundamentally flawed – and what you should do instead

#data-engineering#json#pyspark...

apache-iceberg

Parquet Was Never Enough: Why Your Raw Data Lake Is a Data Swamp Waiting to Happen

While Parquet excels at storage efficiency, it lacks transactional integrity. Open table formats like Iceberg, Delta Lake, and Hudi are increasingly seen as essential for reliable data pipelines by adding ACID compliance and schema evolution.

#apache-iceberg#apache-parquet#data-architecture...