Tagged with

#cdc

5 articles found

Your Events Will Be Duplicated: Idempotency at Scale

cdc

Featured

Your Events Will Be Duplicated: Idempotency at Scale

At-least-once delivery guarantees duplicates. Here’s how to handle them without losing your mind, or your data.

#cdc#event-driven#idempotency...

batch ingestion

Snowflake CDC Showdown: Streams, Dynamic Tables, or Stored Procedures, Pick Your Poison

A no-BS technical comparison of Snowflake Streams, Dynamic Tables, and Stored Procedures for building batch CDC pipelines from source to landing zone.

#batch ingestion#cdc#Data Engineering...

cdc

From Hourly to Real-Time: Architecting Event-Driven Pipelines with CDC

Case study analysis of using Change Data Capture (CDC) to eliminate batch latency bottlenecks at scale, inspired by Pinterest’s recent architecture updates.

#cdc#event-driven#kafka...

cdc

Snowflake OpenFlow: The Native CDC Savior Is Still On Training Wheels

Snowflake’s OpenFlow promises seamless CDC from Oracle and SQL Server, but early adopters reveal performance and usability gaps that make it a tough sell against established tools.

#cdc#data-engineering#etl...

cdc

CDC vs. Microbatching: The Data Pipeline Cold War You’re Fighting Daily

Change Data Capture and microbatching aren’t just technical choices, they’re architectural philosophies that dictate how responsive your data systems can be.

#cdc#data-pipelines#microbatching...