Tagged with

7 articles found

SQL Server 2008 to 2025: Your Replication Options Are Worse Than You Think

Direct replication from SQL Server 2008 to 2025 isn’t supported. Here’s how CDC, middle-tier servers, and backup-restore strategies actually work in practice.

#cdc#data migration#Legacy Systems...

cdc

Why Your DynamoDB BI Pipeline Will Crash (And How to Fix It)

A practical guide to building real-time analytics from DynamoDB using CDC, streaming to Redshift, and dbt transformations

#cdc#dbt#dynamodb...

cdc

Your Events Will Be Duplicated: Idempotency at Scale

At-least-once delivery guarantees duplicates. Here’s how to handle them without losing your mind, or your data.

#cdc#event-driven#idempotency...

batch ingestion

Snowflake CDC Showdown: Streams, Dynamic Tables, or Stored Procedures, Pick Your Poison

A no-BS technical comparison of Snowflake Streams, Dynamic Tables, and Stored Procedures for building batch CDC pipelines from source to landing zone.

#batch ingestion#cdc#Data Engineering...

cdc

From Hourly to Real-Time: Architecting Event-Driven Pipelines with CDC

Case study analysis of using Change Data Capture (CDC) to eliminate batch latency bottlenecks at scale, inspired by Pinterest’s recent architecture updates.

#cdc#event-driven#kafka...

cdc

Snowflake OpenFlow: The Native CDC Savior Is Still On Training Wheels

Snowflake’s OpenFlow promises seamless CDC from Oracle and SQL Server, but early adopters reveal performance and usability gaps that make it a tough sell against established tools.

#cdc#data-engineering#etl...

cdc

CDC vs. Microbatching: The Data Pipeline Cold War You’re Fighting Daily

Change Data Capture and microbatching aren’t just technical choices, they’re architectural philosophies that dictate how responsive your data systems can be.

#cdc#data-pipelines#microbatching...