dataiotech Labs
dbaguide/academy/data-integration-engineering
MDBA-DINTModül #8Advanced → Expert

8. Data Integration & CDC

WAL internals, logical replication slots, Debezium, and Kafka streaming

Explores Write-Ahead Log (WAL) internals, logical replication slot maintenance, Change Data Capture (CDC) streaming with Debezium and Apache Kafka, slot bloat mitigation, and disk recovery.

Publish Progress100%
2
Published
0
Planned
Engineered Competencies Mastered in this Module:
✓WAL LSN ordering, Full Page Writes (FPW), and logical decoding plugins
✓Active replication slot lag triage and unbounded WAL growth remediation
✓Debezium and Apache Kafka transactional outbox stream architectures
✓Foreign Data Wrappers (postgres_fdw) for cross-engine data federation
Share this engineering module on LinkedIn and X:

Module Syllabus & Lessons2 Lessons

Click published lessons to start learning immediately. Upcoming lessons detail planned objectives below.

MDBA
Educational & Engineering Resource Mapping

The Modern DBA Academy curriculum maps directly to dbaguide's battle-tested deep-dive articles, incident runbooks, diagnostic scripts, and architecture blueprints. Published items connect directly to their verified engineering resources.

MDBA-DINT-001LessonExpertDeep DivePublished

WAL Internals & Logical Replication Streams

Write-Ahead Log byte structures, full-page writes, LSN ordering, and logical decoding plugins.

Key Objectives:
  • •Understand Full Page Writes (FPW) and torn page protection mechanics after system crashes
  • •Analyze how logical replication slots protect required WAL files from premature deletion
Prerequisite:MDBA-FUND-001
Next in Syllabus:MDBA-DINT-002: Replication Slot Lag & Disk Saturation Triage
MDBA-DINT-002Lab DrillAdvancedRunbookPublished

Replication Slot Lag & Disk Saturation Triage

Emergency mitigation when inactive replication slots cause explosive WAL disk consumption.

Key Objectives:
  • •Query pg_replication_slots to isolate lagging consumers and unconsumed WAL volume
  • •Execute emergency slot drop or max_slot_wal_keep_size rules to prevent total disk exhaustion
Prerequisite:MDBA-DINT-001
CURRICULUM UPDATES

Get notified about new lessons and labs in 8. Data Integration & CDC.

Receive instant updates whenever new engineering modules, emergency incident runbooks, diagnostic scripts, and one-command Docker drills are published.