Sign in Subscribe

design-patterns

Jan
02
Write-Audit-Publish Pattern with Apache Iceberg on AWS using WAP id

Write-Audit-Publish Pattern with Apache Iceberg on AWS using WAP id

Detailed implementation of Write-Audit-Publish (WAP) Data Quality Pattern in AWS using Apache Iceberg WAP ID i.e. for Apache Iceberg < 1.2.0.
11 min read
Dec
29
Write-Audit-Publish Pattern with Apache Iceberg on AWS using Branches

Write-Audit-Publish Pattern with Apache Iceberg on AWS using Branches

Detailed implementation of Write-Audit-Publish (WAP) Data Quality Pattern in AWS using Apache Iceberg Braches i.e. for Apache Iceberg > 1.2.0. It also covers the gotchas while using this pattern and using Athena as a query Engine.
10 min read