Understanding Apache Paimon Concurrency Control

Designing and testing Apache Paimon concurrency control to reveal common conflict scenarios

My girl

Not a member? You can still check out this article through here.

Previously, we tried Apache Paimon at the playground. In the conclusion I mentioned that I would like to know what scenarios concurrency control is designed to handle and what happens when there is a conflict.

This article will design an experiment environment that actually shows what snapshot conflict and files conflict are.

First, use this more complicated playground.

GitHub - wirelessr/paimon-trino-flink-playground at jdbc

If you already have a main branch, you can just checkout to the jdbc branch.

Experiment Design

We will start two Flink tasks and keep receiving data from Kafka and writing to the same Paimon…