Core concepts
Storage Engine
In Tansu, all brokers are stateless, equal and act without consensus (e.g., Raft). When an API request is made, the receiving broker optimistically executes the operation using its current state. At the end of the operational the new state is persisted to the storage engine. If the state was out of date, the storage engine rejects the request, responding with its current state. The broker then retries the operation with the newer state.
The broker supports the following storage engines:
An example using Mirror Maker to replicate data between Tansu brokers, which could be adapted to migrate from SQLite to S3 storage, or off load data to replicas for fetchers to use.