Apache Iceberg

Topics backed by JSON Schema, Apache Avro or Protocol Buffer schema can be written as Apache Iceberg tables.

Tansu automatically maps each type used in the schema into an equivalent in Apache Arrow. Using Apache Parquet as a mezzanine format with minor changes for Apache Iceberg.

The iceberg subcommand will automatically load environment variables from a file named .env in the current directory or any of its parents.

Usage: tansu broker iceberg [OPTIONS] --location <LOCATION> --catalog <CATALOG>

Options:
      --location <LOCATION>    Apache Parquet files are written to this location, examples are: file://./lake or s3://lake/ [env: DATA_LAKE=]
      --catalog <CATALOG>      Apache Iceberg Catalog, examples are: http://localhost:8181/ [env: ICEBERG_CATALOG=]
      --namespace <NAMESPACE>  Iceberg namespace [env: ICEBERG_NAMESPACE=] [default: tansu]
      --warehouse <WAREHOUSE>  Iceberg warehouse [env: ICEBERG_WAREHOUSE=]
  -h, --help                   Print help