This command adds additional fields to be parsed from Kafka event messages. This creates additional columns, corresponding to these additional fields, in the target table.
Usage
vcli: admin> blobexpansion add-columns --database-name DATABASE
--table-name TABLE
--arrow-schema ARROW_SCHEMA
[--tenant-id TENANT]
[--source-column-name SOURCE_COLUMN]
[--add-copy-source-column]Required Parameters
| Kafka bucket name containing the source topic |
| Source Kafka topic name |
| Column definitions to add, as a comma-separated list of name-type Example |
Options
| Tenant ID (optional) |
| Source column name (defaults to 'value') |
| If set, copies the raw source (json) to the target table. |
Example
This example shows the blobexpansion add-columns command with sample values.
vcli: admin> blobexpansion add-columns --tenant-id 1 --database-name kafka_bucket --table-name my_topic --source-column-name value --arrow-schema new_col1-string,new_col2-int --add-copy-source-column