Kafka
AivenRelease Notes
All releases can be found at https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/releases
v2.8.0
What's Changed
- Updated Kafka.Decimal and Debezium.VariableScaleDecimal processing and adjusted tests (#82)
- Added methods to LogicalConverterRegistry (#79)
- Manifest contains valid specification information. #58 (#74)
- Converted LogicalConverter libraries to true utility classes (#78)
- Added log warning on lookup retries (#83)
- Use the project defined in the connector configuration when useCredentialsProjectId is set to true (#75)
- Retain the original topic, partition and offset in Kafka metadata record (#70)
New Contributors
- @SamoylovMD made their first contribution in https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/pull/70
- @hpmouton made their first contribution in https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/pull/74
Full Changelog
https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/compare/v2.7.0...v2.8.0
Co-authored-by
- Ryan Skraba ryan.skraba@aiven.io
- Maksim Samoilov maxim.samoilov@team.wrike.com
- Mouton HoutonH@bdv.local
- veliuenal veli.uenal@deliveryhero.com
v2.7.0
What's Changed
- Deprecate GCS batch loading feature (#20)
- Deprecate partition decorator syntax feature (#21)
- Bumps org.eclipse.jetty:jetty-server from 9.4.53.v20231009 to 9.4.56.v20240826.
- Bumps org.eclipse.jetty:jetty-servlets from 9.4.53.v20231009 to 9.4.54.v20240208.
- Add header provider (#57)
- Retry getTable process before rasing any failure (#51)
- Enable bigdecimal conversion for Debezium numeric types (#41)
- Add optional configuration flag to use project ID from keyfile (#38)
New Contributors
- @gharris1727 made their first contribution in https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/pull/28
- @jeqo made their first contribution in https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/pull/29
- @veliuenal made their first contribution in https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/pull/38
Full Changelog
https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/compare/v2.6.0...v2.7.0
v2.6.0
What's Changed
- Adds opt-in support for the Storage Write API, which can be enabled via the
useStorageWriteApiproperty. If enabled, the default stream will be used, unless theenableBatchModeproperty is set totrue, in which case, the pending type stream will be used instead. NOTE: This is currently a beta feature and is not recommended for use in production. - Permits multiple topics to be routed to the same table with the
topic2TableMapproperty (https://github.com/confluentinc/kafka-connect-bigquery/pull/361) - Adds retry logic for “jobInternalError” errors when performing merge queries in upsert/delete mode (https://github.com/confluentinc/kafka-connect-bigquery/pull/363)