sarama Files

[!NOTE]
This release contains significant changes. Notably Sarama will now use the ApiVersionRequest response from each broker to aid in selecting the protocol version to use. The existing Version field in sarama.Config will continue to provide a "pinning" mechanism, but can safely be set to a maximum or higher value than the remote cluster and sarama will sensibly pick compatible versions. There is also a performance improvement relating to MetadataRequests whereby Sarama will avoid having more than a single request to each broker in-flight at any given time. These new (optimal) behaviour is on by default can be opt-ed out via the Metadata.SingleFlight field in Config.

What's Changed

:tada: New Features / Improvements

• feat(protocol): negotiate API versions by @trapped in https://github.com/IBM/sarama/pull/3209
• feat: option to group metadata refreshes so only one is in-flight at a time by @cupcicm in https://github.com/IBM/sarama/pull/3225
• feat: use singleflight metadata by default by @dnwe in https://github.com/IBM/sarama/pull/3231
• feat(protocol): support CreateTopicRequest V4 by @dnwe in https://github.com/IBM/sarama/pull/3238
• feat: always send ApiVersionsRequest and fallback to v0 by @dnwe in https://github.com/IBM/sarama/pull/3234

:bug: Fixes

• fix(consumer): stuck on the batch with zero records length by @sterligov in https://github.com/IBM/sarama/pull/3221
• fix: sync response header version to clamped request header by @trapped in https://github.com/IBM/sarama/pull/3223
• fix(decoder): handle null arrays correctly by @dnwe in https://github.com/IBM/sarama/pull/3144
• fix: hardcode lz4 writer blocksize to 64kb by @dnwe in https://github.com/IBM/sarama/pull/3258

:package: Dependency updates

• chore(deps): bump the golang-x group across 1 directory with 2 updates by @dependabot[bot] in https://github.com/IBM/sarama/pull/3185
• chore(deps): bump the golang-x group across 7 directories with 2 updates by @dependabot[bot] in https://github.com/IBM/sarama/pull/3219
• fix(deps): update module golang.org/x/net to v0.43.0 by @renovate[bot] in https://github.com/IBM/sarama/pull/3244
• chore(deps): bump the golang-x group across 6 directories with 1 update by @dependabot[bot] in https://github.com/IBM/sarama/pull/3262
• chore(deps): update github/codeql-action action to v3.29.9 by @renovate[bot] in https://github.com/IBM/sarama/pull/3242
• fix(deps): update github.com/rcrowley/go-metrics digest to 65e299d by @renovate[bot] in https://github.com/IBM/sarama/pull/3164
• fix(deps): update module github.com/stretchr/testify to v1.11.0 by @renovate[bot] in https://github.com/IBM/sarama/pull/3268
• chore(deps): update docker/bake-action action to v6.9.0 by @renovate[bot] in https://github.com/IBM/sarama/pull/3264

:wrench: Maintenance

• chore(lint): enable copyloopvar by @alexandear in https://github.com/IBM/sarama/pull/3214
• chore: fix inconsistent function name in comment by @stellrust in https://github.com/IBM/sarama/pull/3227
• chore(style): refactor compress.go for readability by @dnwe in https://github.com/IBM/sarama/pull/3260
• chore: replace unnecessary go-multierror dependency by @bestbug456 in https://github.com/IBM/sarama/pull/3243

New Contributors

• @ibm-mend-app[bot] made their first contribution in https://github.com/IBM/sarama/pull/3201
• @alexandear made their first contribution in https://github.com/IBM/sarama/pull/3214
• @trapped made their first contribution in https://github.com/IBM/sarama/pull/3209
• @cupcicm made their first contribution in https://github.com/IBM/sarama/pull/3225
• @sterligov made their first contribution in https://github.com/IBM/sarama/pull/3221
• @stellrust made their first contribution in https://github.com/IBM/sarama/pull/3227
• @bestbug456 made their first contribution in https://github.com/IBM/sarama/pull/3243

Full Changelog: https://github.com/IBM/sarama/compare/v1.45.2...v1.46.0