build(deps): bump the franz-go group across 1 directory with 3 updates

[dependabot]

Bumps the franz-go group with 2 updates in the / directory: github.com/twmb/franz-go and github.com/twmb/franz-go/pkg/kadm.

Updates github.com/twmb/franz-go from 1.20.7 to 1.21.3

Changelog

Sourced from github.com/twmb/franz-go's changelog.

v1.21.3

This patch release contains a few bug fixes and a few internal improvements.

• PollRecords / PollFetches could permanently hang since v1.21.0 if a consumer session stopped (usually via metadata updates) while fetches to more than four brokers were pending and no poll was in flight. This could only affect users that deliberately set MaxConcurrentFetches(0), or that were using ShareMaxRecordsStrict.

• Producing to a topic whose partitions ALL have a retriable load error (e.g. a rolling restart of an RF=1 broker briefly leaving every partition leaderless) no longer fails records up front with "unable to partition record due to no usable partitions". Instead, the records remain buffered and retried as metadata reloads.

• Classic consumer groups now rejoin immediately when an offset commit returns UNKNOWN_MEMBER_ID or ILLEGAL_GENERATION (the broker lost the member, e.g. a session expired during a network blip), rather than consuming as a zombie until the heartbeat loop notices the dead session.

• DescribeShareGroupOffsets, AlterShareGroupOffsets, and DeleteShareGroupOffsets are now routed to the group coordinator rather than the share coordinator (which would reject the requests for being misrouted).

• The client-internal metadata cache now deeply clones the cached response before putting it into the cache and before returning it via RequestCachedMetadata (which is now used by default in kadm), eliminating data race possibilities.

• Various next-gen rebalancer session improvements.

Relevant commits

• f8842170 improvement kgo: fall back to all partitions when no partition is writable (thanks @​ericsg666!)
• 824e34d2 improvement kgo: rejoin a classic group when a commit returns a fatal member error (thanks @​v14dis14v!)
• f520e820 bugfix kgo: do not exit manageFetchConcurrency while sources are pending in wantFetch (thanks @​SLoeuillet!)
• 8d9c836b bugfix kgo: isolate metadata cache from broker response
• 19f7dbb2 bugfix kgo,kfake: route share group offset RPCs to the group coordinator

v1.21.2

This patch release contains two narrow bug fixes and one small feature. Deps are also bumped so that you are force-pinned to a klauspost/compress version that has a stack-splitting bugfix that sometimes affected franz-go.

• PurgeTopicsFromConsuming now correctly persists deleted topics if

... (truncated)

Commits

• a0f8f33 Merge pull request #1342 from twmb/cl
• 8ec013c CHANGELOG: 1.21.3
• a4af6ec Merge pull request #1340 from twmb/1326
• 78d39df Merge pull request #1339 from SLoeuillet/fix-fetch-manager-quit-pending-wantf...
• 8f57ffd kgo: address review comments in the fetch manager quit test
• 5bcb52d kgo: force an 848 heartbeat on subscription changes instead of bouncing
• 2a60a49 kgo: drain stale rejoin signals before an 848 initial join
• 0269fef kgo: ack 848 revocations immediately instead of bouncing the session
• f884217 kgo: fall back to all partitions when no partition is writable
• 824e34d kgo: rejoin a classic group when a commit returns a fatal member error
• Additional commits viewable in compare view

Updates github.com/twmb/franz-go/pkg/kadm from 1.17.2 to 1.18.0

Changelog

Sourced from github.com/twmb/franz-go/pkg/kadm's changelog.

v1.18.0

This release adds support for Kafka 3.7, adds a few community requested APIs, some internal improvements, and fixes two bugs. One of the bugfixes is for a deadlock; it is recommended to bump to this release to ensure you do not run into the deadlock. The features in this release are relatively small.

This adds protocol support for KIP-890 and KIP-994, and adds further protocol support for [KIP-848][KIP-848]. If you are using transactions, you may see a new kerr.TransactionAbortable error, which signals that your ongoing transaction should be aborted and will not be successful if you try to commit it.

Lastly, there have been a few improvements to pkg/sr that are not mentioned in these changelog notes.

Bug fixes

• If you canceled the context used while producing while your client was at the maximum buffered records or bytes, it was possible to experience deadlocks. This has been fixed. See #832 for more details.

• Previously, if using GetConsumeTopics while regex consuming, the function would return all topics ever discovered. It now returns only the topics that are being consumed.

Improvements

• The client now internaly ignores OutOfOrderSequenceNumber errors that are encountered when consuming if possible. If a producer produces very infrequently, it is possible the broker forgets the producer by the next time the producer produces. In this case, the producer receives an OutOfOrderSequenceNumber error. The client now internally resets properly so that you do not see the error.

Features

• AllowRebalance and CloseAllowingRebalance have been added to GroupTransactSession.
• The FetchTopic type now has includes the topic's TopicID.
• The ErrGroupSession internal error field is now public, allowing you to test how you handle the internal error.
• You may now receive a kerr.TransactionAbortable error from many functions while using transactions.

Relevant commits

• 0fd1959d kgo: support Kafka 3.8's kip-890 modifications
• 68163c55 bugfix kgo: do not add all topics to internal tps map when regex consuming
• 3548d1f7 improvement kgo: ignore OOOSN where possible

... (truncated)

Commits

• 0a9996b Merge pull request #841 from twmb/1.18-changelog
• 835c682 CHANGELOG: note incoming release
• d771ddf Merge pull request #838 from twmb/810
• 04356d7 Merge pull request #835 from twmb/819
• 3d71b14 Merge pull request #834 from twmb/805
• 019799a Merge pull request #829 from andrewstucki/sr-client-opts
• 3a0f09a Merge pull request #814 from noamcohen97/new-offset-helper
• 6028e72 Merge pull request #794 from twmb/790
• 581d7ef Merge pull request #789 from sbuliarca/errgroupsession-export-err
• fd084a5 Merge pull request #760 from twmb/753
• Additional commits viewable in compare view

Updates github.com/twmb/franz-go/pkg/kmsg from 1.12.0 to 1.13.1

Changelog

Sourced from github.com/twmb/franz-go/pkg/kmsg's changelog.

v1.13.1

This patch release fixes a bug where a producer could enter a deadlock if a topic is deleted and recreated very quickly while producing.

• 769e02f producer: avoid deadlock when when quickly recreating a topic

v1.13.0

This release contains a few new APIs, two rare bug fixes, updates to plugins, and changes the library to now require 1.18.

Go version

This library has supported Go 1.15 since the beginning. There have been many useful features that this library has not been able to use because of continued backcompat for 1.15. There is really no reason to support such an old version of Go, and Go itself does not support releases prior to 1.18 -- and 1.18 is currently only supported for security backports. Switching to 1.18 allows this library to remove a few 1.15 / 1.16 backcompat files, and allows switching this library from interface{} to any.

Behavior changes

If group consuming fails with an error that looks non-retryable, the error is now injected into polling as a fake errored fetch. Multiple people have ran into problems where their group consumers were failing due to ACLs or due to network issues, and it is hard to detect these failures: you either have to pay close attention to logs, or you have to hook into HookGroupManageError. Now, the error is injected into polling.

Bug fixes

This release contains two bug fixes, one of which is very rare to encounter, and one of which is very easy to encounter but requires configuring the client in a way that (nearly) nobody does.

Rare: If you were using EndAndBeginTransaction, there was an internal race that could result in a deadlock.

Rare configuration: If you configured balancers manually, and you configured CooperativeSticky with any other eager balancer, then the client would internally sometimes think it was eager consuming, and sometimes think it was cooperative consuming. This would result in stuck partitions while consuming.

Features

... (truncated)

Commits

• 1a59c2d Merge pull request #404 from twmb/bugfix
• 5e0ba1c document incoming v1.13.1, update readme, fix golangci-lint
• d984c21 Merge pull request #401 from bgranvea/fix-segment-bench
• 769e02f producer: avoid deadlock when when quickly recreating a topic
• 5c2a90c set async commit
• 8cb298d Merge pull request #399 from twmb/dependabot/go_modules/examples/hooks_and_lo...
• 1141ce4 Merge pull request #397 from twmb/dependabot/go_modules/examples/hooks_and_lo...
• d5ef6e0 Merge pull request #398 from twmb/dependabot/go_modules/examples/bench/google...
• 8215a54 Merge pull request #400 from twmb/dependabot/go_modules/plugin/kprom/google.g...
• 6fdb469 build(deps): bump google.golang.org/protobuf in /plugin/kprom
• Additional commits viewable in compare view