Skip to content

networking: add connection backoff config options#491

Closed
kabakaev wants to merge 1 commit into
fluent:masterfrom
c445:connection-backoff-flb-pr3191
Closed

networking: add connection backoff config options#491
kabakaev wants to merge 1 commit into
fluent:masterfrom
c445:connection-backoff-flb-pr3191

Conversation

@kabakaev
Copy link
Copy Markdown
Contributor

This PR can be merged only if the FLB PR 3191 is accepted and merged.

Signed-off-by: Alexander Kabakaev <kabakaev@gmail.com>
@kabakaev kabakaev force-pushed the connection-backoff-flb-pr3191 branch from 1348b1e to 35f9324 Compare March 15, 2021 11:33
@edsiper
Copy link
Copy Markdown
Member

edsiper commented Dec 12, 2021

note: waiting on fluent/fluent-bit#3191

@edsiper edsiper added the waiting-for-user Waiting for user/contributors feedback or requested changes label Dec 12, 2021
@eschabell eschabell requested a review from esmerel October 23, 2025 13:18
@eschabell eschabell self-assigned this Oct 23, 2025
@eschabell eschabell added conflict Waiting on conflict to be resolved by contributor waiting-on-review Waiting on a review from mainteners and removed waiting-for-user Waiting for user/contributors feedback or requested changes labels Oct 23, 2025
@eschabell
Copy link
Copy Markdown
Collaborator

@esmerel would you mind reviewing this PR? I've nudged the owner on code PR fluent/fluent-bit#3191 which looks ready to merge.


### Connection backoff

This set of options is designed for large-scale fluent-bit deployments, which may need to limit number of TCP SYN packets in case an output destination is unreachable. By default, fluent-bit will retry connecting to an output target on each chunk flush. But if, for example, `net.initial_backoff=8` and `net.max_backoff=60` options are set, then an output plugin will try to reconnect to a failing output only after a delay of 8, 16, 32 and 60 seconds. Each fluent-bit thread will keep trying only once every 60 seconds, until connection is healthy again.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
This set of options is designed for large-scale fluent-bit deployments, which may need to limit number of TCP SYN packets in case an output destination is unreachable. By default, fluent-bit will retry connecting to an output target on each chunk flush. But if, for example, `net.initial_backoff=8` and `net.max_backoff=60` options are set, then an output plugin will try to reconnect to a failing output only after a delay of 8, 16, 32 and 60 seconds. Each fluent-bit thread will keep trying only once every 60 seconds, until connection is healthy again.
This set of options is designed for large-scale Fluent Bit deployments, which may need to limit number of TCP SYN packets in case an output destination is unreachable. By default, Fluent Bit will retry connecting to an output target on each chunk flush. But if, for example, `net.initial_backoff=8` and `net.max_backoff=60` options are set, then an output plugin will try to reconnect to a failing output only after a delay of 8, 16, 32 and 60 seconds. Each Fluent Bit thread will keep trying only once every 60 seconds, until connection is healthy again.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks generally ok to me as long as my suggestion is applied, but I can't see the conflicts to fix them.

@esmerel esmerel removed the waiting-on-review Waiting on a review from mainteners label Oct 28, 2025
@eschabell eschabell added waiting-for-user Waiting for user/contributors feedback or requested changes waiting-on-review Waiting on a review from mainteners labels Nov 4, 2025
@eschabell
Copy link
Copy Markdown
Collaborator

@kabakaev can you look at the review suggestions and conflicts so this is ready when code PR fluent/fluent-bit#3191 merges?

@eschabell eschabell removed the waiting-on-review Waiting on a review from mainteners label Nov 4, 2025
@eschabell eschabell removed the waiting-for-user Waiting for user/contributors feedback or requested changes label Dec 3, 2025
@eschabell eschabell added the waiting-for-user Waiting for user/contributors feedback or requested changes label Mar 26, 2026
@eschabell eschabell added Stale and removed waiting-for-user Waiting for user/contributors feedback or requested changes waiting-on-code-merge labels May 29, 2026
@eschabell
Copy link
Copy Markdown
Collaborator

@kabakaev as you can see, the conflicts I had to fix resulted in taking the path to a new docs PR. I'll update the code PR to reflect that and your attribution will remain in this new docs PR. I will close this in favor of the new #2590 which will be waiting only on the code PR fluent/fluent-bit#3191 merging.

@eschabell eschabell closed this May 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

conflict Waiting on conflict to be resolved by contributor Stale

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants