Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Error when source.Start() never returns #2997

Merged
merged 1 commit into from
Nov 8, 2024

Conversation

alvaroaleman
Copy link
Member

Contrary to everything else in controller-runtime, we expect source.Start to be non-blocking. If someone implements a custom source and gets this wrong, the resulting behavior is that the binary starts successfully, but no reconciliation happens which is extremely difficult to understand and debug.

This change makes us use the CacheSyncTimeout not only for the sources WaitForSync but also for its Start.

It is worth noting that the current design of both requiring Start to not block and WaitForSync to block is very confusing. It likely came to be because we basicaly require two distinct contexsts in Start, one to indicate the lifetime of the Source and one to indicate the Start timeout.

To overall simplify and improve the code, the change also parallelizes the Start of the sources.

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: alvaroaleman

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Oct 26, 2024
@k8s-ci-robot k8s-ci-robot added approved Indicates a PR has been approved by an approver from all required OWNERS files. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Oct 26, 2024
Contrary to everything else in controller-runtime, we expect
`source.Start` to be non-blocking. If someone implements a custom source
and gets this wrong, the resulting behavior is that the binary starts
successfully, but no reconciliation happens which is extremely difficult
to understand and debug.

This change makes us use the `CacheSyncTimeout` not only for the sources
`WaitForSync` but also for its `Start`.

It is worth noting that the current design of both requiring `Start` to
not block and `WaitForSync` to block is very confusing. It likely came
to be because we basicaly require two distinct contexsts in `Start`, one
to indicate the lifetime of the `Source` and one to indicate the `Start`
timeout.

To overall simplify and improve the code, the change also parallelizes
the `Start` of the sources.
@troy0820
Copy link
Member

troy0820 commented Nov 8, 2024

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 8, 2024
@k8s-ci-robot
Copy link
Contributor

LGTM label has been added.

Git tree hash: f396e706f3c7a54b960ef9bc49e32407f4aa4b17

@k8s-ci-robot k8s-ci-robot merged commit 63a3800 into kubernetes-sigs:main Nov 8, 2024
8 of 9 checks passed
@troy0820
Copy link
Member

troy0820 commented Nov 8, 2024

Wasn't sure this would merge so quickly or else I would've put a hold on it to allow others to review. Do you want to cherry-pick this @alvaroaleman?

@alvaroaleman
Copy link
Member Author

Wasn't sure this would merge so quickly or else I would've put a hold on it to allow others to review. Do you want to cherry-pick this @alvaroaleman?

No. No problem, it happens. I will do a follow-up regarding your comment and in case there are more comments

alvaroaleman added a commit to alvaroaleman/controller-runtime that referenced this pull request Nov 8, 2024
@alvaroaleman
Copy link
Member Author

#3006

@alvaroaleman alvaroaleman deleted the start-take-two branch November 8, 2024 22:01
alvaroaleman added a commit to alvaroaleman/controller-runtime that referenced this pull request Nov 8, 2024
alvaroaleman added a commit to alvaroaleman/controller-runtime that referenced this pull request Nov 10, 2024
alvaroaleman added a commit to alvaroaleman/controller-runtime that referenced this pull request Nov 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants