Skip to content

Use Revise.jl in workers and rethink anonymous functions #301

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
JordiBolibar opened this issue Apr 16, 2025 · 1 comment
Closed

Use Revise.jl in workers and rethink anonymous functions #301

JordiBolibar opened this issue Apr 16, 2025 · 1 comment
Labels
enhancement New feature or request performance Improve code performance

Comments

@JordiBolibar
Copy link
Member

Right now we were not using Revise.jl in the workers. I just discovered this because as soon as I implemented it in #299 I broke everything. Apparently, as it is explained here, Revise.jl cannot handle anonymous functions in workers. We are extensively using this in pmaps, since it's the only nice way I've found to iterate over just a subset of the input arguments while keeping others fixed.

Surprisingly, the effect of not using Revise.jl in workers is not that catastrophic, meaning that I don't have the feeling the workers are recompiling everything every time there are code changes. Nonetheless, it would be interesting to find a good workaround for anonymous function usage, since I think there might be other issues involved around them.

For now, I'll just remove @everywhere using Revise from #299.

@JordiBolibar JordiBolibar added enhancement New feature or request performance Improve code performance labels Apr 16, 2025
@JordiBolibar
Copy link
Member Author

Following more testing, this seems to work now. So I'll keep it for now and come back to this if there are issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request performance Improve code performance
Projects
None yet
Development

No branches or pull requests

1 participant