You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Many CI setups do this nowadays and I consider it the best practice.
CIs usually dump a lot of logs together but they also have a concept of steps. When looking at logs pages, steps are normally collapsed and it's easy to navigate to the step of interest with a single click. They are mostly mapped to shell commands but what if one command encapsulates several high-level actions. It's preferable to separate those actions as different steps in CI setups so that things like runnings tests and setting up the environment/deps would not show up together. Moreover, some CIs even differentiate types of failures during the install and test stages (Travis CI shows FAILURE in one case and ERROR in the other, for example).
When opening the testing step, it's harder to visually find the useful part if it starts with the pip install logs. This affects the CI UX.
Plus, CIs usually have per-step timing info which is quite helpful when it comes to figuring out slow things.
In the past, there was a nasty tox bug that looked like the test invocation was failing, hiding that the real reason was the install step. Making it separate allowed to actually identify what the problem was.
Follow-up for https://github.com/pypa/setuptools/pull/2486/files#r546904721
Many CI setups do this nowadays and I consider it the best practice.
When opening the testing step, it's harder to visually find the useful part if it starts with the
pip install
logs. This affects the CI UX.Plus, CIs usually have per-step timing info which is quite helpful when it comes to figuring out slow things.
The text was updated successfully, but these errors were encountered: