Systematically repairing failed scope nested requests

[markwhiting]

We bundle requests by scope to try to get more consistent results, e.g.:

Answer these questions about the conditions in each experiment in this paper: ...

But, sometimes, we get bad results, and it's a little annoying that we have to rerun entire requests to fix them because it costs time and money.

Could we run targeted requests for a particular scope? e.g.:

There are 2 experiments [a, b], and a has 3 conditions [a_1, a_2, a_3, a_4]. Answer these questions about a_2: ...

I think this probably works better than we expect, and tooling for it may help us think about tooling for feature versions, feature mechanisms (e.g., OpenAI vs. human vs. Anthropic), and other things that we need to support.