Raycaster priority - PivotControls

[soadzoor]

Describe the feature you'd like:

I have an application where users can add models into the scene, and they can change the models' position / orientation with the help of PivotControls.

Whenever a model is selected, the PivotControls appear in the selected model's position.

I set depthTest={false}, so the PivotControls are always rendered on top of the other objects.

This works visually, but it doesn't affect the Raycaster, so a lot of times the actual object is being "clicked"/intersected first (because it's closer to the camera, therefore the PivotControls don't work, the user can't move the object.

How could I set up kind of a priority list to the raycaster, so whenever the "PivotControls" is being intersected, all the other objects are being ignored?