Steps to reproduce:

1. Open attached project
2. Open scene "repro"
3. In hierarchy, select plane and notice that it has "Cast Shadows" set to "Shadows Only"
4. Now try selecting this plane using scene view. You can't
5. Change scene mode from "Shaded" to "UV Charts"
6. Plane becomes visible but you still can't select it

7. Add Cube to scene
8. Although it's invisible using "UV Charts" it's still possible to select it

Reproduced with: 5.2.0p1, 5.2.4p1, 5.3.2p2, 5.4.0b4