Reproduction steps:
1. Open the attached “IN-94910” project
2. Open the “Scenes/Test” Scene
3. Enable only the “NoneChild” GameObject from “TestSub” Subscene in the Hierarchy window
4. Enter the Play Mode
5. Observe the Console window
6. Enable only the “WithChild” GameObject from “TestSub” Subscene in the Hierarchy window
7. Enter the Play Mode
8. Observe the Console window

Expected result: Raycast consistently hits after shifts
Actual result: Raycast will fail to hit the cube starting from the second {{FixedStep}}

Reproducible with: 1.2.0 (2022.3.59f1), 1.3.2 (6000.0.41f1), 1.3.10 (6000.0.41f1, 6000.1.0b9, 6000.2.0a6)

Reproducible on: Windows 10
Not reproducible on: No other environments tested