Reproduction steps:d

1. Open the attached “Repro“ projected
2. Open the “Assets/Scenes/HandsDemoScene AVP.unity“ Scene
3. Select the “VirtualTabletop” GameObject (Table > VirtualTabletop) in the Hierarchy
4. Disable the “Box Collider“ Component and enable the “Mesh Collider“ Component in the Inspector
5. Build the project on “visionOS” platform (File > Build Settings > visionOS > Build)
6. Open the project in Xcode and run it on an Apple Vision Pro device or visionOS simulator
7. Try to interact with the 3 cubes on the left side of the tabletop

Expected result: The cubes are consistently interactable
Actual result: Picking up objects is not consistent, picking up from the bottom part of the cube is not possible (using simulator)

Reproducible with: 1.0.3, 1.1.6 (2022.3.27f1)

Reproducible on: MR using visionOS Simulator 1.1 - built using M1 MacOS 14.4.1
Not reproducible on: No other environment tested