Search Issue Tracker

Fixed in 2020.2

Fixed in 2018.4, 2019.4

Votes

14

Found in

2019.2.17f1

Issue ID

1207427

Regression

No

PhotoCaptureFrame Fails to Provide Camera Matrices on HoloLens 2

XR

-

1. With the same Unity App built on top of Unity PhotoCapture and PhotoCaptureFrame API, it is able to take photo and retrieve CameraToWorld and CameraProjection matrices on HoloLens 1. The app works fine taking photo data, however, always fails to provide CameraToWorld and CameraProjection matrices on HoloLens 2.

2. How we can reproduce it using the example you attached
1) Have Windows SDK 18362 and VS2019 installed
2) Load UnityPhotoCapture scene into Unity 2019.2.17f1
3) Choose Universal Windows Platform as platform, and ensure capabilities WebCam, Microphone, Location and SpatialPerception are enabled, and Virtual Reality Supprt - Windows Mixed Reality is enabled as well.
4) Build and deploy the app onto Hololens 2
5) Once app gets launched, air-tap to take a photo and watch debug log. It prints out "Failed to get camera to world matrix!" and "Failed to get camera projection matrix!"

  1. Response avatar

    Resolution Note (fix version 2020.2):

    Legacy WMR is not available in 2020.2, but we will be adding this feature for XR WMR plugin within the next month.

Comments (31)

  1. 90fb1739d136a9e64c67c446fcb31ac9?d=mm

    MatrixInception

    Feb 20, 2021 14:00

    Looks like Microsoft is working with Unity to solve this, but no timeline yet... see related MRTK github issue here: https://github.com/microsoft/MixedRealityToolkit-Unity/issues/7224

  2. F8797d76488b30df35af74c85a966c88?d=mm

    holoben22

    Feb 05, 2021 23:06

    Still not fixed for HL2 in Unity 2019.4.18f1

  3. 39713a136904bd7f2048afa736fd6532?d=mm

    jozhard

    Jan 12, 2021 16:35

    Still having the same issue with 2019.4.17f1: localToWorld matrix always has the same values. I don't know what the Unity team means with "Fixed".

  4. 63f9f16383643c39d8564370b6cb4873?d=mm

    pocce90

    Nov 23, 2020 13:25

    @VSTREAMDIGITAL do you have a link for that issue?

  5. 8e754bce497dc1d875778cb7a4a92172?d=mm

    Walkramis

    Nov 20, 2020 07:53

    @VSTREAMDIGITAL do you have a link to that new issue?

  6. E1e77b8d741a2aba9bdb6bcca6b9b09c?d=mm

    vstreamdigital

    Nov 19, 2020 10:40

    This is also still an issue for me in 2019.4.14f1, using Windows SDK 10.0.19041.0 and built for ARM on a Hololens 2 running the latest windows update.

    I've submitted a fresh bug report about it and referenced this one so maybe it'll help shine some light on the issue.

  7. 90fb1739d136a9e64c67c446fcb31ac9?d=mm

    MatrixInception

    Nov 16, 2020 23:13

    Tested with Unity 2018.4.29f1 deployed onto HoloLens 2, PhotoCaptureFrame.TryGetCameraToWorldMatrix() still returns the same matrix result for totally different positions and rotations for consecutive photos taken.

    This is very frustrating...

  8. 8e754bce497dc1d875778cb7a4a92172?d=mm

    Walkramis

    Nov 04, 2020 09:58

    With the latest release it seems that the projection matrix is being updated between captures, but for me the cameratoworld matrix is still always returning the same value. Since this has been "fixed" since August, is there some way to push this further or is this being worked on?

  9. F84bbc4ab81706e9c06ad6865d555480?d=mm

    MarionV

    Oct 22, 2020 08:29

    Hi. Unity did a release (2019.4.13) and it says : XR: Fixed rotated projection when using PhotoCaptureFrame on HoloLens 2. I hoped it corrected this massive bug, so I did a quick test and CamToWorld stays the same between different tests on a single session. Is it normal ? Has someone else tested it ?

  10. A1754b6181149e63275f9cb008cb1ff7?d=mm

    fyyang

    Oct 16, 2020 00:01

    I got same matrix from TryGetCameraToWorldMatrix all the time with 2019.4.6f1 on HL2? Any updates?

Add comment

Log in to post comment

All about bugs

View bugs we have successfully reproduced, and vote for the bugs you want to see fixed most urgently.