Search Issue Tracker

Fixed in Unity 2019.1

Votes

0

Found in

2018.2.6f1

Issue ID

1094435

Regression

Yes

EditMode test cases that use an invalid TestCaseAttribute fail silently in Batch mode

Unity Test Runner

-

-

Priority: 2Necessary for shipping a final release

-

Severity: 2Core functionality majorly impacted

To reproduce:

1. Download the attached project "TestCaseAttribute.zip" and open in Unity
2. Open Test Runner window
3. Select the EditMode tab
4. Press "Run All" button
5. Observe that one Test fails and register an Error in it:

"System.Reflection.TargetParameterCountException : Incorrect number of parameters specified for TestCase"

6. Close Unity Editor
7. Run Tests in a Batch mode with a command:

"./Unity -projectPath /Users/unity/Documents/PS/Editor-Tests/TestCaseAttribute -runEditorTests -editorTestsResultFile ~/Desktop/Test/log.xml -logFile ~/Desktop/Test/newlog.log"

8. Open Test folder in Desktop and inspect "log.xml" file

Expected results: In "log.xml" you will find the same Error which was in Unity Editor
Actual results: In "log.xml" there is no Error - Test failed silently

Notes:
- This issue appears on both Windows and macOS
- Could not check for Regression on Unity 2018.2.0a1 and 2018.2.0a2 because Unity Editor crashes and on Unity 2018.2.0a3 Batch mode for some reason stops

Reproduced on Unity 2018.2.0a4, 2018.2.14f1, 2018.3.0b7 and 2019.1.0a6
Not reproduced on Unity 2017.4.0f1, 2017.4.13f1 and 2018.1.9f2
Regression on Unity 2018.2.0a4

All about bugs

View bugs we have successfully reproduced, and vote for the bugs you want to see fixed most urgently.