Search Issue Tracker

Fixed in 2017.3.0f3

Votes

37

Found in

5.6.0f1

Issue ID

893804

Regression

No

Running Unity in batchmode gives a result file with the wrong test type

Deployment Management

-

Repro Steps:

1. Open command prompt
2. Write this command: "{UNITY_PATH}\Editor\Unity.exe" -batchmode -runEditorTests -projectPath "{PROJECT_PATH}" -editorTestsResultFile "{PROJECT_PATH}\results.xml"
3. Open the "results.xml" file
4. See that the "type" is equal to "TestSuite" and not to "TestRun"

Expected: The "results.xml" file to show that the "type" is equal to "TestRun"
Actual: The "results.xml" file to show that the "type" is equal to "TestSuite"

Fixed in: 2017.3.0a4

Reproduced on: 5.6.0f1,
Can't reproduce on: 5.5.2f1: just doesn't create the "results.xml" file, 5.4.0f3: Aborts batch-mode due to failure. "An exception was thrown when running unit tests"

The user also attached the "results.xml' file.

Comments (8)

  1. amitpandeyblogs

    Jun 05, 2020 19:49

    https://www.cardiachill.com/users/Studybulletin
    https://www.bcinterruption.com/users/Studybulletin
    https://www.cardchronicle.com/users/Studybulletin
    https://www.dukebasketballreport.com/users/Studybulletin
    https://www.fromtherumbleseat.com/users/Studybulletin
    https://www.gobblercountry.com/users/Studybulletin
    https://www.shakinthesouthland.com/users/Studybulletin
    https://www.stateoftheu.com/users/Studybulletin
    https://www.streakingthelawn.com/users/Studybulletin
    https://www.tarheelblog.com/users/Studybulletin
    https://www.tomahawknation.com/users/Studybulletin
    https://www.nunesmagician.com/users/Studybulletin
    https://www.aseaofblue.com/users/Studybulletin
    https://www.alligatorarmy.com/users/Studybulletin
    https://www.anchorofgold.com/users/Studybulletin
    https://www.andthevalleyshook.com/users/Studybulletin
    https://www.arkansasfight.com/users/Studybulletin
    https://www.collegeandmagnolia.com/users/Studybulletin
    https://www.dawgsports.com/users/Studybulletin
    https://www.forwhomthecowbelltolls.com/users/Studybulletin
    https://www.garnetandblackattack.com/users/Studybulletin
    https://www.goodbullhunting.com/users/Studybulletin
    https://www.redcuprebellion.com/users/Studybulletin
    https://www.rockmnation.com/users/Studybulletin
    https://www.rockytoptalk.com/users/Studybulletin
    https://www.rollbamaroll.com/users/Studybulletin
    https://www.teamspeedkills.com/users/Studybulletin
    https://www.bannersociety.com/users/Studybulletin
    https://www.barkingcarnival.com/users/Studybulletin
    https://www.blackandgoldbanneret.com/users/Studybulletin
    https://www.downthedrive.com/users/Studybulletin
    https://www.everydayshouldbesaturday.com/users/Studybulletin
    https://www.footballstudyhall.com/users/Studybulletin
    https://www.thedailystampede.com/users/Studybulletin
    https://www.theuconnblog.com/users/Studybulletin
    https://www.underdogdynasty.com/users/Studybulletin
    https://www.bloggingthebracket.com/users/Studybulletin
    https://www.midmajormadness.com/users/Studybulletin
    https://www.ubbullrun.com/users/Studybulletin
    https://www.hustlebelt.com/users/Studybulletin
    https://www.slipperstillfits.com/users/Studybulletin
    https://www.minerrush.com/users/Studybulletin
    https://www.theicegarden.com/users/Studybulletin
    https://www.sbncollegehockey.com/users/Studybulletin
    https://www.coppernblue.com/users/Studybulletin
    https://www.nucksmisconduct.com/users/Studybulletin
    https://www.matchsticksandgasoline.com/users/Studybulletin
    https://www.knightsonice.com/users/Studybulletin
    https://www.jewelsfromthecrown.com/users/Studybulletin
    https://www.fiveforhowling.com/users/Studybulletin
    https://www.fearthefin.com/users/Studybulletin
    https://www.battleofcali.com/users/Studybulletin
    https://www.anaheimcalling.com/users/Studybulletin
    https://www.stlouisgametime.com/users/Studybulletin
    https://www.secondcityhockey.com/users/Studybulletin
    https://www.ontheforecheck.com/users/Studybulletin
    https://www.milehighhockey.com/users/Studybulletin
    https://www.hockeywilderness.com/users/Studybulletin
    https://www.defendingbigd.com/users/Studybulletin
    https://www.arcticicehockey.com/users/Studybulletin
    https://www.jacketscannon.com/users/Studybulletin
    https://www.pensburgh.com/users/Studybulletin
    https://www.lighthousehockey.com/users/Studybulletin
    https://www.japersrink.com/users/Studybulletin
    https://www.canescountry.com/users/Studybulletin
    https://www.broadstreethockey.com/users/Studybulletin
    https://www.blueshirtbanter.com/users/Studybulletin
    https://www.allaboutthejersey.com/users/Studybulletin
    https://www.wingingitinmotown.com/users/Studybulletin
    https://www.stanleycupofchowder.com/users/Studybulletin
    https://www.silversevensens.com/users/Studybulletin
    https://www.rawcharge.com/users/Studybulletin
    https://www.pensionplanpuppets.com/users/Studybulletin
    https://www.litterboxcats.com/users/Studybulletin
    https://www.habseyesontheprize.com/users/Studybulletin
    https://www.diebytheblade.com/users/Studybulletin
    https://throughitalltogether.sbnation.co...s/Studybulletin
    https://www.starsandstripesfc.com/users/Studybulletin
    https://lionofviennasuite.sbnation.com/users/Studybulletin
    https://www.threelionsroar.com/users/Studybulletin
    https://www.nevermanagealone.com/users/Studybulletin
    https://www.indomitablecitysoccer.com/users/Studybulletin
    https://www.fmfstateofmind.com/users/Studybulletin
    https://www.allforxi.com/users/Studybulletin
    https://weaintgotnohistory.sbnation.com/users/Studybulletin
    https://thetilehurstend.sbnation.com/users/Studybulletin
    https://theshortfuse.sbnation.com/users/Studybulletin
    https://liverpooloffside.sbnation.com/users/Studybulletin
    https://thebusbybabe.sbnation.com/users/Studybulletin
    https://stmarysmusings.sbnation.com/users/Studybulletin
    https://royalbluemersey.sbnation.com/users/Studybulletin
    https://rokerreport.sbnation.com/users/Studybulletin
    https://fosseposse.sbnation.com/users/Studybulletin
    https://cottagersconfidential.sbnation.c...s/Studybulletin
    https://cominghomenewcastle.sbnation.com/users/Studybulletin
    https://cartilagefreecaptain.sbnation.co...s/Studybulletin
    https://bracethehammer.sbnation.com/users/Studybulletin
    https://bitterandblue.sbnation.com/users/Studybulletin
    https://7500toholte.sbnation.com/users/Studybulletin
    https://www.jerseydoesntshrink.com/users/Studybulletin
    https://www.fearthewall.com/users/Studybulletin
    https://www.bavarianfootballworks.com/users/Studybulletin
    https://www.violanation.com/users/Studybulletin
    https://www.thesirenssong.com/users/Studybulletin
    https://acmilan.theoffside.com/users/Studybulletin
    https://www.serpentsofmadonnina.com/users/Studybulletin
    https://www.chiesaditotti.com/users/Studybulletin
    https://www.blackwhitereadallover.com/users/Studybulletin
    https://www.villarrealusa.com/users/Studybulletin
    https://www.managingmadrid.com/users/Studybulletin
    https://www.intothecalderon.com/users/Studybulletin
    https://www.barcablaugranes.com/users/Studybulletin
    https://www.wakingthered.com/users/Studybulletin
    https://www.twiceacosmo.com/users/Studybulletin
    https://www.themaneland.com/users/Studybulletin
    https://www.thebluetestament.com/users/Studybulletin
    https://www.thebentmusket.com/users/Studybulletin
    https://www.stumptownfooty.com/users/Studybulletin
    https://www.sounderatheart.com/users/Studybulletin
    https://www.rslsoapbox.com/users/Studybulletin
    https://www.onceametro.com/users/Studybulletin
    https://www.mountroyalsoccer.com/users/Studybulletin
    https://www.massivereport.com/users/Studybulletin
    https://www.lagconfidential.com/users/Studybulletin
    https://www.hudsonriverblue.com/users/Studybulletin
    https://www.hottimeinoldtown.com/users/Studybulletin
    https://www.dynamotheory.com/users/Studybulletin
    https://www.eightysixforever.com/users/Studybulletin
    https://www.epluribusloonum.com/users/Studybulletin
    https://www.dirtysouthsoccer.com/users/Studybulletin
    https://www.centerlinesoccer.com/users/Studybulletin
    https://www.burgundywave.com/users/Studybulletin
    https://www.brotherlygame.com/users/Studybulletin
    https://www.blackandredunited.com/users/Studybulletin
    https://www.bigdsoccer.com/users/Studybulletin
    https://www.angelsonparade.com/users/Studybulletin
    https://www.badlefthook.com/users/Studybulletin
    https://www.mmamania.com/users/Studybulletin
    https://www.mmafighting.com/users/Studybulletin
    https://www.cagesideseats.com/users/Studybulletin
    https://www.bloodyelbow.com/users/Studybulletin
    https://www.progressiveboink.com/users/Studybulletin
    https://www.outsports.com/users/Studybulletin
    https://blog.sbnation.com/users/Studybulletin
    https://www.anddownthestretchtheycome.co...s/Studybulletin
    https://www.americanninjawarriornation.c...s/Studybulletin
    https://www.stridenation.com/users/Studybulletin
    https://www.podiumcafe.com/users/Studybulletin
    https://www.futnation.com/users/Studybulletin
    https://dknation.draftkings.com/users/Studybulletin

    https://www.youtube.com/redirect?event=video_description&q=https://studybulletin.in/?ncid=tcep&google_editors_picks=true&redir_token=O-AwK8MkNLmmsZfR3fhonBGVP6V8MTUyNDcxMzgwMkAxNTI0NjI3NDAy&v=RyqiTW_ipyU

    https://www.youtube.com/redirect?event=video_description&q=https://studybulletin.com/?ncid=tcep&google_editors_picks=true&redir_token=O-AwK8MkNLmmsZfR3fhonBGVP6V8MTUyNDcxMzgwMkAxNTI0NjI3NDAy&v=RyqiTW_ipyU

    http://kw.pm.org/wiki/index.cgi?Kunak

    https://promodj.com/forum/software/1140641/Studybulletin

    https://medium.com/@lali.amitpandeyji/shoe-dog-review-phil-knight-book-review-47313ad39177

    https://forums.developer.amazon.com/questions/227511/account-dormant-still.html

    https://www.blogger.com/profile/12356523480604244742

    https://drive.google.com/file/d/1owSMA75mwlzaXEmDY7mimfDXbfI93rfT/edit

    https://sites.google.com/view/studybulletin/

    https://www.justgiving.com/crowdfunding/amit-pandey

    https://www.bloglovin.com/@amitpandey6/studybulletin-5451919

    https://studybulletin.podbean.com

    http://site-2604872-9724-6304.mystrikingly.com

    http://studybulletin.aircus.com

    https://www.walkscore.com/people/160977074053/walk-score-user

    http://c-73-170-204-100.hsd1.ca.comcast.net/viewtopic.php?t=2517
    https://www.justgiving.com/crowdfunding/amit-pandey-2
    https://www.justgiving.com/crowdfunding/amit-pandey
    https://t.me/s/studybulletin
    https://draft.blogger.com/profile/12356523480604244742
    https://amitpandeydhn022.hatenablog.com/
    https://stackoverflow.com/questions/12246547/how-to-create-gmail-filter-searching-for-text-only-at-start-of-subject-line/62222258#62222258

  2. ELihaib

    Nov 03, 2017 17:07

    Also on 2017.2

  3. fltech

    Sep 08, 2017 07:30

  4. fltech

    Sep 08, 2017 07:28

    I reproduce this issue in version 2017.1.0f3.

  5. jkrumow

    Jul 11, 2017 12:46

    I can still reproduce this error in version 5.6.2f1.

    As mentioned above, it is currently not possible to properly publish the xml-reports on a Continuous Integration System.

  6. c9iner

    Jun 10, 2017 19:04

    We also have this issue and cannot parse the xml automatically, which makes Unit test reporting impossible.

  7. at-at

    May 10, 2017 11:21

    Specifically, the issue is that any reports produced now are malformed XML that doesn't follow either the NUnit3 or NUnit2 format specifications. This means that we cannot parse them automatically to actually *use* the results for anything meaningful.

  8. at-at

    May 10, 2017 11:18

    We have this issue too, running unity on Mac OS X 10.11.6 and triggering batchmode tests through Jenkins over SSH.
    Coupled with issue 892798 (inexplicably closed as by design?), these prevent any automated testing, which unfortunately means 5.6.0 is off limits for a lot of studios doing anything beyond indie/hobbyist projects, including us.

Add comment

Log in to post comment

All about bugs

View bugs we have successfully reproduced, and vote for the bugs you want to see fixed most urgently.