Skip to content

Broken test isn't marked as failed #2

@IZaiarnyi

Description

@IZaiarnyi

I've a test which fell down by exception before Assertion but in test manager it was marked as passed.

Junit result file:

<?xml version="1.0" encoding="UTF-8"?>
<!-- Generated by org.testng.reporters.JUnitReportReporter -->
<testsuite skipped="0" hostname="vsts-agent-allure-2-7-0-zc7m7" name="com.cloud.tests.api.MultiSceneTests" tests="1" failures="0" timestamp="10 Aug 2018 19:59:19 GMT" time="0.616" errors="1">
  <testcase name="checkThumbnailFromMultipleScenesAttachedToProject" time="0.616" classname="com.cloud.tests.api.MultiSceneTests">
    <error type="java.lang.NullPointerException" message="@Url parameter is null.">
      <![CDATA[java.lang.NullPointerException: @Url parameter is null.
at retrofit2.Utils.checkNotNull(Utils.java:280)
at retrofit2.ParameterHandler$RelativeUrl.apply(ParameterHandler.java:59)
at retrofit2.ServiceMethod.toCall(ServiceMethod.java:110)
at retrofit2.OkHttpCall.createRawCall(OkHttpCall.java:184)
at retrofit2.OkHttpCall.execute(OkHttpCall.java:167)
at com.cloud.tests.api.MultiSceneTests.checkThumbnailFromMultipleScenesAttachedToProject(MultiSceneTests.java:166)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
]]>
    </error>
  </testcase> <!-- checkThumbnailFromMultipleScenesAttachedToProject -->
</testsuite> <!-- com.cloud.tests.api.MultiSceneTests -->

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions