CI failures: 20180918

[joyeecheung]

Failures in node-test-pull-request/17202 to node-test-pull-request/17294 that failed more than 2 PRs

Jenkins Failure

Reason	java.io.IOException: Backing channel 'JNLP4-connect connection from ... is disconnected.
Type	JENKINS_FAILURE
Failed PR	3 (nodejs/node#22890, nodejs/node#22903, nodejs/node#22418)
Appeared	test-digitalocean-freebsd11-x64-2, test-softlayer-ubuntu1804_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-5
First CI	https://ci.nodejs.org/job/node-test-pull-request/17237/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17294/

Example

java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:59136' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283)
	at com.sun.proxy.$Proxy85.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1137)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1129)

---

Build Failure

Reason	ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run?
Type	BUILD_FAILURE
Failed PR	5 (nodejs/node#22418, nodejs/node#22902, nodejs/node#22861, nodejs/node#22660, nodejs/node#22903)
Appeared	test-requireio_williamkapke-debian9-arm64_pi3-1, test-requireio_piccoloaiutante-debian9-arm64_pi3-1, test-requireio_williamkapke-debian9-arm64_pi3-2, test-requireio_continuationlabs-debian9-armv6l_pi1p-1, test-requireio_pivotalagency-debian9-arm64_pi3-1, test-requireio_davglass-debian9-arm64_pi3-1, test-requireio_securogroup-debian9-arm64_pi3-2, test-requireio_kahwee-debian9-arm64_pi3-1, test-requireio_williamkapke-debian9-arm64_pi3-3, test-requireio_pivotalagency-debian9-arm64_pi3-2, test-requireio_securogroup-debian9-armv6l_pi1p-2, test-requireio_notthetup_sayanee-debian9-arm64_pi3-1, test-requireio_securogroup-debian9-arm64_pi3-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17270/

Example

ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run? 
For example, /home/iojs/build/workspace/node-test-binary-arm/out/junit/test.xml is 7 hr 53 min old

Notifying upstream projects of job completion
Finished: FAILURE

---

Reason	There is not enough space in the file system.
Type	BUILD_FAILURE
Failed PR	5 (nodejs/node#22846, nodejs/node#21846, nodejs/node#22740, nodejs/node#22239, nodejs/node#20713)
Appeared	test-osuosl-aix61-ppc64_be-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17216/

Example

There is not enough space in the file system.
Assembler:
/tmp//cct4lCKe.s: line 1844736: 1252-161 A system problem occurred while processing file /tmp/asqMDMaa
as: There is not enough space in the file system.
Assembler:
/tmp//ccsG2kv1.s: line 122: 1252-161 A system problem occurred while processing file /tmp/asaMFMaa

---

Reason	sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory
Type	BUILD_FAILURE
Failed PR	5 (nodejs/node#22418, nodejs/node#22902, nodejs/node#22861, nodejs/node#22660, nodejs/node#22903)
Appeared	test-requireio_ceejbot-debian9-armv6l_pi1p-1, test-requireio_louiscntr-debian9-armv7l_pi2-1, test-requireio_mininodes-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-3, test-requireio_davglass-debian9-armv6l_pi1p-1, test-requireio_mininodes-debian9-armv7l_pi2-1, test-requireio_bengl-debian9-armv6l_pi1p-1, test-requireio_ceejbot-debian9-armv7l_pi2-1, test-requireio_sambthompson-debian9-armv7l_pi2-1, test-requireio_securogroup-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-1, test-requireio_mcollina-debian9-armv7l_pi2-1, test-requireio_rvagg-debian9-armv7l_pi2-1, test-requireio_mhdawson-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-2, test-requireio_andineck-debian9-armv6l_pi1p-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-1, test-requireio_jasnell-debian9-armv7l_pi2-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-2, test-requireio_chrislea-debian9-armv6l_pi1p-1, test-requireio_bengl-debian9-armv6l_pi1p-2, test-requireio_indieisaconcept-debian9-armv6l_pi1p-1, test-requireio_continuationlabs-debian9-armv6l_pi1p-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17270/

Example

sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory

---

Reason	Error: 'NoneType' object has no attribute 'getitem'
Type	BUILD_FAILURE
Failed PR	3 (nodejs/node#22418, nodejs/node#22858, nodejs/node#22788)
Appeared	test-softlayer-ubuntu1404-x86-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17283/

Example

Error: 'NoneType' object has no attribute '__getitem__'
POST BUILD TASK : FAILURE
END OF POST BUILD TASK : 0
Recording test results
Recording fingerprints
Notifying upstream projects of job completion

---

Reason	error: pathspec ... did not match any file(s) known to git.
Type	BUILD_FAILURE
Failed PR	3 (nodejs/node#22880, nodejs/node#22418, nodejs/node#22914)
Appeared	test-azure_msft-win10-x64-1, test-azure_msft-win10-x64-4, test-azure_msft-win10-x64-2, test-azure_msft-win10-x64-3, test-rackspace-win2008r2-x64-6, test-azure_msft-win2016-x64-5, test-azure_msft-win2016-x64-2, test-azure_msft-win2016-x64-4, test-azure_msft-win2016-x64-3, test-rackspace-win2012r2-x64-4, test-rackspace-win2012r2-x64-5, test-rackspace-win2012r2-x64-3, test-rackspace-win2012r2-x64-1, test-rackspace-win2008r2-x64-2, test-rackspace-win2008r2-x64-1, test-azure_msft-win2008r2-x64-1, test-azure_msft-win2008r2-x64-2, test-rackspace-win2012r2-x64-9, test-rackspace-win2012r2-x64-2, test-rackspace-win2012r2-x64-7, test-azure_msft-win2012r2-x64-1, test-rackspace-win2012r2-x64-8, test-azure_msft-win2012r2-x64-2, test-rackspace-win2012r2-x64-6, test-azure_msft-win2012r2-x64-3
First CI	https://ci.nodejs.org/job/node-test-pull-request/17218/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17293/

Example

error: pathspec 'refs/remotes/jenkins_tmp/jenkins-node-test-commit-windows-fanned-20827-bin-win-vs2017' did not match any file(s) known to git.

c:\workspace\node-test-binary-windows>if 1 NEQ 0 exit /b 1 
Build step 'Execute Windows batch command' marked build as failure
Run condition [Always] enabling perform for step [[Execute Windows batch command, Execute shell]]
[node-test-binary-windows] $ cmd /c call C:\Users\ADMINI~1\AppData\Local\Temp\jenkins375521525818467789.bat

---

Reason	ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type	BUILD_FAILURE
Failed PR	2 (nodejs/node#22754, nodejs/node#22920)
Appeared	test-digitalocean-freebsd11-x64-2, test-joyent-smartos16-x64-1, test-joyent-smartos17-x64-2, test-joyent-smartos16-x64-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/17231/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17273/

Example

ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Notifying upstream projects of job completion
Finished: FAILURE

---

Reason	fatal: Could not read from remote repository.
Type	BUILD_FAILURE
Failed PR	2 (nodejs/node#22878, nodejs/node#22550)
Appeared	test-azure_msft-win2016-x64-4, test-azure_msft-win10-x64-1, test-azure_msft-win2016-x64-3
First CI	https://ci.nodejs.org/job/node-test-pull-request/17207/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17211/

Example

fatal: Could not read from remote repository.

---

JSTest Failure

Reason	parallel/test-heapdump-worker
Type	JS_TEST_FAILURE
Failed PR	7 (nodejs/node#22846, nodejs/node#22911, nodejs/node#22797, nodejs/node#22868, nodejs/node#22932, nodejs/node#22861, nodejs/node#22218)
Appeared	test-azure_msft-win2016-x64-4, test-azure_msft-win2016-x64-2, test-digitalocean-ubuntu1604_sharedlibs_container-x64-6, test-joyent-ubuntu1604_sharedlibs_container-x64-3, test-digitalocean-ubuntu1604_sharedlibs_container-x64-10, test-digitalocean-ubuntu1604_sharedlibs_container-x64-1, test-digitalocean-alpine37_container-x64-2, test-softlayer-centos6-x64-1, test-rackspace-centos7-x64-1, test-rackspace-fedora27-x64-1, test-softlayer-ubuntu1404-x64-1, test-rackspace-ubuntu1604-x64-1, test-joyent-ubuntu1710-x64-1, test-digitalocean-ubuntu1804_container-x64-2, test-macstadium-macos10.11-x64-2, test-osuosl-ubuntu1404-ppc64_le-1, test-joyent-smartos16-x64-1, test-joyent-smartos17-x64-2, test-scaleway-ubuntu1604-armv7l-1, test-packetnet-ubuntu1604-arm64-2, test-requireio_indieisaconcept-debian9-armv6l_pi1p-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-1, test-requireio_pivotalagency-debian9-arm64_pi3-2, undefined
First CI	https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17290/

Example

not ok 187 parallel/test-heapdump-worker
  ---
  duration_ms: 2.562
  severity: fail
  exitcode: 134
  stack: |-
    npm[7204]: src\inspector_agent.cc:729: Assertion `(client_) != nullptr' failed.
     1: 00007FF7D0FB0B05 
     2: 00007FF7D0F8A0E6 
     3: 00007FF7D0F8A1B1 
     4: 00007FF7D0E9B476 
     5: 00007FF7D0EEEA9C 
     6: 00007FF7D0FE9AE4 
     7: 00007FF7D1A43080 
     8: 00007FF8A2648364 
     9: 00007FF8A3EDE851 
  ...

---

Reason	parallel/test-zlib-convenience-methods
Type	JS_TEST_FAILURE
Failed PR	6 (nodejs/node#22846, nodejs/node#22331, nodejs/node#22904, nodejs/node#22660, nodejs/node#22927, nodejs/node#22932)
Appeared	test-softlayer-ubuntu1404-x86-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17285/

Example

not ok 2030 parallel/test-zlib-convenience-methods
  ---
  duration_ms: 0.282
  severity: crashed
  exitcode: -6
  stack: |-
    *** Error in `out/Release/node': double free or corruption (!prev): 0x0d3f3800 ***
  ...

---

Reason	parallel/test-http2-pipe
Type	JS_TEST_FAILURE
Failed PR	3 (nodejs/node#22858, nodejs/node#22914, nodejs/node#22932)
Appeared	test-rackspace-win2008r2-x64-6, test-rackspace-win2008r2-x64-3
First CI	https://ci.nodejs.org/job/node-test-pull-request/17238/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17285/

Example

not ok 270 parallel/test-http2-pipe
  ---
  duration_ms: 0.321
  severity: fail
  exitcode: 1
  stack: |-
    events.js:167
          throw er; // Unhandled 'error' event
          ^
    
    Error: read ECONNRESET
        at TCP.onStreamRead (internal/stream_base_commons.js:111:27)
    Emitted 'error' event at:
        at emitErrorNT (internal/streams/destroy.js:82:8)
        at emitErrorAndCloseNT (internal/streams/destroy.js:50:3)
        at process._tickCallback (internal/process/next_tick.js:63:19)
  ...

---

Reason	addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#22880, nodejs/node#22888)
Appeared	test-requireio-osx1010-x64-1, test-digitalocean-freebsd11-x64-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/17208/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17221/

Example

not ok 1905 addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary
  ---
  duration_ms: 120.707
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...

---

Reason	parallel/test-worker-syntax-error
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#22843, nodejs/node#22239)
Appeared	test-azure_msft-win10-x64-3, test-rackspace-win2012r2-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/17202/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17215/

Example

not ok 521 parallel/test-worker-syntax-error
  ---
  duration_ms: 0.195
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
        at Object.mustCall (c:\workspace\node-test-binary-windows\test\common\index.js:310:10)
        at Object.<anonymous> (c:\workspace\node-test-binary-windows\test\parallel\test-worker-syntax-error.js:12:24)
        at Module._compile (internal/modules/cjs/loader.js:693:30)
        at Object.Module._extensions..js (internal/modules/cjs/loader.js:704:10)
        at Module.load (internal/modules/cjs/loader.js:603:32)
        at tryModuleLoad (internal/modules/cjs/loader.js:542:12)
        at Function.Module._load (internal/modules/cjs/loader.js:534:3)
        at Function.Module.runMain (internal/modules/cjs/loader.js:746:12)
        at startup (internal/bootstrap/node.js:270:19)
  ...

---

Git Failure

Reason	warning: failed to remove out/Release/.nfs0000000000c2d81c00000c87
Type	GIT_FAILURE
Failed PR	16 (nodejs/node#22239, nodejs/node#22888, nodejs/node#22788, nodejs/node#22331, nodejs/node#22845, nodejs/node#22754, nodejs/node#22898, nodejs/node#22861, nodejs/node#22902, nodejs/node#22418, nodejs/node#22890, nodejs/node#22858, nodejs/node#22834, nodejs/node#22903, nodejs/node#21846, nodejs/node#22900)
Appeared	test-requireio_continuationlabs-debian9-armv6l_pi1p-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/17215/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/17251/

Example

warning: failed to remove out/Release/.nfs0000000000c2d81c00000c87

[joyeecheung]

Progress

• addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary

In progress

• java.io.IOException: Backing channel 'JNLP4-connect connection from ... is disconnected.
  • I've marked test-softlayer-ubuntu1804_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-1 and test-softlayer-ubuntu1604_sharedlibs_container-x64-5 offline. These are all docker containers running on test-softlayer-ubuntu1604_docker-x64-1
• Fanned jobs not resuming properly: Keeping old binaries to allow resuming fanned jobs build#1496
  • ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run?
  • sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory:
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
  • error: pathspec ... did not match any file(s) known to git.
  • fatal: Could not read from remote repository.

Fixed

• parallel/test-heapdump-worker: worker: only stop inspector if started node#22927
• Marked as flaky in test: mark some tests as flaky node#22941
  • parallel/test-worker-syntax-error on Windows: maybe Investigate flaky test-worker-syntax-error-file node#22762 ?
  • parallel/test-http2-pipe on Windows: flaky: parallel/test-http2-* on Windows node#20750
• There is not enough space in the file system. on test-osuosl-aix61-ppc64_be-2
• warning: failed to remove out/Release/.nfs0000000000c2d81c00000c87 (stray process holding the lock)
• Not supposed to run on x86 ubuntu 1404: ci: no ubuntu1?04-32 since node 10 build#1498
  • Error: 'NoneType' object has no attribute '__getitem__'
  • parallel/test-zlib-convenience-methods

[refack]

• There is not enough space in the file system.
test-osuosl-aix61-ppc64_be-2
  fixed

• • ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them
  • sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?

  This just means tests didn't run. From what I've seen it's resumes of *-fanned.
  Keeping old binaries to allow resuming fanned jobs build#1496 is a WIP
  The real signature is 15:19:08 fatal: Couldn't find remote ref refs/heads/jenkins-node-test-commit-arm-fanned-3558-binary-pi1p/cc-armv6

• Fails in parallel/test-zlib-convenience-methods
  on test-softlayer-ubuntu1404-x86-1
  Stopped testing node >= v10 on x86 platforms ci: no ubuntu1?04-32 since node 10 build#1498

[joaocgreis]

The fatal: Could not read from remote repository. should be fixed. I have a PR on the slow simmer with temp repo updates, but this part is already there.

[refack]

nodejs/node#22941 landed marking 4 windows flaky test