aqa-tests: TAP report parsing error: expected '', but found ''

Describe the bug TAP report parsing error: expected ‘<document start>’, but found ‘<scalar>’ https://ci.adoptopenjdk.net/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl/363/console

20:05:32  TAP Reports Processing: START
20:05:32  Looking for TAP results report in workspace using pattern: **/*.tap
20:05:39  Saving reports...
20:05:39  Processing '/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl/builds/363/tap-master-files/openjdk-tests/TKG/test_output_16019215963274/TestTargetResult.tap'
20:05:39  Parsing TAP test result [/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl/builds/363/tap-master-files/openjdk-tests/TKG/test_output_16019215963274/TestTargetResult.tap].
20:05:39  org.tap4j.parser.ParserException: Error parsing TAP Stream: Error parsing YAML [ok 2 - jdk_lang_native_j9_win_0 # skip
20:05:39    ---
20:05:39  ok 3 - jdk_math_j9_0
20:05:39    ---
20:05:39  ok 4 - jdk_util_j9_0
20:05:39    ---
20:05:39  ok 5 - jdk11_tier1_cipher_0
20:05:39    ---
20:05:39  ok 6 - jdk11_tier1_buffer_0
20:05:39    ---
20:05:39  ok 7 - jdk11_tier1_iso8859_0
20:05:39    ---
20:05:39  ok 8 - jdk11_tier1_pack200_0
20:05:39    ---
20:05:39  ]: expected '<document start>', but found '<scalar>'
20:05:39   in 'string', line 2, column 3:
20:05:39        ---
20:05:39        ^
20:05:39  
20:05:39  	at org.tap4j.parser.Tap13Parser.parseTapStream(Tap13Parser.java:257)
20:05:39  	at org.tap4j.parser.Tap13Parser.parseFile(Tap13Parser.java:231)
20:05:39  	at org.tap4j.plugin.TapParser.parse(TapParser.java:173)
20:05:39  	at org.tap4j.plugin.TapPublisher.loadResults(TapPublisher.java:572)
20:05:39  	at org.tap4j.plugin.TapPublisher.performImpl(TapPublisher.java:444)
20:05:39  	at org.tap4j.plugin.TapPublisher.perform(TapPublisher.java:403)
20:05:39  	at jenkins.tasks.SimpleBuildStep.perform(SimpleBuildStep.java:112)
20:05:39  	at sun.reflect.GeneratedMethodAccessor19828.invoke(Unknown Source)
20:05:39  	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
20:05:39  	at java.lang.reflect.Method.invoke(Method.java:498)
20:05:39  	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:92)
20:05:39  	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:70)
20:05:39  	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
20:05:39  	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
20:05:39  	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
20:05:39  	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
20:05:39  	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
20:05:39  	at java.lang.Thread.run(Thread.java:748)
20:05:39  Caused by: org.tap4j.parser.ParserException: Error parsing YAML [ok 2 - jdk_lang_native_j9_win_0 # skip
20:05:39    ---
20:05:39  ok 3 - jdk_math_j9_0
20:05:39    ---
20:05:39  ok 4 - jdk_util_j9_0
20:05:39    ---
20:05:39  ok 5 - jdk11_tier1_cipher_0
20:05:39    ---
20:05:39  ok 6 - jdk11_tier1_buffer_0
20:05:39    ---
20:05:39  ok 7 - jdk11_tier1_iso8859_0
20:05:39    ---
20:05:39  ok 8 - jdk11_tier1_pack200_0
20:05:39    ---
20:05:39  ]: expected '<document start>', but found '<scalar>'
20:05:39   in 'string', line 2, column 3:
20:05:39        ---
20:05:39        ^
20:05:39  
20:05:39  	at org.tap4j.parser.Tap13Parser.parseDiagnostics(Tap13Parser.java:469)
20:05:39  	at org.tap4j.parser.Tap13Parser.onFinish(Tap13Parser.java:431)
20:05:39  	at org.tap4j.parser.Tap13Parser.parseTapStream(Tap13Parser.java:255)
20:05:39  	... 17 more
20:05:39  Caused by: expected '<document start>', but found '<scalar>'
20:05:39   in 'string', line 2, column 3:
20:05:39        ---
20:05:39        ^
20:05:39  
20:05:39  	at org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserImpl.java:225)
20:05:39  	at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)
20:05:39  	at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:148)
20:05:39  	at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:122)
20:05:39  	at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:150)
20:05:39  	at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:490)
20:05:39  	at org.yaml.snakeyaml.Yaml.load(Yaml.java:416)
20:05:39  	at org.tap4j.parser.Tap13Parser.parseDiagnostics(Tap13Parser.java:459)
20:05:39  	... 19 more
20:05:39  TAP parse errors found in the build. Marking build as UNSTABLE
20:05:39  TAP Reports Processing: FINISH
[Pipeline] junit
20:05:39  Recording test results

To Reproduce Steps to reproduce the behavior (or Grinder rerun link): https://ci.adoptopenjdk.net/job/Grinder/parambuild/?TARGET=sanity.openjdk&CUSTOM_TARGET=&SDK_RESOURCE=upstream&VENDOR_TEST_SHAS=&JDK_BRANCH=openj9&TEST_FLAG=&VENDOR_TEST_DIRS=&ARTIFACTORY_REPO=&ARTIFACTORY_ROOT_DIR=&PLATFORM=x86-64_linux_xl&KEEP_REPORTDIR=true&PERSONAL_BUILD=false&ADOPTOPENJDK_REPO=https%3A%2F%2Fgithub.com%2FAdoptOpenJDK%2Fopenjdk-tests.git&JDK_IMPL=openj9&LABEL=&TKG_BRANCH=master&EXTRA_OPTIONS=&SSH_AGENT_CREDENTIAL=&IS_PARALLEL=false&CUSTOMIZED_SDK_URL=&BUILD_IDENTIFIER=&AUTO_DETECT=true&ADOPTOPENJDK_BRANCH=master&TKG_SHA=&ARTIFACTORY_SERVER=&CUSTOMIZED_SDK_URL_CREDENTIAL_ID=&OPENJDK_SHA=&KEEP_WORKSPACE=false&JDK_VERSION=11&BUILD_LIST=openjdk&USER_CREDENTIALS_ID=&UPSTREAM_JOB_NUMBER=706&ITERATIONS=1&VENDOR_TEST_REPOS=&JDK_REPO=https%3A%2F%2Fgithub.com%2Fibmruntimes%2Fopenj9-openjdk-jdk11&TIME_LIMIT=10&RELEASE_TAG=openj9-0.23.0&OPENJ9_BRANCH=master&OPENJ9_SHA=&JCK_GIT_REPO=&VENDOR_TEST_BRANCHES=&UPSTREAM_JOB_NAME=build-scripts%2Fjobs%2Fjdk11u%2Fjdk11u-linux-x64-openj9-linuxXL&OPENJ9_REPO=https%3A%2F%2Fgithub.com%2Feclipse%2Fopenj9.git&JVM_OPTIONS=&TKG_REPO=https%3A%2F%2Fgithub.com%2FAdoptOpenJDK%2FTKG.git

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Additional context Add any other context about the problem here.

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 16 (16 by maintainers)

Most upvoted comments

Looks like it’s a machine issue realted to a missing perl module: 20:13:17 Can't locate Time/HiRes.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .). We need this module to print out timestamp for tap output. It’s supposed to come with perl, I will update the prerequisites to include it.

renfeiw on Oct 7, 2020

just as a note, @smlambert is the github id that I use (@ShelleyLambert is one autocreated for me by IBM that I will not see notifications for)

All tests use Time::HiRes, since we parse all test output and create TAP output for all tests. We have been doing this for some time without incident (which is why I assumed its part of core Perl installation). These tests are also not new, they are just reorganized into new test targets.

To answer @Haroon-Khel question in https://github.com/AdoptOpenJDK/openjdk-tests/issues/1998#issuecomment-705519313 “Rerun in Grinder” link copies the exact parameters used in the run you are copying it from. Someone running a Grinder should be aware that the upstream builds are deleted at a fast pace, so you would switch the SDK_RESOURCE from upstream to nightly to pick up the latest nightly build, since that upstream job will have already been deleted (unless you happen to be rerunning with a day or two of the failure).

Test pipelines do not build sdks, they take built sdks from various sources: SDK_RESOURCE=nightly pulls from Adopt APIv3 latest ea builds SDK_RESOURCE=releases pulls from Adopt APIv3 latest ga builds SDK_RESOURCE=upstream pulls from another job on the same CI server (as defined in UPSTREAM_JOB_NAME, UPSTREAM_JOB_NUMBER) SDK_RESOURCE=customized pulls from the location provided in CUSTOMIZED_SDK_URL

smlambert on Oct 8, 2020

I’ll install Time::HiRes onto test-ibmcloud-rhel6-x64-1 and we can re run the test. If it passes, Ill add the package to the playbooks

Haroon-Khel on Oct 8, 2020

@Haroon-Khel Can you check for this module on other machines as it would be good to confirm if this is machine specific? Unless Perl-SHA-Digest has a prereq of Time::HiRes the installation of it is unlikely to resolve this issue

sxa on Oct 8, 2020