Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

jdk16 sanity.openjdk failures #11135

Closed
pshipton opened this issue Nov 9, 2020 · 25 comments
Closed

jdk16 sanity.openjdk failures #11135

pshipton opened this issue Nov 9, 2020 · 25 comments

Comments

@pshipton
Copy link
Member

pshipton commented Nov 9, 2020

I ran a sanity.openjdk on jdk16 and found the following failures.

https://ci.eclipse.org/openj9/job/Test_openjdknext_j9_sanity.openjdk_s390x_linux_Personal/4

java/foreign/TestMemoryHandleAsUnsigned.java.TestMemoryHandleAsUnsigned
java/foreign/TestMismatch.java.TestMismatch
java/foreign/TestNoForeignUnsafeOverride.java.TestNoForeignUnsafeOverride

java/lang/invoke/MethodHandles/TestDropReturn.java.TestDropReturn
java/lang/invoke/MethodHandles/publicLookup/Driver.java.Driver
java/lang/invoke/MethodHandlesPermuteArgumentsTest.java.MethodHandlesPermuteArgumentsTest
java/lang/invoke/lambda/superProtectedMethod/SuperMethodTest.java.SuperMethodTest

java/lang/reflect/sealed_classes/SealedClassesReflectionTest.java.SealedClassesReflectionTest

java/foreign/TestAdaptVarHandles.java.TestAdaptVarHandles
java/foreign/TestAddressHandle.java.TestAddressHandle
java/foreign/TestMemoryAccess.java.TestMemoryAccess
java/foreign/TestMemoryAlignment.java.TestMemoryAlignment
java/foreign/TestMemoryCopy.java.TestMemoryCopy
java/foreign/TestRebase.java.TestRebase
java/foreign/TestSegments.java.TestSegments
java/foreign/TestSharedAccess.java.TestSharedAccess
java/foreign/TestSlices.java.TestSlices
java/foreign/TestSpliterator.java.TestSpliterator
java/foreign/TestTypeAccess.java.TestTypeAccess
java/foreign/TestVarHandleCombinators.java.TestVarHandleCombinators
java/foreign/TestNative.java.TestNative

java/util/stream/test/org/openjdk/tests/java/util/stream/SegmentTestDataProvider.java.SegmentTestDataProvider
java/util/stream/test/org/openjdk/tests/java/util/stream/SpliteratorTest.java.SpliteratorTest

@pshipton
Copy link
Member Author

pshipton commented Nov 9, 2020

@tajila @babsingh fyi

@pshipton pshipton added this to the Release 0.25 (Java 16) milestone Nov 9, 2020
@babsingh
Copy link
Contributor

babsingh commented Nov 9, 2020

Acknowledged. Will add these failures to my TODO list.

@babsingh
Copy link
Contributor

babsingh commented Nov 10, 2020

All "java/foreign/*" and "java/util/stream/*" test cases are failing because of the below exception:

15:05:19  java.lang.ClassCastException: java.lang.invoke.DirectHandle incompatible with java.lang.invoke.BoundMethodHandle
15:05:19  	at java.base/java.lang.invoke.VarHandles.noCheckedExceptions(VarHandles.java:625)
...

FIX (impacts the JDK-next extension's repo): ibmruntimes/openj9-openjdk-jdk#248.
With this FIX, make test-jdk_foreign passes locally for me.

The above FIX will allow OpenJDK's VarHandles and IndirectVarHandle to work with OpenJ9's VarHandle implementation.

But, the above FIX will need to be reverted for testing the new OpenJDK JSR292 support (#7352).

@tajila @pshipton Should we merge the above FIX to resolve the failures, and then revert it once OpenJDK JSR292 support is complete?

@babsingh
Copy link
Contributor

babsingh commented Nov 10, 2020

While building JDK16, Java warnings are being treated as errors:

*/src/jdk.compiler/share/classes/com/sun/tools/javac/parser/JavaTokenizer.java:1059: warning: [removal] stripIndent() in String has been deprecated and marked for removal
                        string = string.stripIndent();
                                       ^
*/src/jdk.compiler/share/classes/com/sun/tools/javac/parser/JavaTokenizer.java:1068: warning: [removal] translateEscapes() in String has been deprecated and marked for removal
                        string = string.translateEscapes();

Temporary FIX (impacts the JDK-next extension's repo):

diff --git a/make/common/JavaCompilation.gmk b/make/common/JavaCompilation.gmk

-  JAVA_WARNINGS_ARE_ERRORS ?= -Werror
+#  JAVA_WARNINGS_ARE_ERRORS ?= -Werror

@babsingh
Copy link
Contributor

babsingh commented Nov 10, 2020

java/lang/invoke/MethodHandles/TestDropReturn.java.TestDropReturn

FAILURE:

14:41:37  /home/jenkins/workspace/Test_openjdknext_j9_sanity.openjdk_s390x_linux_Personal/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/lang/invoke/MethodHandles/TestDropReturn.java:48: error: cannot find symbol
14:41:37          mh = MethodHandles.dropReturn(mh);
14:41:37                            ^
14:41:37    symbol:   method dropReturn(MethodHandle)
14:41:37    location: class MethodHandles
14:41:37  1 error

FIX:

A new method, MethodHandles.dropReturn, needs to be implemented for OpenJ9-JDK16 in order to address the above failure:

// JDK16+
// Replace the return type of "mh" with a void return type
// Throw NPE if mh is null
public static MethodHandle dropReturn(MethodHandle mh) {
    return mh with void return type;
}

If OpenJDK JSR292 support (#7352) is complete for JDK16, then the above work won't be needed. Unless, we plan to keep both implementations fully operational.

@babsingh
Copy link
Contributor

babsingh commented Nov 10, 2020

Remaining Failures: Pending Investigation

NOTE: Below failures 1, 2 and 3 might be fixed automatically, once OpenJDK JSR292 support (#7352) is complete for JDK16.

  1. java/lang/invoke/MethodHandles/publicLookup/Driver.java.Driver
14:41:37  CL1: verify access for [java.lang.Object/publicLookup, q.EndPoint/publicLookup, q.EndPoint/publicLookup]
14:41:37  java.lang.AssertionError: unexpected result
14:41:37  	at m1/p.Main.assertTrue(Main.java:104)
14:41:37  	at m1/p.Main.checkTypeConsistency(Main.java:98)
14:41:37  	at m1/p.Main$Test.verifyAccess(Main.java:66)
14:41:37  	at m1/p.Main.main(Main.java:89)
...
  1. java/lang/invoke/MethodHandlesPermuteArgumentsTest.java.MethodHandlesPermuteArgumentsTest
14:45:19  JavaTest Message: JUnit Failure: testPermuteArguments(test.java.lang.invoke.MethodHandlesPermuteArgumentsTest): null
14:45:19  java.lang.NullPointerException
14:45:19  	at test.java.lang.invoke.MethodHandlesPermuteArgumentsTest.assertMatches(MethodHandlesPermuteArgumentsTest.java:248)
14:45:19  	at test.java.lang.invoke.MethodHandlesPermuteArgumentsTest.assertThrows(MethodHandlesPermuteArgumentsTest.java:240)
14:45:19  	at test.java.lang.invoke.MethodHandlesPermuteArgumentsTest.testBadReorderArrayLength(MethodHandlesPermuteArgumentsTest.java:203)
14:45:19  	at test.java.lang.invoke.MethodHandlesPermuteArgumentsTest.testPermuteArguments0(MethodHandlesPermuteArgumentsTest.java:62)
14:45:19  	at test.java.lang.invoke.MethodHandlesPermuteArgumentsTest$$Lambda$9/0x00000000bb166510.run(Unknown Source)
14:45:19  	at test.java.lang.invoke.lib.CodeCacheOverflowProcessor$$Lambda$10/0x00000000bb166c10.run(Unknown Source)
14:45:19  	at jdk.test.lib.Utils.filterException(Utils.java:633)
14:45:19  	at test.java.lang.invoke.lib.CodeCacheOverflowProcessor.runMHTest(CodeCacheOverflowProcessor.java:71)
14:45:19  	at test.java.lang.invoke.MethodHandlesPermuteArgumentsTest.testPermuteArguments(MethodHandlesPermuteArgumentsTest.java:51)
  1. java/lang/invoke/lambda/superProtectedMethod/SuperMethodTest.java.SuperMethodTest
14:41:37  test p.SuperMethodTest.splitPackage(): failure
14:41:37  java.lang.IllegalAccessError: Class p/SuperMethodTest$B$$Lambda$10/0x000000003c048ce0 illegally accessing "protected" member of class p/SuperMethodTest$A
14:41:37  	at p.SuperMethodTest$B$$Lambda$10/0x000000003c048ce0.run(Unknown Source)
14:41:37  	at p.SuperMethodTest.splitPackage(SuperMethodTest.java:101)
  1. java/lang/reflect/sealed_classes/SealedClassesReflectionTest.java.SealedClassesReflectionTest
//Seen 8 times
14:46:44  test SealedClassesReflectionTest.testSealedClasses(java.lang.Class@16c8b04a): failure
14:46:44  java.lang.AssertionError: expected [true] but found [false]
14:46:44  	at org.testng.Assert.fail(Assert.java:94)
14:46:44  	at org.testng.Assert.failNotEquals(Assert.java:496)
14:46:44  	at org.testng.Assert.assertTrue(Assert.java:42)
14:46:44  	at org.testng.Assert.assertTrue(Assert.java:52)
14:46:44  	at SealedClassesReflectionTest.testSealedClasses(SealedClassesReflectionTest.java:87)

//Seen 9 times
14:46:44  test SealedClassesReflectionTest.testSealedReflection(java.lang.Class@16c8b04a, 2, [Ljava.lang.String;@f4f71042, [Ljava.lang.Class;@503931f0, [LSealedClassesReflectionTest$SealedStatus;@5f672dcb): failure
14:46:44  java.lang.AssertionError: expected [true] but found [false]
14:46:44  	at org.testng.Assert.fail(Assert.java:94)
14:46:44  	at org.testng.Assert.failNotEquals(Assert.java:496)
14:46:44  	at org.testng.Assert.assertTrue(Assert.java:42)
14:46:44  	at org.testng.Assert.assertTrue(Assert.java:52)
14:46:44  	at SealedClassesReflectionTest.testSealedReflection(SealedClassesReflectionTest.java:217)

//Seen 3 times
14:46:44  test SealedClassesReflectionTest.testnon_sealedClasses(java.lang.Class@3b2700e3): failure
14:46:44  java.lang.AssertionError: expected [true] but found [false]
14:46:44  	at org.testng.Assert.fail(Assert.java:94)
14:46:44  	at org.testng.Assert.failNotEquals(Assert.java:496)
14:46:44  	at org.testng.Assert.assertTrue(Assert.java:42)
14:46:44  	at org.testng.Assert.assertTrue(Assert.java:52)
14:46:44  	at SealedClassesReflectionTest.testnon_sealedClasses(SealedClassesReflectionTest.java:130)

@pshipton
Copy link
Member Author

Should we merge the above FIX to resolve the failures, and then revert it once OpenJDK JSR292 support is complete

From my point of view, these tests don't need to be passing atm, the failures don't block any promotion. I'll defer to Tobi. If we think OpenJDK JSR292 support will be complete for JDK16, I'm happy to wait for that to be enabled by default.

@babsingh
Copy link
Contributor

babsingh commented Nov 10, 2020

SUMMARY: All failures reported here except the SealedClassesReflectionTest failures should be resolved automatically once OpenJDK JSR292 support (#7352) is complete for JDK16.

@tajila
Copy link
Contributor

tajila commented Nov 10, 2020

The required changes don't seem like it will be a big effort for us. Based on this, and on the fact that we do not need these tests to be passing right now I think we should revisit this issue in January 2021. By then OpenJDK MH work should be functional meaning that support this will be no/little effort. If in January we feel that #7352 is not ready, we will still have time to provide a J9 MH implementation.

@JasonFengJ9
Copy link
Member

JasonFengJ9 commented Nov 10, 2020

Note that SealedClassesReflectionTest is tracked by #10581 as well.

@babsingh
Copy link
Contributor

babsingh commented Nov 10, 2020

Note that SealedClassesReflectionTest is tracked by #10581 as well.

#10581 only covers the testSealedClasses (SealedClassesReflectionTest.java:87) failure. There are two other failures: testSealedReflection (SealedClassesReflectionTest.java:217) and testnon_sealedClasses (SealedClassesReflectionTest.java:130). Refer to #11135 (comment).

@JasonFengJ9
Copy link
Member

Excluding following tests via adoptium/aqa-tests#2088

java/lang/invoke/MethodHandles/publicLookup/Driver.java
java/lang/invoke/MethodHandlesPermuteArgumentsTest.java
java/lang/invoke/lambda/superProtectedMethod/SuperMethodTest.java
java/lang/invoke/MethodHandles/TestDropReturn.java
java/util/stream/test/org/openjdk/tests/java/util/stream/SpliteratorTest.java

They are expected to be fixed by OpenJDK JSR292 support (#7352) for JDK16 as per #11135 (comment) & #11135 (comment).

java/util/stream/test/org/openjdk/tests/java/util/stream/SpliteratorTest.java wasn't mentioned here specifically though it failed in a similar way, so I assume it can be fixed along with others.
@babsingh please comment if otherwise.

fyi @tajila @pshipton

@JasonFengJ9
Copy link
Member

Summary of other issues for JDK16 test suite sanity.openjdk:

@babsingh
Copy link
Contributor

babsingh commented Dec 4, 2020

java/util/stream/SpliteratorTest.java wasn't mentioned here specifically

It is mentioned in #11135 (comment): java/util/stream/* (entire package).

@keithc-ca
Copy link
Contributor

I find if you use a recent jdk15 (e.g. from adoptopenjdk.net) for your bootjdk, the warnings about preview features do not occur.

@pshipton
Copy link
Member Author

pshipton commented Jan 8, 2021

Latest list of failures with the latest jdk16 content (ignoring crypto failures which have another issue).

https://ci.eclipse.org/openj9/job/Test_openjdk16_j9_sanity.openjdk_s390x_linux_Nightly/1/

java/lang/invoke/MethodHandles/classData/ClassDataTest.java.ClassDataTest

java/lang/invoke/lambda/LambdaReceiver.java.LambdaReceiver
java/lang/invoke/lambda/LambdaReceiverBridge.java.LambdaReceiverBridge
java/lang/invoke/lambda/superProtectedMethod/InheritedProtectedMethod.java.InheritedProtectedMethod

java/lang/reflect/records/IsRecordTest.java.IsRecordTest

java/lang/reflect/sealed_classes/SealedClassesReflectionTest.java.SealedClassesReflectionTest

@tajila
Copy link
Contributor

tajila commented Jan 8, 2021

opened #11603 to track java/lang/reflect/sealed_classes/SealedClassesReflectionTest.java.SealedClassesReflectionTest

@tajila
Copy link
Contributor

tajila commented Jan 8, 2021

The SealedClassesReflectionTest failures are caused by #10977

@tajila
Copy link
Contributor

tajila commented Jan 8, 2021

The failures below are all related:

java/lang/invoke/MethodHandles/classData/ClassDataTest.java.ClassDataTest

java/lang/invoke/lambda/LambdaReceiver.java.LambdaReceiver
java/lang/invoke/lambda/LambdaReceiverBridge.java.LambdaReceiverBridge
java/lang/invoke/lambda/superProtectedMethod/InheritedProtectedMethod.java.InheritedProtectedMethod

being tracked in #11366

babsingh added a commit to babsingh/openj9 that referenced this issue Jan 19, 2021
In JDK16, MethodHandlesPermuteArgumentsTest checks the error messages
for the IllegalArgumentException. So, MethodHandles.permuteArguments has
been updated to set the expected error message for the
IllegalArgumentException.

Related: eclipse-openj9#11135

Signed-off-by: Babneet Singh <[email protected]>
@pshipton
Copy link
Member Author

This is no longer tracking anything useful (if it ever was).

@pshipton
Copy link
Member Author

Hmm, although there are some tests excluded under this Issue.
#11135 (comment)

@babsingh are there PRs that will fix the tests excluded in adoptium/aqa-tests#2088 under this issue?

@pshipton pshipton reopened this Jan 26, 2021
@babsingh
Copy link
Contributor

babsingh commented Jan 26, 2021

@pshipton Yes, the following issues are still unresolved:

  1. java/lang/invoke/MethodHandles/classData/ClassDataTest.java (being tracked via JDK16 : java/lang/invoke/MethodHandles/classData/ClassDataTest.java error: <T>classData(Lookup,String,Class<T>) is not public in MethodHandles; cannot be accessed from outside package #11366)
  2. java/lang/invoke/lambda/superProtectedMethod/SuperMethodTest.java (no tracker found JDK16 TEST: invoke/lambda/superProtectedMethod/SuperMethodTest.java - Unexpected IllegalAccessError #11783)
  3. java/lang/invoke/MethodHandles/publicLookup/Driver.java (being tracked via JDK16 TEST: java/lang/invoke/MethodHandles/publicLookup/Driver.java - AssertionError: unexpected result #10648)
  4. java/lang/reflect/sealed_classes/SealedClassesReflectionTest.java (should be fixed by Change Class#permittedSubclasses() to getPermittedSubclasses() and updated tests #11606)
  5. java/lang/invoke/VarHandles/VarHandleTestExact.java (being tracked via JDK16 InternalError: Compile stub invoked! at java.base/java.lang.invoke.VarHandle.withInvokeBehavior(VarHandle.java:1675) #11256)

Notes:

@babsingh
Copy link
Contributor

babsingh commented Jan 29, 2021

@pshipton All important issues, which are reported here, have been addressed for the 0.25 release. Any unresolved issue, which does not need to be fixed for the 0.25 release, has its own standalone tracker. So, we can close this issue.

@pshipton
Copy link
Member Author

pshipton commented Jan 29, 2021

We need to fix the excludes to refer to the correct issues/PRs before closing this. How can we re-assign the following?

java/lang/invoke/lambda/superProtectedMethod/SuperMethodTest.java nm this one is listed twice
java/lang/invoke/MethodHandlesPermuteArgumentsTest.java

@babsingh
Copy link
Contributor

We need to fix the excludes to refer to the correct issues/PRs before closing this. How can we re-assign the following?

smlambert pushed a commit to adoptium/aqa-tests that referenced this issue Feb 1, 2021
eclipse-openj9/openj9#11135 refers to an uber issue, which will be closed soon.
So, the references to eclipse-openj9/openj9#11135 have been replaced with
stand-alone trackers for the respective issues.

Also, a duplicate for SuperMethodTest.java has been removed.

Signed-off-by: Babneet Singh <[email protected]>
patkarns added a commit to patkarns/openjdk-tests that referenced this issue Mar 4, 2021
* Add add-exports to HCRLateAttachWorkload_previewEnabled (adoptium#2208)

- Add add-exports to HCRLateAttachWorkload_previewEnabled

Signed-off-by: Longyu Zhang <[email protected]>

* Convert iteration based STF based load tests to time-based tests (adoptium#2203)

Signed-off-by: [email protected] <[email protected]>

* AUTO: auto exclude test jdk_foreign_native impl=openj9 ver=16+ (adoptium#2219)

- related: adoptium#2218 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: smlambert <[email protected]>

* get.sh: stop mandating GNU tar --strip when extracting debug images (adoptium#2184)

Signed-off-by: Stewart X Addison <[email protected]>

* Remove references to eclipse-openj9/openj9#11135 (adoptium#2215)

eclipse-openj9/openj9#11135 refers to an uber issue, which will be closed soon.
So, the references to eclipse-openj9/openj9#11135 have been replaced with
stand-alone trackers for the respective issues.

Also, a duplicate for SuperMethodTest.java has been removed.

Signed-off-by: Babneet Singh <[email protected]>

* Exclude ChaCha20/ChaCha20Poly1305ParamTest.java (adoptium#2221)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <[email protected]>

* Update OpenJ9 JDK17 exclude list (adoptium#2217)

* Apply adoptium#2188 to OpenJ9 JDK17 exclude list

Apply adoptium#2188 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <[email protected]>

* Apply adoptium#2192 to OpenJ9 JDK17 exclude list

Apply adoptium#2192 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <[email protected]>

* Apply adoptium#2215 to OpenJ9 JDK17 exclude list

Apply adoptium#2215 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <[email protected]>

* Fix charsets,i18n,language_tag and locale_matching for 16 and Create new 4 test cases (adoptium#2214)

Co-authored-by: Kentaro Kuramochi <[email protected]>

* Allow users to set lightweight option (adoptium#2216)

The benefit of having lightweight checkout is to save space on Jenkins master.
However, Jenkins does not support using Repository URL and Branch build parameters with lightweight checkout together (see https://issues.jenkins.io/browse/JENKINS-48431).

In this PR, we set LIGHT_WEIGHT_CEHCKOUT to false and use Repository URL and Branch as build parameters by default. If LIGHT_WEIGHT_CEHCKOUT is set to true, set Repository URL and Branch to its explicit value

Signed-off-by: lanxia <[email protected]>

* Create ParallelStreamsLoadTest (adoptium#2229)

Signed-off-by: Simon Rushton <[email protected]>

* Remove _5m from ParallelStreamsLoadTest targets (adoptium#2231)

Signed-off-by: Simon Rushton <[email protected]>

* Enable java/lang/reflect/DefaultMethodMembers/FilterNotMostSpecific.java (adoptium#2230)

This was forgot after resolving openj9 issue #7623

Signed-off-by: Jason Feng <[email protected]>

* Merge openj9_custom into jdk_custom (adoptium#2232)

- Remove openj9_custom to merge it into jdk_custom

Signed-off-by: Longyu Zhang <[email protected]>

* Move JdiTest playlist entry from lambdaLoadTest to otherLoadTest (adoptium#2233)

Signed-off-by: Simon Rushton <[email protected]>

* Reinstate ChaCha20Poly1305ParamTest (adoptium#2236)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <[email protected]>

* Replace deprecated triggers with new syntax (adoptium#2237)

See https://github.com/jenkinsci/job-dsl-plugin/blob/master/docs/Migration.md#migrating-to-177

Signed-off-by: Adam Brousseau <[email protected]>

* Update userGuide to include vendor disable feature (adoptium#2239)

Signed-off-by: renfeiw <[email protected]>

* Use the new format of disable in playlist file (adoptium#2240)

Signed-off-by: renfeiw <[email protected]>

* Add a custom playlist target to run system tests (adoptium#2234)

Signed-off-by: [email protected] <[email protected]>

* OpenJ9 AArch64: Enable a BigInteger test back again (adoptium#2242)

This commit enables the following test, which used to fail with timeouts
on AArch64:

- java/math/BigInteger/LargeValueExceptions.java (eclipse-openj9/openj9#9082)

Signed-off-by: KONNO Kazuhiro <[email protected]>

* OpenJ9 AArch64: excluding stream/CountLargeTest (adoptium#2243)

The following test is known to timeout with OpenJ9 AArch64.
This commit excludes it.

- java/util/stream/test/org/openjdk/tests/java/util/stream/CountLargeTest.java eclipse-openj9/openj9#9040

Signed-off-by: KONNO Kazuhiro <[email protected]>

* Allow test autogen user to specify parallel params (adoptium#2248)

- Param PARALLEL_DEFAULT will be set as default
  PARALLEL option
- Param NUM_MACHINES will be set if passed

Signed-off-by: Adam Brousseau <[email protected]>

* Exclude com/sun/crypto AEAD ByteBuffer tests (adoptium#2249)

Issue eclipse-openj9/openj9#11390

Signed-off-by: Peter Shipton <[email protected]>

* Fix command injection vulnerability in autoTestPR (adoptium#2244)

Fixes a command injection vulnerability with the auto test PR GitHub Workflow.

See https://securitylab.github.com/research/github-actions-untrusted-input

Also removes the unecessary `&& github.event_name != 'pull_request'` condition from the autoTestPR job because it will always be satisfied. (This workflow only triggers upon issue_comment, so `github.event_name` will never be 'pull_request')

* Update the userGuide (adoptium#2259)

- add a one line to cover the special case of auto disable

Signed-off-by: renfeiw <[email protected]>

* Add certain directories trigger for PR/push testing (adoptium#2241)

* Add certain directories trigger for PR/push testing

* use run-aqa with the target specified by the changed dirs

* remove unnecessary push trigger, leave only PR trigger

* merge openj9 and hotspot, deal with duplication situation

* Combine getChangeLocation and getBuildLists into one getBuildLists, remove unnecessary code

Co-authored-by: xichen1 <[email protected]>

* Add 1 hour timeouts to all copyArtifacts steps (adoptium#2261)

Avoid long hanging builds when copyArtifacts hangs

Signed-off-by: Adam Brousseau <[email protected]>

* Set Lightweight checkout on child jobs (adoptium#2251)

Pass along the LIGHT_WEIGHT_CHECKOUT parameter
to the generater in order to have children
with the same value. Generally this will be false
for Ginders and true eveywhere else

Fixes adoptium#2250

Signed-off-by: Adam Brousseau <[email protected]>

* Revert "Exclude com/sun/crypto AEAD ByteBuffer tests (adoptium#2249)" (adoptium#2266)

This reverts commit 2227228.

* AUTO: auto exclude test dacapo-jython impl=openj9 ver=16+ (adoptium#2269)

- related: adoptium#2256 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: smlambert <[email protected]>

* Only pass LIGHTWEIGHT to DSL if defined (adoptium#2270)

- Currently it will put NULL which will cause
  toBoolean() to fail

Related adoptium#2251

Signed-off-by: Adam Brousseau <[email protected]>

* Add jdk_vector for jdk16+ (adoptium#2267)

Signed-off-by: lanxia <[email protected]>

* AUTO: auto exclude test jdk_foreign_native plat=.*(ppc|arm|390).* (adoptium#2280)

- related: adoptium#2265 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: adamfarley <[email protected]>

* temporarily fix bug of get changed files (adoptium#2277)

* Exclude jdk_net related failed tests temporarily (adoptium#2282)

- exclude jdk_net failed tests temporarily
- for jdk 11, 15, and 16 on related  platforms

Signed-off-by: Longyu Zhang <[email protected]>

* add suffix to ignore native tests (adoptium#2283)

* add suffix to ignore native tests

* remove unnecessary matrix.bulid_list in target list

* Remove maketest.sh (adoptium#2285)

Signed-off-by: [email protected] <[email protected]>

* Add comment-triggered PR build action (adoptium#2222)

* Add comment-triggered PR build action (adoptium#2199)

Add workflow `action.yml` that triggers on a PR comment starting with the word `action` then runs AQA tests based on the parameters.
Add `action_argparse.py` that parses PR comments to determine the parameters for AQA tests in the `action.yml` workflow.

Co-authored-by: Xichen Pan <[email protected]>
Co-authored-by: patkarns <[email protected]>

* Update indentation for exclusion user guide (adoptium#2288)

Signed-off-by: renfeiw <[email protected]>

* Fix reportStatus job running on every comment (adoptium#2290)

Prevents reportStatus from running on every comment by checking for the same conditions as parseComment:
- The comment must begin with `run aqa` keyword
- The comment must be a PR comment

* Use any node for copying TAP files in parallel test builds (adoptium#2295)

Resolve: adoptium#2262

Signed-off-by: lanxia <[email protected]>

* Set ulimit for sharedclasscache multithread tests (adoptium#2274)

Signed-off-by: Simon Rushton <[email protected]>

* Add test excluded label for auto exclusion (adoptium#2300)

Signed-off-by: renfeiw <[email protected]>

* Change subset to version (adoptium#2301)

Signed-off-by: renfeiw <[email protected]>

* Fix GitHub head ref error (adoptium#2308)

* test error

* test error

* remove parentheses

* use github.head_ref

* remove test file

* Update userGuide to change subset to version (adoptium#2307)

Signed-off-by: renfeiw <[email protected]>

* remove PushOrPRtestbuild.yml (adoptium#2309)

* Add alpine-linux and x86-64_solaris platforms (adoptium#2304)

* Trial external_custom target

Signed-off-by: Shelley Lambert <[email protected]>

* Update build.xml

Signed-off-by: Shelley Lambert <[email protected]>

* Add alpine-linux platform label

Signed-off-by: Shelley Lambert <[email protected]>

* add bits

Signed-off-by: Shelley Lambert <[email protected]>

* Add x86_solaris

Signed-off-by: Shelley Lambert <[email protected]>

* Remove waitForANodeToBecomeActive post-parallel (adoptium#2312)

This step is unnecessary now that we run
on any node. Also remove function as it
was only used for this step.

Follow up to adoptium#2295

Signed-off-by: Adam Brousseau <[email protected]>

* Remove ParallelStreamsLoadTest_special_J9 long running modes 113, 614 (adoptium#2315)

Modes 113 and 614 take too long to run across all platforms, and
contribute to special.system timeout problems on Windows.

(5) 113: -Xgcpolicy:gencon
-Xjit:count=0,optlevel=warm,gcOnResolve,rtResolve -Xmn512k
-Xnocompressedrefs
aix 8: 23min, 11: 31min
osx 8: 10min, 11: 20min
plinux 8: 18min, 11: 23min
xlinux 8: 25min, 11: 40min
zlinux 8: 12min, 11: 14min
Windows 11: 30min

(20) 614: -Xcompressedrefs -Xgcpolicy:gencon -Xjit:counts="- - - - - - 1
1 1 1000 250 250 - - - 10000 100000
10000",gcOnResolve,rtResolve,sampleInterval=2,scorchingSampleThreshold=10000,quickProfile
-Xmn512k -Xcheck:gc:vmthreads:all:quiet
aix 8: 19min, 11: 27min
osx 8: 17min, 11: 17min
plinux 8: 18min, 11: 22min
xlinux 8: 24min, 11: 33min
zlinux 8: 10min, 11: 14min
Windows 11: 27min

Signed-off-by: Peter Shipton <[email protected]>

* Change Renaissance 0.9.0 to 0.11.0 in build.xml (adoptium#2314)

Fixes adoptium#2298

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (adoptium#2316)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <[email protected]>

* AUTO: auto exclude test renaissance-dec-tree ver=16+ (adoptium#2319)

- related: adoptium#2255 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: smlambert <[email protected]>

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (adoptium#2325)

Fixes adoptium#2316 (comment)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <[email protected]>

* Set parallel machine limit to the total number of machines (adoptium#2330)

Resolve: eclipse-openj9/openj9#12088
Signed-off-by: lanxia <[email protected]>

* Convert subset to version (adoptium#2329)

- using version in playlists

Signed-off-by: renfeiw <[email protected]>

* Handle a git command's request for a username on Windows (adoptium#2287)

If we call git ls-remote on Window, when the repo doesn't exist,
the command asks for a username and hangs.

This change disables the request for a username and provides more
useful error messages. It also handles the problem appropriately,
so instead of failing the build, it correctly sets the repo location
to the non-'u' version.

Added some timeout-handling code as well, in case someone's running
this on a version of git older than 2.3, which may ignore the env
var we're using to suppress the username request.

Signed-off-by: Adam Farley <[email protected]>

* OpenJ9 JDK17 Exclude java/lang/Thread/UncaughtExceptionsTest.java (adoptium#2333)

Signed-off-by: Jason Feng <[email protected]>

* Only run foreign native test on x86_64 or aarch64 platforms (adoptium#2334)

This test requires CLinker, and the upstream community has no
current intention to port it to new platforms. So we need to exclude
the test on platforms that aren't x86-64 or aarch64.

Signed-off-by: Adam Farley <[email protected]>

* Enable download testimage for jdk8 (adoptium#2320)

Signed-off-by: Sophia Guo <[email protected]>

* Ignore leading and trailing whitespace in parsing (adoptium#2318)

Also simplifies the mapping of comment/command arguments to outputs.

* os upate to latest (adoptium#2331)

* use sw.os.alpine-linux label instead of sw.os.musl for Alpine (adoptium#2336)

Signed-off-by: Stewart X Addison <[email protected]>

Co-authored-by: LongyuZhang <[email protected]>
Co-authored-by: Mesbah Alam <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: smlambert <[email protected]>
Co-authored-by: Stewart X Addison <[email protected]>
Co-authored-by: Babneet Singh <[email protected]>
Co-authored-by: Peter Shipton <[email protected]>
Co-authored-by: KKES335 <[email protected]>
Co-authored-by: Kentaro Kuramochi <[email protected]>
Co-authored-by: Lan Xia <[email protected]>
Co-authored-by: Simon Rushton <[email protected]>
Co-authored-by: Jason Feng <[email protected]>
Co-authored-by: AdamBrousseau <[email protected]>
Co-authored-by: Renfei Wang <[email protected]>
Co-authored-by: KONNO Kazuhiro <[email protected]>
Co-authored-by: Deric Cheung <[email protected]>
Co-authored-by: XichenPan <[email protected]>
Co-authored-by: xichen1 <[email protected]>
Co-authored-by: adamfarley <[email protected]>
Co-authored-by: yanshan24 <[email protected]>
Co-authored-by: Shelley Lambert <[email protected]>
Co-authored-by: YananW <[email protected]>
Co-authored-by: Adam Farley <[email protected]>
Co-authored-by: sophia-guo <[email protected]>
smlambert added a commit to adoptium/aqa-tests that referenced this issue Apr 28, 2021
* Create createTestList.py

* Delete createTestList.py

* Sync original repo (#5)

* Add add-exports to HCRLateAttachWorkload_previewEnabled (#2208)

- Add add-exports to HCRLateAttachWorkload_previewEnabled

Signed-off-by: Longyu Zhang <[email protected]>

* Convert iteration based STF based load tests to time-based tests (#2203)

Signed-off-by: [email protected] <[email protected]>

* AUTO: auto exclude test jdk_foreign_native impl=openj9 ver=16+ (#2219)

- related: #2218 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: smlambert <[email protected]>

* get.sh: stop mandating GNU tar --strip when extracting debug images (#2184)

Signed-off-by: Stewart X Addison <[email protected]>

* Remove references to eclipse-openj9/openj9#11135 (#2215)

eclipse-openj9/openj9#11135 refers to an uber issue, which will be closed soon.
So, the references to eclipse-openj9/openj9#11135 have been replaced with
stand-alone trackers for the respective issues.

Also, a duplicate for SuperMethodTest.java has been removed.

Signed-off-by: Babneet Singh <[email protected]>

* Exclude ChaCha20/ChaCha20Poly1305ParamTest.java (#2221)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <[email protected]>

* Update OpenJ9 JDK17 exclude list (#2217)

* Apply #2188 to OpenJ9 JDK17 exclude list

Apply #2188 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <[email protected]>

* Apply #2192 to OpenJ9 JDK17 exclude list

Apply #2192 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <[email protected]>

* Apply #2215 to OpenJ9 JDK17 exclude list

Apply #2215 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <[email protected]>

* Fix charsets,i18n,language_tag and locale_matching for 16 and Create new 4 test cases (#2214)

Co-authored-by: Kentaro Kuramochi <[email protected]>

* Allow users to set lightweight option (#2216)

The benefit of having lightweight checkout is to save space on Jenkins master.
However, Jenkins does not support using Repository URL and Branch build parameters with lightweight checkout together (see https://issues.jenkins.io/browse/JENKINS-48431).

In this PR, we set LIGHT_WEIGHT_CEHCKOUT to false and use Repository URL and Branch as build parameters by default. If LIGHT_WEIGHT_CEHCKOUT is set to true, set Repository URL and Branch to its explicit value

Signed-off-by: lanxia <[email protected]>

* Create ParallelStreamsLoadTest (#2229)

Signed-off-by: Simon Rushton <[email protected]>

* Remove _5m from ParallelStreamsLoadTest targets (#2231)

Signed-off-by: Simon Rushton <[email protected]>

* Enable java/lang/reflect/DefaultMethodMembers/FilterNotMostSpecific.java (#2230)

This was forgot after resolving openj9 issue #7623

Signed-off-by: Jason Feng <[email protected]>

* Merge openj9_custom into jdk_custom (#2232)

- Remove openj9_custom to merge it into jdk_custom

Signed-off-by: Longyu Zhang <[email protected]>

* Move JdiTest playlist entry from lambdaLoadTest to otherLoadTest (#2233)

Signed-off-by: Simon Rushton <[email protected]>

* Reinstate ChaCha20Poly1305ParamTest (#2236)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <[email protected]>

* Replace deprecated triggers with new syntax (#2237)

See https://github.com/jenkinsci/job-dsl-plugin/blob/master/docs/Migration.md#migrating-to-177

Signed-off-by: Adam Brousseau <[email protected]>

* Update userGuide to include vendor disable feature (#2239)

Signed-off-by: renfeiw <[email protected]>

* Use the new format of disable in playlist file (#2240)

Signed-off-by: renfeiw <[email protected]>

* Add a custom playlist target to run system tests (#2234)

Signed-off-by: [email protected] <[email protected]>

* OpenJ9 AArch64: Enable a BigInteger test back again (#2242)

This commit enables the following test, which used to fail with timeouts
on AArch64:

- java/math/BigInteger/LargeValueExceptions.java (eclipse-openj9/openj9#9082)

Signed-off-by: KONNO Kazuhiro <[email protected]>

* OpenJ9 AArch64: excluding stream/CountLargeTest (#2243)

The following test is known to timeout with OpenJ9 AArch64.
This commit excludes it.

- java/util/stream/test/org/openjdk/tests/java/util/stream/CountLargeTest.java eclipse-openj9/openj9#9040

Signed-off-by: KONNO Kazuhiro <[email protected]>

* Allow test autogen user to specify parallel params (#2248)

- Param PARALLEL_DEFAULT will be set as default
  PARALLEL option
- Param NUM_MACHINES will be set if passed

Signed-off-by: Adam Brousseau <[email protected]>

* Exclude com/sun/crypto AEAD ByteBuffer tests (#2249)

Issue eclipse-openj9/openj9#11390

Signed-off-by: Peter Shipton <[email protected]>

* Fix command injection vulnerability in autoTestPR (#2244)

Fixes a command injection vulnerability with the auto test PR GitHub Workflow.

See https://securitylab.github.com/research/github-actions-untrusted-input

Also removes the unecessary `&& github.event_name != 'pull_request'` condition from the autoTestPR job because it will always be satisfied. (This workflow only triggers upon issue_comment, so `github.event_name` will never be 'pull_request')

* Update the userGuide (#2259)

- add a one line to cover the special case of auto disable

Signed-off-by: renfeiw <[email protected]>

* Add certain directories trigger for PR/push testing (#2241)

* Add certain directories trigger for PR/push testing

* use run-aqa with the target specified by the changed dirs

* remove unnecessary push trigger, leave only PR trigger

* merge openj9 and hotspot, deal with duplication situation

* Combine getChangeLocation and getBuildLists into one getBuildLists, remove unnecessary code

Co-authored-by: xichen1 <[email protected]>

* Add 1 hour timeouts to all copyArtifacts steps (#2261)

Avoid long hanging builds when copyArtifacts hangs

Signed-off-by: Adam Brousseau <[email protected]>

* Set Lightweight checkout on child jobs (#2251)

Pass along the LIGHT_WEIGHT_CHECKOUT parameter
to the generater in order to have children
with the same value. Generally this will be false
for Ginders and true eveywhere else

Fixes #2250

Signed-off-by: Adam Brousseau <[email protected]>

* Revert "Exclude com/sun/crypto AEAD ByteBuffer tests (#2249)" (#2266)

This reverts commit 2227228.

* AUTO: auto exclude test dacapo-jython impl=openj9 ver=16+ (#2269)

- related: #2256 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: smlambert <[email protected]>

* Only pass LIGHTWEIGHT to DSL if defined (#2270)

- Currently it will put NULL which will cause
  toBoolean() to fail

Related #2251

Signed-off-by: Adam Brousseau <[email protected]>

* Add jdk_vector for jdk16+ (#2267)

Signed-off-by: lanxia <[email protected]>

* AUTO: auto exclude test jdk_foreign_native plat=.*(ppc|arm|390).* (#2280)

- related: #2265 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: adamfarley <[email protected]>

* temporarily fix bug of get changed files (#2277)

* Exclude jdk_net related failed tests temporarily (#2282)

- exclude jdk_net failed tests temporarily
- for jdk 11, 15, and 16 on related  platforms

Signed-off-by: Longyu Zhang <[email protected]>

* add suffix to ignore native tests (#2283)

* add suffix to ignore native tests

* remove unnecessary matrix.bulid_list in target list

* Remove maketest.sh (#2285)

Signed-off-by: [email protected] <[email protected]>

* Add comment-triggered PR build action (#2222)

* Add comment-triggered PR build action (#2199)

Add workflow `action.yml` that triggers on a PR comment starting with the word `action` then runs AQA tests based on the parameters.
Add `action_argparse.py` that parses PR comments to determine the parameters for AQA tests in the `action.yml` workflow.

Co-authored-by: Xichen Pan <[email protected]>
Co-authored-by: patkarns <[email protected]>

* Update indentation for exclusion user guide (#2288)

Signed-off-by: renfeiw <[email protected]>

* Fix reportStatus job running on every comment (#2290)

Prevents reportStatus from running on every comment by checking for the same conditions as parseComment:
- The comment must begin with `run aqa` keyword
- The comment must be a PR comment

* Use any node for copying TAP files in parallel test builds (#2295)

Resolve: #2262

Signed-off-by: lanxia <[email protected]>

* Set ulimit for sharedclasscache multithread tests (#2274)

Signed-off-by: Simon Rushton <[email protected]>

* Add test excluded label for auto exclusion (#2300)

Signed-off-by: renfeiw <[email protected]>

* Change subset to version (#2301)

Signed-off-by: renfeiw <[email protected]>

* Fix GitHub head ref error (#2308)

* test error

* test error

* remove parentheses

* use github.head_ref

* remove test file

* Update userGuide to change subset to version (#2307)

Signed-off-by: renfeiw <[email protected]>

* remove PushOrPRtestbuild.yml (#2309)

* Add alpine-linux and x86-64_solaris platforms (#2304)

* Trial external_custom target

Signed-off-by: Shelley Lambert <[email protected]>

* Update build.xml

Signed-off-by: Shelley Lambert <[email protected]>

* Add alpine-linux platform label

Signed-off-by: Shelley Lambert <[email protected]>

* add bits

Signed-off-by: Shelley Lambert <[email protected]>

* Add x86_solaris

Signed-off-by: Shelley Lambert <[email protected]>

* Remove waitForANodeToBecomeActive post-parallel (#2312)

This step is unnecessary now that we run
on any node. Also remove function as it
was only used for this step.

Follow up to #2295

Signed-off-by: Adam Brousseau <[email protected]>

* Remove ParallelStreamsLoadTest_special_J9 long running modes 113, 614 (#2315)

Modes 113 and 614 take too long to run across all platforms, and
contribute to special.system timeout problems on Windows.

(5) 113: -Xgcpolicy:gencon
-Xjit:count=0,optlevel=warm,gcOnResolve,rtResolve -Xmn512k
-Xnocompressedrefs
aix 8: 23min, 11: 31min
osx 8: 10min, 11: 20min
plinux 8: 18min, 11: 23min
xlinux 8: 25min, 11: 40min
zlinux 8: 12min, 11: 14min
Windows 11: 30min

(20) 614: -Xcompressedrefs -Xgcpolicy:gencon -Xjit:counts="- - - - - - 1
1 1 1000 250 250 - - - 10000 100000
10000",gcOnResolve,rtResolve,sampleInterval=2,scorchingSampleThreshold=10000,quickProfile
-Xmn512k -Xcheck:gc:vmthreads:all:quiet
aix 8: 19min, 11: 27min
osx 8: 17min, 11: 17min
plinux 8: 18min, 11: 22min
xlinux 8: 24min, 11: 33min
zlinux 8: 10min, 11: 14min
Windows 11: 27min

Signed-off-by: Peter Shipton <[email protected]>

* Change Renaissance 0.9.0 to 0.11.0 in build.xml (#2314)

Fixes #2298

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (#2316)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <[email protected]>

* AUTO: auto exclude test renaissance-dec-tree ver=16+ (#2319)

- related: #2255 (comment)

Signed-off-by: GitHub <[email protected]>

Co-authored-by: smlambert <[email protected]>

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (#2325)

Fixes #2316 (comment)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <[email protected]>

* Set parallel machine limit to the total number of machines (#2330)

Resolve: eclipse-openj9/openj9#12088
Signed-off-by: lanxia <[email protected]>

* Convert subset to version (#2329)

- using version in playlists

Signed-off-by: renfeiw <[email protected]>

* Handle a git command's request for a username on Windows (#2287)

If we call git ls-remote on Window, when the repo doesn't exist,
the command asks for a username and hangs.

This change disables the request for a username and provides more
useful error messages. It also handles the problem appropriately,
so instead of failing the build, it correctly sets the repo location
to the non-'u' version.

Added some timeout-handling code as well, in case someone's running
this on a version of git older than 2.3, which may ignore the env
var we're using to suppress the username request.

Signed-off-by: Adam Farley <[email protected]>

* OpenJ9 JDK17 Exclude java/lang/Thread/UncaughtExceptionsTest.java (#2333)

Signed-off-by: Jason Feng <[email protected]>

* Only run foreign native test on x86_64 or aarch64 platforms (#2334)

This test requires CLinker, and the upstream community has no
current intention to port it to new platforms. So we need to exclude
the test on platforms that aren't x86-64 or aarch64.

Signed-off-by: Adam Farley <[email protected]>

* Enable download testimage for jdk8 (#2320)

Signed-off-by: Sophia Guo <[email protected]>

* Ignore leading and trailing whitespace in parsing (#2318)

Also simplifies the mapping of comment/command arguments to outputs.

* os upate to latest (#2331)

* use sw.os.alpine-linux label instead of sw.os.musl for Alpine (#2336)

Signed-off-by: Stewart X Addison <[email protected]>

Co-authored-by: LongyuZhang <[email protected]>
Co-authored-by: Mesbah Alam <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: smlambert <[email protected]>
Co-authored-by: Stewart X Addison <[email protected]>
Co-authored-by: Babneet Singh <[email protected]>
Co-authored-by: Peter Shipton <[email protected]>
Co-authored-by: KKES335 <[email protected]>
Co-authored-by: Kentaro Kuramochi <[email protected]>
Co-authored-by: Lan Xia <[email protected]>
Co-authored-by: Simon Rushton <[email protected]>
Co-authored-by: Jason Feng <[email protected]>
Co-authored-by: AdamBrousseau <[email protected]>
Co-authored-by: Renfei Wang <[email protected]>
Co-authored-by: KONNO Kazuhiro <[email protected]>
Co-authored-by: Deric Cheung <[email protected]>
Co-authored-by: XichenPan <[email protected]>
Co-authored-by: xichen1 <[email protected]>
Co-authored-by: adamfarley <[email protected]>
Co-authored-by: yanshan24 <[email protected]>
Co-authored-by: Shelley Lambert <[email protected]>
Co-authored-by: YananW <[email protected]>
Co-authored-by: Adam Farley <[email protected]>
Co-authored-by: sophia-guo <[email protected]>

* Update testJobTemplate

Testing param separator

* Update testJobTemplate

adding styles to header

* Update testJobTemplate

Categorized all parameters

* Update testJobTemplate

updated CSS variables

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

Testing parameter separator

* Update testJobTemplate

added CSS styles to parameter separators

* Update testJobTemplate to better reflect mockup

* Update testJobTemplate

* update testJobTemplate, added subtitle styling

* fixed typo

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Style parameters in testJobTemplate

* Add link to Grinder Wiki

* edited styling for Grinder wiki link

* edited 'grinder wiki' positioning

* Added padding to 'Grinder Wiki' link

* Updated JDK_BRANCH parameter order

* added spaces back to copyright

* Update some parameters' default values

* Removed extra tab

* Removed Grinder wiki link and separator bg color

* removed extra spaces in testJobTemplate

* added examples in CUSTOM_TARGET

* fixed /n error

* changed multiline string declaration

* added triple quotations around description

* moved CUSTOM_TARGET examples to the right spot

Co-authored-by: LongyuZhang <[email protected]>
Co-authored-by: Mesbah Alam <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: smlambert <[email protected]>
Co-authored-by: Stewart X Addison <[email protected]>
Co-authored-by: Babneet Singh <[email protected]>
Co-authored-by: Peter Shipton <[email protected]>
Co-authored-by: KKES335 <[email protected]>
Co-authored-by: Kentaro Kuramochi <[email protected]>
Co-authored-by: Lan Xia <[email protected]>
Co-authored-by: Simon Rushton <[email protected]>
Co-authored-by: Jason Feng <[email protected]>
Co-authored-by: AdamBrousseau <[email protected]>
Co-authored-by: Renfei Wang <[email protected]>
Co-authored-by: KONNO Kazuhiro <[email protected]>
Co-authored-by: Deric Cheung <[email protected]>
Co-authored-by: XichenPan <[email protected]>
Co-authored-by: xichen1 <[email protected]>
Co-authored-by: adamfarley <[email protected]>
Co-authored-by: yanshan24 <[email protected]>
Co-authored-by: Shelley Lambert <[email protected]>
Co-authored-by: YananW <[email protected]>
Co-authored-by: Adam Farley <[email protected]>
Co-authored-by: sophia-guo <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants