Skip to content

[SPARK-3425] do not set MaxPermSize for OpenJDK 1.8 #2301

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

mattf
Copy link

@mattf mattf commented Sep 6, 2014

Closes #2387

@SparkQA
Copy link

SparkQA commented Sep 6, 2014

QA tests have started for PR 2301 at commit 2cfafd8.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Sep 6, 2014

QA tests have finished for PR 2301 at commit 2cfafd8.

  • This patch passes unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@@ -105,7 +105,7 @@ else
exit 1
fi
fi
JAVA_VERSION=$($RUNNER -version 2>&1 | sed 's/java version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q')
JAVA_VERSION=$($RUNNER -version 2>&1 | sed 's/java\|openjdk version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This regex seems wrong.. it now breaks the case when you print "java version X". You need parens around the (java\|openjdk). Also, are you sure that OpenJDK 1.8 prints this string instead of "java version X"? I tried 1.6 and it still prints "java".

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice catch. i had tried parens, but they don't work. it'll have to be a .*

$ java -version
openjdk version "1.8.0_11"
OpenJDK Runtime Environment (build 1.8.0_11-b12)
OpenJDK 64-Bit Server VM (build 25.11-b02, mixed mode)
$ echo 'openjdk version "1.8.0_11"' | sed 's/java\|openjdk version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q'
18
$ echo 'java version "1.8.0_11"' | sed 's/java\|openjdk version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q'   
 version "1.8.0_11"
$ echo 'java version "1.8.0_11"' | sed 's/(java\|openjdk) version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q'
java version "1.8.0_11"
$ echo 'openjdk version "1.8.0_11"' | sed 's/(java\|openjdk) version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q'
openjdk version "1.8.0_11"
$ echo 'java version "1.8.0_11"' | sed 's/.* version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q'
18
$ echo 'openjdk version "1.8.0_11"' | sed 's/.* version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q'
18

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would work if you add backslahes before the open and close parentheses and increment the final numbers to \2 and \3.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you're correct

@SparkQA
Copy link

SparkQA commented Sep 8, 2014

QA tests have started for PR 2301 at commit 7df7c63.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Sep 8, 2014

QA tests have finished for PR 2301 at commit 7df7c63.

  • This patch fails unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@mattf
Copy link
Author

mattf commented Sep 8, 2014

This patch fails unit tests.

failures appear to be from mima and hive, unrelated to this patch

@pwendell
Copy link
Contributor

pwendell commented Sep 8, 2014

Jenkins, retest this please.

@SparkQA
Copy link

SparkQA commented Sep 8, 2014

QA tests have started for PR 2301 at commit 7df7c63.

  • This patch does not merge cleanly!

@mattf
Copy link
Author

mattf commented Sep 8, 2014

rebased on new master

jenkins, retest this please

@SparkQA
Copy link

SparkQA commented Sep 8, 2014

QA tests have finished for PR 2301 at commit 7df7c63.

  • This patch passes unit tests.
  • This patch does not merge cleanly!

@mattf
Copy link
Author

mattf commented Sep 8, 2014

This patch does not merge cleanly!

rebased already, please try again

@jkbradley
Copy link
Member

LGTM (@mattf I was asked to check it out.) I only tested this patch with Java 1.7.0_60.

@mattf
Copy link
Author

mattf commented Sep 14, 2014

@mateiz @pwendell pls take another look

@pwendell
Copy link
Contributor

Jenkins, test this please. LGTM pending tests.

@pwendell
Copy link
Contributor

Note: need to add "Closes #2387" to the description.

@SparkQA
Copy link

SparkQA commented Sep 15, 2014

QA tests have started for PR 2301 at commit 20f3c09.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Sep 15, 2014

QA tests have finished for PR 2301 at commit 20f3c09.

  • This patch passes unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@asfgit asfgit closed this in fe2b1d6 Sep 15, 2014
@mattf mattf deleted the SPARK-3425 branch September 15, 2014 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants