Tags: peter-toth/spark
Tags
HOTFIX-5670: CDPD-58080: [SPARK-32951][SQL] Foldable propagation from… … Aggregate This PR adds foldable propagation from `Aggregate` as per: apache#29771 (comment) This is an improvement as `Aggregate`'s `aggregateExpressions` can contain foldables that can be propagated up. No. New UT. Closes apache#29816 from peter-toth/SPARK-32951-foldable-propagation-from-aggregate. Authored-by: Peter Toth <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]> (cherry picked from commit f03c035) Change-Id: Ia6ed87cb7001eb3fbd40e69997e40fef455dbfb2
HOTFIX-5661: CDPD-57535: Revert temporary workaround pinning snakeyam… …l to 2.0 not vulnerable to CVE-2022-1471 This reverts commit 093aaf5d29fa0ae3c4e94a319974dac8d594ac21. Change-Id: Ic6f2242b4feabc0dc44d62834a63083b4f934d40 (cherry picked from commit dd2803e92190dda40eac6ad56698e4b51b57ab1c) (cherry picked from commit 2a1e824)
CDPD-55116: [LIVY-975][SPARK-41958][CORE] Disallow arbitrary custom c… …lasspath with proxy user in cluster mode This PR proposes to disallow arbitrary custom classpath with proxy user in cluster mode by default. To avoid arbitrary classpath in spark cluster. Yes. User should reenable this feature by `spark.submit.proxyUser.allowCustomClasspathInClusterMode`. Manually tested. Closes apache#39474 from Ngone51/dev. Change-Id: I4087d953997c61c357b592e1e0ce984e699d6193 Lead-authored-by: Peter Toth <[email protected]> Co-authored-by: Yi Wu <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit c79f8cc93d94b74669a5947988cf1ca1109edeb0)
CDPD-57535: Revert temporary workaround pinning snakeyaml to 2.0 not … …vulnerable to CVE-2022-1471 This reverts commit 093aaf5d29fa0ae3c4e94a319974dac8d594ac21. Change-Id: Ic6f2242b4feabc0dc44d62834a63083b4f934d40 (cherry picked from commit dd2803e92190dda40eac6ad56698e4b51b57ab1c)
CDPD-57535: Revert temporary workaround pinning snakeyaml to 2.0 not … …vulnerable to CVE-2022-1471 This reverts commit 093aaf5d29fa0ae3c4e94a319974dac8d594ac21. Change-Id: Ic6f2242b4feabc0dc44d62834a63083b4f934d40 (cherry picked from commit dd2803e92190dda40eac6ad56698e4b51b57ab1c)
CDPD-53193. Fire INSERT events via HMS after DML actions from Spark Change-Id: I8b261d96c1ffc45eeae18bec06568adda27e5530
CDPD-56258. [SPARK-41958][CORE] Disallow arbitrary custom classpath w… …ith proxy user in cluster mode This PR proposes to disallow arbitrary custom classpath with proxy user in cluster mode by default. To avoid arbitrary classpath in spark cluster. Yes. User should reenable this feature by `spark.submit.proxyUser.allowCustomClasspathInClusterMode`. Manually tested. Closes apache#39474 from Ngone51/dev. Change-Id: I4087d953997c61c357b592e1e0ce984e699d6193 Lead-authored-by: Peter Toth <[email protected]> Co-authored-by: Yi Wu <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit c79f8cc93d94b74669a5947988cf1ca1109edeb0)
CDPD-56258. [SPARK-41958][CORE] Disallow arbitrary custom classpath w… …ith proxy user in cluster mode This PR proposes to disallow arbitrary custom classpath with proxy user in cluster mode by default. To avoid arbitrary classpath in spark cluster. Yes. User should reenable this feature by `spark.submit.proxyUser.allowCustomClasspathInClusterMode`. Manually tested. Closes apache#39474 from Ngone51/dev. Change-Id: I4087d953997c61c357b592e1e0ce984e699d6193 Lead-authored-by: Peter Toth <[email protected]> Co-authored-by: Yi Wu <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit c79f8cc93d94b74669a5947988cf1ca1109edeb0)
PreviousNext