15 Pull requests opened by 14 people

• [SPARK-47193][SQL] Ensure SQL conf is propagated to executors when actions are called on RDD returned by `Dataset#rdd`

  #48325 opened Oct 2, 2024

• [SPARK-49863][SQL] Fix NormalizeFloatingNumbers to preserve nullability of nested structs

  #48331 opened Oct 3, 2024

• [SPARK-42838][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_2000

  #48332 opened Oct 3, 2024

• [SPARK-49827][SQL] Fetching all partitions from hive metastore in batches

  #48337 opened Oct 3, 2024

• [SPARK-49604][SQL] GROUP_BY_POS_OUT_OF_RANGE should not appear if group by Literal

  #48340 opened Oct 3, 2024

• [SPARK-49873][SQL] Assign proper error class for _LEGACY_ERROR_TEMP_1325

  #48346 opened Oct 4, 2024

• [SPARK-37178][ML] Add Target Encoding to ml.feature

  #48347 opened Oct 4, 2024

• [SPARK-49876][CONNECT] Get rid of global locks from Spark Connect Service

  #48350 opened Oct 4, 2024

• [SPARK-49877][SQL] Change classifyException function signature: add isRuntime argument

  #48351 opened Oct 4, 2024

• [WIP][SPARK-49881][SQL] Skipping DeduplicateRelations rule conditionally to improve analyzer perf

  #48354 opened Oct 4, 2024

• [DO-NOT-REVIEW] [SPARK-49883][SS] State Store Checkpoint Structure V2 Integration with RocksDB and RocksDBFileManager

  #48355 opened Oct 4, 2024

• [DO-NOT-REVIEW] [SPARK-49884][SS] State Store Checkpoint Structure V2 Backward compatibility Tests

  #48356 opened Oct 4, 2024

• [SPARK-49868][DOC][FOLLOWUP] Update docs for executor failure tracking configrations

  #48358 opened Oct 4, 2024

• [WIP][SPARK-49564][SQL] Add SQL pipe syntax for set operations

  #48359 opened Oct 5, 2024

• [MINOR][SQL] Move iterator.hasNext into try block

  #48360 opened Oct 5, 2024

26 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [SPARK-49768][SQL] Provide error conditions for `make_date`/`make_timestamp` errors `_LEGACY_ERROR_TEMP_2000`

  #48242 commented on Oct 5, 2024 • 21 new comments

• [SPARK-49854][SQL] Clone artifact manager during session clone

  #48320 commented on Oct 5, 2024 • 16 new comments

• [SPARK-49846][SS] Add numUpdatedStateRows and numRemovedStateRows metrics for use with transformWithState operator

  #48317 commented on Oct 4, 2024 • 10 new comments

• [SPARK-49773][SQL] Uncaught Java exception from `make_timestamp()` with bad timezone

  #48260 commented on Oct 5, 2024 • 7 new comments

• Respect user schema nullability for file data sources when DSV2 Table is used.

  #48321 commented on Oct 4, 2024 • 4 new comments

• [SPARK-49549][SQL] Assign a name to the error conditions _LEGACY_ERROR_TEMP_3055, 3146

  #48288 commented on Oct 2, 2024 • 4 new comments

• [SPARK-49802][SS] Add support for read change feed for map and list types used in stateful processors

  #48274 commented on Oct 3, 2024 • 4 new comments

• [SPARK-49744][SS][PYTHON] Implement TTL support for ListState in TransformWithStateInPandas

  #48253 commented on Oct 4, 2024 • 3 new comments

• [SPARK-49748][CORE] Add `getCondition` and deprecate `getErrorClass` in `SparkThrowable`

  #48196 commented on Oct 3, 2024 • 2 new comments

• [SPARK-49857][CORE] Add storageLevel to Dataset localCheckpoint API

  #48324 commented on Oct 4, 2024 • 1 new comment

• [SPARK-49683][SQL]Block trim collations on all collation code paths.

  #48311 commented on Oct 3, 2024 • 1 new comment

• [SPARK-49829][SS] Revise the optimization on adding input to state store in stream-stream join (correctness fix)

  #48297 commented on Oct 4, 2024 • 1 new comment

• [SPARK-49631][SQL] Remove the ANSI config suggestion in ARITHMETIC_OVERFLOW

  #48206 commented on Oct 4, 2024 • 1 new comment

• [SPARK-49601][SS][PYTHON] Support Initial State Handling for TransformWithStateInPandas

  #48005 commented on Oct 3, 2024 • 1 new comment

• [SPARK-49564][SQL] Add SQL pipe syntax for the JOIN operator

  #48270 commented on Oct 5, 2024 • 0 new comments

• [SPARK-49695][SQL] Postgres fix xor push-down

  #48144 commented on Oct 5, 2024 • 0 new comments

• [SPARK-49821][SS][PYTHON] Implement MapState and TTL support for TransformWithStateInPandas

  #48290 commented on Oct 2, 2024 • 0 new comments

• [SPARK-49827][SQL] Adding batches with retry mechanism for fetching …

  #48296 commented on Oct 4, 2024 • 0 new comments

• [SPARK-49491][SQL] Replace AnyRefMap with HashMap

  #48128 commented on Oct 3, 2024 • 0 new comments

• [SPARK-48155][FOLLOWUP][SQL] AQEPropagateEmptyRelation for left anti join should check if remain child is just BroadcastQueryStageExec

  #48300 commented on Oct 4, 2024 • 0 new comments

• [SPARK-49461][SS] Persistent Checkpoint ID to commit logs and read it back

  #47932 commented on Oct 3, 2024 • 0 new comments

• [DO-NOT-REVIEW][DRAFT] integration3

  #48318 commented on Oct 4, 2024 • 0 new comments

• [SPARK-49411][SS] Communicate State Store Checkpoint ID between driver and stateful operators

  #47895 commented on Oct 4, 2024 • 0 new comments

• [SPARK-49162][SQL] Push down date_trunc function

  #47666 commented on Oct 4, 2024 • 0 new comments

• [SPARK-49856][SQL] Refactor the compileExpression of JdbcDialect for simplify the subclass.

  #48322 commented on Oct 4, 2024 • 0 new comments

• [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform`

  #47493 commented on Oct 4, 2024 • 0 new comments