2025년 Snowpark Connect for Spark 릴리스 정보¶

새로운 기능¶

• Relax version requirements for grpcio and aiobotocore.

개선 사항¶

• Specify dependencies version in meta.yaml.

• Build compiled and architecture-specific conda package.

• Ensure all CloudPickleSerializer.loads are not done in TCM.

• Include OSS SQL tests that start with the WITH clause.

• Do not upload Spark jars when running the server for pyt.

• Update internal queries count.

버그 수정 사항¶

• Fix tests for tcm.

• Fix CSV column name discrepancy from Spark.

• Use type cache for empty frames.

• Resolve Windows OSS runner general issues.

개선 사항¶

• Generate unique workload names.

Bug Fixes¶

• Fix staged file reading.

새로운 기능¶

• Add parameter for view creation strategies.

• Support string <-> year month interval.

• Support multiple pivot columns and aliases for pivot values in Spark SQL.

• Integrate OpenTelemetry span and traces.

개선 사항¶

없습니다.

버그 수정 사항¶

• Add a trailing slash for remove command.

• Invalid GROUP BY issue with aggregation function and nilary functions.

• Notebook exceeds gRPC maximum message size.

• Fix temporary view creation with colliding names.

• array_size with null argument.

• Fix for $.0 JSON array access in get_json_object function.

• Fix self ANTI and SEMI LEFT joins.

• Handle different types in SQL function range.

• Fixed temporary view describe.

새로운 기능¶

• Add rowToInferSchema for CSV reading.

• Support INSERT INTO with CTE SQL command.

• I/O changes to add _SUCCESS file generation and metadata file filtering.

• update(submit): Support installing Snowpark Connect for Spark in the Snowpark Submit client container.

개선 사항¶

없습니다.

버그 수정 사항¶

• Fix _SUCCESS path update.

• Throw error on remove failure update.

• Sequence function supporting integral types inputs.

• Fix types in empty CreateTempViewUsing.

• Fix Parquet file repartitioning on write.

• Resolve aliases in ORDER BY clause correctly.

• Remove scope temp session parameter.

• Fixed multiple self joins with join condition.

• Fix column name resolution in pivot.

• SQL parser aware of session timezone.

• Interval type coercion with other types.

• Fix having with nested CTEs.

• Improve qualified name resolution in Spark.

새로운 기능¶

• Add script to run on the output from Git action for merging SQLs.

• Add --rebuild-whl parameter to notebook test runner.

• Add support for both qualifiers after join.

개선 사항¶

없습니다.

버그 수정 사항¶

• Support escape parameter in SQL LIKE commands.

• Overwrite bug in partitions.

• Validate column count on INSERT.

• Incompatibility for pow with NAN.

• Cross JOIN with condition.

• Column attribution logic in nested queries.

• Update error message for interval test.

• String type coercion in set operation UNION and EXCEPT, coerce NUMERIC, DATE, DATETIME to STRING.

• Correctly resolve Snowpark columns after a full outer self JOIN.

• Expression in aggregate function might be zero improvement.

• Update: Revert “[SCOS GA BUG] string type coercion in set opera”

• DataFrame union of decimal type columns now widen as necessary.

• String type coercion in set operation UNION and EXCEPT, coerce NUMERIC, DATE, DATETIME to STRING (part1).

• Object not existed issue in TCM.

• Fix to_binary(x, 'hex') where x has odd number of letters and digits.

• Fix joins with empty tables.

• Fix HAVING clause to prioritize grouping columns over aggregate aliases with same name.

새로운 기능¶

• RepairTable 지원

• :code:`jdk4py`를 |spconnect|의 선택적 종속성으로 지정하여 최종 사용자를 위한 Java 홈 구성을 간소화합니다.

• 더 많은 간격 유형 사례를 지원합니다.

개선 사항¶

없습니다.

버그 수정 사항¶

• 한정자를 리팩터링하여 Join 문제를 해결합니다.

• 필터 및 정렬 순서 표현식을 허용하도록 :code:`percentile_cont`를 수정합니다.

• histogram_numeric UDAF를 수정합니다.

• 여러 인자와 함께 호출할 때 COUNT 함수를 수정합니다.

새로운 기능¶

• GROUP BY 절이 명시적으로 선택된 경우 해당 절에서 표현식을 지원하도록 했습니다.

• 더 나은 문제 해결을 위해 오류 메시지에 오류 코드를 추가했습니다.

개선 사항¶

없습니다.

버그 수정 사항¶

• 지원되지 않는 캐스팅 문제를 해결하도록 윈도우 함수를 수정했습니다.