Sail Files

Overview

You can find the release summary in the documentation.

The PySail Python package is available on PyPI.

What's Changed

• fix: correct percent-encoded partition directories in timestamp-partitioned Delta Table by @lonless9 in https://github.com/lakehq/sail/pull/1669
• chore: update Copilot setup by @linhr in https://github.com/lakehq/sail/pull/1676
• chore: optimize mtime scripts by @linhr in https://github.com/lakehq/sail/pull/1677
• fix: incorrect comment by @shehabgamin in https://github.com/lakehq/sail/pull/1685
• chore: address clippy 1.95.0 warnings by @lonless9 in https://github.com/lakehq/sail/pull/1679
• fix: check cross join enabled config for joins without criteria by @Copilot in https://github.com/lakehq/sail/pull/1688
• fix: retrieve Spark version from the environment for Spark Connect by @Copilot in https://github.com/lakehq/sail/pull/1687
• feat: incremental version checksum for Delta Lake by @Copilot in https://github.com/lakehq/sail/pull/1675
• fix: normalize datetime64[ns] to datetime64[us] in assert_frame_equal patch by @Copilot in https://github.com/lakehq/sail/pull/1689
• feat: add to_variant_object function by @davidlghellin in https://github.com/lakehq/sail/pull/1635
• chore: add workflow for patched Spark package artifacts by @linhr in https://github.com/lakehq/sail/pull/1700
• chore: disable JVM-dependent tests by @shehabgamin in https://github.com/lakehq/sail/pull/1703
• fix: implement isLocal and isStreaming plan analysis in Spark Connect by @Copilot in https://github.com/lakehq/sail/pull/1696
• feat: add schema_of_variant_agg aggregate function by @davidlghellin in https://github.com/lakehq/sail/pull/1640
• chore: patch PySpark client for cleanup issue by @linhr in https://github.com/lakehq/sail/pull/1704
• fix: preserve timestamp type and timezone in DATE_TRUNC by @shehabgamin in https://github.com/lakehq/sail/pull/1717
• chore: update deps by @shehabgamin in https://github.com/lakehq/sail/pull/1724
• fix: bump rust to 1.95 by @shehabgamin in https://github.com/lakehq/sail/pull/1725
• chore: add custom agent for Spark parity tests by @linhr in https://github.com/lakehq/sail/pull/1709
• deps(cargo): bump mimalloc from 0.1.48 to 0.1.49 in the all group by @dependabot[bot] in https://github.com/lakehq/sail/pull/1733
• deps(npm): bump the all group with 4 updates by @dependabot[bot] in https://github.com/lakehq/sail/pull/1732
• fix: include persistent views in catalog and resolve view column types by @shehabgamin in https://github.com/lakehq/sail/pull/1686
• feat: support spark_partition_id by @Copilot in https://github.com/lakehq/sail/pull/1727
• feat: initial alter table support for Delta Lake by @lonless9 in https://github.com/lakehq/sail/pull/1708
• fix: last_day/next_day now accept Timestamp input and ansi mode by @davidlghellin in https://github.com/lakehq/sail/pull/1719
• feat: support escape char for like and ilike by @shehabgamin in https://github.com/lakehq/sail/pull/1718
• feat: initial deletion vectors support for Delta Lake by @lonless9 in https://github.com/lakehq/sail/pull/1673
• fix: coerce view types at query output for Arrow compatibility by @pomykalakyle in https://github.com/lakehq/sail/pull/1738
• fix: validate Python UDF usage in join conditions by @Copilot in https://github.com/lakehq/sail/pull/1694
• feat: schema_of_csv by @Copilot in https://github.com/lakehq/sail/pull/1707
• fix: clean up codec for next_day by @linhr in https://github.com/lakehq/sail/pull/1743
• test: add comprehensive ntile window function feature tests by @davidlghellin in https://github.com/lakehq/sail/pull/1721
• feat: support GeneratedColumns for Delta Lake by @lonless9 in https://github.com/lakehq/sail/pull/1701
• refactor: consolidate timestamp format utilities by @Copilot in https://github.com/lakehq/sail/pull/1745
• test: add comprehensive NaN/Infinity cast feature tests by @davidlghellin in https://github.com/lakehq/sail/pull/1723
• fix: support TIME literal and time() function for Spark 4.1.1 by @Copilot in https://github.com/lakehq/sail/pull/1739
• feat: support Python UDTF analyze method for dynamic return type by @Copilot in https://github.com/lakehq/sail/pull/1740
• fix: levenshtein per-row threshold and scalar NULL handling by @davidlghellin in https://github.com/lakehq/sail/pull/1511
• fix: arrays_zip NULL and zero-arg handling by @davidlghellin in https://github.com/lakehq/sail/pull/1722
• refactor: use table source directly for system table physical planning by @Copilot in https://github.com/lakehq/sail/pull/1746
• chore: update Copilot instructions by @linhr in https://github.com/lakehq/sail/pull/1747
• docs: add Ibis integration guide by @kunallakhanpal in https://github.com/lakehq/sail/pull/1749
• fix: align error messages with Spark 3.5.7 parity tests by @Copilot in https://github.com/lakehq/sail/pull/1756
• chore: cargo update by @shehabgamin in https://github.com/lakehq/sail/pull/1772
• docs: document Spark Connect replacements for JVM-only sparkContext patterns by @Copilot in https://github.com/lakehq/sail/pull/1777
• docs: surface Spark compatibility script in README and migration guide by @shehabgamin in https://github.com/lakehq/sail/pull/1776
• docs: rework Spark compatibility section in README by @shehabgamin in https://github.com/lakehq/sail/pull/1778
• docs: add minor clarification by @linhr in https://github.com/lakehq/sail/pull/1781
• docs: add note about local time zone configuration by @Copilot in https://github.com/lakehq/sail/pull/1774
• fix: add schema_of_variant_agg to codec and improve variant field validation by @lonless9 in https://github.com/lakehq/sail/pull/1784
• fix: spark parity for concat_ws, fillna, and withColumn by @shehabgamin in https://github.com/lakehq/sail/pull/1775
• feat: implement quote() string function by @Copilot in https://github.com/lakehq/sail/pull/1780
• feat: add Hive Metastore catalog provider with HA and Kerberos support by @santosh-d3vpl3x in https://github.com/lakehq/sail/pull/1768
• docs: fix min_sasl_qop option for HMS by @linhr in https://github.com/lakehq/sail/pull/1787
• test: pytest container by @lonless9 in https://github.com/lakehq/sail/pull/1631
• feat: support user-defined metadata for Delta Lake by @lonless9 in https://github.com/lakehq/sail/pull/1752
• feat: implement product aggregate function by @Copilot in https://github.com/lakehq/sail/pull/1792
• feat: implement DML operation foundation for Iceberg by @lonless9 in https://github.com/lakehq/sail/pull/1674
• refactor: remove TableFormat::create_provider by @Copilot in https://github.com/lakehq/sail/pull/1788
• refactor: remove logical extension node for Delta scans by @Copilot in https://github.com/lakehq/sail/pull/1793
• fix: case-insensitive file extension matching for listing table formats by @shehabgamin in https://github.com/lakehq/sail/pull/1807
• chore: prepare v0.6.1 by @linhr in https://github.com/lakehq/sail/pull/1811

Full Changelog: https://github.com/lakehq/sail/compare/v0.6.0...v0.6.1