Pathway Files

Added

• JetStream extension is now supported in both NATS read and write connectors.
• The Iceberg connectors now support Glue as a catalog backend.
• New Table.add_update_timestamp_utc function for tracking update time of rows in the table

Changed

• BREAKING The API for the Iceberg connectors has changed. The catalog parameter is now required in both pw.io.iceberg.read and pw.io.iceberg.write. This parameter can be either of type pw.io.iceberg.RestCatalog or pw.io.iceberg.GlueCatalog, and it must contain the connection parameters.
• BREAKING paddlepaddle is no longer a dependency of the Pathway package. The reason is that choosing a specific version for the hardware it will be run on is advantageous from the performance point of view. To install paddlepaddle follow instructions on https://www.paddlepaddle.org.cn/en/install/quick.
• pw.xpacks.llm.question_answering.BaseRAGQuestionAnswerer now supports document reranking. This enables two-stage retrieval where initial vector similarity search is followed by reranking to improve document relevance ordering.

Fixed

• Endpoints created by pw.io.http.rest_connector now accept requests both with and without a trailing slash. For example, /endpoint/ and /endpoint are now treated equivalently.
• Schemas that inherit from other schemas now automatically preserve all properties from their parent schemas.
• Fixed an issue where the persistence configuration failed when provided with a relative filesystem path.
• Fixed unique name autogeneration for the Python connectors.