Bytewax Files

Overview

• bytewax.inputs.SimplePollingSource now allows you to retain state to support at-least-once delivery.

• Fixes a bug when using bytewax.operators.windowing.SlidingWindower where values would be assigned to an extra window if their timestamps were near the end of the correct window.

• Upstream type hints on bytewax.connectors.kafka.operators.serialize_key, bytewax.connectors.kafka.operators.serialize_value, and bytewax.connectors.kafka.operators.serialize have been made more broad to support all Kafka serializers, like confluent_kafka.serialization.StringSerializer.

• Breaking change - Fixes a bug which caused two of the same types of windowing operators in a dataflow to spuriously result in a ValueError. This fix invalidates any recovery data for all windowing operators; it is recommended to delete and re-create the recovery store if you are using windowing operators.

• Fixes a performance issue where bytewax.operators.StatefulBatchLogic.notify_at (and thus many of the other stateful operators' notify_at derived from it) was being called superfluously.

What's Changed

• Only call notify_at on keys awoken that activation by @davidselassie in https://github.com/bytewax/bytewax/pull/472
• Add xrefs to visualization API docs by @davidselassie in https://github.com/bytewax/bytewax/pull/473
• Adds a TestingSource.PAUSE special item by @davidselassie in https://github.com/bytewax/bytewax/pull/474
• Comment on how final operators can't be used on infinite streams by @davidselassie in https://github.com/bytewax/bytewax/pull/477
• re initialize tutorial documentation - by @lfunderburk in https://github.com/bytewax/bytewax/pull/464
• fold_window did not have operator annotation by @davidselassie in https://github.com/bytewax/bytewax/pull/481
• Fix xrefs in windowing docs by @davidselassie in https://github.com/bytewax/bytewax/pull/482
• Correct Kafka serialization type hints by @davidselassie in https://github.com/bytewax/bytewax/pull/483
• init order book guide migration by @lfunderburk in https://github.com/bytewax/bytewax/pull/480
• Fix issue with SlidingWindower assigning to too many windows by @davidselassie in https://github.com/bytewax/bytewax/pull/486
• init guide migration missing values by @lfunderburk in https://github.com/bytewax/bytewax/pull/484
• fix link missing data by @lfunderburk in https://github.com/bytewax/bytewax/pull/489
• Changes due to RTD deprecations by @davidselassie in https://github.com/bytewax/bytewax/pull/488
• init migration profiling time series by @lfunderburk in https://github.com/bytewax/bytewax/pull/490
• Migration guide Recoverable cart by @lfunderburk in https://github.com/bytewax/bytewax/pull/491
• Allow SimplePollingSource to have basic recovery state by @davidselassie in https://github.com/bytewax/bytewax/pull/492
• Make Sphinx emit entire traceback when building docs by @davidselassie in https://github.com/bytewax/bytewax/pull/493
• Namespace module by @whoahbot in https://github.com/bytewax/bytewax/pull/494
• Prepare for v0.20.2 release by @whoahbot in https://github.com/bytewax/bytewax/pull/496

Full Changelog: https://github.com/bytewax/bytewax/compare/v0.20.1...v0.21.0