Benthos Files

For installation instructions check out the getting started guide.

Added

• postgres_cdc: PostgreSQL CDC events now include commit_ts_ms metadata field with the transaction commit timestamp for insert, update, and delete operations. (@josephwoodward, #4554)

Fixed

• aws_dynamodb_cdc: DynamoDB Streams connector now recovers from expired shard iterators by re-acquiring fresh iterators from the last read position, eliminating data gaps on prolonged backpressure or idle periods. (@squiidz, #4545)
• file: File output now validates paths to reject OS-specific invalid characters (colons on macOS, control characters and special chars on Windows, NUL on all platforms) that cause silent data loss. (@twmb, #4053)
• oracledb_cdc: Fixed goroutine leak in streaming reconnect loop and added time-to-first-row metric for LogMiner performance tracking. (@josephwoodward, #4540)

Changed

• general: try_catch processor is now available in cloud distributions alongside other try/catch processors. (@josephwoodward, #4562)
• oracledb_cdc: Snapshot messages now include the current SCN in metadata, improving CDC standard conformance for change data capture operations. (@josephwoodward, #4542)
• sentry: Migrated sentry_capture processor to sentry-go v0.47.0 by attaching extras as a context instead of the removed SetExtras API. (@twmb, #4549)

Unreleased

Fixed

• aws_dynamodb_cdc: The CDC input now recovers automatically from an expired DynamoDB Streams shard iterator (ExpiredIteratorException), which previously caused an affected shard to retry the dead iterator indefinitely and stall until a pod restart. The shard now obtains a fresh iterator and resumes from the last read position without a data gap.

The full change log can be found here.