Benthos Files

For installation instructions check out the getting started guide.

Added

• elasticsearch: Added support for using Elasticsearch API keys for authentication. (@dbason, #4492)
• oracledb_cdc: Oracle CDC connector now publishes an oracledb_cdc_publish_lag_ns metric tracking latency between database commits and event publication. (@josephwoodward, #4520)
• oracledb_cdc: Oracle CDC connector now supports a configurable min_scn_window_size parameter to skip mining cycles when the SCN gap is too small. (@josephwoodward, #4530)
• aws_bedrock_embeddings: Support Cohere input_type and v4 response. (@squiidz, #4473)

Fixed

• bigquery: BigQuery CDC now rejects writes to pre-existing tables that lack a PRIMARY KEY, with a clear error message guiding users to add one. (@squiidz, #4503)
• bigquery: Fix CDC row-error indexing and metric consistency. (@squiidz, #4504)
• doris: Corrected the Doris Stream Load connector release version from 4.86.0 to 4.96.0. (@josephwoodward, #4523)
• oracledb_cdc: Oracle CDC connector now gracefully handles log recycle errors (ORA-01368) by logging a warning and retrying. (@josephwoodward, #4516)
• postgresql_cdc: PostgreSQL CDC connector now correctly passes sslmode=require in the DSN instead of having it overwritten by TLS configuration. (@josephwoodward, #4518)
• protobuf: Disabled hyperpb profile-guided recompilation in protobuf and schema_registry_decode processors to prevent unbounded heap growth from profile-retention memory leaks. (@squiidz, #4527)
• aws_dynamodb_cdc: Only checkpoint contiguously acked positions. (@squiidz, #4510)

Changed

• oracledb_cdc: Oracle CDC connector now begins at the current SCN upon connector start, with SCN fetching moved into the Connect function. (@josephwoodward, #4509)
• oracledb_cdc: Oracle CDC connector implements adaptive SCN windowing and improves LogMiner session reuse. (@josephwoodward, #4531)
• oracledb_cdc: Reduce allocations of parsing redo log queries to increase throughput. (@josephwoodward, #4533)

The full change log can be found here.