What's Changed
- Fix multiple query by @wudidapaopao in https://github.com/chdb-io/chdb/pull/348
- Patch: split Resize/StrictResize to avoid lock contention by @wudidapaopao in https://github.com/chdb-io/chdb/pull/349
- Improve the prompt messages of the command-line tool by @wudidapaopao in https://github.com/chdb-io/chdb/pull/345
- Add version guide by @auxten in https://github.com/chdb-io/chdb/pull/351
-
Add PyArrow RecordBatchReader support for streaming data export by @wudidapaopao in https://github.com/chdb-io/chdb/pull/354
:::python
Example of Using PyArrow RecordBatchReader with
deltalake.write_deltalake
import pyarrow as pa from deltalake import write_deltalake from chdb import session as chs
sess = chs.Session()
Get streaming result in arrow format
stream_result = sess.send_query("SELECT * FROM numbers(100000)", "Arrow")
Create RecordBatchReader with custom batch size (default rows_per_batch=1000000)
batch_reader = stream_result.record_batch(rows_per_batch=10000)
Use RecordBatchReader with external libraries like Delta Lake
write_deltalake( table_or_uri="./my_delta_table", data=batch_reader, mode="overwrite" )
stream_result.close()
sess.close()
Full Changelog: https://github.com/chdb-io/chdb/compare/v3.4.1...v3.5.0