ReplicaDB Files

What's Changed

This release focuses on PostgreSQL binary COPY performance optimization and cross-database compatibility improvements.

🚀 Major Enhancements

• PostgreSQL Binary COPY Support: Implemented high-performance binary COPY protocol for PostgreSQL sinks, significantly improving replication throughput
• Cross-Database Binary COPY: Enhanced binary COPY to support replication from MySQL, MongoDB, SQL Server, Oracle, and DB2 sources to PostgreSQL sinks
• Robust Type Encoding: Added comprehensive binary encoding for NUMERIC, FLOAT/REAL/DOUBLE, DATE, TIME, and TIMESTAMP types with automatic text fallback
• SQL Server IMAGE Support: Added replication support for SQL Server IMAGE (deprecated BLOB) data type

🐛 Bug Fixes

• Fixed DB2 JDBC compatibility by properly implementing JDBC spec for wasNull() calls after getXXX() operations
• Fixed DB2 test schema to use BIGINT instead of NUMERIC(19) for proper type alignment
• Fixed SQL Server source schema for float types in test scenarios
• Added null checks for DATE/TIME/TIMESTAMP in binary encoding to prevent null pointer exceptions
• Excluded Oracle2OracleCrossVersionLobTest from integration tests to improve CI/CD reliability

🔧 Improvements

• Complete JDBC specification compliance for all type handlers in binary COPY operations
• Enhanced PostgreSQL binary COPY with MySQL and MongoDB source compatibility
• Improved error handling with automatic fallback to text encoding when binary encoding fails
• Added comprehensive documentation for schema-flexible binary COPY implementation
• Optimized type detection and conversion logic for cross-database scenarios

🧪 CI/CD & Testing

• Updated test fixtures for SQL Server IMAGE replication
• Added binary COPY integration tests for PostgreSQL
• Fixed test mock implementations with missing JDBC overrides
• Enhanced test coverage for cross-database binary COPY scenarios

📚 Infrastructure

• Updated CI workflow to exclude flaky Oracle LOB tests
• Improved test reliability and execution time

Performance Impact

Binary COPY provides significant performance improvements for PostgreSQL sinks:

• 2-5x faster for bulk data transfer compared to text-based INSERT operations
• Reduced network overhead with compact binary format
• Automatic fallback ensures compatibility when binary encoding is not supported

Commits

• 73d078d: fix: Correct DB2 test schema - use BIGINT instead of NUMERIC(19) (Oscar Salvador Magallanes)
• c4be08c: fix: Complete JDBC spec compliance for all type handlers in binary COPY (Oscar Salvador Magallanes)
• 82ea12b: fix: Fix DB2 JDBC compatibility by following JDBC spec for wasNull() calls (Oscar Salvador Magallanes)
• e737a03: fix: Disable binary COPY for DB2 sources due to JDBC driver incompatibility (Oscar Salvador Magallanes)
• 3839588: feat: Improve PostgreSQL binary COPY with MySQL/MongoDB compatibility (Oscar Salvador Magallanes)
• 825b574: docs: Add comprehensive plan for schema-flexible binary COPY (Oscar Salvador Magallanes)
• b15269e: revert: Re-enable binary COPY for all database sources (Oscar Salvador Magallanes)
• 551dacf: fix: Disable binary COPY for cross-database replication (Oscar Salvador Magallanes)
• 6ccae4c: fix: Add null checks for DATE/TIME/TIMESTAMP in binary encoding (Oscar Salvador Magallanes)
• c610eb8: fix: Exclude Oracle2OracleCrossVersionLobTest from integration tests (Oscar Salvador Magallanes)
• 52d1351: fix: Correct SQL Server source schema for float types (Oscar Salvador Magallanes)
• 14e016d: fix: Add robust FLOAT/REAL/DOUBLE binary encoding with text fallback (Oscar Salvador Magallanes)
• f5cc113: feat: Add robust NUMERIC binary encoding with text fallback (Oscar Salvador Magallanes)
• a194159: Add PostgreSQL binary COPY encodings and tests (Oscar Salvador Magallanes)
• 15dda7d: Add missing JDBC overrides to Postgresql test mock (Oscar Salvador Magallanes)
• f3fea25: Add binary COPY support for PostgreSQL (Oscar Salvador Magallanes)
• f4b445c: Update Sqlserver2PostgresTest.java (Oscar Salvador Magallanes)
• 280a6b1: Update Sqlserver2PostgresTest.java (Oscar Salvador Magallanes)
• f6cbcc5: Update sqlserver-image-source.sql (Oscar Salvador Magallanes)
• 4ca987c: Update CT_Push.yml (Oscar Salvador Magallanes)
• 6baf49f: Add IMAGE replication tests and SQL fixtures (Oscar Salvador Magallanes)

Full Changelog: https://github.com/osalvador/ReplicaDB/compare/v0.16.1...v0.17.0