Search Results for "parse files"

Canal is an open-source project developed by Alibaba that simulates MySQL slave functionality to parse MySQL binlog files. It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing.

...MyDumper is Open Source and maintained by the community, it is not a Percona, MariaDB or MySQL product. Parallelism (hence, speed) and performance (avoids expensive character set conversion routines, efficient code overall) Easier to manage output (separate files for tables, dump metadata, etc, easy to view/parse data) Consistency - maintains snapshot across all threads, provides accurate master and slave log positions, etc. Manageability - supports PCRE for specifying database and tables inclusions and exclusions.

SymmetricDS is database replication and file synchronization software. It is a platform-independent, web-enabled, and database-agnostic synchronization tool. With initial data load, bidirectional change data capture, conflict resolution, and data transformation, it is a comprehensive data replication solution.

...Furthermore, this library gives us more features such as zooming. pgBadger is able to autodetect your log file format (syslog, stderr or csvlog). It is designed to parse huge log files as well as gzip compressed file.

Reads a PostgreSQL database log file, extracts the SQL statements and executes them in the same order and timing against another database server. Useful for performance tests with real-world workload.

HyperSQL is like a doxygen plus javadoc for SQL, hypermapping SQL views, packages, procedures, and functions to HTML source code listings and showing all code locations where these are used.

pyproperties provides support for properties files in Python. Being written entirely from scratch it is not in any way derived from java.util.Properties. There are projects which try to mimic j.u.P. This is not one of them. It can read, parse and store properties files but also provides some more advanced functionality like manipulating comments and type-guessing.

This is a PHP script that is used to parse the DMOZ RDF data dump files automatically. It features downloading of the files, extracting, cleaning, parsing and inserting the data into a MySQL database. This script is pretty fast!

Myq3log is a Quake 3 Log analyser. It use Php to parse the log files and mysql to store data in. You can browse in those data with a php interface too.

The Trace Sniffer application is designed to parse Oracle trace files generated through the use of the Oracle event trigger, 10046. It's purpose is to provide database users, administrators or developers, the opportunity to find problem areas with SQL st

Eugene2 is the second version of an EXPRESS (ISO 10303-11/STEP) tool. It is able to parse and check EXPRESS schemata, and to parse and check STEP exchange files (ISO 10303-21/STEP). Eugene2 can produce different kind of output. Mainly meta-data that e

Text::FixedWidth is a Perl module that provides a simple object-oriented interface to parse and manipulate fixed column-width text files. The module currently exposes three public methods: new, print_all, and select_distinct.

...There's a full write up/article detailing exactly what I did/how it works here: PHP MySQL "instant" Audit Trail: http://www.flatcoder.co.uk/php-mysql-instant-auditorauditing/ This came about when a client asked for a way to audit their system. The codebase was an old PHP application with more files/scripts that anyone would like to plough through! The solution was a simple "drop in" replacement for the mysql_query call. From there, a simple search/replace on the codebase. The auditor will capture "who did what" and "when". It is also smart enough to fully parse the raw MySQL query and compare updates to existing rows. ...