Search Results for "data transformation"
Sort By:
Showing 29 open source projects for "data transformation"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
2
Addax
Addax is a versatile open-source ETL tool
Addax is a data integration and ETL (Extract, Transform, Load) tool designed for high-performance data migration tasks. It simplifies the process of moving data between different systems and formats. -
3
Blue Whale Configuration Platform
Blue Whale smart cloud configuration platform
Has accumulated experience in supporting hundreds of Tencent businesses, compatible with various complex system architectures, born in operation and maintenance, and proficient in operation and maintenance. From configuration management to job execution, task scheduling and monitoring self-healing, and then through operation and maintenance big data analysis to assist operational decision-making, it covers the full-cycle assurance management of business operations in a comprehensive manner. The open PaaS has a powerful development framework and scheduling engine, as well as a complete operation and maintenance development training system, which helps the rapid transformation and upgrading of operation and maintenance. ... -
4
Greenmask
PostgreSQL database anonymization and synthetic data generation tool
Greenmask is a powerful open-source utility that is designed for logical database backup dumping, obfuscation, and restoration. It offers extensive functionality for backup, anonymization, and data masking. Greenmask is written in pure Go and includes ported PostgreSQL libraries that allows for platform independence. This tool is stateless and does not require any changes to your database schema. It is designed to be highly customizable and backward-compatible with existing PostgreSQL... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
SQL Notebook
SQL Notebook — Casual data exploration in SQL
SQL Notebook is a free Windows application for querying and analyzing data across multiple sources, including SQLite, PostgreSQL, Excel, and CSV files. It combines a SQL editor with a notebook interface, allowing for data exploration, transformation, and visualization in one place. SQL Notebook is ideal for analysts and data enthusiasts. -
6
Datacap
DataCap is integrated software for data transformation
Datacap is an open-source data catalog and governance tool that helps organizations manage and document their data assets. It provides metadata management, lineage tracking, and collaboration features to ensure data transparency and quality. Datacap is designed for teams that need a lightweight, self-hosted solution to organize and govern their data ecosystems. -
7
osm2pgsql
Import OpenStreetMap data into a PostgreSQL/PostGIS database
osm2pgsql is a powerful tool for importing OpenStreetMap (OSM) data into a PostgreSQL/PostGIS database, enabling geographic data analysis and map rendering. It supports various rendering schemas like "flex" and "lua" to customize how data is loaded and indexed. Designed for performance and scalability, osm2pgsql is widely used in map tile generation pipelines and by GIS professionals handling large-scale spatial datasets. -
8
Lantern Database
PostgreSQL vector database extension for building AI applications
Lantern is a real-time data transformation engine that enables data engineers to build, run, and monitor streaming data pipelines with SQL. It’s designed to process events in motion, offering low-latency stream transformations, aggregations, and enrichment in a declarative way. Lantern is especially suited for modern data infrastructure and analytics platforms. -
9
SymmetricDS
SymmetricDS is database replication and file synchronization software
SymmetricDS is an open-source platform for database replication and synchronization across heterogeneous systems. It supports multi-master and one-way replication with conflict resolution and works over unreliable networks. SymmetricDS is ideal for distributed applications, data warehousing, and edge deployments where consistency and availability are key. -
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
10
ioredis
A performance-focused Redis client for Node.js
...It supports Cluster, Sentinel, Streams, Pipelining and of course Lua scripting & Pub/Sub (with the support of binary messages). High performance. Delightful API. It works with Node callbacks and Native promises. Transformation of command arguments and replies. Transparent key prefixing. Abstraction for Lua scripting, allowing you to define custom commands. Support for binary data. Support for TLS. Support for offline queue and ready checking. Support for ES6 types, such as Map and Set. Support for GEO commands. Support for Redis ACL. Sophisticated error handling strategy. ... -
11
SymmetricDS
Database Replication, Filtered Synchronization, and Transformation
SymmetricDS is database replication and file synchronization software. It is a platform-independent, web-enabled, and database-agnostic synchronization tool. With initial data load, bidirectional change data capture, conflict resolution, and data transformation, it is a comprehensive data replication solution. -
12
HStreamDB
HStreamDB is an open-source, cloud-native streaming database
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications. By subscribing to streams in HStreamDB, any update of the data stream will be pushed to your apps in real-time, and this promotes your apps to be more responsive. You can also replace message brokers with HStreamDB and everything you do with message brokers can be done better with HStreamDB. HStreamDB provides built-in support for event time-based stream processing. ... -
13
GETL
ETL engine based on Groovy
P.S. Dear friends. Repository migration to https://github.com/ascrus/getl . You can download jar file from this site or maven. GETL - based package in Groovy, which automates the work of loading and transforming data. His name is an acronym for «Groovy ETL». GETL is a set of libraries of pre-built classes and objects that can be used to solve problems unpacking, transform and load data into programs written in Groovy, or Java, as well as from any software that supports the work with... -
14
Ecto
A toolkit for data mapping and language integrated query
Ecto is the official Elixir library that serves as a database wrapper and integrated query system, enabling developers to define schemas, construct and execute type-safe queries, manage database migrations, and validate data via changesets; it is the foundational tool for working with relational databases in Elixir. Note that mix test does not run the tests in the integration_test folder. To run integration tests, you can clone ecto_sql in a sibling directory and then run its integration... -
15
Korma
Tasty SQL for Clojure
Korma is a DSL for Clojure that wraps SQL via expressive, composable Clojure constructs. It allows developers to build powerful and reusable database queries using rich abstractions instead of raw SQL strings. The most recent stable release is Korma 0.4.3, as noted above. The current edge release is Korma 0.5.0-RC1 (released Feb 28, 2018). It is not guaranteed to be bug free, and we'd welcome help from the community in identifying any bugs or regressions. The plan is to either release a... -
16
Adele
Adhoc Data Exploration - Live & Easy
Adele was developed to simplify the daily work with data. Use it as a swiss knife to fill the gap between your work with spreadsheet application like MS Excel and enterprise servers like SAP ERP. Specialized tools like Rapid Miner, KNIME or similiary stuff should not be replaced. But Adele is designed for business people working with spreadsheet applications to analyse their data. There are many technical concepts in an easier way included. For example realtime OLAP, transformations,... -
17
Xcerpt is a Query and Transformation Language for XML and Semistructured data. Instead of the navigational approach of XPath-based languages like XSLT or XQuery, Xcerpt uses patterns for querying and is based on concepts of logic programming like unifica
-
18
Octopus Graphical Editor is a front end / GUI to help users to create XML files for Enhydra Octopus, which is a Java based ETL (Extraction, Transformation and Load) tool.
-
19
Toolsverse ETL Framework
Open source Extract Transform Load engine written in Java
ETL Framework is a standalone Extract Transform Load engine written in Java. It includes executables for all major platforms and can be easily integrated into other applications. Key Features: * embeddable, open source and free * fast and scalable * uses target database features to do transformations and loads * manual and automatic data mapping * data streaming * bulk data loads * data quality features using SQL, JavaScript? and regex * data transformations Requirements *... -
20
fzpgloader
FasterZip PostgreSQL Loader - ETL for postgresql FasterZip PostgreSQL
FasterZip PostgreSQL Loader - ETL for postgresql FasterZip PostgreSQL This is a Java application that lets you filter the information into a file before loading using a copy (psql does not require). Use a configuration file for the data connection to the db, source file and special parameters. You can make SQL (using HSQL) the source file, allowing the transformation of data prior to loading. Can run on any OS that use Java without needing to install any additional components (other than the JRE course) To make SQL on the source file, keep in mind: 1) The file will be played under the name "origin" 2) If the option encCol1era, not in the configuration file or encCol1era = 0, the columns are automatically named file like this: col1, col2, ... coln, and the SQL touches take these names. ... -
21
Moved to sf.net/projects/cloveretl/ !!! CloverETL is a Java ETL framework which transforms structured or unstructured data. Works as a standalone application or embedded in other applications as a data transformation library of functions.
-
22
The csvdatamix project aims to randomize CSV input data files in order to conceal the original state of the data. Similar to data masking or data transformation. Also has mapping abilities to translate back to the original state of the data.
-
23
Palo ETL Server is a Java based Tool for Extraction, Transformation and Loading of mass data into the Palo OLAP Server. Palo ETL Server is one part of the Palo Suite.
-
24
Java command line tool for calculating the complexity of a database model using the Small Worlds Data Transformation Measure.
-
25
Wets is a very flexible ETL which can handle data coming from text file / XML / MySQL / postgreSQL and Zope server and because of the language associated there is no limitation concerning the transformation process. See the drop project for a GUI.