Search Results for "data migration"
Sort By:
Showing 170 open source projects for "data migration"
View related business solutions-
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
1
Addax
Addax is a versatile open-source ETL tool
Addax is a data integration and ETL (Extract, Transform, Load) tool designed for high-performance data migration tasks. It simplifies the process of moving data between different systems and formats. -
2
DBeaver
Free universal database tool
...It is useful for developers, SQL programmers, database administrators and analysts. DBeaver comes with plenty of great features such as metadata and SQL editors, ERD, data export/import/migration and more. Plugins are available for certain databases, and there are also several database management utilities. DBeaver’s Enterprise Edition provides even more features and supports non-JDBC datasources. -
3
ReplicaDB
ReplicaDB is open source tool for database replication
ReplicaDB is an open-source, multi-platform tool for database replication, enabling the migration and synchronization of data across different relational and NoSQL databases. It is optimized for efficiency and minimal downtime. -
4
Ora2Pg
Ora2Pg is a free tool used to migrate an Oracle database
ora2pg is an open-source tool used to migrate Oracle databases to PostgreSQL. It connects to an Oracle database, extracts schema and data, and generates SQL-compatible output for PostgreSQL. It supports complex migration scenarios, including stored procedures, triggers, data types, and performance optimization, making it ideal for enterprises transitioning away from Oracle systems. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
pgsync
Postgres to Elasticsearch/OpenSearch sync
pgsync is a lightweight tool for syncing Postgres databases across environments, such as from production to staging. It allows selective table syncing, data masking, and parallel copying for fast and safe data migration. pgsync is ideal for developers who need realistic test data without exposing sensitive information. -
6
BigQuery Utils
Useful scripts, udfs, views, and other utilities for migration
BigQuery Utils is a large utility repository focused on helping users operate, optimize, and migrate workloads in BigQuery through reusable assets rather than a single application. It brings together scripts, user-defined functions, views, stored procedures, dashboards, notebooks, and supporting tools that address common data warehouse and analytics tasks. The repository is especially useful for organizations that need practical building blocks for migration from other database systems, since it includes compatibility-oriented utilities and migration-focused UDFs that mimic behavior from platforms such as Oracle, Redshift, and Netezza. It also supports day-to-day operational work by offering optimization scripts, billing queries, performance testing examples, and dashboards built on INFORMATION_SCHEMA metadata so teams can better understand slot usage, reservations, job execution, and errors. -
7
Memgraph
Open-source graph database, tuned for dynamic analytics environments
A high-performance, in-memory graph database designed for real-time analytics and complex network data processing. -
8
Chat2DB
AI-driven database tool and SQL client
...Just enter the names of the tables and columns, and we will automatically configure the type, password, and comment, saving you 90% of the time. Imports and exports data in multiple formats (CSV, XLSX, XLS, SQL) to facilitate exchange, backup, and migration. Transfers data between different databases or through cloud services, as a backup and recovery solution that guarantees the minimum loss of data and downtime during migrations. -
9
pv-migrate
CLI tool to easily migrate Kubernetes persistent volumes
pv-migrate is a CLI tool/kubectl plugin to easily migrate the contents of one Kubernetes PersistentVolumeClaim to another. On Kubernetes, if you need to rename a resource (like a Deployment) or to move it to a different namespace, you can simply create a copy of its manifest with the new namespace and/or name and apply it. However, it is not as simple with PersistentVolumeClaim resources: They are not only metadata, but they also store data in the underlying storage backend. In these cases,... -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
10
React Router
Declarative routing for React
...You can use it maximally as a React framework or minimally as a library with your own architecture. First‑class type safety with automatic type generation for route params and data. It is designed to facilitate migration from React 18 to React 19 with non‑breaking upgrades -
11
Upscheme
Database migrations and schema updates made easy
...With support for major relational database systems via Doctrine DBAL, Upscheme enables cross-platform migrations with minimal code, reducing friction when evolving your application’s data model. The project includes tools to generate migration files, handle dependencies between tasks, and execute changes reliably across environments without requiring low-level SQL scripting. By focusing on upgrades and avoiding potentially unsafe downgrades, it prioritizes safety and predictability for real-world application upgrades. -
12
UnoPIM
A free and open source Laravel-based PIM software to help businesses
Unopim is an open-source Product Information Management (PIM) system designed to help businesses manage and centralize product data. It provides a structured way to collect, enrich, and distribute product information across multiple channels, improving data consistency and accuracy. Unopim is designed to streamline product data management for e-commerce, retail, and marketing applications, allowing for better data governance and more efficient updates. -
13
gh-ost
GitHub's online schema migrations for MySQL
gh-ost is a triggerless online schema migration solution for MySQL. It is testable and provides pausability, dynamic control/reconfiguration, auditing, and many operational perks. gh-ost produces a light workload on the master throughout the migration, decoupled from the existing workload on the migrated table. It has been designed based on years of experience with existing solutions, and changes the paradigm of table migrations. -
14
SyncLite
Build Anything Sync Anywhere
SyncLite is an open-source, low-code, comprehensive relational data consolidation platform enabling developers to rapidly build data-intensive applications for edge, desktop and mobile environments. SyncLite enables real-time, transactional data replication and consolidation from various sources including edge/desktop applications using popular embedded databases (SQLite, DuckDB, Apache Derby, H2, HyperSQL), data streaming applications, IoT message brokers, traditional database systems(ETL)... -
15
JUDI.jl
Julia Devito inversion
JUDI is a framework for large-scale seismic modeling and inversion and is designed to enable rapid translations of algorithms to fast and efficient code that scales to industry-size 3D problems. The focus of the package lies on seismic modeling as well as PDE-constrained optimization such as full-waveform inversion (FWI) and imaging (LS-RTM). Wave equations in JUDI are solved with Devito, a Python domain-specific language for automated finite-difference (FD) computations. JUDI's modeling... -
16
Superduper
Superduper: Integrate AI models and machine learning workflows
...This allows developers to completely avoid implementing MLOps, ETL pipelines, model deployment, data migration, and synchronization. Using Superduper is simply "CAPE": Connect to your data, apply arbitrary AI to that data, package and reuse the application on arbitrary data, and execute AI-database queries and predictions on the resulting AI outputs and data. -
17
PMXT
A unified API for trading across prediction markets
...It also includes MCP support for AI agents, enabling integration with tools like Claude, Cursor, and other MCP-compatible environments. With support for unified order placement, market discovery, and migration tools for Dome API users, PMXT streamlines development in the growing prediction markets ecosystem. -
18
Pop Database
A Tasty Treat For All Your Database Needs
Pop is a data access toolkit for Go that simplifies database interactions. It combines the power of an ORM with the flexibility of SQL, providing developers with tools to manage database schemas, run migrations, and perform CRUD operations. -
19
rudderstack
Privacy and Security focused Segment-alternative, in Golang
Quickly deploy flexible, powerful customer data pipelines, then send the data to your entire stack—without the engineering headache. Our complete toolset makes it easy to level-up your customer data stack. Spare your data engineers the headache. Our 180+ integrations, along with custom webhook sources and destinations, save data teams hundred of hours. Say goodbye to different versions of the truth. Our SDKs track anonymous and known users at the source and reconcile users in your warehouse... -
20
Velero
Backup and migrate Kubernetes applications and their persistent volume
Backup and migrate Kubernetes resources and persistent volumes. Velero is an open source tool to safely backup and restore, perform disaster recovery, and migrate Kubernetes cluster resources and persistent volumes. Reduces time to recovery in case of infrastructure loss, data corruption, and/or service outages. Enables cluster portability by easily migrating Kubernetes resources from one cluster to another. Offers key data protection features such as scheduled backups, retention schedules,... -
21
Gradle Kotlin DSL converter
Convert from Groovy to Kotlin DSL for Gradle, focused on Android
Welcome! After a lot of pain trying to migrate from Gradle's Groovy to Kotlin DSL on Android Studio, I developed this tool to solve most migration issues and reduce the amount of work you need in order to make things ready. Please see this tool as a helper, a first resource like Android Studio's Java converter to Kotlin: it won't make a perfect conversion, but it helps a lot in reducing the time you would spend on repetitive tasks. Sometimes you just want to copy and paste. Just copy... -
22
AWS SDK for pandas
Easy integration with Athena, Glue, Redshift, Timestream, Neptune
aws-sdk-pandas (formerly AWS Data Wrangler) bridges pandas with the AWS analytics stack so DataFrames flow seamlessly to and from cloud services. With a few lines of code, you can read from and write to Amazon S3 in Parquet/CSV/JSON/ORC, register tables in the AWS Glue Data Catalog, and query with Amazon Athena directly into pandas. The library abstracts efficient patterns like partitioning, compression, and vectorized I/O so you get performant data lake operations without hand-rolling... -
23
TDengine
Open-source time-series database with high-performance and scalability
...TDengine’s native distributed architecture powers out-of-the-box scalability and high availability. Nodes can be added through simple configuration to achieve greater data processing power. In addition, this feature is open source. TDengine uses SQL as the query language, thereby reducing learning and migration costs, while adding SQL extensions to handle time-series data better, and supporting convenient and flexible schemaless data ingestion. -
24
Apache Airflow Provider
Great Expectations Airflow operator
Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+. If your Airflow version is 2.1.0, and you want to install this provider version, first upgrade Airflow to at least version 2.1.0. Otherwise, your Airflow package version will be upgraded automatically, and you will have to manually run airflow upgrade db to complete the migration. This operator currently works with the Great Expectations V3 Batch Request API only. If you would like to use the... -
25
The Acton programming language
The Acton Programming Language
...Never stop for an upgrade; Live upgrade your running application through compiler-supported code and data migration. Acton programs, and the actor model, work well from simple script-style applications on a single machine up to large distributed systems across a Data Center. Run at your scale.