Search Results for "data transformation"
Sort By:
Showing 86 open source projects for "data transformation"
View related business solutions-
Build Securely on Azure with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
Earn up to 16% annual interest with Nexo.Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
1
The Data Engineering Handbook
Links to everything you'd ever want to learn about data engineering
...It includes beginner and intermediate boot camps, interview guides, data cleaning and transformation resources, and curated lists of newsletters and industry communities, making it useful both for self-study and technical interview preparation. The repository is actively maintained and widely starred, reflecting its role as a go-to reference for newcomers and experienced practitioners alike. -
2
glom
Python's nested data operator
...Its declarative specification style lets users describe the output shape they want instead of manually building transformation logic. glom is especially useful for data processing, API response cleanup, configuration handling, and scripts that need reliable nested data manipulation. -
3
Blue Whale Configuration Platform
Blue Whale smart cloud configuration platform
Has accumulated experience in supporting hundreds of Tencent businesses, compatible with various complex system architectures, born in operation and maintenance, and proficient in operation and maintenance. From configuration management to job execution, task scheduling and monitoring self-healing, and then through operation and maintenance big data analysis to assist operational decision-making, it covers the full-cycle assurance management of business operations in a comprehensive manner. The open PaaS has a powerful development framework and scheduling engine, as well as a complete operation and maintenance development training system, which helps the rapid transformation and upgrading of operation and maintenance. ... -
4
OpenVDB
Sparse volume data structure and tools
OpenVDB is an open-source C++ library for storing and manipulating sparse volumetric data on three-dimensional grids. It was originally developed by DreamWorks Animation for volumetric work in feature film production. The project centers on a hierarchical data structure that keeps large empty regions efficient while still supporting detailed volume information. It includes tools for creating, editing, transforming, filtering, rendering, and exchanging volume data. The repository also... -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
Kapacitor
Open source framework for processing, monitoring, and alerting
Open source framework for processing, monitoring, and alerting on time series data. Kapacitor is a real-time data processing engine for monitoring and alerting, specifically designed to work with time-series data from InfluxDB. -
6
Hacks
A collection of hacks and one-off scripts
Hacks is a collection of experimental scripts, utilities, and one-off tools created to solve specific problems in security research, data processing, and automation. Rather than being a single cohesive application, it serves as a repository of practical command-line tools that can be used independently or combined into workflows. The scripts cover a wide range of tasks, including URL manipulation, parameter replacement, data extraction, and reconnaissance automation. Many of the tools in the... -
7
Symfony Serializer
Handles serializing and deserializing data structures
Symfony Serializer is a PHP component that converts objects into various formats (like JSON, XML, or YAML) and vice versa. It handles data normalization and denormalization, making it ideal for APIs and data transformation tasks. The serializer supports complex object graphs and custom normalization logic, allowing developers to convert data in a structured and efficient manner. -
8
Apache Spark
A unified analytics engine for large-scale data processing
Apache Spark is a unified engine for large-scale data processing, offering APIs for batch jobs, streaming, machine learning, and graph computation. It builds on resilient distributed datasets (RDDs) and the newer DataFrame/Dataset abstractions to provide fault-tolerant, in-memory computation across clusters. Spark’s execution engine handles scheduling, shuffles, caching, and data locality so users can focus on transformations rather than infrastructure plumbing. With Spark Streaming... -
9
kpt
Automate Kubernetes Configuration Editing
...Because they are expected to be used for in-place transformation, the functions need to be idempotent. The package orchestrator enables the magic behind the unique WYSIWYG experience. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
Chimney
Scala library for boilerplate-free, type-safe data transformations
Chimney is a Scala library that facilitates boilerplate-free, type-safe data transformations between different data types. It enables developers to define mappings between source and target types, ensuring that transformations are checked at compile time, thereby reducing runtime errors and enhancing code reliability. -
11
Flix
The Flix Programming Language
Flix is a statically typed programming language combining functional, imperative, and logic paradigms, with first‑class Datalog constraints and a polymorphic effect system. Designed to run on the JVM, Flix enforces purity tracking at compile time, supports algebraic data types, tail‑call elimination, and allows entire Datalog programs as values. -
12
PHP Map
PHP arrays and collections made easy
Aimeos/Map is a lightweight PHP collection utility that makes working with arrays and array-like data much easier and more expressive by offering a fluent, object-oriented interface inspired by jQuery and Laravel collections. It wraps standard PHP arrays in a “Map” object, letting developers chain powerful methods for creating, transforming, filtering, sorting, and aggregating data without verbose boilerplate code. This approach improves readability and maintainability when dealing with... -
13
LoopVectorization.jl
Macro(s) for vectorizing loops
LoopVectorization.jl is a Julia package for accelerating numerical loops by automatically applying SIMD (Single Instruction, Multiple Data) vectorization and other low-level optimizations. It analyzes loops and generates highly efficient code that leverages CPU vector instructions, making it ideal for performance-critical computing in fields such as scientific computing, signal processing, and machine learning. -
14
Chartkick
Create beautiful JavaScript charts with one line of Ruby
...Because of its integration with ActiveRecord, developers can quickly visualize trends in their application’s data with minimal transformation. Chartkick is especially valued in dashboards, reporting tools, and admin panels where quick, maintainable visualization is needed without heavy front-end development. -
15
rxRust
Zero-cost & Type-safe Reactive Extensions for Rust
rxRust is a zero-cost, type-safe implementation of Reactive Extensions for Rust that brings functional reactive programming paradigms into the Rust ecosystem. It enables developers to model asynchronous data streams and event-driven systems declaratively, using composable operators that transform and combine streams over time. The library is designed to leverage Rust’s ownership and type systems to ensure memory safety and efficient resource management without sacrificing performance. It... -
16
Kornia
Open Source Differentiable Computer Vision Library
Kornia is a differentiable computer vision library for PyTorch. It consists of a set of routines and differentiable modules to solve generic computer vision problems. At its core, the package uses PyTorch as its main backend both for efficiency and to take advantage of the reverse-mode auto-differentiation to define and compute the gradient of complex functions. Inspired by existing packages, this library is composed by a subset of packages containing operators that can be inserted within... -
17
ioredis
A performance-focused Redis client for Node.js
...It supports Cluster, Sentinel, Streams, Pipelining and of course Lua scripting & Pub/Sub (with the support of binary messages). High performance. Delightful API. It works with Node callbacks and Native promises. Transformation of command arguments and replies. Transparent key prefixing. Abstraction for Lua scripting, allowing you to define custom commands. Support for binary data. Support for TLS. Support for offline queue and ready checking. Support for ES6 types, such as Map and Set. Support for GEO commands. Support for Redis ACL. Sophisticated error handling strategy. ... -
18
bidji
data transformation and code generation
Bidji project is a set of tools for: - data transformation - code generation (which uses data transformation) -
19
lcd-image-converter
Tool to create bitmaps and fonts for embedded applications.
This program allows you to create bitmaps and fonts, and transform them to "C" source format for embedded applications. The transformation of the images to the source code is made by using templates. Therefore, by modifying the templates, you can change the format of the output within certain limits. -
20
Monocle
Optics library for Scala
Monocle is a pure functional, optics library for Scala providing immutable data access and transformation tools — including Lens, Prism, Iso, Optional, and Traversal. It enables composable, declarative modifications of deeply nested immutable structures in a concise and type-safe fashion. -
21
LinAsm
Collection of fast and optimized assembly libraries for x86-64 Linux
...It implements many common and widely used algorithms for array manipulations: searching, sorting, arithmetic and vector operations, unit conversions; fast mathematical and statistic functions; numbers and time converting algorithms; finite impulse response (FIR) digital filters; spectrum analysis algorithms, Fast Hartley transformation; CPU cache friendly functions and extremely fast abstract data types (ADT) such as hash tables b-trees, and much more. LinAsm libraries are written on FASM assembly language. They are stable and have appropriate benchmarks for many units. All libraries are well documented and grouped by their functionality. To get more information about this library, please visit the official web site: http://linasm.sourceforge.net -
22
Prompt Engineering Interactive Tutorial
Anthropic's Interactive Prompt Engineering Tutorial
Prompt-eng-interactive-tutorial is a comprehensive, hands-on tutorial that teaches the craft of prompt engineering with Claude through guided, executable lessons. It starts with the anatomy of a good prompt and moves into techniques that deliver the “80/20” gains—separating instructions from data, specifying schemas, and setting evaluation criteria. The course leans heavily on realistic failure modes (ambiguity, hallucination, brittle instructions) and shows how to iteratively debug prompts the way you would debug code. Lessons include building prompts from scratch for common tasks like extraction, classification, transformation, and step-by-step reasoning, with checkpoints that let you compare your outputs against solid baselines. ... -
23
VulcanSQL
Data API Framework for AI Agents and Data Apps
Vulcan SQL is a modern data API framework that lets you build secure and scalable data APIs directly from SQL files. Designed for data teams, it allows the definition of parameterized queries, policy enforcement, and transformation layers using familiar SQL syntax. Vulcan SQL integrates with BI tools and data warehouses, making it easy to expose internal datasets as RESTful APIs. -
24
towhee
Framework that is dedicated to making neural data processing
Towhee is an open-source machine-learning pipeline that helps you encode your unstructured data into embeddings. You can use our Python API to build a prototype of your pipeline and use Towhee to automatically optimize it for production-ready environments. From images to text to 3D molecular structures, Towhee supports data transformation for nearly 20 different unstructured data modalities. We provide end-to-end pipeline optimizations, covering everything from data decoding/encoding, to model inference, making your pipeline execution 10x faster. ... -
25
XForms to XHTML+Javascript (AJAX) conversion based on a unique XSL transformation. Suitable server-side (PHP) or client-side (Internet Explorer, Mozilla FireFox, Opera, Safari) browser treatement where an XSLT 1.0 engine is available
