Search Results for "dag"
Sort By:
Showing 33 open source projects for "dag"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Hamilton DAGWorks
Helps scientists define testable, modular, self-documenting dataflow
Hamilton is a lightweight Python library for directed acyclic graphs (DAGs) of data transformations. Your DAG is portable; it runs anywhere Python runs, whether it's a script, notebook, Airflow pipeline, FastAPI server, etc. Your DAG is expressive; Hamilton has extensive features to define and modify the execution of a DAG (e.g., data validation, experiment tracking, remote execution). To create a DAG, write regular Python functions that specify their dependencies with their parameters. ... -
2
IPFS GeoIP
GeoIP lookup over DAG-CBOR dataset loaded from IPFS
GeoIP lookup over IPFS. GeoIP lookup over DAG-CBOR dataset loaded from IPFS. -
3
gusty
Making DAG construction easier
gusty allows you to control your Airflow DAGs, Task Groups, and Tasks with greater ease. gusty manages collections of tasks, represented as any number of YAML, Python, SQL, Jupyter Notebook, or R Markdown files. A directory of task files is instantly rendered into a DAG by passing a file path to gusty's create_dag function. gusty also manages dependencies (within one DAG) and external dependencies (dependencies on tasks in other DAGs) for each task file you define. All you have to do is provide a list of dependencies or external_dependencies inside of a task file, and gusty will automatically set each task's dependencies and create external task sensors for any external dependencies listed. gusty works with both Airflow 1.x and Airflow 2.x, and has even more features, all of which aim to make the creation, management, and iteration of DAGs more fluid, so that you can intuitively design your DAG and build your tasks. -
4
Spacemesh
Go Implementation of the Spacemesh protocol full node
...Unlike Proof of Work, PoST leverages unused hard drive space to secure the network, enabling anyone with a computer to participate without specialized hardware. Spacemesh introduces a mesh-based block DAG (Directed Acyclic Graph) structure for scalable and parallel consensus. The project aims to build a decentralized, permissionless, and egalitarian financial operating system accessible to everyone. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
Pyper
Concurrent Python made simple
Pyper is a Python-native orchestration and scheduling framework designed for modern data workflows, machine learning pipelines, and any task that benefits from a lightweight DAG-based execution engine. Unlike heavier platforms like Airflow, Pyper aims to remain lean, modular, and developer-friendly, embracing Pythonic conventions and minimizing boilerplate. It focuses on local development ergonomics and seamless transition to production environments, making it ideal for small teams and individuals needing a programmable and flexible orchestration solution without the overhead of enterprise systems. -
6
React Force Graph
React component for 2D, 3D, VR and AR force directed graphs
...Developers can customize node shapes, text, images, link styles, directional particles, geometries, and graph behavior. The components also support dynamic updates, node selection, graph focusing, collision detection, DAG layouts, and advanced visual effects. -
7
CGraph
A general, three-party dependency-free, cross-platform
CGraph is a high-performance, cross-platform Directed Acyclic Graph (DAG) framework implemented in pure C++ with no third-party dependencies, designed for building complex task pipelines and parallel execution workflows. It allows developers to model computational processes as graph structures, where nodes represent tasks and edges define dependencies, enabling efficient scheduling and execution. The framework includes a pipeline system that supports sequential and parallel execution, conditional branching, aggregation, and loop control, making it highly flexible for advanced workflows. ... -
8
ClickVisual
Log analytic and data visualize platform built on clickhouse
ClickVisual is a lightweight browser-based logs analytics and logs search platform for ClickHouse. -
9
X6
JavaScript diagramming library that uses SVG and HTML for rendering
Provides easy-to-use node customization capabilities and out-of-the-box interactive components, allowing us to quickly build flowcharts, DAG diagrams, ER diagrams and other graph applications. Extremely easy to customize: support custom node styles and interactions using SVG/HTML/React/Vue/Angular. Out of the box: built-in 10+ image editing supporting extensions, such as frame selection, alignment line, small map, etc. A complete event system that can listen to any event that occurs in the chart. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
LangGraph
Build resilient language agents as graphs
...Compared to other LLM frameworks, it offers these core benefits: cycles, controllability, and persistence. LangGraph allows you to define flows that involve cycles, essential for most agentic architectures, differentiating it from DAG-based solutions. As a very low-level framework, it provides fine-grained control over both the flow and state of your application, crucial for creating reliable agents. Additionally, LangGraph includes built-in persistence, enabling advanced human-in-the-loop and memory features. -
11
json-joy
json-joy — JSON CRDT, JSON CRDT Patch, JSON Patch
json-joy library implements cutting-edge real-time and collaborative editing algorithms and other utilities for JSON data models. Major focus of json-joy is development of the JSON CRDT protocol, a Conflict-free Replicated Data Type that enables seamless merging of changes in JSON data models, avoiding conflicts between replicas. -
12
Sogou C++ Workflow
C++ parallel computing and asynchronous networking engine
As Sogou`s C++ server engine, Sogou C++ Workflow supports almost all back-end C++ online services of Sogou, including all search services, cloud input method, online advertisements, etc., handling more than 10 billion requests every day. This is an enterprise-level programming engine in light and elegant design which can satisfy most C++ back-end development requirements. -
13
Dolphin Scheduler
A distributed and extensible workflow scheduler platform
Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available `out of the box`. Dedicated to solving the complex task dependencies in data processing, making the scheduler system out of the box for data processing. Decentralized multi-master and multi-worker, HA is supported by itself, overload processing. -
14
3D Force-Directed Graph
3D force-directed graph component using ThreeJS/WebGL
3D Force-Directed Graph is a web component for visualizing graph data in an interactive three-dimensional environment. It uses Three.js and WebGL for rendering while force simulation engines calculate node positions dynamically. Developers can customize nodes, links, labels, geometry, colors, directional arrows, particles, and other visual properties. Users can interact with graphs through dragging, clicking, selection, camera movement, and focus controls. The library supports dynamic data... -
15
Lossless Claw
LCM (Lossless Context Management) plugin for OpenClaw
Lossless Claw is an advanced context management plugin for the OpenClaw agent ecosystem that redefines how conversational memory is handled in large language model systems. Instead of relying on traditional sliding-window truncation or lossy summarization, it introduces a lossless architecture that preserves all historical messages while maintaining usable context within token limits. The system stores every interaction in a persistent database and incrementally summarizes older content into... -
16
Argo Workflows
Workflow engine for Kubernetes
...Define workflows where each step in the workflow is a container. Model multi-step workflows as a sequence of tasks or capture the dependencies between tasks using a directed acyclic graph (DAG). Easily run compute intensive jobs for machine learning or data processing in a fraction of the time using Argo Workflows on Kubernetes. Run CI/CD pipelines natively on Kubernetes without configuring complex software development products. Argo Workflows is the most popular workflow execution engine for Kubernetes. It can run 1000s of workflows a day, each with 1000s of concurrent tasks. ... -
17
Griptape
Python framework for AI workflows and pipelines with chain of thought
The Griptape framework provides developers with the ability to create AI systems that operate across two dimensions: predictability and creativity. For predictability, Griptape enforces structures like sequential pipelines, DAG-based workflows, and long-term memory. To facilitate creativity, Griptape safely prompts LLMs with tools (keeping output data off prompt by using short-term memory), which connects them to external APIs and data stores. The framework allows developers to transition between those two dimensions effortlessly based on their use case. ... -
18
FileDAG Storage
A distributed storage service built on the IPFS technology stack
...First, the file or object management module needs to be abstracted on the basis of merkle-dag; second, the file cannot be deleted directly, only the data blocks that are no longer needed can be released through garbage collection. -
19
CausalNex
A Python library that helps data scientists to infer causation
CausalNex is a Python library that uses Bayesian Networks to combine machine learning and domain expertise for causal reasoning. You can use CausalNex to uncover structural relationships in your data, learn complex distributions, and observe the effect of potential interventions. -
20
Tributary
Streaming reactive and dataflow graphs in Python
Tributary is a library for constructing dataflow graphs in Python. Unlike many other DAG libraries in Python (airflow, luigi, prefect, dagster, dask, kedro, etc), tributary is not designed with data/etl pipelines or scheduling in mind. Instead, tributary is more similar to libraries like mdf, loman, pyungo, streamz, or pyfunctional, in that it is designed to be used as the implementation for a data model. One such example is the greeks library, which leverages tributary to build data models for options pricing. -
21
Couler
Unified Interface for Constructing and Managing Workflows
Couler is a system designed for unified machine learning workflow optimization in the cloud. Couler endeavors to provide a unified interface for constructing and optimizing workflows across various workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow. Couler enhances workflow efficiency through features like Autonomous Workflow Construction, Automatic Artifact Caching Mechanisms, Big Workflow Auto Parallelism Optimization, and Automatic Hyperparameters Tuning. -
22
Cyclone
Powerful workflow engine and end-to-end pipeline solutions
...It can run anywhere Kubernetes is deployed: public cloud, on-prem or hybrid cloud. Cyclone is architectured with a low-level workflow engine that is application agnostic, offering capabilities like workflow DAG scheduling, resource lifecycle management and most importantly, a pluggable and extensible framework for extending the core APIs. Above which, Cyclone provides built-in support for high-level functionalities, with CI/CD pipelines and AI DevOps being two notable examples, and it is possible to expand to more use cases as well. With Cyclone, users end up with the flexibility of workflow orchestration and the usability of complete CI/CD and AI DevOps solutions. ... -
23
img
Standalone, daemon-less, unprivileged Dockerfile and OCI
Standalone, daemon-less, unprivileged Dockerfile and OCI compatible container image builder. img is more cache-efficient than Docker and can also execute multiple build stages concurrently, as it internally uses BuildKit's DAG solver. The commands/UX are the same as docker {build, tag, push, pull, login, logout, save} so all you have to do is replace docker with img in your scripts, command line, and/or life. This is a glorified cli tool built on top of the build kit. The goal of this project is to be able to build container images for unprivileged users. ... -
24
qD Messages
Lightning fast peer-to-peer cross-platform messenger
qDesk Messages is on track to become the first fully featured, cross-platform, publicly auditable, decentralized, real-time, dag-based end-to-end encrypted messenger with a feature to exchange goods and services and send payments. In this module, you can create end-to-end encrypted channels, organize them in folders, share the folder structure with your invite, control the channels you own, and participate in self-owned channels. Have private conversations or public channel discussions. ... -
25
DAGService
Library for storing and replicating hash-linked data over the IPFS
DAGService is aiming to be the bare minimum needed for IPLD-based applications to interact with the IPFS network by getting and putting blocks to it. The goal of DAGService to provide a minimal layer between the data model of IPLD and full-blown IPFS. It provides the bare minimum functionality for any application to interact with the IPFS network (by getting and putting IPLD blocks) without having to deal with the complexities of operating a full IPFS node. It is an attempt to remake the...
