Search Results for "task"
Sort By:
Showing 42 open source projects for "task"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
Gradle Task Tree
Gradle plugin that adds a 'taskTree' task that prints task dependency
A Gradle plugin that adds a taskTree task to your build. Running it prints out a hierarchical, easy‑to‑read task dependency tree, helping you visualize the build execution order. -
2
gusty
Making DAG construction easier
gusty allows you to control your Airflow DAGs, Task Groups, and Tasks with greater ease. gusty manages collections of tasks, represented as any number of YAML, Python, SQL, Jupyter Notebook, or R Markdown files. A directory of task files is instantly rendered into a DAG by passing a file path to gusty's create_dag function. gusty also manages dependencies (within one DAG) and external dependencies (dependencies on tasks in other DAGs) for each task file you define. ... -
3
ResumableFunctions.jl
C# style generators a.k.a. semi-coroutines for Julia
...The package ResumableFunctions provides the same functionality for the Julia language by introducing the @resumable and the @yield macros. These macros can be used to replace the Task switching functions produce and consume which were deprecated in Julia v0.6. Channels are the preferred way for inter-task communication in Julia v0.6+, but their performance is subpar for iterator applications. -
4
Dolphin Scheduler
A distributed and extensible workflow scheduler platform
...Support many task types e.g., spark,flink,hive, mr, shell, python, sub_process. Support custom task types, Distributed scheduling, and the overall scheduling capability will increase linearly with the scale of the cluster. -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
Dask
Parallel computing with task scheduling
Dask is a Python library for parallel and distributed computing, designed to scale analytics workloads from single machines to large clusters. It integrates with familiar tools like NumPy, Pandas, and scikit-learn while enabling execution across cores or nodes with minimal code changes. Dask excels at handling large datasets that don’t fit into memory and is widely used in data science, machine learning, and big data pipelines. -
6
Qualitis
Qualitis is a one-stop data quality management platform
Qualitis is a data quality management platform that supports quality verification, notification, and management for various datasource. It is used to solve various data quality problems caused by data processing. Based on Spring Boot, Qualitis submits quality model task to Linkis platform. It provides functions such as data quality model construction, data quality model execution, data quality verification, reports of data quality generation and so on. At the same time, Qualitis provides enterprise-level features of financial-level resource isolation, management and access control. It is also guaranteed working well under high-concurrency, high-performance and high-availability scenarios. -
7
PySR
High-Performance Symbolic Regression in Python and Julia
PySR is an open-source tool for Symbolic Regression: a machine learning task where the goal is to find an interpretable symbolic expression that optimizes some objective. Over a period of several years, PySR has been engineered from the ground up to be (1) as high-performance as possible, (2) as configurable as possible, and (3) easy to use. PySR is developed alongside the Julia library SymbolicRegression.jl, which forms the powerful search engine of PySR. -
8
CleanVision
Automatically find issues in image datasets
...CleanVision helps you automatically identify common types of data issues lurking in image datasets. This package currently detects issues in the raw images themselves, making it a useful tool for any computer vision task such as: classification, segmentation, object detection, pose estimation, keypoint detection, generative modeling, etc. -
9
ElasticJob
Distributed scheduled job framework
ElasticJob is a distributed scheduling solution consisting of two separate projects, ElasticJob-Lite and ElasticJob-Cloud. ElasticJob-Lite is a lightweight, decentralized solution that provides distributed task sharding services. ElasticJob-Cloud uses Mesos to manage and isolate resources. It uses a unified job API for each project. Developers only need code one time and can deploy at will. Support job sharding and high availability in distributed system. Scale out for throughput and efficiency improvement. Job processing capacity is flexible and scalable with the allocation of resources. ... -
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
10
Orange Data Mining
Orange: Interactive data analysis
Open source machine learning and data visualization. Build data analysis workflows visually, with a large, diverse toolbox. Perform simple data analysis with clever data visualization. Explore statistical distributions, box plots and scatter plots, or dive deeper with decision trees, hierarchical clustering, heatmaps, MDS and linear projections. Even your multidimensional data can become sensible in 2D, especially with clever attribute ranking and selections. Interactive data exploration for... -
11
Luigi
Python module that helps you build complex pipelines of batch jobs
...These tasks can be anything, but are typically long running things like Hadoop jobs, dumping data to/from databases, running machine learning algorithms, or anything else. You can build pretty much any task you want, but Luigi also comes with a toolbox of several common task templates that you use. It includes support for running Python mapreduce jobs in Hadoop, as well as Hive, and Pig, jobs. It also comes with file system abstractions for HDFS, and local files that ensures all file system operations are atomic. -
12
gt R
Easily generate information-rich, publication-quality tables from R
...These include the table header, the stub, the column labels and spanner column labels, the table body, and the table footer. It all begins with table data (be it a tibble or a data frame). You then decide how to compose your gt table with the elements and formatting you need for the task at hand. Finally, the table is rendered by printing it at the console, including it in an R Markdown document, or exporting it to a file using gtsave(). Currently, gt supports the HTML, LaTeX, and RTF output formats. -
13
Pyper
Concurrent Python made simple
Pyper is a Python-native orchestration and scheduling framework designed for modern data workflows, machine learning pipelines, and any task that benefits from a lightweight DAG-based execution engine. Unlike heavier platforms like Airflow, Pyper aims to remain lean, modular, and developer-friendly, embracing Pythonic conventions and minimizing boilerplate. It focuses on local development ergonomics and seamless transition to production environments, making it ideal for small teams and individuals needing a programmable and flexible orchestration solution without the overhead of enterprise systems. -
14
Excalidraw MCP
Fast and streamable Excalidraw MCP App
...Rather than being just a static whiteboard, Excalidraw-MCP serves diagrams in real time using an MCP backend and streams interactive visual output back to the client, letting AI tools create shapes, connectors, text, and entire diagrams as part of conversational or task-based sessions. Its design supports fast, streamable rendering with smooth viewport control and optional fullscreen editing so that diagrams feel live and fluid as they evolve. Users can deploy it locally or via services like Vercel, then configure their MCP host to point at the Excalidraw-MCP endpoint, so prompts like “draw an architecture diagram” yield immediate visual results within chat. -
15
Blue Whale Configuration Platform
Blue Whale smart cloud configuration platform
Has accumulated experience in supporting hundreds of Tencent businesses, compatible with various complex system architectures, born in operation and maintenance, and proficient in operation and maintenance. From configuration management to job execution, task scheduling and monitoring self-healing, and then through operation and maintenance big data analysis to assist operational decision-making, it covers the full-cycle assurance management of business operations in a comprehensive manner. The open PaaS has a powerful development framework and scheduling engine, as well as a complete operation and maintenance development training system, which helps the rapid transformation and upgrading of operation and maintenance. ... -
16
Data Formulator
Create rich visualizations with AI
...However, these systems do not work well for iterative visualization authoring, because they often require analysts to provide, in a single turn, a text-only prompt that fully describes the complex visualization task to be performed, which is unrealistic to both users and models in many cases. In this paper, we present Data Formulator 2, an LLM-powered visualization system to address these challenges. -
17
elder-pt
data flow framework for data analysis applications
...This data has to be combined, processed, interpreted and reduced in size until the physics information of interest is revealed. Eventually, parts of the data is visualized by sorting it into histograms. Elder-Pt is the prototype of a framework, that facilitates the task of event-by-event data analysis. It provides: 1) a parser for textual graph description 2) an API to write processing nodes that will be used in the graph description for the graph 3) a set of frequently used processing nodes -
18
Software tools facilitating the task of surveying architecture (real-time control, parametric modelling, use of digital photographs, processing of point clouds...). Until now, those tools were mainly used to document cultural heritage sites/buildings
-
19
TRAK Architecture Framework
Simple, pragmatic architecture description - for system-thinkers
...TRAK is a derivative of MODAF but is based on ISO/IEC 42010 - the international standard for architecture description. There is a minimal process in which the architect selects the viewpoints (specifications for views) that address the task sponsor's concerns. It has rules that ensure that the description is consistent and also readable by the non technical audience. You -
20
Mara Pipelines
A lightweight opinionated ETL framework, halfway between plain scripts
...No in-app data processing: command line tools as the main tool for interacting with databases and data. Single machine pipeline execution based on Python's multiprocessing. No need for distributed task queues. Easy debugging and output logging. Cost based priority queues: nodes with higher cost (based on recorded run times) are run first. -
21
Gaius.jl
Divide and Conquer Linear Algebra
Gaius.jl is a multi-threaded BLAS-like library using a divide-and-conquer strategy to parallelism, and built on top of the fantastic LoopVectorization.jl. Gaius spawns threads using Julia's depth-first parallel task runtime and so Gaius's routines may be fearlessly nested inside multi-threaded Julia programs. Gaius is not stable or well-tested. Only use it if you're adventurous. -
22
DataGym.ai
Open source annotation and labeling tool for image and video assets
...Your image data can be imported into DATAGYM from your local machine, from any public image URL or directly from an AWS cloud S3 bucket. Machine learning teams spend up to 80% of their time on data preparation. DATAGYM provides AI-powered annotation functions to help you accelerate your labeling task. The Pre-Labeling feature enables turbo-labeling – it processes thousands of images in the background within a very short time. -
23
BitSail
BitSail is a distributed high-performance data integration engine
BitSail is ByteDance's open source data integration engine which is based on distributed architecture and provides high performance. It supports data synchronization between multiple heterogeneous data sources, and provides global data integration solutions in batch, streaming, and incremental scenarios. At present, it serves almost all business lines in ByteDance, such as Douyin, Toutiao, etc., and synchronizes hundreds of trillions of data every day. BitSail has been widely used and... -
24
DISTOD
Distributed discovery of bidirectional order dependencies
...Because the bODs of a specific dataset are usually not explicitly given, they need to be discovered. The discovery of all minimal bODs (in set-based canonical form) is a task with exponential complexity in the number of attributes. -
25
Ubuntu -16.04-DataScience-stack
To provide a customized environment to practice data science
Although its a relatively easy task to setup, a customized environment to practice data science with the python tool stack is less common, including this site, Vagrant boxes and osboxes.org. Hence this project is kicked out as of early 2019.
