Search Results for "parallel language"
Sort By:
Showing 56 open source projects for "parallel language"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
Large Language Models (LLMs)
Connect MATLAB to LLM APIs, including OpenAI® Chat Completions
This repository enables MATLAB to connect with large language models (LLMs) such as OpenAI's ChatGPT, DALL-E, Azure OpenAI, and Ollama, integrating their natural language processing and image generation capabilities directly within MATLAB environments. It facilitates creating chatbots, summarizing text, and image generation, among other tasks. -
2
The Julia Programming Language
High-level, high-performance dynamic language for technical computing
Julia is a fast, open source high-performance dynamic language for technical computing. It can be used for data visualization and plotting, deep learning, machine learning, scientific computing, parallel computing and so much more. Having a high level syntax, Julia is easy to use for programmers of every level and background. Julia has more than 2,800 community-registered packages including various mathematical libraries, data manipulation tools, and packages for general purpose computing. ... -
3
multi-agent-shogun
Samurai-inspired multi-agent system for Claude Code
multi-agent-shogun is a multi-agent orchestration system designed to coordinate multiple AI coding agents working in parallel. Inspired by the hierarchy of a feudal Japanese military structure, the system organizes agents into roles such as Shogun, Karo, and Ashigaru, which correspond to strategist, coordinator, and worker agents. A user interacts primarily with the Shogun agent by issuing natural language instructions that describe the desired tasks. -
4
vLLM
A high-throughput and memory-efficient inference and serving engine
vLLM is a fast and easy-to-use library for LLM inference and serving. High-throughput serving with various decoding algorithms, including parallel sampling, beam search, and more. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
5
nndeploy
An Easy-to-Use and High-Performance AI Deployment Framework
nndeploy is an open-source framework designed to simplify the deployment of artificial intelligence models across multiple hardware platforms and devices. The framework focuses on making it easier to transform trained AI models into production-ready applications that can run efficiently on desktops, mobile devices, servers, and edge computing hardware. Developers can use visual workflows to design and configure AI processing pipelines by connecting modular nodes that represent different... -
6
ChainForge
An open-source visual programming environment
ChainForge is an open-source visual programming environment designed to help developers systematically test, compare, and evaluate prompts and outputs across multiple large language models in a structured and scalable way. Instead of relying on isolated prompt experimentation, it introduces a dataflow-based interface that allows users to create complex prompt pipelines and evaluate them across different models, parameters, and datasets simultaneously. The platform enables rapid experimentation by generating permutations of prompts and inputs, making it possible to test hundreds of variations in parallel and analyze performance trends more effectively. ... -
7
Megatron
Ongoing research training transformer models at scale
Megatron is a large, powerful transformer developed by the Applied Deep Learning Research team at NVIDIA. This repository is for ongoing research on training large transformer language models at scale. We developed efficient, model-parallel (tensor, sequence, and pipeline), and multi-node pre-training of transformer based models such as GPT, BERT, and T5 using mixed precision. Megatron is also used in NeMo Megatron, a framework to help enterprises overcome the challenges of building and training sophisticated natural language processing models with billions and trillions of parameters. ... -
8
Kimi K2.5
Moonshot's most powerful AI model
Kimi K2.5 is Moonshot AI’s open-source, native multimodal agentic model built through continual pretraining on approximately 15 trillion mixed vision and text tokens. Based on a 1T-parameter Mixture-of-Experts (MoE) architecture with 32B activated parameters, it integrates advanced language reasoning with strong visual understanding. K2.5 supports both “Thinking” and “Instant” modes, enabling either deep step-by-step reasoning or low-latency responses depending on the task. Designed for agentic workflows, it features an Agent Swarm mechanism that decomposes complex problems into coordinated sub-agents executing in parallel. ... -
9
Zoo Code
Zoo Code gives you a whole dev team of AI agents in your code editor
Zoo Code is an AI coding assistant that brings a team-style agent workflow directly into the code editor. It can generate, refactor, debug, document, and explain code while working with the surrounding codebase. Dedicated Code, Architect, Ask, Debug, and Custom modes adapt the assistant to different tasks. Its orchestrator can delegate work, coordinate parallel subtasks, and recover parent or child tasks. Semantic code search helps agents locate relevant code without a separate indexing... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
Superset LLM
Run an army of Claude Code, Codex, etc. on your machine
Superset is a development environment and terminal-based platform designed to orchestrate multiple AI coding agents simultaneously within a single workspace. The tool enables developers to run many autonomous coding agents in parallel without the typical overhead of manually managing multiple terminals, repositories, or branches. Each agent task is isolated in its own Git worktree, ensuring that code changes from different agents do not interfere with each other while allowing developers to... -
11
Parallax
Parallax is a distributed model serving framework
Parallax is a decentralized inference framework designed to run large language models across distributed computing resources. Instead of relying on centralized GPU clusters in data centers, the system allows multiple heterogeneous machines to collaborate in serving AI inference workloads. Parallax divides model layers across different nodes and dynamically coordinates them to form a complete inference pipeline. A two-stage scheduling architecture determines how model layers are allocated to... -
12
Prime Agent
A self-improving RLM agent for coding workflows
Prime Agent is an open-source coding and research agent designed for complex workflows and long-running autonomous tasks. Its Recursive Language Model architecture treats context as programmable variables and subagents as callable functions inside a persistent Python environment. Files, shell commands, tools, context operations, and agent coordination are handled programmatically through the same runtime. Built-in subagents can work in parallel or continue tasks independently while returning results to a parent agent. ... -
13
wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
wllama is a WebAssembly-based library that enables large language model inference directly inside a web browser. Built as a binding for the llama.cpp inference engine, the project allows developers to run LLM models locally without requiring a server backend or dedicated GPU hardware. The library leverages WebAssembly SIMD capabilities to achieve efficient execution within modern browsers while maintaining compatibility across platforms. By running models locally on the user’s device, wllama... -
14
MiroFish
A Simple and Universal Swarm Intelligence Engine
MiroFish is a next-generation artificial intelligence prediction engine that leverages multi-agent technology and swarm-intelligence simulation to model, simulate, and forecast complex real-world scenarios. The system extracts “seed” information from sources such as breaking news, policy documents, and market signals to construct a high-fidelity digital parallel world populated by thousands of virtual agents with independent memory and behavior rules. Users can inject variables or conditions... -
15
BigMac
An open-source toolkit for BigMac-style pipeline-parallel training
BigMac is an open-source toolkit for pipeline-parallel training of multimodal large language models. It preserves optimized language-model pipeline schedules while placing encoder and generator work around them. This design reduces activation memory without bringing back cross-module pipeline bubbles. Its scheduler creates global operator plans, while its executor runs those plans through a shared schedule abstraction. -
16
CGraph
A general, three-party dependency-free, cross-platform
CGraph is a high-performance, cross-platform Directed Acyclic Graph (DAG) framework implemented in pure C++ with no third-party dependencies, designed for building complex task pipelines and parallel execution workflows. It allows developers to model computational processes as graph structures, where nodes represent tasks and edges define dependencies, enabling efficient scheduling and execution. The framework includes a pipeline system that supports sequential and parallel execution,... -
17
DFlash
Block Diffusion for Ultra-Fast Speculative Decoding
DFlash is an open-source framework for ultra-fast speculative decoding using a lightweight block diffusion model to draft text in parallel with a target large language model, dramatically improving inference speed without sacrificing generation quality. It acts as a “drafter” that proposes likely continuations which the main model then verifies, enabling significant throughput gains compared to traditional autoregressive decoding methods that generate token by token. -
18
Stanza
Stanford NLP Python library for many human languages
...Starting from raw text to syntactic analysis and entity recognition, Stanza brings state-of-the-art NLP models to languages of your choosing. Stanza is a Python natural language analysis package. It contains tools, which can be used in a pipeline, to convert a string containing human language text into lists of sentences and words, to generate base forms of those words, their parts of speech and morphological features, to give a syntactic structure dependency parse, and to recognize named entities. The toolkit is designed to be parallel among more than 70 languages, using the Universal Dependencies formalism. ... -
19
MathCode
A Frontier Mathematical Coding Agent
MathCode is a terminal-based AI coding assistant focused on mathematical formalization and theorem proving. It is designed to transform plain-language mathematical reasoning into verified Lean 4 code and formal proofs. The project combines AI agents with Lean Language Server Protocol integration, allowing it to inspect compiler feedback, search for lemmas, and iteratively repair failed proof attempts. It supports an agentic proving workflow where the system behaves more like an interactive... -
20
Xtuner
A Next-Generation Training Engine Built for Ultra-Large MoE Models
Xtuner is a large-scale training engine designed for efficient training and fine-tuning of modern large language models, particularly mixture-of-experts architectures. The framework focuses on enabling scalable training for extremely large models while maintaining efficiency across distributed computing environments. Unlike traditional 3D parallel training strategies, XTuner introduces optimized parallelism techniques that simplify scaling and reduce system complexity when training massive models. ... -
21
Atropos
Language Model Reinforcement Learning Environments frameworks
...It provides foundational tooling for asynchronous RL loops where environment services communicate with trainers and inference engines, enabling complex workflow orchestration in distributed and parallel setups. This framework facilitates experimentation with RLHF (Reinforcement Learning from Human Feedback), RLAIF, or multi-turn training approaches by abstracting environment logic, scoring, and logging into reusable components. -
22
magentic
Seamlessly integrate LLMs as Python functions
Easily integrate Large Language Models into your Python code. Simply use the @prompt and @chatprompt decorators to create functions that return structured output from the LLM. Mix LLM queries and function calling with regular Python code to create complex logic. -
23
MiniMax-01
Large-language-model & vision-language-model based on Linear Attention
MiniMax-01 is the official repository for two flagship models: MiniMax-Text-01, a long-context language model, and MiniMax-VL-01, a vision-language model built on top of it. MiniMax-Text-01 uses a hybrid attention architecture that blends Lightning Attention, standard softmax attention, and Mixture-of-Experts (MoE) routing to achieve both high throughput and long-context reasoning. It has 456 billion total parameters with 45.9 billion activated per token and is trained with advanced parallel strategies such as LASP+, varlen ring attention, and Expert Tensor Parallelism, enabling a training context of 1 million tokens and up to 4 million tokens at inference. ... -
24
Step3-VL-10B
Multimodal model achieving SOTA performance
Step3-VL-10B is an open-source multimodal foundation model developed by StepFun AI that pushes the boundaries of what compact models can achieve by combining visual and language understanding in a single architecture. Despite having only about 10 billion parameters, it delivers performance that rivals or even surpasses much larger models (10×–20× larger) on a wide range of multimodal benchmarks covering reasoning, perception, and complex tasks, positioning it as one of the most powerful... -
25
Colossal-AI
Making large AI models cheaper, faster and more accessible
...However, distributed training, especially model parallelism, often requires domain expertise in computer systems and architecture. It remains a challenge for AI researchers to implement complex distributed training solutions for their models. Colossal-AI provides a collection of parallel components for you. We aim to support you to write your distributed deep learning models just like how you write your model on your laptop.
