Search Results for "parallel"
Sort By:
Showing 19 open source projects for "parallel"
View related business solutions-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
parallel-ssh
Asynchronous parallel SSH client library.
parallel-ssh is an asynchronous parallel SSH library designed for large-scale automation. It differentiates itself from alternatives, other libraries and higher-level frameworks like Ansible or Chef in several ways. -
2
Otter-Grader
A Python and R autograding solution
...It is designed to work with classes at any scale by abstracting away the autograding internals in a way that is compatible with any instructor's assignment distribution and collection pipeline. Otter supports local grading through parallel Docker containers, grading using the autograder platforms of 3rd party learning management systems (LMSs), the deployment of an Otter-managed grading virtual machine, and a client package that allows students to run public checks on their own machines. Otter is designed to grade Python scripts and Jupyter Notebooks, and is compatible with a few different LMSs, including Canvas and Gradescope. -
3
GenAI Processors
GenAI Processors is a lightweight Python library
...Its central abstraction is the Processor, a unit of work that consumes an asynchronous stream of parts (text, images, audio, JSON) and produces another stream, making it natural to chain operations and keep everything streaming end-to-end. Processors can be composed sequentially (to build multi-step flows) or in parallel (to fan-out work and merge results), which makes sophisticated agent behaviors easy to express with simple operators. The library offers built-in processors for classic turn-based Gemini calls as well as Live API streaming, so you can mix “batch” and real-time interactions in the same graph. It leans on Python’s asyncio to coordinate concurrency, handle network I/O, and juggle background compute threads without blocking. -
4
jlens
Companion code for the global workspace interpretability paper
...The transformed vectors are decoded through the model’s own unembedding into ranked vocabulary predictions. The package can fit new lenses, load saved ones, apply them to prompts, and merge results from parallel fitting jobs. Interactive layer-by-position views reveal how token rankings evolve across the network and compare them with the model’s final output. It supports open-weight Hugging Face decoder models, with Qwen used in the included examples. The repository also provides synthetic evaluation data and an end-to-end notebook, but it is not maintained. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
mosdepth
fast BAM/CRAM depth calculation for WGS, exome, or targeted sequencing
mosdepth is a fast BAM/CRAM depth calculation tool for genomic data, allowing efficient computation of sequencing coverage. -
6
PyOpenCL
OpenCL integration for Python, plus shiny features
PyOpenCL is a Python wrapper for the OpenCL framework, providing seamless access to parallel computing on CPUs, GPUs, and other accelerators. It enables developers to harness the full power of heterogeneous computing directly from Python, combining Python’s ease of use with the performance benefits of OpenCL. PyOpenCL also includes convenient features for managing memory, compiling kernels, and interfacing with NumPy, making it a preferred choice in scientific computing, data analysis, and machine learning workflows that demand acceleration. -
7
LangExtract
A Python library for extracting structured information
...LangExtract supports a wide range of models, including Google Gemini, OpenAI GPT, and local LLMs via Ollama, making it adaptable to different deployment environments and compliance needs. The system excels at handling long documents using optimized chunking, multi-pass extraction, and parallel processing to ensure both high recall and structured consistency. -
8
Nevergrad
A Python toolbox for performing gradient-free optimization
Nevergrad is a Python library for derivative-free optimization, offering robust implementations of many algorithms suited for black-box functions (i.e. functions where gradients are unavailable or unreliable). It targets hyperparameter search, architecture search, control problems, and experimental tuning—domains in which gradient-based methods may fail or be inapplicable. The library provides an easy interface to define an optimization problem (parameter space, loss function, budget) and... -
9
Stanza
Stanford NLP Python library for many human languages
...It contains tools, which can be used in a pipeline, to convert a string containing human language text into lists of sentences and words, to generate base forms of those words, their parts of speech and morphological features, to give a syntactic structure dependency parse, and to recognize named entities. The toolkit is designed to be parallel among more than 70 languages, using the Universal Dependencies formalism. Stanza is built with highly accurate neural network components that also enable efficient training and evaluation with your own annotated data. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
10
DeepEP
DeepEP: an efficient expert-parallel communication library
DeepEP is a communication library designed specifically to support Mixture-of-Experts (MoE) and expert parallelism (EP) deployments. Its core role is to implement high-throughput, low-latency all-to-all GPU communication kernels, which handle the dispatching of tokens to different experts (or shards) and then combining expert outputs back into the main data flow. Because MoE architectures require routing inputs to different experts, communication overhead can become a bottleneck — DeepEP... -
11
eCxx
A C++ library for AVR and NodeMCU
NOTE: This project is marked with 'Status: Abandoned' on SourceForge because not enough time can be dedicated to this project. However it may still get sporadic commits to the repository. eCxx is a library for AVR and NodeMCU tailored for micro LED displays and lighting effects. eCxx is utilizing Makefile build system. Java and Python based applications/tools are also included to ease the development and debugging process using the host PC. On one side, eCxx supports the original... -
12
FairScale
PyTorch extensions for high performance and large scale training
FairScale is a collection of PyTorch performance and scaling primitives that pioneered many of the ideas now used for large-model training. It introduced Fully Sharded Data Parallel (FSDP) style techniques that shard model parameters, gradients, and optimizer states across ranks to fit bigger models into the same memory budget. The library also provides pipeline parallelism, activation checkpointing, mixed precision, optimizer state sharding (OSS), and auto-wrapping policies that reduce boilerplate in complex distributed setups. ... -
13
Fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python
Fairseq(-py) is a sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling and other text generation tasks. We provide reference implementations of various sequence modeling papers. Recent work by Microsoft and Google has shown that data parallel training can be made significantly more efficient by sharding the model parameters and optimizer state across data parallel workers. These ideas are encapsulated in the new FullyShardedDataParallel (FSDP) wrapper provided by fairscale. Fairseq can be extended through user-supplied plug-ins. Models define the neural network architecture and encapsulate all of the learnable parameters. ... -
14
RecNN
Reinforced Recommendation toolkit built around pytorch 1.7
This is my school project. It focuses on Reinforcement Learning for personalized news recommendation. The main distinction is that it tries to solve online off-policy learning with dynamically generated item embeddings. I want to create a library with SOTA algorithms for reinforcement learning recommendation, providing the level of abstraction you like. -
15
ComplexEventExtraction
Expression pattern collection of Chinese compound event extraction
ComplexEventExtraction is a Chinese NLP project for identifying relationships between events expressed in compound sentences. It defines patterns for causal, conditional, sequential, contrastive, and parallel event structures. The system uses explicit connective words and phrase combinations to split text into linked event pairs. Extracted results can support event graphs that represent how situations develop, conflict, or depend on one another. The repository catalogs hundreds of linguistic patterns and demonstrates them on a large Chinese news corpus. ... -
16
PyCNN
Image Processing with Cellular Neural Networks in Python
Image Processing with Cellular Neural Networks in Python. Cellular Neural Networks (CNN) are a parallel computing paradigm that was first proposed in 1988. Cellular neural networks are similar to neural networks, with the difference that communication is allowed only between neighboring units. Image Processing is one of its applications. CNN processors were designed to perform image processing; specifically, the original application of CNN processors was to perform real-time ultra-high frame-rate (>10,000 frame/s) processing unachievable by digital processors. -
17
Robot Framework FTP Library
FTP client for Robot Framework
SOURCE CODE MOVED TO https://github.com/kowalpy/Robot-Framework-FTP-Library . NEW RELEASES WILL APPEAR ONLY AT GITHUB AND PYPI. This Python library makes it possible to test or use FTP server using Robot Framework keywords. Together with the library, there are also available project example and keywords documentation created by libdoc. This sourceforge webpage is linked from http://robotframework.org/#test-libraries as external library so it can be considered as the official Robot... -
18
PyMW is a Python module for parallel master-worker computing in a variety of environments. With the PyMW module, users can write a single program that scales from multicore machines to global computing platforms.
-
19
nVidia CUDA and MPI python wrappers. These wrappers are written in pure C no swig or boost necessary. The CUDA wrapper exposes the CUDA runtime and Driver API's.
- Previous
- You're on page 1
- Next
