Search Results for "parallel" - Page 17
Sort By:
Showing 1185 open source projects for "parallel"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
1
FairScale
PyTorch extensions for high performance and large scale training
FairScale is a collection of PyTorch performance and scaling primitives that pioneered many of the ideas now used for large-model training. It introduced Fully Sharded Data Parallel (FSDP) style techniques that shard model parameters, gradients, and optimizer states across ranks to fit bigger models into the same memory budget. The library also provides pipeline parallelism, activation checkpointing, mixed precision, optimizer state sharding (OSS), and auto-wrapping policies that reduce boilerplate in complex distributed setups. ... -
2
TextBox
A text generation library with pre-trained language models github.com
...From a model perspective, we incorporate 47 pre-trained language models/modules covering the categories of general, translation, Chinese, dialogue, controllable, distilled, prompting, and lightweight models (modules). From a training perspective, we support 4 pre-training objectives and 4 efficient and robust training strategies, such as distributed data parallel and efficient generation. Compared with the previous version of TextBox, this extension mainly focuses on building a unified, flexible, and standardized framework for better supporting PLM-based text generation models. -
3
OK
Welcome to the future of programming languages
...The language emphasises readability and pushing logic out into functions so cases remain simple. It includes concurrency via a map function that executes callbacks in parallel. The project is illustrative of Duffield’s vision: code should feel “magical to write” by removing what is unnecessary. -
4
WFIO .NET Bindings
.NET bindings for WFIO
This subproject contains a parallel implementation effort for the .NET Virtual Machine. It allows for you to use the WFIO interface in your .NET applications and will include a translation layer so that you can talk to the native WFIO libraries. This subproject exists partially to overcome the 8.3 file naming convention that WFIO itself is limited to. -
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
5
FLoops.jl
Fast sequential, threaded, and distributed for-loops for Julia
Fast sequential, threaded, and distributed for-loops for Julia, fold for humans.FLoops.jl provides a macro @floop. It can be used to generate a fast generic sequential and parallel iteration over complex collections. Furthermore, the loop written in @floop can be executed with any compatible executors. See FoldsThreads.jl for various thread-based executors that are optimized for different kinds of loops. FoldsCUDA.jl provides an executor for GPU. FLoops.jl also provides a simple distributed executor. -
6
webotron
Using industrial automation techniques for creating web scraping tools
Industry uses machines that can easily maim or kill their operators and is also used in very adverse environments. In spite of this, production quality must be close to perfect without reliance on operator skill or attentiveness. Control programs must be robust, yet simple enough to be understood and maintained by non programmer skilled trades like electricians . The main programming model is the PLC which implements double buffering and an event loop. The most advanced production model... -
7
ImageJ2x
Java Image Processing Program
...The program supports simultaneous that number of windows (images), limited only by available memory. It is multithreaded, so that time-consuming operations such as reading lists in parallel with other operations are performed. It can calculate area and pixel value statistics of user-defined selection. It can measure distances and angles. It can record density histograms and line profiles. It supports standard image processing functions such as contrast manipulation, sharpening, smoothing, edge detection and filtering it through all kinds of geometric transformations such as Zoom in / out and rotation. ... -
8
ThreadsX.jl
Parallelized Base functions
...The public API functions of ThreadsX expect that the data structure and function(s) passed as argument are "thread-friendly" in the sense that operating on distinct elements in the given container from multiple tasks in parallel is safe. For example, ThreadsX.sum(f, array) assumes that executing f(::eltype(array)) and accessing elements as in array[i] from multiple threads is safe. -
9
OpenProject Community Ed Virtual Machine
Free & Open Source - Project / Task / Time & Team Management Software
Please click the Files Tab above to get all the related files of this system. ( Right Click Each File, to Open Them in New Tab, one by one, to download them all ) This is a Complete Virtual Machine, with Web Based OpenProject Software, for all sorts of Project Management / Task Management / Time Management & Team Management Activities. This Web Based Software can be operated by all Teams, in parallel, on your local and trusted work network. Have a look at the Video below for details. Refer Wiki for more instructions. -
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
10
Vue Query
Hooks for fetching, caching and updating asynchronous data in Vue
...Transport/protocol/backend agnostic data fetching (REST, GraphQL, promises, whatever!) Auto Caching + Refetching (stale-while-revalidate, Window Refocus, Polling/Realtime) Parallel + Dependent Queries. Mutations + Reactive Query Refetching. Multi-layer Cache + Automatic Garbage Collection. Paginated + Cursor-based Queries. Load-More + Infinite Scroll Queries w/ Scroll Recovery. Request Cancellation. (experimental) Suspense + Fetch-As-You-Render Query Prefetching (experimental) SSR support. If you need to update options on your query dynamically, make sure to pass them as reactive variables. -
11
dispy
Distributed and Parallel Computing with/for Python.
dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing. -
12
Elephas
Distributed Deep learning with Keras & Spark
...Elephas intends to keep the simplicity and high usability of Keras, thereby allowing for fast prototyping of distributed models, which can be run on massive data sets. Elephas implements a class of data-parallel algorithms on top of Keras, using Spark's RDDs and data frames. Keras Models are initialized on the driver, then serialized and shipped to workers, alongside with data and broadcasted model parameters. Spark workers deserialize the model, train their chunk of data and send their gradients back to the driver. The "master" model on the driver is updated by an optimizer, which takes gradients either synchronously or asynchronously. ... -
13
Buck
Build system that encourages the creation of small, reusable modules
...It encourages the creation of small, reusable modules consisting of code and resources, and supports a variety of languages on many platforms. Buck builds independent artifacts in parallel to take advantage of multiple cores on your machine. Further, it reduces incremental build times by keeping track of unchanged modules so that the minimal set of modules is rebuilt. Buck only uses the declared inputs, which means everybody gets the same results. Buck looks at the contents of your inputs, not their timestamps to figure out what needs to be built. ... -
14
rayshade-mathematica
rayshade and POV for Mathematica Export + view
Beautifully Render* your Graphic3D and Shown or Manipulate right in the Front End (without Export to, ie 3DStudio Art Renderer, et al). For use with Mathematica 4.0 - 13.1. Makes file.ray or .pov that will look much like image in notebook except rendered. Works easily/automatically with many Graphics3D (and some Graphic) as well. However graphics in 13.1 is too big to comment on: many will work many not. Has many options to fix renders that aren't so auto. Now very portable... -
15
Fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python
Fairseq(-py) is a sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling and other text generation tasks. We provide reference implementations of various sequence modeling papers. Recent work by Microsoft and Google has shown that data parallel training can be made significantly more efficient by sharding the model parameters and optimizer state across data parallel workers. These ideas are encapsulated in the new FullyShardedDataParallel (FSDP) wrapper provided by fairscale. Fairseq can be extended through user-supplied plug-ins. Models define the neural network architecture and encapsulate all of the learnable parameters. ... -
16
FUNseq
Cell segmentation/tracking for determing aggresive cancer phenotypes
This page shows the cell segmentation/tracking program for FUNseq pipeline. Identifying a sparse subset of cancer cells from a large heterogeneous population, based on aggressive phenotypes (like invasive migration, multipolar divisions, or asymmetric lineage development) is challenging. Also, such aberration identification is critical, as cells exhibiting these characteristics are linearly correlated with poor prognosis. A high-throughput screening microscope has been developed in our... -
17
parallax
a new way to create parallel projects
this project is a simple way to create projects whos depends of parallelism -
18
Crunch
Insane(ly slow but wicked good) PNG image optimization
Crunch is an image compression tool for lossy PNG image file optimization. Using a combination of selective bit depth, color palette reduction and color type, as well as zopfli DEFLATE compression algorithm encoding that employs the pngquant and zopflipng PNG optimization tools, Crunch is effectively able to optimize and compress images with minimal decrease in image quality. While it may produce file size gains larger than those produced by lossless approaches, the impact on image quality... -
19
Mycat2
MySQL Proxy using Java NIO based on Sharding SQL, Calcite
...Any cross-currant cross-table join query, support cross-currant cross-table non-associated query, support cross-currant cross-table association query, support cross-currant cross-table Window grammar, support global secondary index, limited support storage process, support visualization configuration. Support parallel extraction of result sets, support the automatic transfer of back-end result sets, support multiple routing notes, and optimizer notes. Parameterization of the requested SQL, cache physics execution plan, and request of the same parameterization SQL, will avoid some analysis and optimization processes. -
20
With the JServiceServer you can provide services over a network via http (like web services) without any XML-overhead. It has been developed for small computer systems like Java-microcontrollers.
-
21
pacman.store
Pacman Mirror via IPFS for ArchLinux, Endeavouros, Manjaro
...The data is held and shared by a collaborative cluster, which is provided by volunteers. Install ipfs on each of your systems - I recommend my AUR package go-ipfs-git which uses the hardened service file. It makes sense to set the parallel downloads to two and disable the download timeout, to avoid unnecessary aborts if ipfs needs initially a bit more time to find the right peers in the network (especially on high latency internet connections). -
22
ESC/POS Print Driver for PHP
PHP library for printing to ESC/POS-compatible thermal printers
This project implements a subset of Epson's ESC/POS protocol for thermal receipt printers. It allows you to generate and print receipts with basic formatting, cutting, and barcodes on a compatible printer. The library was developed to add drop-in support for receipt printing to any PHP app, including web-based point-of-sale (POS) applications. Many thermal receipt printers support ESC/POS to some degree. This library is designed for use with the composer PHP dependency manager. To make use... -
23
Dispatch-Proxy
Combine internet connections, increase your download speed
dispatch-proxy is a Node.js tool that exposes a local proxy and distributes outgoing connections across multiple network interfaces to combine bandwidth for parallel transfers. Instead of trying to accelerate a single TCP flow, it improves aggregate throughput by load-balancing many connections—useful for download managers, package managers, or browsers that open multiple requests at once. It can bind new outbound sockets to different interfaces, letting a machine take advantage of Wi-Fi and Ethernet (or multiple uplinks) simultaneously. ... -
24
Cyclops
An advanced platform for writing functional applications in Java 8
Fast purely functional datastructures (Vector, Seq / List, LazySeq / LazyList, NonEmptyList, HashSet, TreeSet, TrieSet, HashMap, LinkedMap, MultiMap, TreeMap, BankersQueue, LazyString, Discrete Interval Encoded Tree, Zipper, Range, Tree, DifferenceList, HList, Dependent Map). Structural Pattern Matching API (deconstruct algebraic product and sum types). Improved type safety via the removal of unsafe APIs -- E.g. Unlike Optional, Option has no get method (which could throw a null pointer) --... -
25
Jekyll Avatar
A Jekyll plugin for rendering GitHub avatars
...Jekyll Avatar makes it easy to add GitHub avatars to your Jekyll site by specifying a username. If performance is a concern, Jekyll Avatar is deeply integrated with the GitHub avatar API, ensuring avatars are cached and load in parallel. It even automatically upgrades users to Retina images, when supported.
