Search Results for "parallel"

...It supports multi-GPU and multi-node distributed training using DDP, FSDP, and tensor parallelism, capable of scaling up to 70B+ parameter models. The framework integrates seamlessly with PyTorch 2.x features such as torch.compile, Fully Sharded Data Parallel (FSDP), and modern configuration management.

Sombrero is a fast wavelet image processing and object detection C library for astronomical images. Sombrero is named after the "Mexican Hat" shape of the wavelet masks used in image convolution and is released under the GNU LGPL library.

Grenade is a composable, dependently typed, practical, and fast recurrent neural network library for concise and precise specifications of complex networks in Haskell. Because the types are so rich, there's no specific term level code required to construct this network; although it is of course possible and easy to construct and deconstruct the networks and layers explicitly oneself. Networks in Grenade can be thought of as a heterogeneous list of layers, where their type includes not only...

...It's aim is to compare the efficiency of both technologies and to check where which hacks works better. What is more one of my tasks is to compare different ways of decomposing computations in parallel.

FlexCRFs: A Flexible Conditional Random Fields Toolkit for Labeling and Segmenting Sequence Data (this includes a parallel implementation of CRFs called PCRFs to support training CRF models on massively parallel computer systems).