Search Results for "hardware"

...It supports advanced parallelism strategies including tensor, pipeline, data, expert, and context parallelism, enabling training across massive multi-GPU and multi-node clusters. The framework includes mixed-precision training options such as FP16, BF16, FP8, and FP4 to maximize performance and memory efficiency on modern hardware. Megatron-LM is widely used in research and industry for pretraining GPT-, BERT-, T5-, and multimodal-style models, with tooling for checkpoint conversion and interoperability with Hugging Face. Overall, it is a production-grade system for organizations pushing the limits of large-scale language model training.

...With a focus on the MILP methods we implement a load balancing and speed up the solving process in a multiplicative way. Sometimes we have super-linear speedup with a small set of hardware. With a splitting of problems, parallel computing and distributing the actual best solution to all running processes we solve CBP much faster than a sequential processing can do.

RGP: Red General de Posicionamiento (Project Number P022-06/E16 - Junta de Andalucía) -- General Network Positioning based on open software and hardware. This project is the development and test of the standard IEC-60870-5 application layer protocol

This project aims to build a portable pure C++ framework for GPGPU operations. It is conceived to ease scientific researches that need to speed up algebric and calculus operations on normal hardware, without the need of graphic programming knowledge.