Search Results for "types"

...It provides optimized kernels for MLA decoding, including support for variable-length sequences, helping reduce latency and increase throughput in model inference systems using that attention style. The library supports both BF16 and FP16 data types, and includes a paged KV cache implementation with a block size of 64 to efficiently manage memory during decoding. On very compute-bound settings, it can reach up to ~660 TFLOPS on H800 SXM5 hardware, while in memory-bound configurations it can push memory throughput to ~3000 GB/s. The team regularly updates it with performance improvements; for example, a 2025 update claims 5 % to 15 % gains on compute-bound workloads while maintaining API compatibility.

StarSpace is a general-purpose embedding-based learning framework that trains embeddings for entities (words, sentences, users, items) under various supervision signals (classification, ranking, matching). Instead of focusing on one task, StarSpace supports multi-task and multi-domain setups—for instance, you can train embeddings so that textual queries match item descriptions, sentences map to labels, or users align with liked items in the same embedding space. The training objective is...