Search Results for "moves"

Besides the usual FP32, it supports FP16, quantized INT4, INT5 and INT8 inference. This project is focused on CPU, but cuBLAS is also supported. RWKV is a novel large language model architecture, with the largest model in the family having 14B parameters. In contrast to Transformer with O(n^2) attention, RWKV requires only state from the previous step to calculate logits. This makes RWKV very CPU-friendly on large context lengths.

...Inference runs fully locally after model weights are downloaded and does not require PyTorch, Transformers, or a cloud API. The runtime supports English, multilingual, and typed-decision Laya checkpoints while preserving their original calibration and output formats. Its implementation moves the encoder, decision transformer, scoring head, and action head into MLX. The project reports short-decision latency in the single-digit to low-teens millisecond range on an M3 Max, depending on the checkpoint. It also includes routing utilities, demos, validation tests, benchmarks, and a Python API.

Step-Audio is a unified, open-source framework aimed at building intelligent speech systems that combine both comprehension and generation: it integrates large language models (LLMs) with speech input/output to handle not only semantic understanding but also rich vocal characteristics like tone, style, dialect, emotion, and prosody. The design moves beyond traditional separate-component pipelines (ASR → text model → TTS), instead offering a multimodal model that ingests speech or audio and produces speech accordingly, enabling natural dialogue, voice cloning, and expressive speech synthesis. Through its architecture, Step-Audio supports multilingual interaction, dialects, emotional tones (joy, sadness, etc.), and even more creative speech styles (like rap or singing), while allowing dynamic control over speech characteristics. ...