LTM-2-miniMagic AI
|
SmolLM2Hugging Face
|
|||||
Related Products
|
||||||
About
LTM-2-mini is a 100M token context model: LTM-2-mini. 100M tokens equals ~10 million lines of code or ~750 novels.
For each decoded token, LTM-2-mini’s sequence-dimension algorithm is roughly 1000x cheaper than the attention mechanism in Llama 3.1 405B1 for a 100M token context window.
The contrast in memory requirements is even larger – running Llama 3.1 405B with a 100M token context requires 638 H100s per user just to store a single 100M token KV cache.2 In contrast, LTM requires a small fraction of a single H100’s HBM per user for the same context.
|
About
SmolLM2 is a collection of state-of-the-art, compact language models developed for on-device applications. The models in this collection range from 1.7B parameters to smaller 360M and 135M versions, designed to perform efficiently even on less powerful hardware. These models excel in text generation tasks and are optimized for real-time, low-latency applications, providing high-quality results across various use cases, including content creation, coding assistance, and natural language processing. SmolLM2's flexibility makes it a suitable choice for developers looking to integrate powerful AI into mobile devices, edge computing, and other resource-constrained environments.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Supported
Mac
Supported
Linux
Supported
Cloud
Not Supported
On-Premises
Supported
iPhone
Supported
iPad
Supported
Android
Supported
Chromebook
Not Supported
|
|||||
Audience
AI developers interested in a 100M token context model LLM
|
Audience
Developers and AI enthusiasts looking to integrate compact, high-performance language models into mobile apps, edge computing systems, or other devices with limited processing power
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Not Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Not Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Not Supported
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
Free
Open source
Free Version
Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Not Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationMagic AI
Founded: 2022
United States
magic.dev/
|
Company InformationHugging Face
Founded: 2016
United States
huggingface.co/collections/HuggingFaceTB/smollm2-6723884218bcda64b34d7db9
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Hugging Face
Not Supported
Locally AI
Not Supported
Mirai
Not Supported
Private Mind
Not Supported
Runpod
Not Supported
|
Integrations
Hugging Face
Supported
Locally AI
Supported
Mirai
Supported
Private Mind
Supported
Runpod
Supported
|
|||||
|
|
|