Search Results for "context" - Page 72
Sort By:
Showing 1844 open source projects for "context"
View related business solutions-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
1
MiMo-V2.5
Omnimodal AI model for agents, coding, and long-context tasks
MiMo-V2.5 is a native omnimodal large language model developed by Xiaomi, designed for advanced agentic workflows, multimodal reasoning, and long-context processing. Built on a Mixture-of-Experts architecture with approximately 309B total parameters and around 15B activated per inference, it balances high capability with efficient execution. The model natively processes text, images, video, and audio within a unified system, enabling cross-modal understanding and complex task execution in a single pipeline. ... -
2
DeepSeek-V4-Flash
Efficient MoE model for million-token reasoning and coding
DeepSeek-V4-Flash is a preview Mixture-of-Experts language model built for efficient million-token context intelligence. It has 284B total parameters with 13B activated and supports a 1M-token context window, making it suitable for long-document reasoning, complex coding, agentic workflows, and large-scale information processing. The model uses a hybrid attention architecture that combines Compressed Sparse Attention and Heavily Compressed Attention to improve long-context efficiency, while Manifold-Constrained Hyper-Connections strengthen signal stability across layers. ... -
3
Qwen3-Next
Qwen3-Next: 80B instruct LLM with ultra-long context up to 1M tokens
Qwen3-Next-80B-A3B-Instruct is the flagship release in the Qwen3-Next series, designed as a next-generation foundation model for ultra-long context and efficient reasoning. With 80B total parameters and 3B activated at a time, it leverages hybrid attention (Gated DeltaNet + Gated Attention) and a high-sparsity Mixture-of-Experts architecture to achieve exceptional efficiency. The model natively supports a context length of 262K tokens and can be extended up to 1 million tokens using RoPE scaling (YaRN), making it highly capable for processing large documents and extended conversations. ... -
4
Hunyuan-A13B-Instruct
Efficient 13B MoE language model with long context and reasoning modes
...Open-source under a custom license, it's ideal for researchers and developers seeking scalable, high-context AI capabilities with optimized inference. -
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
5
Postproxy-MCP
MCP (Model Context Protocol) server for integrating PostProxy API
PostProxy MCP is a Model Context Protocol (MCP) server that integrates the PostProxy API directly into Claude Code, enabling AI-assisted publishing to social media platforms like Instagram, YouTube, TikTok, Facebook, LinkedIn, X/Twitter, and Threads. -
6
Hy3 preview
Efficient MoE model for reasoning, coding, and AI agent workflows
Hy3 preview is Tencent Hunyuan’s latest open-weight Mixture-of-Experts language model, designed for advanced reasoning, coding, instruction following, and autonomous agent workflows. It is the first model built on Tencent’s rebuilt training infrastructure and introduces significant improvements in context learning, software engineering, and tool-based task execution. The model features 295B total parameters with only 21B activated during inference, plus a dedicated 3.8B Multi-Token Prediction (MTP) layer that accelerates generation through speculative decoding. Architecturally, it uses 192 routed experts with top-8 activation, a dense-MoE hybrid design, and a native 256K-token context window. ... -
7
Qwen2-7B-Instruct
Instruction-tuned 7B language model for chat and complex tasks
...Built on a transformer architecture with SwiGLU activation and group query attention, it is optimized for chat, reasoning, coding, multilingual tasks, and extended context understanding up to 131,072 tokens. The model was pretrained on a large-scale dataset and aligned via supervised fine-tuning and direct preference optimization. It shows strong performance across benchmarks such as MMLU, MT-Bench, GSM8K, and Humaneval, often surpassing similarly sized open-source models. Designed for conversational use, it integrates with Hugging Face Transformers and supports long-context applications via YARN and vLLM for efficient deployment. -
8
QwQ-32B
QwQ-32B is a reasoning-focused language model for complex tasks
...For long input handling, it supports YaRN (Yet another RoPE Namer) for context scaling. -
9
LongCat-2.0
Trillion-parameter MoE model for coding and million-token reasoning
...The model was pretrained on more than 35 trillion tokens and trained entirely on a large-scale cluster of domestically developed AI accelerators, demonstrating stable frontier-scale training without rollback events. LongCat-2.0 introduces LongCat Sparse Attention and extensive 1M-context training, enabling native processing of million-token inputs for long-document analysis, repository-scale coding, and complex multi-step reasoning. Dedicated post-training further strengthens coding and agent performance, producing competitive benchmark results against leading proprietary models. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
10
Devstral Small 2
Lightweight 24B agentic coding model with vision and long context
...The model achieves competitive performance on SWE-bench, validating its effectiveness for real-world coding and automation tasks. It introduces vision capabilities, enabling image understanding alongside text for more versatile development workflows. Devstral Small 2 supports a 256k context window, allowing it to reason across large repositories, long diffs, and extended technical contexts. Its architecture improves generalization across diverse prompts and coding environments while leveraging advanced attention scaling techniques. -
11
Qwen2.5-14B-Instruct
Powerful 14B LLM with strong instruction and long-text handling
Qwen2.5-14B-Instruct is a powerful instruction-tuned language model developed by the Qwen team, based on the Qwen2.5 architecture. It features 14.7 billion parameters and is optimized for tasks like dialogue, long-form generation, and structured output. The model supports context lengths up to 128K tokens and can generate up to 8K tokens, making it suitable for long-context applications. It demonstrates improved performance in coding, mathematics, and multilingual understanding across over 29 languages. Qwen2.5-14B-Instruct is built on a transformer backbone with RoPE, SwiGLU, RMSNorm, and attention QKV bias. ... -
12
Hy4 preview
770B MoE model for coding, research, reasoning, and long-context work
...Its architecture uses Gated DeepSeek Sparse Attention with IndexCache for cross-layer sparse-index reuse and identity Hyper-Connections to improve information flow. A native 10B-parameter Multi-Token Prediction layer enables speculative decoding for faster inference. Hy4-preview supports a native 1M-token context window, allowing it to process large codebases, numerous files, and complex extended workflows. Tencent specifically optimized the model for software engineering, office and financial analysis, game development, and scientific research. -
13
Qwen3.8-Flash-Next
Efficient multimodal MoE model for coding, reasoning, and AI agents
...Its hybrid architecture combines Gated DeltaNet with Qwen Sparse Attention (QSA), which processes micro-blocks rather than individual tokens to reduce latency in long-context agent workloads. The model also introduces Gated Residual connections and scalable n-gram embeddings to improve efficiency while limiting inference overhead. It contains 512 MoE experts, activating 10 routed experts plus one shared expert per token. Qwen3.8-Flash-Next natively handles text, images, and video and supports a 262K-token context window extensible to 1M tokens. ... -
14
GLM-5.3-Flash
Efficient 320B multimodal MoE model for coding and autonomous agents
GLM-5.3-Flash is Z.ai’s natively multimodal model designed for efficient coding, agentic engineering, reasoning, and long-context workloads. It uses a sparse architecture with 320B total parameters and only 18B active parameters, targeting high capability with substantially lower inference costs. The model introduces a hybrid architecture combining sparse and linear attention to reduce long-context serving costs while retaining precise understanding across large inputs. ... -
15
Nemotron 3.5 Lightning
Efficient 30B MoE model for long-running agents and local inference
...It uses a hybrid Mixture-of-Experts architecture combining Mamba-2, MoE, and selected attention layers, with 30B total parameters but only 3B active during inference. The model supports context windows up to 1 million tokens, enabling long-running workflows and large-context reasoning. Its NVFP4 quantization reduces deployment requirements while targeting NVIDIA hardware ranging from DGX Spark and RTX 5090 systems to H100, H200, and GB200 accelerators. NVIDIA also provides DSpark, Multi-Token Prediction, and DFlash speculative decoding methods to accelerate text generation. ... -
16
DiffusionGemma
NVFP4 DiffusionGemma model for fast multimodal text generation
...Its diffusion-based generation produces tokens in parallel 256-token blocks, enabling very high-speed output, with reported generation above 1,100 tokens per second on NVIDIA Hopper H100 in FP8. The model supports a 256K-token context window, configurable thinking mode, native function calling, structured JSON output, and multilingual inference across 35+ languages. The NVFP4 quantization reduces weights and activations from 16-bit to 4-bit, lowering disk size and GPU memory needs for vLLM deployment. -
17
Gemma 4 12B
Unified multimodal Gemma model for local coding and reasoning
...It supports text, image, audio, and video inputs with text output, making it useful for transcription, image understanding, video analysis, coding, and agentic workflows. The model has 11.95B parameters, 48 layers, a 256K-token context window, and support for over 140 languages. It also includes configurable thinking modes, native system prompt support, function calling, and strong benchmark performance for its size. It is optimized for consumer GPUs, workstations, and streamlined local deployment. -
18
Qwen3.6-35B-A3B-FP8
FP8 Qwen model for efficient multimodal coding and agent tasks
...It is a multimodal open-weight model that combines a causal language model with a vision encoder, supporting text, image, and video inputs. Built for stability and real-world developer use, it emphasizes agentic coding, repository-level reasoning, and productive long-context workflows. A key capability is thinking preservation, which allows the model to retain reasoning traces from earlier messages, helping reduce repeated computation and improving consistency in iterative tasks. The model uses a Mixture-of-Experts design with 35B total parameters and 3B active, supports a native context window of 262,144 tokens, and can be extended to about 1,010,000 tokens with YaRN. ... -
19
Kimi K2.7 Code
Coding-focused Kimi model for long-horizon agent workflows
...It improves end-to-end task completion across real-world programming scenarios while reducing thinking-token usage by about 30% compared with K2.6. Architecturally, it uses a 1T-parameter Mixture-of-Experts design with 32B activated parameters, 61 layers, 384 experts, a 256K-token context window, and a MoonViT vision encoder. The model supports image and video input, native INT4 quantization, interleaved thinking, and multi-step tool calling. It also forces preserve-thinking mode by default, retaining full reasoning context across multi-turn interactions to improve coding-agent consistency. K2.7 Code is recommended for use through Kimi Code CLI and can be deployed with vLLM, SGLang, or KTransformers. -
20
Mistral Large 3 675B Base 2512
Frontier-scale 675B multimodal base model for custom AI training
...As the base version, it is not fine-tuned for instruction following or reasoning, making it ideal for teams planning their own domain-specific finetuning or custom training pipelines. The model is engineered for reliability, long-context comprehension, and stable performance across many enterprise, scientific, and knowledge-intensive workloads. Its architecture includes a powerful language MoE and a 2.5B-parameter vision encoder, enabling multimodal understanding out of the box. Mistral Large 3 Base supports deployment on-premises using FP8 or NVFP4 formats, enabling high-performance workflows on B200, H200, H100, or A100 hardware. -
21
Mistral Large 3 675B Instruct 2512 NVFP4
Quantized 675B multimodal instruct model optimized for NVFP4
...This NVFP4 checkpoint is a post-training-activation quantized version of the original instruct model, created through a collaboration between Mistral AI, vLLM, and Red Hat using llm-compressor. It retains the same instruction-tuned behavior as the FP8 model, making it ideal for production assistants, agentic workflows, scientific tasks, and long-context enterprise systems. The model integrates a 673B-parameter MoE language backbone with a 2.5B-parameter vision encoder, enabling rich multimodal analysis across text and images. Designed for efficient deployment, it runs on a single H100 or A100 node in NVFP4 while delivering performance similar to FP8 for short- and mid-context workloads. -
22
Mistral Large 3 675B Instruct 2512
Frontier-scale 675B multimodal instruct MoE model for enterprise AIMis
...With a 256k context window, it excels at long-document comprehension, deep retrieval workflows, and complex knowledge-intensive tasks. -
23
Ministral 3 3B Reasoning 2512
Compact 3B-param multimodal model for efficient on-device reasoning
...It supports dozens of languages, allowing it to function across global and multilingual contexts. The model retains strong system-prompt adherence, supports function-calling with structured JSON output, and offers a large 256k token context window for extended context reasoning. -
24
Alpamayo 2 Super
Open VLA model for autonomous driving reasoning and planning
...Built on the NVIDIA Cosmos platform, it enables vehicles to perceive, reason, plan, and generate driving actions using human-like decision making rather than relying solely on predefined rules. The model processes multi-camera video, navigation signals, and driving context to produce driving trajectories alongside interpretable Chain-of-Causation reasoning, improving transparency for validation and safety analysis. Alpamayo2-Super is part of the broader NVIDIA Alpamayo ecosystem, which also includes simulation frameworks, reinforcement learning infrastructure, datasets, and physical AI tools for end-to-end autonomous vehicle development. ... -
25
Llama-3.2-1B
Llama 3.2–1B: Multilingual, instruction-tuned model for mobile AI
...Llama 3.2-1B outperforms other open models in several benchmarks relative to its size and offers quantized versions for efficiency. It uses a refined transformer architecture with Grouped-Query Attention (GQA) and supports long context windows of up to 128k tokens.
