Search Results for "spatial"
Sort By:
Showing 51 open source projects for "spatial"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
Autonomous Agents
Autonomous Agents (LLMs) research papers. Updated Daily
...The project explores how multiple agents can cooperate and interact with complex environments through machine learning, imitation learning, and multimodal sensing. It includes frameworks that integrate visual perception, tactile sensing, and spatial reasoning to guide the actions of robotic agents during manipulation or collaborative tasks. One of the central concepts explored in the repository is the integration of different sensory modalities using advanced machine learning techniques such as Feature-wise Linear Modulation and graph-based attention mechanisms. These methods allow agents to combine visual and geometric information while maintaining awareness of the spatial relationships between agents and objects. -
2
TorchIO
Medical imaging toolkit for deep learning
TorchIO is an open-source Python library for efficient loading, preprocessing, augmentation and patch-based sampling of 3D medical images in deep learning, following the design of PyTorch. It includes multiple intensity and spatial transforms for data augmentation and preprocessing. These transforms include typical computer vision operations such as random affine transformations and also domain-specific ones such as simulation of intensity artifacts due to MRI magnetic field inhomogeneity (bias) or k-space motion artifacts. TorchIO is a Python package containing a set of tools to efficiently read, preprocess, sample, augment, and write 3D medical images in deep learning applications written in PyTorch, including intensity and spatial transforms for data augmentation and preprocessing. ... -
3
ML Ferret
Refer and Ground Anything Anywhere at Any Granularity
...The core idea is a hybrid region representation that mixes discrete coordinates with continuous visual features, so the model can fluidly handle “any-form” referring while maintaining precise spatial localization. The repo presents the vision-language pipeline, model assets, and paper resources that show how Ferret answers questions, follows instructions, and returns grounded outputs rather than just text. In practice, this enables tasks like “find that small red icon next to the chart and describe it” where both the linguistic reference and the visual region are ambiguous without fine spatial reasoning. -
4
Qwen3-VL
Qwen3-VL, the multimodal large language model series by Alibaba Cloud
...Qwen3-VL is built for complex tasks such as GUI automation, multimodal coding (converting images or videos into HTML, CSS, JS, or Draw.io diagrams), long-context reasoning with support up to 1M tokens, and comprehensive video understanding. It also brings advanced perception capabilities, including spatial grounding, object recognition, OCR across 32 languages, and robust handling of challenging inputs like low-light or distorted text. -
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
5
PenEcho
Think with AI beyond the chat box
PenEcho is an open-source shared canvas that makes handwriting, equations, diagrams, and spatial context part of an AI conversation. Users can draw with pressure-sensitive ink, erase, pan, zoom, type formatted text, and arrange ideas across a large virtual workspace. The application sends focused visual regions to an API, Codex CLI, or Claude CLI and converts model responses into editable canvas commands. AI output can include text, formulas, plots, mixed drawings, erasures, and declarative animations. ... -
6
Lyra 2
Project Lyra: Open Generative 3D World Models
...It enables the creation of fully explorable 3D environments from minimal inputs such as a single image or video, leveraging self-distillation methods to generate consistent spatial representations. The system evolves across versions, with newer iterations introducing long-horizon generation and improved 3D consistency across frames. It combines elements of computer vision, generative modeling, and spatial intelligence to produce dynamic and navigable virtual worlds. The architecture is designed to handle both 3D and 4D scene generation, making it suitable for applications such as simulation, gaming, and virtual environments. ... -
7
Step-Video-T2V
State-of-the-art (SoTA) text-to-video pre-trained model
Step-Video-T2V is a state-of-the-art text-to-video foundation model developed to generate videos from natural-language prompts; its 30B-parameter architecture is designed to produce coherent, temporally extended video sequences — up to around 204 frames — based on input text. Under the hood it uses a compressed latent representation (a Video-VAE) to reduce spatial and temporal redundancy, and a denoising diffusion (or similar) process over that latent space to generate smooth, plausible motion and visuals. The model handles bilingual input (e.g. English and Chinese) thanks to dual encoders, and supports end-to-end text-to-video generation without requiring external assets. Its training and generation pipeline includes techniques like flow-matching, full 3D attention for temporal consistency, and fine-tuning approaches (e.g. video-based DPO) to improve fidelity and reduce artifacts. ... -
8
HDBSCAN
A high performance implementation of HDBSCAN clustering
HDBSCAN - Hierarchical Density-Based Spatial Clustering of Applications with Noise. Performs DBSCAN over varying epsilon values and integrates the result to find a clustering that gives the best stability over epsilon. This allows HDBSCAN to find clusters of varying densities (unlike DBSCAN), and be more robust to parameter selection. In practice this means that HDBSCAN returns a good clustering straight away with little or no parameter tuning -- and the primary parameter, minimum cluster size, is intuitive and easy to select. ... -
9
SAM 3D Objects
Models for object and human mesh reconstruction
SAM 3D Objects is a foundation model that reconstructs full 3D geometry, texture, and spatial layout of objects and scenes from a single image. Given one RGB image and object masks (for example, from the Segment Anything family), it can generate a textured 3D mesh for each object, including pose and approximate scene layout. The model is specifically designed to be robust in real-world images with clutter, occlusions, small objects, and unusual viewpoints, where many earlier 3D-from-image systems struggle. ... -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
10
DeepSeek-OCR 2
Visual Causal Flow
...It is designed to handle complex layouts and noisy documents by giving the model causal reasoning capabilities that mimic human visual scanning behavior, enhancing OCR performance on documents with rich spatial structure. The repository provides model code and inference scripts that let researchers and developers run and benchmark the system on both images and PDFs, with support for batch evaluation and optimized pipelines leveraging vLLM and transformers. -
11
Claw3D
Claw3D is an open source 3D engine built on OpenClaw
...It is designed as a 3D “virtual office” where users can observe, manage, and interact with multiple AI agents performing tasks such as coding, reviewing pull requests, and coordinating workflows in real time. Instead of relying on traditional dashboards or logs, Claw3D introduces a spatial interface that allows users to navigate through a simulated office and watch agents collaborate, effectively turning abstract processes into tangible visual interactions. The system supports task assignment, progress tracking, and communication between agents, creating a representation of autonomous or semi-autonomous workflows. ... -
12
CyberPPT
A Codex Skill for generating high-density, editable PowerPoints
...Image-generation blueprints guide reconstruction while native text, shapes, tables, charts, and vectors preserve core editability. Multiple quality gates inspect structure, visuals, overflow, spatial alignment, curves, and editable elements. Delivery includes the PPTX, rendered previews, manifests, and QA results, with failed hard gates blocking completion. -
13
The Agency
A complete AI agency at your fingertips
Agency Agents is an open-source collection of specialized AI agent personas designed to function like a complete virtual agency spanning engineering, design, marketing, product, project management, testing, support, spatial computing, and other specialized roles. Rather than providing generic prompts, the project organizes each agent as a structured expert profile with personality traits, mission, workflow, deliverables, examples, and success metrics so that each one feels more like a reusable operational role than a one-off instruction. The repository is built for people who want role-based AI collaboration, whether that means using the agents directly inside Claude Code, adapting them as references, or converting them for use in other agentic tools such as Cursor, Aider, Windsurf, Gemini CLI, and OpenCode. -
14
Qwen-2.5-VL
Qwen2.5-VL is the multimodal large language model series
Qwen2.5 is a series of large language models developed by the Qwen team at Alibaba Cloud, designed to enhance natural language understanding and generation across multiple languages. The models are available in various sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B parameters, catering to diverse computational requirements. Trained on a comprehensive dataset of up to 18 trillion tokens, Qwen2.5 models exhibit significant improvements in instruction following, long-text generation... -
15
Qwen-Image-Layered
Qwen-Image-Layered: Layered Decomposition for Inherent Editablity
Qwen-Image-Layered is an extension of the Qwen series of multimodal models that introduces layered image understanding, enabling the model to reason about hierarchical visual structures — such as separating foreground, background, objects, and contextual layers within an image. This architecture allows richer semantic interpretation, enabling use cases such as scene decomposition, object-level editing, layered captioning, and more fine-grained multimodal reasoning than with flat image... -
16
49 Agents IDE
Open-source 2D IDE for managing AI agents in native CLIs
49Agents is an open-source “agentic IDE” that reimagines how developers interact with multiple AI agents, terminals, and development environments by placing everything onto a single infinite, zoomable canvas. Instead of relying on traditional tab-based workflows, it provides a spatial interface where terminals, editors, Git views, and monitoring tools coexist as movable panes, enabling users to manage complex multi-agent systems visually and intuitively. The platform is designed to work across multiple machines simultaneously, allowing agents running on different devices or servers to connect to a unified workspace without requiring SSH, which simplifies distributed development workflows. ... -
17
HeavyDB
HeavyDB (formerly MapD/OmniSciDB)
HeavyDB is an open-source GPU-accelerated analytical database designed to perform extremely fast queries on large datasets. The system is built as a SQL-based relational columnar database engine that leverages modern hardware parallelism, including GPUs and multicore CPUs. Its architecture allows users to query datasets containing billions of rows in milliseconds without requiring traditional indexing, pre-aggregation, or sampling techniques. HeavyDB was originally developed as part of the... -
18
BuildingAI
Build your own AI application system for free
...The platform aims to bridge the gap between natural language interfaces and building design tools by allowing AI systems to interpret user instructions and convert them into structured architectural operations. By combining generative AI capabilities with building data models, the system can assist with tasks such as design generation, spatial reasoning, and building component creation. The project is intended for architects, engineers, and developers exploring how AI can automate or augment design workflows in the architecture, engineering, and construction industries. It supports interactions where users describe building features, layouts, or modifications in natural language and the AI translates those instructions into actionable design operations. -
19
VoxelMorph
Unsupervised Learning for Image Registration
VoxelMorph is an open-source deep learning framework designed for medical image registration, a process that aligns multiple medical scans into a common spatial coordinate system. Traditional image registration techniques typically rely on optimization procedures that must be executed separately for each pair of images, which can be computationally expensive and slow. VoxelMorph approaches the problem using neural networks that learn to predict deformation fields that transform one image so that it aligns with another. ... -
20
SlowFast
Video understanding codebase from FAIR for reproducing video models
SlowFast is a video understanding framework that captures both spatial semantics and temporal dynamics efficiently by processing video frames at two different temporal resolutions. The slow pathway encodes semantic context by sampling frames sparsely, while the fast pathway captures motion and fine temporal cues by operating on densely sampled frames with fewer channels. Together, these two pathways complement each other, allowing the network to model both appearance and motion without excessive computational cost. ... -
21
LLaMA-Mesh
Unifying 3D Mesh Generation with Language Models
...As a result, the model can generate mesh models directly from text prompts, explain mesh structures in natural language, or output mixed text-and-mesh sequences. This unified representation enables a single model to operate across both textual and spatial domains. -
22
Seamless Communication
Foundational Models for State-of-the-Art Speech and Text Translation
Seamless Communication is a research project focused on building more integrated, low-latency multimodal communication between humans and AI agents. The motivation is to move beyond “text in, text out” and enable direct, live, multi-turn exchange involving language, gesture, gaze, vision, and modality switching without user friction. The system architecture includes a real-time multimodal signal pipeline for audio, video, and sensor data, a dialog manager that can decide when to act (speak,... -
23
hCaptcha Challenger
Gracefully face hCaptcha challenge with multimodal llms
...Instead of relying on third-party captcha-solving services or browser scripts, the system operates independently by using pretrained neural networks that can classify images, detect objects, and interpret spatial relationships. The framework includes support for multiple types of captcha challenges such as object selection, drag-and-drop puzzles, and image labeling tasks. It implements an agent-style workflow where the system interprets the challenge prompt, selects the appropriate vision model, and generates the required interaction automatically. -
24
HY-World 1.5
A Systematic Framework for Interactive World Modeling
...It blends advanced reasoning with multimodal synthesis, enabling agents to describe scenes, generate context-appropriate responses, and contribute to narrative or gameplay flows. The underlying framework typically supports large-context state tracking across extended interactions, blending temporal and spatial multimodal signals. -
25
Mesh R-CNN
code for Mesh R-CNN, ICCV 2019
...Unlike voxel-based or point-based approaches, Mesh R-CNN uses a differentiable mesh representation, allowing it to efficiently refine surface geometry while maintaining high spatial detail. The system combines 2D detection from Mask R-CNN with 3D reasoning modules that output full mesh reconstructions aligned with the input image. It has been evaluated on datasets such as Pix3D, where it demonstrates state-of-the-art performance in reconstructing real-world object geometry.
