Search Results for "indexing" - Page 2
Sort By:
Showing 47 open source projects for "indexing"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
1
Memvid
Video-based AI memory library. Store millions of text chunks in MP4
...This innovative approach uses standard video containers and offers millisecond-level semantic search across large corpora with dramatically less storage than vector DBs. It's self-contained—no DB needed—and supports features like PDF indexing, chat integration, and cloud dashboards. -
2
claude-obsidian
Claude + Obsidian knowledge companion
...The system follows the LLM Wiki pattern, where information is stored as persistent markdown files that grow richer over time through cross-referencing and synthesis. It includes features such as contradiction detection, orphaned note identification, and automatic indexing. A persistent memory layer ensures continuity across sessions, eliminating the need for repeated context. It also performs autonomous research to fill knowledge gaps and expand the knowledge base. Overall, it turns note-taking into an active, compounding intelligence system. -
3
WeKnora
LLM framework for document understanding and semantic retrieval
WeKnora is an open source framework developed for deep document understanding and semantic information retrieval using large language models. It focuses on analyzing complex and heterogeneous documents by combining multiple processing stages such as multimodal document parsing, vector indexing, and intelligent retrieval. It follows the Retrieval-Augmented Generation (RAG) paradigm, where relevant document segments are retrieved and used by language models to generate accurate, context-aware responses. This approach enables the system to provide more reliable answers by grounding model reasoning in the content of uploaded documents. ... -
4
PipesHub
Workplace AI platform for enterprise search and workflow automation
PipesHub AI is an open-source, enterprise-grade workplace AI platform designed to unify search, knowledge management, and workflow automation across distributed organizational systems. It connects to a wide range of enterprise tools such as Google Workspace, Slack, Jira, and Confluence, aggregating data into a centralized knowledge layer that can be queried using natural language. The platform uses knowledge graphs and ranking algorithms to provide context-rich answers along with traceable... -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
DocuBrowse
This does for Documents what repo-browser does for repos
DocuBrowse is a local AI-powered document search engine for personal or professional file collections. It indexes documents such as PDFs, Word files, spreadsheets, presentations, ebooks, HTML, text, and Markdown. The system combines SQLite FTS5 keyword search with local semantic embeddings for meaning-based retrieval. Users can click search results to generate an AI synopsis before opening the original file. It runs entirely on the user’s machine with Ollama models, so it does not require... -
6
The Hypersim Dataset
Photorealistic Synthetic Dataset for Holistic Indoor Scene
Hypersim is a large-scale, photorealistic synthetic dataset and tooling suite for indoor scene understanding research. It provides richly annotated renderings—RGB, depth, surface normals, instance and semantic segmentations, and material/lighting metadata—produced from high-fidelity virtual environments. The dataset spans diverse furniture layouts, room types, and camera trajectories, enabling robust training for geometry, segmentation, and SLAM-adjacent tasks. Rendering pipelines and... -
7
SeaGOAT
local-first semantic code search engine
SeaGOAT is an open-source semantic code search engine designed to help developers explore and understand large codebases more efficiently. Instead of relying solely on traditional keyword search, it uses vector embeddings to represent the meaning of code and queries, allowing users to perform semantic searches that find relevant code even when the exact keywords are not present. The tool runs locally on a developer’s machine and processes repositories using a combination of embedding models... -
8
tldw Server
Your Personal Research Multi-Tool
tldw-server (mirror) is a mirrored distribution of an open-source backend service designed to store, process, and serve summarized information extracted from long pieces of content. The name “tldw” reflects the phrase “too long; didn’t watch,” which refers to tools that condense lengthy videos, articles, or documents into concise summaries. The server component typically acts as the core infrastructure that manages summaries, metadata, and retrieval operations for client applications or user... -
9
Haystack
Haystack is an open source NLP framework to interact with your data
Apply the latest NLP technology to your own data with the use of Haystack's pipeline architecture. Implement production-ready semantic search, question answering, summarization and document ranking for a wide range of NLP applications. Evaluate components and fine-tune models. Ask questions in natural language and find granular answers in your documents using the latest QA models with the help of Haystack pipelines. Perform semantic search and retrieve ranked documents according to meaning,... -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
10
TypeAgent Python
Structured RAG: ingest, index, query
TypeAgent Python is an experimental Python implementation of Microsoft’s TypeAgent architecture designed to explore how large language models can interact with structured software systems. The project focuses on implementing structured Retrieval-Augmented Generation workflows that allow agents to ingest information, index it in structured form, and answer queries using language models. Instead of relying solely on free-form prompts, the architecture emphasizes converting natural language... -
11
yt-fts
Search all of YouTube from the command line
yt-fts, short for YouTube Full Text Search, is an open-source command-line tool that enables users to search the spoken content of YouTube videos by indexing their subtitles. The program automatically downloads subtitles from a specified YouTube channel using the yt-dlp utility and stores them in a local SQLite database. Once indexed, users can perform full-text searches across all transcripts to quickly locate keywords or phrases mentioned within the videos. The tool returns search results with timestamps and direct links to the exact moment in the video where the phrase occurs. ... -
12
Deep Lake
Data Lake for Deep Learning. Build, manage, and query datasets
Deep Lake (or Deeplake, formerly known as Activeloop Hub) is a data lake for deep learning applications. Our open-source dataset format is optimized for rapid streaming and querying of data while training models at scale, and it includes a simple API for creating, storing, and collaborating on AI datasets of any size. It can be deployed locally or in the cloud, and it enables you to store all of your data in one place, ranging from simple annotations to large videos. Deep Lake is used by... -
13
txtai
Build AI-powered semantic search applications
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications. Traditional search systems use keywords to find data. Semantic search applications have an understanding of natural language and identify results that have the same meaning, not necessarily the same keywords. Backed by state-of-the-art machine learning models, data is transformed into vector representations for search (also known as embeddings). Innovation is happening at a rapid... -
14
LexiFinder
AI-powered semantic indexing: automating the creation of book indexes
LexiFinder is a tool to generate analytic indexes from documents automatically. Given one or more source documents and a set of keywords, it extracts all nouns, compares them semantically to the keywords using a pretrained NLP model, and produces a structured, hierarchical index ready to be included in a book or manuscript. LexiFinder works in two ways: as a command-line tool for scripting, automation, and batch processing, and as a graphical application for a guided, point-and-click... -
15
Tensor Puzzles
Solve puzzles. Improve your pytorch
Tensor Puzzles is an interactive collection of 21 exercises for learning tensor programming in PyTorch and NumPy. Each puzzle asks the learner to recreate a familiar array operation from first principles. Solutions must fit on one short line and use only a restricted set of indexing, arithmetic, comparison, and broadcasting tools. Standard convenience functions such as sum, view, squeeze, and take are intentionally prohibited. This constraint encourages a deeper understanding of shapes, indexing, and vectorized computation. Automated tests and visual examples help learners check their reasoning as they progress. ... -
16
LangChain-ChatGLM-Webui
Automatic question answering for local knowledge bases based on LLM
LangChain-ChatGLM-Webui is an open-source web interface that integrates the ChatGLM large language model with the LangChain framework to create an interactive conversational AI platform. The project provides a graphical interface that allows users to interact with language models through chat sessions while also connecting those models to external knowledge sources. It supports retrieval-augmented generation workflows that enable the system to answer questions based on local documents or... -
17
LLM Applications
A comprehensive guide to building RAG-based LLM applications
LLM Applications is a practical reference repository that demonstrates how to build production-grade applications powered by large language models. The project focuses particularly on Retrieval-Augmented Generation architectures, which combine language models with external knowledge sources to improve accuracy and reliability. It provides step-by-step guidance for constructing systems that ingest documents, split them into chunks, generate embeddings, index them in vector databases, and... -
18
AI-powered enterprise search engine
AI-powered enterprise search engine
AI-powered enterprise search engine is an open-source, AI-powered enterprise search engine designed to help organizations quickly locate and retrieve information scattered across multiple internal tools, documents, and communication platforms. It enables users to search across sources such as Slack, Confluence, Jira, Google Drive, and other enterprise systems, consolidating fragmented knowledge into a single, unified search experience. By leveraging natural language processing, Gerev allows... -
19
Music Source Separation
Separate audio recordings into individual sources
...It aims to give users the ability to take any existing song and decompose it into separate stems (vocals, accompaniment, etc.), or to train custom separation models on their own datasets (e.g. for speech enhancement, instrument isolation, or other audio-separation tasks). The repository provides training scripts (e.g. using datasets such as MUSDB18), preprocessing steps (audio-to-HDF5 packing, indexing), evaluation pipelines, and inference scripts to perform separation on arbitrary audio files. This makes the project useful both for researchers in music information retrieval / audio machine learning and for hobbyists or practitioners who want to experiment with remixing, karaoke, or audio editing. -
20
Paperless-ng
A supercharged version of paperless, scan, index and archive docs
Paperless is a simple Django application running in two parts, a Consumer (the thing that does the indexing) and a Web server (the part that lets you search & download already-indexed documents). Paper is a nightmare. Environmental issues aside, there’s no excuse for it in the 21st century. It takes up space, collects dust, doesn’t support any form of a search feature, indexing is tedious, it’s heavy and prone to damage & loss. I wrote this to make “going paperless” easier. ... -
21
DrQA
Reading Wikipedia to Answer Open-Domain Questions
DrQA is an open-domain question answering system that reads large text corpora—famously Wikipedia—to answer natural language questions with extractive spans. It follows a two-stage pipeline: a fast document retriever first narrows down candidate articles, and a neural machine reader then predicts the exact answer span from those passages. The retriever relies on classic IR features (like TF-IDF and n-gram statistics) to remain lightweight and scalable to millions of documents. The reader is... -
22
Deep-Learning-with-PyTorch-Tutorials
Deep Learning and PyTorch Introduction Video Tutorial with Source Code
Deep-Learning-with-PyTorch-Tutorials is a companion repository for an introductory deep learning course built around PyTorch. It provides source code, notebooks, and presentation materials for a practical video-based learning path. The lessons begin with PyTorch setup, tensors, indexing, mathematical operations, gradients, and basic optimization. They then move into neural networks, logistic regression, multilayer perceptrons, CNNs, ResNet, RNNs, LSTMs, autoencoders, VAEs, GANs, graph convolutional networks, and transfer learning. The repository is designed for learners who want to connect deep learning concepts with executable examples. ...