Search Results for "summarization"
Sort By:
Showing 63 open source projects for "summarization"
View related business solutions-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Automatic text summarizer
Module for automatic summarization of text documents and HTML pages
Sumy is an automatic text summarization library that provides multiple algorithms for extracting key content from documents and articles. Simple library and command line utility for extracting summary from HTML pages or plain texts. The package also contains a simple evaluation framework for text summaries. Implemented summarization methods are described in the documentation. -
2
LLM TLDR
95% token savings. 155x faster queries. 16 languages
LLM TLDR is a tool that leverages large language models (LLMs) to generate concise, coherent summaries (TL;DRs) of long documents, articles, or text files, helping users quickly understand large amounts of content without reading every word. It integrates with LLM APIs to handle input texts of varying lengths and complexity, applying techniques like chunking, context management, and multi-pass summarization to preserve accuracy even when the source is very large. The system supports both extractive and abstractive summarization styles so that users can choose whether they want condensed highlights or a more narrative paraphrase of key ideas. To enhance usability, LLM-TLDR includes command-line tools and integration examples for common workflows like batch summarization, webhook ingestion, and automation in documentation pipelines. -
3
PaperQA2
High accuracy RAG for answering questions from scientific documents
PaperQA2 is a package for doing high-accuracy retrieval augmented generation (RAG) on PDFs or text files, with a focus on the scientific literature. See our recent 2024 paper to see examples of PaperQA2's superhuman performance in scientific tasks like question answering, summarization, and contradiction detection. In this example we take a folder of research paper PDFs, magically get their metadata - including citation counts and a retraction check, then parse and cache PDFs into a full-text search index, and finally answer the user question with an LLM agent. -
4
Python Client For NLP Cloud
NLP Cloud serves high performance pre-trained or custom models for NER
NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, dialogue summarization, paraphrasing, intent classification, product description and ad generation, chatbot, grammar and spelling correction, keywords and keyphrases extraction, text generation, image generation, blog post generation, source code generation, question answering, automatic speech recognition, machine translation, language detection, semantic search, semantic similarity, tokenization, POS tagging, embeddings, and dependency parsing. ... -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
5
MemPalace
The highest-scoring AI memory system ever benchmarked
MemPalace is an open-source AI memory system designed to solve one of the most persistent limitations of large language models: the loss of context between sessions. Instead of relying on summarization or selective extraction like most memory tools, it takes a radically different approach by storing conversations in their entirety and making them retrievable through structured organization and semantic search. The system is inspired by the classical “memory palace” mnemonic technique, organizing information into hierarchical spaces such as wings, rooms, and halls, which allows AI agents to navigate past knowledge in a more contextual and intuitive way. ... -
6
doccano
Open source annotation tool for machine learning practitioners
...It provides annotation features for text classification, sequence labeling and sequence-to-sequence tasks. So, you can create labeled data for sentiment analysis, named entity recognition, text summarization and so on. Just create a project, upload data and start annotating. You can build a dataset in hours. -
7
tldw Server
Your Personal Research Multi-Tool
...The server component typically acts as the core infrastructure that manages summaries, metadata, and retrieval operations for client applications or user interfaces. In practical deployments, a system like this can support AI-powered summarization pipelines that process transcripts, articles, or other long-form material and store condensed versions for easier consumption. The mirrored project hosted on SourceForge exists to preserve the availability of the code and provide an alternative download location for developers and researchers. Such servers are commonly integrated with AI models that generate summaries and tag content automatically. -
8
Claude Cookbooks
A collection of notebooks/recipes showcasing ways of using Claude
Claude Cookbooks is a curated collection of practical examples, notebooks, and implementation guides that demonstrate how to effectively use Claude’s API across a wide range of tasks. It serves as both a learning resource and a reference library, helping developers understand how to apply AI capabilities such as classification, summarization, and retrieval-augmented generation in real-world scenarios. The repository includes structured examples for integrating Claude with external tools, databases, and APIs, showcasing how to extend its functionality beyond basic text generation. It also covers advanced techniques like sub-agent orchestration, prompt optimization, and automated evaluation workflows. ... -
9
NVIDIA AI Blueprint
Suite of reference architectures for building GPU-accelerated vision
...The project is organized around real-time video intelligence, downstream analytics, and agentic offline processing. It supports workflows such as natural-language video search, visual question answering, long-video summarization, clip retrieval, verified alerts, and incident analysis. It is designed for technical users who need deployable reference architectures for smart spaces, warehouse automation, SOP validation, monitoring, and operational video analytics. The repository includes Python agent code, Docker Compose deployment configurations, skills, scripts, and a Next.js-based UI. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
10
LongBench
LongBench v2 and LongBench (ACL 25'&24')
...LongBench addresses this gap by providing datasets that require models to process and reason over long sequences of text across multiple tasks. The benchmark includes multiple categories such as single-document question answering, multi-document reasoning, summarization, long dialogue understanding, and code analysis. It supports bilingual evaluation in English and Chinese to assess multilingual capabilities across extended contexts. Newer versions of the benchmark introduce extremely long context windows ranging from thousands to millions of tokens, enabling researchers to test the limits of modern long-context models. -
11
Hallucination Leaderboard
Leaderboard Comparing LLM Performance at Producing Hallucinations
...The project provides a standardized benchmark that evaluates different models using a dedicated hallucination detection system known as the Hallucination Evaluation Model. Each model is tested on document summarization tasks to measure how often generated responses introduce information that is not supported by the original source material. The results are published as a leaderboard that allows researchers and developers to compare model reliability and factual consistency. By focusing on hallucination rates rather than traditional metrics such as accuracy or fluency, the benchmark highlights an important aspect of AI system safety and trustworthiness. ... -
12
Live Agent Studio
Open source AI Agents hosted on the oTTomator Live Agent Studio
Live Agent Studio is a curated repository of open-source AI agents associated with the oTTomator Live Agent Studio platform, showcasing a variety of agent implementations that illustrate how autonomous and semi-autonomous tools can be constructed using modern AI frameworks. Each agent in the collection is designed for a specific use case — such as content summarization, task automation, travel planning, or RAG workflows — and is provided with the code or configuration needed to explore and extend it on your own, making the repository both a learning resource and a practical starting point for real projects. The repository is community focused, with sample agents like tweet generators, smart selectors, research assistants, and multi-tool workflows that show how agents can integrate with tools like n8n or custom Python code. ... -
13
TrendRadar
AI-driven public opinion trend monitor with multi-platform aggregation
TrendRadar is an AI-powered trend and hotspot tracking system that aggregates information from dozens of news, social, and content platforms to help users cut through information overload and focus on what matters. It automatically crawls and monitors trends across 30+ sources with smart filtering, keyword triggers, sentiment analysis, and natural language summarization to give actionable insights. The tool supports multiple alert modes—such as daily summaries, incremental change monitoring, and current rankings—and can push notifications through messaging platforms like Telegram, Slack, WeChat, DingTalk, and email. Users can deploy it quickly via Python and GitHub Actions, and it also supports RSS feeds and Docker deployment for flexible integration. ... -
14
ReMe
Memory Management Kit for Agents
...The toolkit provides APIs to offload large, ephemeral outputs to external storage and reload them on demand, which reduces memory bloat and keeps active context concise. By combining embeddings, vector search, and summarization workflows, ReMe lets developers build agent systems that can recall and apply past knowledge in future reasoning tasks. The project fits into the broader agent-oriented programming ecosystem by supplying a standardized memory layer that integrates with agent frameworks. -
15
TruLens
Evaluation and Tracking for LLM Experiments
...An easy-to-use interface that allows developers to compare different versions of their applications, facilitating informed decision-making and optimization. TruLens supports various use cases, including question-answering, summarization, retrieval-augmented generation, and agent-based applications. -
16
llmware
Unified framework for building enterprise RAG pipelines
...It provides a unified interface for constructing retrieval-augmented generation pipelines, agent workflows, and document intelligence applications. One of the framework’s defining characteristics is its collection of small specialized language models optimized for specific tasks such as summarization, classification, and document analysis. The system supports a wide range of inference backends including PyTorch, OpenVINO, ONNX Runtime, and other optimized runtimes, allowing developers to choose the most efficient execution environment for their hardware. -
17
Claw Compactor
14-stage Fusion Pipeline for LLM token compression
Claw Compactor is a utility designed to optimize and manage the context limitations inherent in AI agent systems, particularly those built on OpenClaw-like architectures. It addresses the challenge of finite context windows in language models by compressing or summarizing historical interactions while preserving essential information. The system works by transforming older conversation data into condensed representations that maintain continuity without exceeding token limits. This approach... -
18
Deep Agents
The batteries-included agent harness
Deep Agents is an open-source, batteries-included agent harness designed for long-running, multi-step AI work. It provides an opinionated agent setup while allowing developers to override or replace individual pieces without forking the project. The framework is model-agnostic and works with tool-calling models from hosted providers, open-weight deployments, or local runtimes. Built on LangGraph, it includes persistence, checkpointing, streaming, and production-oriented orchestration. Agents... -
19
LOTUS
AI-Powered Data Processing: Use LOTUS to process all of your datasets
...The core concept of the framework is the use of semantic operators, which extend traditional relational database operations to support reasoning over text and other unstructured data. These operators allow tasks such as semantic filtering, ranking, clustering, and summarization to be expressed directly within data processing pipelines. The LOTUS engine automatically optimizes how language models are used during execution, which can significantly improve performance and reduce computational cost. -
20
Transformers
State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX
...Using pre-trained models can reduce your compute costs, carbon footprint, and save you the time and resources required to train a model from scratch. These models support common tasks in different modalities. Text, for tasks like text classification, information extraction, question answering, summarization, translation, text generation, in over 100 languages. Images, for tasks like image classification, object detection, and segmentation. Audio, for tasks like speech recognition and audio classification. Transformers provides APIs to quickly download and use those pretrained models on a given text, fine-tune them on your own datasets and then share them with the community on our model hub. ... -
21
MedGemma
Collection of Gemma 3 variants that are trained for performance
...It includes multiple variants such as a 4 billion-parameter multimodal model that can process both medical images and text and a 27 billion-parameter text-only (and multimodal) model that offers deeper clinical reasoning and understanding at higher capacity, making it suitable for complex tasks like medical question answering, summarization of clinical notes, or generating reports from radiology images. The multimodal versions pair a SigLIP-based image encoder pre-trained on diverse de-identified medical imaging data. -
22
ChatPaper
Use ChatGPT to summarize the arXiv papers
ChatPaper is an AI-assisted research toolkit designed to accelerate academic reading and writing workflows. It uses language models to summarize papers and help researchers screen literature more efficiently. The project also supports full-paper translation, writing improvement, peer-review analysis, and responses to reviewer comments. It can retrieve recent arXiv papers based on keywords and time ranges for topic-focused research. Related tools can generate literature reviews, suggest paper... -
23
ArXiv MCP Server
A Model Context Protocol server for searching and analyzing arXiv
arxiv-mcp-server bridges AI assistants and the arXiv repository through a clean MCP interface, enabling search, metadata retrieval, and content access without bespoke scraping. With simple tools like “search” and “fetch,” an agent can find papers, pull abstracts, and download PDFs for downstream summarization or analysis. The project includes packaging and CI to publish to PyPI, plus tests and linting for reliability. Issue threads show feature requests such as extracting embedded LaTeX and improving markdown conversion, reflecting active community use in research flows. It’s designed to be drop-in for MCP clients, giving them typed inputs/outputs and predictable errors around a well-known academic corpus. ... -
24
txtai
Build AI-powered semantic search applications
...Innovation is happening at a rapid pace, models can understand concepts in documents, audio, images and more. Machine-learning pipelines to run extractive question-answering, zero-shot labeling, transcription, translation, summarization and text extraction. Cloud-native architecture that scales out with container orchestration systems (e.g. Kubernetes). Applications range from similarity search to complex NLP-driven data extractions to generate structured databases. The following applications are powered by txtai. -
25
LangChain
⚡ Building applications with LLMs through composability ⚡
Large language models (LLMs) are emerging as a transformative technology, enabling developers to build applications that they previously could not. But using these LLMs in isolation is often not enough to create a truly powerful app - the real power comes when you can combine them with other sources of computation or knowledge. This library is aimed at assisting in the development of those types of applications.
