Search Results for "summarization" - Page 5
Sort By:
Showing 165 open source projects for "summarization"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
1
YAYI
Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM
...The architecture is based on transformer-style language models optimized for conversational understanding and generation. In addition to producing coherent responses, the system is designed to handle tasks such as summarization, translation, question answering, and text classification. The repository provides model checkpoints, training resources, and inference tools that allow developers to deploy the model in their own applications. By releasing both the model and supporting infrastructure, the project encourages experimentation and research in multilingual AI systems. -
2
sketch
AI code-writing assistant that understands data content
Sketch is an open-source AI-powered data analysis assistant designed specifically for pandas users, enabling natural language interaction with tabular datasets to generate code, insights, and transformations. It works by summarizing the structure and statistical properties of a dataset and providing that context to a language model, allowing it to generate highly relevant and accurate responses tailored to the data. The tool integrates directly into pandas dataframes through an extension,... -
3
RAGs
Build ChatGPT over your data, all with natural language
...The system automatically generates pipeline configurations that control how documents are retrieved, processed, and summarized before being used by a language model to generate responses. Users can also inspect and adjust parameters such as the number of retrieved documents, summarization strategies, and query settings through a configuration interface. Once the pipeline is created, the system enables conversational queries over the connected data sources, effectively creating a personalized knowledge assistant. -
4
NLG-Eval
Evaluation code for various unsupervised automated metrics
NLG-Eval is a toolkit for evaluating the quality of natural language generation (NLG) outputs using multiple automated metrics such as BLEU, METEOR, and ROUGE. -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
5
Summarize from Feedback
Code for "Learning to summarize from human feedback"
...Because the codebase is experimental, parts of it may not run out-of-box depending on dependencies or environment, but it remains a canonical reference for how to implement summarization via human feedback. -
6
ChatHN
Chat with Hacker News using natural language
...It connects an OpenAI model to the official Hacker News API through function calling, allowing the model to retrieve live structured data when needed. Built-in functions can fetch top stories, open a specific story, include leading comments, and prepare the current top discussion for summarization. Responses are streamed through the Vercel AI SDK so the interface can display generated text progressively. The application uses Next.js for the web framework and Tailwind CSS for presentation. It can be run locally with an OpenAI API key or deployed to Vercel through a streamlined setup. ChatHN demonstrates how tool-enabled language models can turn a conventional public API into a conversational research interface. -
7
PromethAI
Open-source framework that gives you AI Agents
PromethAI-Backend is a backend framework for AI-driven automation and knowledge extraction. It is designed to integrate with large language models (LLMs) to provide AI-enhanced workflows, including content generation, summarization, and data analysis. -
8
onepoint
Assistant tool that integrates coding, writing, and reading functions
Onepoint is an open-source AI assistant based on Electron, designed to create the ultimate desktop productivity tool. Its initial goal was to develop a smart floating window similar to Apple's intelligent assistant that does not take up desktop space or system performance and can be quickly accessed through global hotkeys for user convenience. With ChatGPT technology, users can continuously train onepoint to generate and reconstruct content with greater accuracy (onpoint), thereby improving... -
9
Fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python
Fairseq(-py) is a sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling and other text generation tasks. We provide reference implementations of various sequence modeling papers. Recent work by Microsoft and Google has shown that data parallel training can be made significantly more efficient by sharding the model parameters and optimizer state across data parallel workers. These ideas are encapsulated in the new FullyShardedDataParallel (FSDP) wrapper provided by fairscale. ... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
Tensorflow Transformers
State of the art faster Transformer with Tensorflow 2.0
Imagine auto-regressive generation to be 90x faster. tf-transformers (Tensorflow Transformers) is designed to harness the full power of Tensorflow 2, designed specifically for Transformer based architecture. These models can be applied on text, for tasks like text classification, information extraction, question answering, summarization, translation, text generation, in over 100 languages. Images, for tasks like image classification, object detection, and segmentation. Audio, for tasks like speech recognition and audio classification. Faster AutoReggressive Decoding, TFlite support, creating TFRecords is simple. Auto-Batching tf.data.dataset or tf.ragged tensors. ... -
11
KoGPT
KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)
KoGPT is a Korean language model based on OpenAI’s GPT architecture, designed for various natural language processing (NLP) tasks such as text generation, summarization, and dialogue systems. -
12
fairseq-lua
Facebook AI Research Sequence-to-Sequence Toolkit
...The framework implements sequence-to-sequence models with attention, beam search decoding, and distributed training, providing a research platform for exploring translation, summarization, and language modeling. Its modular design made it easy to prototype new architectures by modifying encoders, decoders, or attention mechanisms. Although now deprecated in favor of the PyTorch rewrite, fairseq-lua played a key role in advancing large-scale NMT systems, such as early versions of Facebook’s production translation models. ... -
13
Reminiscence
Self-Hosted Bookmark And Archive Manager
...Supports archival of media elements of a web page using third-party download managers. Directory-based categorization of bookmarks. Automatic tagging of HTML links. Automatic summarization of HTML content. Special readability mode. Search bookmarks according to url, title, tags or summary. Supports multiple user accounts. Supports public and group directories for every user. Upload any file from web interface for archiving. Easy to use admin interface for managing multiple users. Import bookmarks from Netscape Bookmark HTML file format. ... -
14
onnxt5
Summarization, translation, sentiment-analysis, text-generation, etc.
...Please note that the first time you call get_encoder_decoder_tokenizer, the models are being downloaded which might take a minute or two. Other tasks just require to change the prefix in your prompt, for instance for summarization. Run any of the T5 trained tasks in a line (translation, summarization, sentiment analysis, completion, generation) Export your own T5 models to ONNX easily. Utility functions to generate what you need quickly. Up to 4X speedup compared to PyTorch execution for smaller contexts. -
15
Stats With Julia Book
Collection of runnable Julia code examples for a statistics book
StatsWithJuliaBook is the companion code repository for the book Statistics with Julia: Fundamentals for Data Science, Machine Learning and Artificial Intelligence. It contains over 200 code blocks that correspond to the book’s ten chapters and three appendices, covering topics from probability theory and data summarization to regression analysis, hypothesis testing, and machine learning basics. The repository is designed for Julia users and provides ready-to-run examples that reinforce theoretical concepts with practical implementation. Readers can explore how Julia supports statistical modeling, simulation, and computational methods in data science workflows. ... -
16
Synonyms
Chinese synonyms, chat robot, intelligent question and answer toolkit
...Better Chinese synonyms, chatbot, intelligent question and answer toolkit. synonymsCan be used for many tasks in natural language understanding, text alignment, recommendation algorithms, similarity calculation, semantic shifting, keyword extraction, concept extraction, automatic summarization, search engines, etc. Print synonyms in a friendly way for easy debugging. "Synonyms Cilin" was compiled by Mei Jiaju and others in 1983, and now widely used is "Synonyms Cilin Extended Edition" maintained by the Social Computing and Information Retrieval Research Center of Harbin Institute of Technology. Classes and subclasses, sort out the relationship between words, the extended version of the synonym word forest contains more than 70,000 words, of which more than 30,000 words are shared in the form of open data. -
17
fastNLP
fastNLP: A Modularized and Extensible NLP Framework
...Provide a variety of neural network components and recurrence models (covering tasks such as Chinese word segmentation, named entity recognition, syntactic analysis, text classification, text matching, metaphor resolution, summarization, etc.). Trainer provides a variety of built-in Callback functions to facilitate experiment recording, exception capture, etc. Automatic download of some datasets and pre-trained models. -
18
Delta ML
Deep learning based natural language and speech processing platform
...What you see in training is what you get in serving: all data processing and features extraction are integrated into a model graph. Text classification, named entity recognition, question and answering, text summarization, etc. Uniform I/O interfaces and no changes for new models. -
19
nlp_chinese_corpus
Large Scale Chinese Corpus for NLP
nlp_chinese_corpus is a large-scale Chinese corpus collection for natural language processing research and development. It was created to make high-volume Chinese text data easier to access for students, researchers, and practitioners. The repository gathers several major datasets, including Chinese Wikipedia entries, news articles, encyclopedia-style question answering data, community question answering data, and Chinese-English translation sentence pairs. Each dataset includes... -
20
TextRank
TextRank implementation for Python 3
TextRank is an implementation of the TextRank algorithm for extractive text summarization and keyword extraction, inspired by Google’s PageRank. -
21
NLP Tasks
Natural Language Processing Tasks and References
...It organizes a broad range of NLP subjects so researchers and students can quickly discover areas for further study. Topics include speech recognition, text classification, question answering, machine translation, summarization, sentiment analysis, information extraction, and many others. Individual sections link to research papers, datasets, software projects, challenges, and background material. The collection places particular emphasis on deep-learning approaches that were prominent when the repository was assembled. Rather than implementing one NLP system, it serves as a structured starting point for exploring tasks, research directions, benchmarks, and available resources. -
22
unfluff
Automatically extract body content (and other cool stuff) from HTML
...It’s a tool very much aimed at content-analysis, web scraping, building datasets, or repurposing article text for downstream processing (like machine-learning or summarization). The API is simple: you feed in raw HTML and it returns a structured object with the extracted text and other fields. It supports caching internal representations to speed up repeated extractions. While its language support is best for English, it is still widely used in web-content-processing pipelines. The repository notes some limitations (e.g., languages like Chinese/Arabic/Korean may not be well-supported). ... -
23
TextTeaser
TextTeaser is an automatic summarization algorithm
...Originally inspired by research and earlier implementations, textteaser provides a lightweight solution for summarization without requiring heavy machine learning models. It is particularly useful for developers, researchers, or content platforms seeking a simple, rule-based approach to article summarization. -
24
seq2seq
A general-purpose encoder-decoder framework for Tensorflow
seq2seq is an early, influential TensorFlow reference implementation for sequence-to-sequence learning with attention, covering tasks like neural machine translation, summarization, and dialogue. It packaged encoders, decoders, attention mechanisms, and beam search into a modular training and inference framework. The codebase showcased best practices for batching, bucketing by sequence length, and handling variable-length sequences efficiently on GPUs. Researchers used it as a baseline to reproduce classic results and to prototype new attention variants and training tricks. ... -
25
Kinetic Model Builder
GUI for building, simulating and optimizing kinetic models.
...Optional user defined constraint equations for model parameters are parsed with EigenLab (https://github.com/marcel-goldschen-ohm/EigenLab). Convenient simulation and summarization across 2-dimensional sets of stimulus conditions makes constructing stimulus-response curves incredibly simple. For ion channels, this is useful for simulating dose-response or current-voltage curves both with and without a secondary stimulus (e.g. some drug). A series of video tutorials are available at https://www.youtube.com/watch?...
