Search Results for "data integration" - Page 7
Sort By:
Showing 440 open source projects for "data integration"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
Local Deep Research
95% on SimpleQA (e.g. Qwen3.6-27B on a 3090)
Local Deep Research is an open-source AI-powered research assistant designed to perform deep, iterative investigations by combining large language models with multi-source search capabilities. It runs locally, giving users full control over their data, privacy, and infrastructure while supporting both local and cloud-based LLMs. The system breaks down complex queries into smaller steps, performs parallel searches across web and academic sources, and generates structured, citation-backed... -
2
WhatsApp MCP Server
WhatsApp MCP server enabling AI access to chats and messaging
whatsapp-mcp is an open source Model Context Protocol (MCP) server that enables AI agents to interact directly with a user’s WhatsApp account through a structured interface. It acts as a bridge between WhatsApp and large language models, allowing controlled access to messages, chats, and contacts. whatsapp-mcp is composed of two main components: a Go-based bridge that connects to the WhatsApp Web API and stores data locally, and a Python-based MCP server that exposes tools for AI... -
3
CoPaw
Your Personal AI Assistant; easy to install, deploy on local or coud
CoPaw is a personal AI assistant designed to run on your own machine or in the cloud, giving you full control over memory, models, and data. Built by the AgentScope team, it connects to multiple chat platforms—including DingTalk, Feishu, QQ, Discord, iMessage, and more—through a single unified assistant. CoPaw supports both cloud-based LLM providers and fully local models such as llama.cpp, MLX, and Ollama, allowing you to operate without API keys if preferred. It includes a browser-based... -
4
NagaAgent
A simple yet powerful agent framework for personal assistants
...It provides abstractions for representing goals, context, and state so that agents can plan sequences of actions, evaluate outcomes, and adjust behavior over time. The project includes mechanisms for semantic memory, reasoning pipelines, and integration points with external data sources and language models so that agents can interpret natural language instructions and produce coherent multi-step outputs. Rather than being a simple chatbot, NagaAgent emphasizes persistent thought cycles, context retention, and the ability to decompose complex tasks into smaller executable units, earning it a place in research explorations of agent design. ... -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
5
OpenFreeMap
Free and open-source map hosting solution with custom styles
OpenFreeMap is a free and open-source map hosting platform that allows developers to display customizable maps in websites and applications without relying on commercial providers. It uses OpenStreetMap data and modern vector tile technologies to deliver high-quality maps with flexible styling options. The platform can be self-hosted or accessed through a public instance, offering full control or convenience depending on user needs. It removes common barriers such as API keys, usage limits,... -
6
Mito
AI-powered Jupyter spreadsheet that converts workflows into Python
Mito is an open source set of Jupyter extensions designed to speed up Python workflows and data analysis. It combines a spreadsheet-style interface with AI-assisted coding, allowing users to explore, clean, and transform data without switching tools. Mito includes a context-aware AI assistant that helps generate code, debug errors, and guide workflows directly inside Jupyter. Its spreadsheet layer supports familiar functions such as filters, pivot tables, and formulas, while automatically... -
7
Ploomber
The fastest way to build data pipelines
Ploomber is an open-source framework designed to simplify the development and deployment of data science and machine learning pipelines. It allows developers to transform exploratory data analysis workflows into production-ready pipelines without rewriting large portions of code. The system integrates with common development environments such as Jupyter Notebook, VS Code, and PyCharm, enabling data scientists to continue working with familiar tools while building scalable workflows. Ploomber... -
8
nb-clean
Clean Jupyter notebooks of outputs, metadata, and empty cells
nb-clean cleans Jupyter notebooks of cell execution counts, metadata, outputs, and (optionally) empty cells, preparing them for committing to version control. It provides both a Git filter and pre-commit hook to automatically clean notebooks before they're staged, and can also be used with other version control systems, as a command line tool, and as a Python library. It can determine if a notebook is clean or not, which can be used as a check in your continuous integration pipelines.... -
9
Claude Code Plugins
Intelligent automation and multi-agent orchestration for Claude Code
...It emphasizes simplicity and composability, allowing developers to define agent behaviors through reusable components rather than monolithic logic. The framework supports integration with various tools and APIs, enabling agents to perform actions such as data retrieval, automation, and decision-making processes. It is particularly useful for experimenting with autonomous or semi-autonomous systems that rely on prompt-driven logic and tool usage. The design encourages transparency and control over how agents operate, making it suitable for both prototyping and production scenarios. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
FEAPDER
Powerful Python crawler framework for scalable web scraping tasks
feapder is a Python-based web crawling framework designed to simplify the process of building scalable and efficient web scrapers. It focuses on providing a developer-friendly environment that makes it easier to create, run, and manage crawlers for a variety of data collection tasks. It includes several built-in spider types, such as AirSpider, Spider, TaskSpider, and BatchSpider, which address different crawling scenarios ranging from lightweight scraping to distributed and batch-based... -
11
NVIDIA Generative AI Examples
Generative AI reference workflows
NVIDIA GenerativeAIExamples is an open-source repository that provides practical reference implementations and example workflows for building generative AI applications using NVIDIA’s software ecosystem. The project is designed to help developers accelerate the development of AI applications by providing ready-to-run pipelines, notebooks, and tools that demonstrate how to integrate large language models into real-world systems. The repository includes examples covering topics such as... -
12
Shynet
Modern, privacy-friendly, and detailed web analytics
Modern, privacy-friendly, and detailed web analytics that works without cookies or JS. There are a lot of web analytics tools. Unfortunately, most of them come with the following caveats. They require handing all of your visitors' info to a third-party company They use cookies to track visitors across sessions, so you need to have those annoying cookie notices. They collect so much personal data that even the NSA is jealous. They are closed source and/or expensive, often with limited data... -
13
docext
An on-premises, OCR-free unstructured data extraction
docext is a document intelligence toolkit that uses vision-language models to extract structured information from documents such as PDFs, forms, and scanned images. The system is designed to operate entirely on-premises, allowing organizations to process sensitive documents without relying on external cloud services. Unlike traditional document processing pipelines that rely heavily on optical character recognition, docext leverages multimodal AI models capable of understanding both visual... -
14
Django Rules
Awesome Django authorization, without the database
...Predicates can be any type of callable -- simple functions, lambdas, methods, callable class objects, partial functions, decorated functions, anything really. A good Django citizen. Seamless integration with Django views, templates and the Admin for testing for object-level permissions. Efficient and smart. No need to mess around with a database to figure out whether John really wrote that book. Simple. Dive in the code. You'll need 10 minutes to figure out how it works. Powerful. rules comes complete with advanced features, such as invocation context and storage for arbitrary data, skipping evaluation of predicates. -
15
RedAmon
AI-powered framework for automated penetration testing and red teaming
RedAmon is an AI-powered red team framework designed to automate offensive cybersecurity operations from reconnaissance to exploitation and post-exploitation. It combines artificial intelligence with traditional penetration testing tools to create a fully autonomous pipeline capable of discovering vulnerabilities and executing security assessments without human intervention. It begins with a multi-phase reconnaissance engine that maps the entire attack surface of a target, collecting... -
16
fairseq2
FAIR Sequence Modeling Toolkit 2
fairseq2 is a modern, modular sequence modeling framework developed by Meta AI Research as a complete redesign of the original fairseq library. Built from the ground up for scalability, composability, and research flexibility, fairseq2 supports a broad range of language, speech, and multimodal content generation tasks, including instruction fine-tuning, reinforcement learning from human feedback (RLHF), and large-scale multilingual modeling. Unlike the original fairseq—which evolved into a... -
17
FFmpeg Quality Metrics
Calculate quality metrics with FFmpeg (SSIM, PSNR, VMAF, VIF)
FFmpeg Quality Metrics is a Python-based tool that evaluates video quality by calculating objective metrics using FFmpeg. It supports widely used metrics such as PSNR, SSIM, VIF, MSAD, and VMAF, enabling detailed comparison between reference and distorted video files. The tool outputs both per-frame data and aggregated statistics like averages and standard deviation, making it useful for research, encoding optimization, and benchmarking. It also includes optional visualization features... -
18
Cr3dOv3r
Know the dangers of credential reuse attacks
Cr3dOv3r is a penetration testing and security auditing tool designed to demonstrate and analyze the risks associated with credential reuse across multiple online services. It allows users to input an email address and automatically checks for data breaches and leaked credentials using public databases. The tool then attempts to verify whether those credentials are reused across various popular platforms, highlighting potential vulnerabilities. It is primarily intended for educational and... -
19
CUDA Python
Performance meets Productivity
CUDA Python is a unified Python interface for accessing and working with the NVIDIA CUDA platform, enabling developers to build GPU-accelerated applications entirely in Python. It acts as a metapackage composed of multiple submodules that provide both high-level and low-level access to CUDA functionality, including runtime APIs, driver APIs, and JIT compilation tools. The project is designed to simplify GPU programming by offering Pythonic abstractions while still exposing the full power of... -
20
Solace Agent Mesh
An event-driven framework designed to build multi-agent AI systems
Solace Agent Mesh is an event-driven framework designed to build, orchestrate, and scale multi-agent AI systems where specialized agents collaborate to solve complex tasks across distributed environments. It addresses one of the main challenges in modern AI systems, which is connecting isolated agents, data sources, and enterprise systems into a cohesive and interoperable ecosystem. The framework uses an asynchronous messaging architecture powered by an event broker, enabling agents to... -
21
Harpoon
Command line OSINT and threat intelligence automation tool
Harpoon is a command line tool designed to assist with open source intelligence (OSINT) and threat intelligence investigations. It helps security professionals and researchers collect and analyze publicly available information from a wide range of online sources. Harpoon is written in Python and organized around a modular plugin system, where each plugin is responsible for querying a specific platform, API, or intelligence service. This design allows users to automate many reconnaissance and... -
22
HolmesGPT
CNCF Sandbox Project
HolmesGPT is an open-source AI agent designed to help DevOps and site reliability engineering teams diagnose and resolve production incidents. The system aggregates signals from observability tools such as logs, metrics, alerts, and distributed traces, then analyzes them using large language models to identify potential root causes. Rather than requiring engineers to manually correlate large volumes of monitoring data, HolmesGPT automatically synthesizes evidence and presents explanations in... -
23
Python-Spider
Python3 web crawler practice
Python-Spider is a repository intended to teach or provide examples for writing web spiders / crawlers in Python — part of a broader learning and resource collection by its author. The code and documentation are oriented toward beginners or intermediate learners who want to learn how to fetch, parse, and extract data from websites programmatically. As part of the author’s public learning-path repositories, python-spider likely includes examples of HTTP requests, HTML parsing, maybe... -
24
Datasets
Hub of ready-to-use datasets for ML models
Datasets is a library for easily accessing and sharing datasets, and evaluation metrics for Natural Language Processing (NLP), computer vision, and audio tasks. Load a dataset in a single line of code, and use our powerful data processing methods to quickly get your dataset ready for training in a deep learning model. Backed by the Apache Arrow format, process large datasets with zero-copy reads without any memory constraints for optimal speed and efficiency. We also feature a deep integration with the Hugging Face Hub, allowing you to easily load and share a dataset with the wider NLP community. ... -
25
NeMo Retriever Library
Document content and metadata extraction microservice
NeMo Retriever Library is a scalable microservice framework designed for extracting, structuring, and enriching content from documents to support downstream generative AI applications. It processes various document types by splitting them into components such as text, tables, charts, and images, and then applies OCR and contextual analysis to convert them into structured data formats. The system is built on NVIDIA NIM microservices, enabling high-performance parallel processing and efficient...
