Search Results for "data capture framework"
Sort By:
Showing 48 open source projects for "data capture framework"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Netcap
A framework for secure and scalable network traffic analysis
The Netcap (NETwork CAPture) framework efficiently converts a stream of network packets into platform-neutral type-safe structured audit records that represent specific protocols or custom abstractions. These audit records can be stored on disk or exchanged over the network, and are well-suited as a data source for machine learning algorithms. Since parsing of untrusted input can be dangerous and network data is potentially malicious, a programming language that provides a garbage-collected memory-safe runtime is used for the implementation. -
2
Kapacitor
Open source framework for processing, monitoring, and alerting
Open source framework for processing, monitoring, and alerting on time series data. Kapacitor is a real-time data processing engine for monitoring and alerting, specifically designed to work with time-series data from InfluxDB. -
3
LangChainGo
LangChain for Go, the easiest way to write LLM-based programs in Go
LangChainGo is a Go-based implementation of the LangChain framework, designed to help developers build applications powered by large language models using the Go programming language. It provides a modular architecture that allows developers to combine components such as language models, chains, agents, memory systems, and vector stores into flexible workflows. The framework emphasizes composability, making it easy to create complex pipelines that integrate LLMs with external data sources, APIs, and tools. ... -
4
Event Horizon
Event Sourcing for Go!
Event Horizon is a CQRS/ES toolkit for Go. Event Horizon is used in production systems but the API is not final! CQRS stands for Command Query Responsibility Segregation and is a technique where object access (the Query part) and modification (the Command part) are separated from each other. This helps in designing complex data models where the actions can be totally independent from the data output. ES stands for Event Sourcing and is a technique where all events that have happened in a... -
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
5
ContainerSSH
ContainerSSH: Launch containers on demand
...The built-in S3 upload ensures you don't lose your data. -
6
wacli
WhatsApp CLI
wacli is a command-line interface for WhatsApp that focuses on syncing, searching, and sending messages through the WhatsApp Web protocol. It is designed as a third-party CLI built on top of whatsmeow, giving developers and power users a local-first way to work with WhatsApp data outside the standard app interface. The project supports interactive authentication through a QR-based login flow and then transitions into a non-interactive sync mode for ongoing message capture. It stores data locally, which enables fast offline search across previously synced conversations and makes it useful for automation, archiving, and analysis workflows. ... -
7
Render
Go package for easily rendering JSON, XML, binary data, and HTML
Render is a package that provides functionality for easily rendering JSON, XML, text, binary data, and HTML templates. Render can be used with pretty much any web framework provided you can access the HTTP.ResponseWriter from your handler. The rendering functions simply wraps Go's existing functionality for marshaling and rendering data. HTML: Uses the html/template package to render HTML templates. JSON: Uses the encoding/json package to marshal data into a JSON-encoded response. ... -
8
Bacalhau
Community-driven, simple, yet powerful framework
Bacalhau is a decentralized compute platform for running jobs on data stored across distributed networks, like IPFS or Filecoin, without moving the data to centralized cloud environments. It allows developers to run containerized workloads close to where the data lives, reducing latency, cost, and privacy risks. Bacalhau supports various runtime environments and is designed to make decentralized data processing as accessible as traditional cloud computing. It’s especially useful for... -
9
Echo
High performance, minimalist Go web framework
...Middleware can be set at root, group or route level. Data binding for HTTP request payload, including JSON, XML or form-data. API to send variety of HTTP response, including JSON, XML, HTML, File, Attachment, Inline, Stream or Blob. Template rendering using any template engine. Customized central HTTP error handling. Easily extendable API. -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
GraphQL-Go-Tools
GraphQL Router / API Gateway framework written in Golang
graphql-go-tools is a high-performance GraphQL Router and API Gateway framework written in Go. It focuses on correctness, extensibility, and performance, supporting features like Federation v1 & v2, subscriptions, and more. -
11
Go Micro
A framework for distributed systems development
...The config interface provides a way to load application level config from any source such as env vars, file, etcd. You can merge the sources and even define fallbacks. A simple data store interface to read, write and delete records. It includes support for memory, file and CockroachDB by default. -
12
Colly
Elegant Scraper and Crawler Framework for Golang
Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Clean API. Fast (>1k request/sec on a single core) Manages request delays and maximum concurrency per domain. Automatic cookie and session handling. Sync/async/parallel scraping. Distributed scraping. Caching, automatic encoding of non-unicode... -
13
ip2region
Ip2region is an offline IP-to-Region localization library and IP data
ip2region is an offline IP geolocation library and data-management framework supporting both IPv4 and IPv6. It ships with raw IP datasets and optimized XDB database files for city-level region lookup. Returned records can include country, province, city, ISP, and ISO country-code information. The XDB format supports large datasets, deduplication, compression, and customizable region fields. -
14
Distributed Transactions Manager
A distributed transaction framework that supports multiple languages
Support HTTP and GRPC, provide easy-to-use interfaces, lower substantially the barrier of getting started with distributed transactions, and newcomers can adapt quickly. Developers no longer worry about suspension, null compensation, idempotent transaction, and other tricky problems, the framework layer handles them all. Suitable for companies with the multi-language stack. Easy for go, python, php, nodejs, ruby and so forth. The only external dependence is the database server, easy to deploy, cluster, and scale horizontally. Supports TCC, SAGA, XA, and transaction messages. DTM is a distributed transaction framework that provides cross-service eventual data consistency. ... -
15
Kratos
Your ultimate Go microservices framework for the cloud-native era
Kratos is a microservice-oriented governance framework implemented by golang, which offers convenient capabilities to help you quickly build a bulletproof application from scratch. The communication protocol is based on the HTTP/gRPC through the definition of Protobuf. Abstract transport layer support: HTTP / gRPC. Powerful middleware design, support: Tracing (OpenTelemetry), Metrics (Prometheus is default), Recovery and more. -
16
Argo Workflows
Workflow engine for Kubernetes
...Argo Workflows is implemented as a Kubernetes CRD (Custom Resource Definition). Define workflows where each step in the workflow is a container. Model multi-step workflows as a sequence of tasks or capture the dependencies between tasks using a directed acyclic graph (DAG). Easily run compute intensive jobs for machine learning or data processing in a fraction of the time using Argo Workflows on Kubernetes. Run CI/CD pipelines natively on Kubernetes without configuring complex software development products. Argo Workflows is the most popular workflow execution engine for Kubernetes. ... -
17
Hyperledger Fabric
Distributed ledger framework for developing solutions and applications
Hyperledger Fabric is an enterprise-grade permissioned distributed ledger framework for developing solutions and applications. Its modular and versatile design satisfies a broad range of industry use cases. It offers a unique approach to consensus that enables performance at scale while preserving privacy. High-performance, secure, permissioned blockchain network. Code written in Go, chaincode (smart contracts) in Go, Javascript, or Java, SDKs in Node.js, Java, Go, REST and Python.... -
18
Blue Whale Configuration Platform
Blue Whale smart cloud configuration platform
Has accumulated experience in supporting hundreds of Tencent businesses, compatible with various complex system architectures, born in operation and maintenance, and proficient in operation and maintenance. From configuration management to job execution, task scheduling and monitoring self-healing, and then through operation and maintenance big data analysis to assist operational decision-making, it covers the full-cycle assurance management of business operations in a comprehensive manner. The open PaaS has a powerful development framework and scheduling engine, as well as a complete operation and maintenance development training system, which helps the rapid transformation and upgrading of operation and maintenance. ... -
19
Artalk
Your Self-hosted Comment System
Artalk is a modern, self-hosted comment system designed to provide a fast, privacy-focused alternative to third-party commenting platforms for blogs, websites, and web applications. It combines a lightweight frontend written in vanilla JavaScript with a high-performance backend powered by Go, enabling efficient cross-platform deployment and low resource usage. The system is framework-agnostic, allowing it to be integrated into virtually any frontend stack without dependency conflicts or... -
20
Goyave
Elegant Golang REST API Framework (v5 WIP)
Goyave is a Golang REST API framework aiming at cleanliness, fast development and power. Goyave is a progressive and accessible web application framework focused on REST APIs, aimed at making backend development easy and enjoyable. It has a philosophy of cleanliness and conciseness to make programs more elegant, easier to maintain and more focused. Get started quickly and master all its powerful functionalities thanks to its extensive documentation. Goyave has an expressive, elegant syntax,... -
21
Fiber
Express inspired web framework written in Go
An Express-inspired web framework written in Go. Fiber is a Go web framework built on top of Fasthttp, the fastest HTTP engine for Go. It's designed to ease things up for fast development with zero memory allocation and performance in mind. Setting up routes for your application has never been so easy! The Express-like route definitions are easy to understand and work with. -
22
gRPC-Go
The Go language implementation of gRPC. HTTP/2 based RPC
gRPC is a modern open source high performance Remote Procedure Call (RPC) framework that can run in any environment. It can efficiently connect services in and across data centers with pluggable support for load balancing, tracing, health checking and authentication. It is also applicable in last mile of distributed computing to connect devices, mobile applications and browsers to backend services. Define your service using Protocol Buffers, a powerful binary serialization toolset and language. ... -
23
Keploy
Testing for Developers. Toolkit that creates test-cases and data mocks
Keploy is a functional testing toolkit for developers. It generates E2E tests for APIs (KTests) along with mocks or stubs(KMocks) by recording real API calls. KTests can be imported as mocks for consumers and vice-versa. Merge KTests with unit testing libraries(like Go-Test, JUnit..) to track combined test coverage. KMocks can also be referenced in existing tests or use anywhere (including any testing framework). KMocks can also be used as tests for the server. Keploy is added as a... -
24
Tau
Open source distributed Platform as a Service (PaaS)
tau is the core runtime and orchestration engine of the Taubyte platform, an event-driven, distributed computing framework for building and running decentralized applications. tau handles the dynamic deployment of code, services, and data across edge and cloud environments based on real-time events. It abstracts infrastructure and simplifies application delivery by combining GitOps principles with a secure, multi-tenant execution model. tau enables seamless scalability, event-based routing, and on-demand execution without managing underlying servers. -
25
Top Go Web Frameworks
Web frameworks for Go, most starred on GitHub
go-web-framework-stars is a curated list of popular Go web framework projects ranked automatically by their star counts on GitHub. The repository generates a markdown table that includes each framework’s name, star and fork counts, open issue counts, a short description, and the timestamp of the last commit, making it a quick way to compare ecosystem maturity and activity.
