Search Results for "data capture framework"
Sort By:
Showing 32 open source projects for "data capture framework"
View related business solutions-
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
PRTG Catches Network Issues Before They Cause DowntimeReactive troubleshooting usually means hearing about a problem from frustrated users, not your monitoring tool. PRTG sets threshold-based alerts across devices, servers and applications, notifying your team by email, SMS or push the moment a metric crosses a set limit. That means catching a failing disk or overloaded server before it becomes an outage and getting time back from firefighting. Start a free trial and set your first alerts today.
-
1
Netcap
A framework for secure and scalable network traffic analysis
The Netcap (NETwork CAPture) framework efficiently converts a stream of network packets into platform-neutral type-safe structured audit records that represent specific protocols or custom abstractions. These audit records can be stored on disk or exchanged over the network, and are well-suited as a data source for machine learning algorithms. Since parsing of untrusted input can be dangerous and network data is potentially malicious, a programming language that provides a garbage-collected memory-safe runtime is used for the implementation. -
2
Kapacitor
Open source framework for processing, monitoring, and alerting
Open source framework for processing, monitoring, and alerting on time series data. Kapacitor is a real-time data processing engine for monitoring and alerting, specifically designed to work with time-series data from InfluxDB. -
3
Event Horizon
Event Sourcing for Go!
Event Horizon is a CQRS/ES toolkit for Go. Event Horizon is used in production systems but the API is not final! CQRS stands for Command Query Responsibility Segregation and is a technique where object access (the Query part) and modification (the Command part) are separated from each other. This helps in designing complex data models where the actions can be totally independent from the data output. ES stands for Event Sourcing and is a technique where all events that have happened in a... -
4
Render
Go package for easily rendering JSON, XML, binary data, and HTML
Render is a package that provides functionality for easily rendering JSON, XML, text, binary data, and HTML templates. Render can be used with pretty much any web framework provided you can access the HTTP.ResponseWriter from your handler. The rendering functions simply wraps Go's existing functionality for marshaling and rendering data. HTML: Uses the html/template package to render HTML templates. JSON: Uses the encoding/json package to marshal data into a JSON-encoded response. ... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
Bacalhau
Community-driven, simple, yet powerful framework
Bacalhau is a decentralized compute platform for running jobs on data stored across distributed networks, like IPFS or Filecoin, without moving the data to centralized cloud environments. It allows developers to run containerized workloads close to where the data lives, reducing latency, cost, and privacy risks. Bacalhau supports various runtime environments and is designed to make decentralized data processing as accessible as traditional cloud computing. It’s especially useful for... -
6
Echo
High performance, minimalist Go web framework
...Middleware can be set at root, group or route level. Data binding for HTTP request payload, including JSON, XML or form-data. API to send variety of HTTP response, including JSON, XML, HTML, File, Attachment, Inline, Stream or Blob. Template rendering using any template engine. Customized central HTTP error handling. Easily extendable API. -
7
GraphQL-Go-Tools
GraphQL Router / API Gateway framework written in Golang
graphql-go-tools is a high-performance GraphQL Router and API Gateway framework written in Go. It focuses on correctness, extensibility, and performance, supporting features like Federation v1 & v2, subscriptions, and more. -
8
Go Micro
A framework for distributed systems development
...The config interface provides a way to load application level config from any source such as env vars, file, etcd. You can merge the sources and even define fallbacks. A simple data store interface to read, write and delete records. It includes support for memory, file and CockroachDB by default. -
9
Colly
Elegant Scraper and Crawler Framework for Golang
Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Clean API. Fast (>1k request/sec on a single core) Manages request delays and maximum concurrency per domain. Automatic cookie and session handling. Sync/async/parallel scraping. Distributed scraping. Caching, automatic encoding of non-unicode... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
Distributed Transactions Manager
A distributed transaction framework that supports multiple languages
Support HTTP and GRPC, provide easy-to-use interfaces, lower substantially the barrier of getting started with distributed transactions, and newcomers can adapt quickly. Developers no longer worry about suspension, null compensation, idempotent transaction, and other tricky problems, the framework layer handles them all. Suitable for companies with the multi-language stack. Easy for go, python, php, nodejs, ruby and so forth. The only external dependence is the database server, easy to deploy, cluster, and scale horizontally. Supports TCC, SAGA, XA, and transaction messages. DTM is a distributed transaction framework that provides cross-service eventual data consistency. ... -
11
Kratos
Your ultimate Go microservices framework for the cloud-native era
Kratos is a microservice-oriented governance framework implemented by golang, which offers convenient capabilities to help you quickly build a bulletproof application from scratch. The communication protocol is based on the HTTP/gRPC through the definition of Protobuf. Abstract transport layer support: HTTP / gRPC. Powerful middleware design, support: Tracing (OpenTelemetry), Metrics (Prometheus is default), Recovery and more. -
12
Argo Workflows
Workflow engine for Kubernetes
...Argo Workflows is implemented as a Kubernetes CRD (Custom Resource Definition). Define workflows where each step in the workflow is a container. Model multi-step workflows as a sequence of tasks or capture the dependencies between tasks using a directed acyclic graph (DAG). Easily run compute intensive jobs for machine learning or data processing in a fraction of the time using Argo Workflows on Kubernetes. Run CI/CD pipelines natively on Kubernetes without configuring complex software development products. Argo Workflows is the most popular workflow execution engine for Kubernetes. ... -
13
Hyperledger Fabric
Distributed ledger framework for developing solutions and applications
Hyperledger Fabric is an enterprise-grade permissioned distributed ledger framework for developing solutions and applications. Its modular and versatile design satisfies a broad range of industry use cases. It offers a unique approach to consensus that enables performance at scale while preserving privacy. High-performance, secure, permissioned blockchain network. Code written in Go, chaincode (smart contracts) in Go, Javascript, or Java, SDKs in Node.js, Java, Go, REST and Python.... -
14
Goyave
Elegant Golang REST API Framework (v5 WIP)
Goyave is a Golang REST API framework aiming at cleanliness, fast development and power. Goyave is a progressive and accessible web application framework focused on REST APIs, aimed at making backend development easy and enjoyable. It has a philosophy of cleanliness and conciseness to make programs more elegant, easier to maintain and more focused. Get started quickly and master all its powerful functionalities thanks to its extensive documentation. Goyave has an expressive, elegant syntax,... -
15
Fiber
Express inspired web framework written in Go
An Express-inspired web framework written in Go. Fiber is a Go web framework built on top of Fasthttp, the fastest HTTP engine for Go. It's designed to ease things up for fast development with zero memory allocation and performance in mind. Setting up routes for your application has never been so easy! The Express-like route definitions are easy to understand and work with. -
16
gRPC-Go
The Go language implementation of gRPC. HTTP/2 based RPC
gRPC is a modern open source high performance Remote Procedure Call (RPC) framework that can run in any environment. It can efficiently connect services in and across data centers with pluggable support for load balancing, tracing, health checking and authentication. It is also applicable in last mile of distributed computing to connect devices, mobile applications and browsers to backend services. Define your service using Protocol Buffers, a powerful binary serialization toolset and language. ... -
17
Keploy
Testing for Developers. Toolkit that creates test-cases and data mocks
Keploy is a functional testing toolkit for developers. It generates E2E tests for APIs (KTests) along with mocks or stubs(KMocks) by recording real API calls. KTests can be imported as mocks for consumers and vice-versa. Merge KTests with unit testing libraries(like Go-Test, JUnit..) to track combined test coverage. KMocks can also be referenced in existing tests or use anywhere (including any testing framework). KMocks can also be used as tests for the server. Keploy is added as a... -
18
ergo
Framework for creating microservices using technologies of Erlang/OTP
...The easiest way to create an OTP-designed application in Golang. The goal of this project is to leverage Erlang/OTP experience with Golang performance. The ideal framework for creating complex and distributed solutions (machine learning, data processing pipeline, etc.) being simple and reliable. You don't have to reinvent the wheel. There are ready-to-use implemented design patterns. Two processes can be linked to each other. Termination one terminates another. Any process can monitor the service node. ... -
19
Top Go Web Frameworks
Web frameworks for Go, most starred on GitHub
go-web-framework-stars is a curated list of popular Go web framework projects ranked automatically by their star counts on GitHub. The repository generates a markdown table that includes each framework’s name, star and fork counts, open issue counts, a short description, and the timestamp of the last commit, making it a quick way to compare ecosystem maturity and activity. -
20
RuleGo
Component orchestration rule engine framework for Go
RuleGo is a high-performance, component-based rule engine implemented in Go. It’s lightweight, embeddable, orchestration-ready, and built for flexible composition of business logic into reusable components. No external middleware dependencies, efficient data processing and linkage on low-cost devices, suitable for IoT edge computing. Embedded and Standalone Deployment modes. Supports embedding RuleGo into existing applications. It can also be deployed independently as middleware, providing... -
21
Ninjabot
A fast cryptocurrency platform for trading bot in Go
A fast cryptocurrency trading bot framework implemented in Go. Ninjabot permits users to create and test custom strategies for spot markets. Ninjabot is an open-source platform that provides tools to implement custom strategies and backtests for trading cryptocurrencies in Go. Ninjabot CLI provides utilities commands to support backtesting and bot development. Currently, we only support Binance exchange. If you want to include support for other exchanges, you need to implement a new struct... -
22
KubeEdge
Kubernetes Native Edge Computing Framework (project under CNCF)
KubeEdge is built upon Kubernetes and extends native containerized application orchestration and device management to hosts at the Edge. It consists of a cloud part and an edge part, and provides core infrastructure support for networking, application deployment, and metadata synchronization between the cloud and edge. It also supports MQTT which enables edge devices to access through edge nodes. With KubeEdge it is easy to get and deploy existing complicated machine learning, image... -
23
Evilginx 3.0
Standalone man-in-the-middle attack framework
Evilginx 3.0 is a standalone security-testing framework that demonstrates reverse-proxy phishing attacks against modern web authentication systems. It sits between a browser and a legitimate service to study how credentials and authenticated session data can be intercepted in adversary-in-the-middle scenarios. Because session tokens can remain valid after multifactor authentication, the project highlights limitations of some traditional 2FA deployments. -
24
Twirp
A simple RPC framework with protobuf service definitions
Twirp is a simple RPC framework built on protobuf. You define a service in a .proto specification file, then Twirp will generate servers and clients for that service. It's your job to fill in the "business logic" that powers the server, and then generated clients can consume your service straight away. Twirp routing and serialization reduces the risk of introducing bugs. Both JSON and Protobuf are supported. The Protobuf protocol is designed to allow backwards compatible changes (unlike... -
25
OpenCensus Libraries for Go
A stats collection and distributed tracing framework
OpenCensus and OpenTracing have merged to form OpenTelemetry, which serves as the next major version of OpenCensus and OpenTracing. OpenCensus is a set of libraries for various languages that allow you to collect application metrics and distributed traces, then transfer the data to a backend of your choice in real time. This data can be analyzed by developers and admins to understand the health of the application and debug problems.
