Search Results for "data capture framework"
Sort By:
Showing 64 open source projects for "data capture framework"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
1
Elastic APM Node.js Agent
Elastic APM Node.js Agent
This is the official Node.js application performance monitoring (APM) agent for the Elastic Observability solution. It is a Node.js package that runs with your Node.js application to automatically capture errors, tracing data, and performance metrics. APM data is sent to your Elastic Observability deployment -- hosted in Elastic's cloud or in your own on-premises deployment -- where you can monitor your application, create alerts, and quick identify root causes of service issues. First, you will need an Elastic Stack deployment. ... -
2
Npgsql
Npgsql is the .NET data provider for PostgreSQL
Npgsql is an open source ADO.NET Data Provider for PostgreSQL, it allows programs written in C#, Visual Basic, F# to access the PostgreSQL database server. It is implemented in 100% C# code, is free and is open source. An Entity Framework Core provider is also available and exposes some features unique to the PostgreSQL database to EF Core users. Finally, a legacy Entity Framework 6.x (non-Core) provider is also available but is no longer being actively maintained. ... -
3
WiFi DensePose
Turn WiFi signals into real-time human pose estimation and detection
...The project demonstrates how commodity mesh routers and signal processing techniques can be leveraged to infer dense human pose information, even through obstacles such as walls. It is designed to showcase the emerging field of RF-based sensing, where machine learning models interpret wireless channel data to reconstruct human movement and posture. The repository includes components for data processing, model inference, and real-time visualization, making it suitable for research and experimental deployments. Its architecture emphasizes performance and reproducibility, allowing developers to explore non-visual motion capture systems using accessible hardware. ... -
4
Unified Communication X
Communication framework for data-centric high-performance applications
Accelerate Your Network Performance with UCX. Collaboration between industry, laboratories, and academia to create an open-source, production-grade communication framework for data-centric and high-performance applications. Unified Communication X (UCX) is an award winning, optimized production proven communication framework for modern, high-bandwidth and low-latency networks. UCX exposes a set of abstract communication primitives which utilize the best of available hardware resources and offloads. ... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
dd-trace
JavaScript APM Tracer
dd-trace is an npm package that you can install in your Node.js application to capture APM (Application Performance Monitoring) data. In Datadog terminology this library is called a Tracer. This data is then sent off to a process that collects and aggregates the data, called an Agent. Finally, the data is sent off to the Datadog servers where it's stored and made available for querying in a myriad of ways, such as displaying in a dashboard or triggering alerts. -
6
Python 3 Network Packet Sniffer
A Network Packet Sniffing tool developed in Python 3
A Network Packet Sniffer developed in Python 3. Packets are disassembled as they arrive at a given network interface controller and their information is displayed on the screen. This application depends exclusively on the NETProtocols library (also developed and maintained by EONRaider) from version 2.0.0 and above and can be run by any Python 3.8+ interpreter. -
7
Osquery
SQL operating system instrumentation and monitoring framework
Osquery is an operating system instrumentation framework for Windows, OS X (macOS), Linux, and FreeBSD. The tools make low-level operating system analytics and monitoring both performant and intuitive. Osquery exposes an operating system as a high-performance relational database. This allows you to write SQL queries to explore operating system data. With osquery, SQL tables represent abstract concepts such as running processes, loaded kernel modules, open network connections, browser plugins, hardware events or file hashes.Osquery queries your devices like a database. ... -
8
Performance Co-Pilot (PCP)
Performance Co-Pilot
Performance Co-Pilot (PCP) provides a framework and services to support system-level performance monitoring and management. It presents a unifying abstraction for all of the performance data in a system, and many tools for interrogating, retrieving and processing that data. PCP is a feature-rich, mature, extensible, cross-platform toolkit supporting both live and retrospective analysis. -
9
NetBox
The premiere source of truth powering network automation
...Available as open source software under the Apache 2.0 license, NetBox is employed by thousands of organizations around the world. Netbox is written in Python and uses the Django web framework. It is a web-based application that can be used to manage IP addresses and the devices and cables connected to them, as well as providing a data center infrastructure management (DCIM) tool. It supports virtualization, inventory management, and cable management. It has a web-based user interface and RESTful API, to easily integrate with other tools and automate tasks. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
magic-trace
magic-trace collects and displays high-resolution traces
magic-trace is a high-resolution performance tracing tool developed to analyze and visualize the execution of programs at a very detailed level using hardware tracing capabilities. It leverages technologies such as Intel Processor Trace to capture precise information about how a program executes over time, including function calls and instruction flow. The tool is designed for performance debugging, allowing developers to identify bottlenecks, inefficiencies, and unexpected behavior in complex systems. It includes a visualization interface that presents traces in an understandable format, making it easier to interpret large volumes of execution data. ... -
11
gRPC-Go
The Go language implementation of gRPC. HTTP/2 based RPC
gRPC is a modern open source high performance Remote Procedure Call (RPC) framework that can run in any environment. It can efficiently connect services in and across data centers with pluggable support for load balancing, tracing, health checking and authentication. It is also applicable in last mile of distributed computing to connect devices, mobile applications and browsers to backend services. Define your service using Protocol Buffers, a powerful binary serialization toolset and language. ... -
12
Tau
Open source distributed Platform as a Service (PaaS)
tau is the core runtime and orchestration engine of the Taubyte platform, an event-driven, distributed computing framework for building and running decentralized applications. tau handles the dynamic deployment of code, services, and data across edge and cloud environments based on real-time events. It abstracts infrastructure and simplifies application delivery by combining GitOps principles with a secure, multi-tenant execution model. tau enables seamless scalability, event-based routing, and on-demand execution without managing underlying servers. -
13
BFE
A modern layer 7 load balancer from baidu
...BFE provides a rich set of plugins for traffic management, security, observability, etc. BFE includes detailed built-in metrics for all subsystems. BFE writes various logs for trouble shooting, data analysis and visualization. BFE also supports distributed tracing. -
14
ecang
Ethercat analyzer. Pcapng (by wireshark) to cvs files converter.
To diagnose a problem or simply to study the internal flow of information in an ethercat fieldbus, one of the common practices is to capture the flow of ethercat datagrams with an ethernet sniffer such as Wireshark (www.wireshark.org). Wireshark provides some filters to facilitate data analysis but the high amount of recorded information still makes an analysis complicated for many people who do not have a very deep knowledge of the ethercat protocol and Wireshark tools. ... -
15
teemIP - CMDB & DDI solution
teemIP : Open source IPAM & DDI solution with CMDB integration.
teemIP is an open source, web-based IP Address Management (IPAM) and DDI solution built on the iTop framework. It provides comprehensive IP management: IPv4/IPv6 plan management, subnet hierarchy, IP lifecycle, VLAN and DNS/DHCP integration. teemIP is now maintained by the teemIP SAS founding team: Christophe Naud (original creator), Martin de Laval and Quentin Ville. The company is being officially incorporated in July 2026. The project remains open source under AGPL... -
16
LSJ-Server
LSJ-Server-Terra (Java Multipurpose Sever connected with MariaDB)
...LSJ-Server (Terra) is a high-performance, lightweight socket server built with Pure Java and MariaDB. It offers a robust backend for IT maintenance and MMORPG/RTS games without heavy framework overhead. [Features] Pure Java & MariaDB: Fast data processing & persistence. Real-time Monitoring: GUI for live logs and user management. Optimized Networking: Low-latency TCP/IP support. [How to Use] Config: Set MariaDB and Port (default: 10815). Control: Use 'Start' and 'Stop' buttons. Manage: Monitor logs/users and use the bottom command field. ... -
17
FlowViewer
FlowViewer is a web-based netflow data analysis tool.
FlowViewer provides a convenient web-based user interface to Mark Fullmer’s flow-tools suite and CMU's netflow data capture/analyzer, SiLK. The inclusion of the underlying SiLK tool set enables FlowViewer users to continue to use the tool with the newer IPFIX netflow data protocol, which includes support for IPv6 and Cisco's v9 and FNF netflow. FlowViewer has been developed for NASA’s Earth Sciences Data and Information System (ESDIS) networks, and credit goes to NASA for their usual outstanding support of innovation. ... -
18
Spektral
Graph Neural Networks with Keras and Tensorflow 2
Spektral is a Python library for graph deep learning, based on the Keras API and TensorFlow 2. The main goal of this project is to provide a simple but flexible framework for creating graph neural networks (GNNs). You can use Spektral for classifying the users of a social network, predicting molecular properties, generating new graphs with GANs, clustering nodes, predicting links, and any other task where data is described by graphs. Spektral implements some of the most popular layers for graph deep learning. ... -
19
RCDCap
RCDCap is a remote capture preprocessor
RCDCap is a packet processing framework. At its core, it incorporates basic mechanisms for local and remote capturing and decapsulation of packets (CISCO ERSPAN and HP ERM are supported). It can be extended to support many types of packet-based traffic analysis by creating plug-ins and loading them in the main application. It includes many optimizations to ensure high performance traffic processing. Some of them are: multithreaded traffic processing; explicit thread pinning; configurable... -
20
jNetPcap - A Libpcap Java Binding
A java PCAP and DPI library
A java wrapper for popular "libpcap" and "WinPcap" libraries. Accurate full API translation. Packet buffers delivered with no copies. Send custom packets, gather statistics. Comprehensive and easily extensible DPI engine. -
21
Savors is a visualization framework that supports the ingestion of data streams created by arbitrary command pipelines. Any number of data streams can be shown synchronized by time in the same or different views, which can be arranged in any layout. These capabilities combined with a powerful parallelization mechanism and interaction models already familiar to administrators allows Savors to display complex visualizations of data streamed from many different systems with minimal effort.
-
22
Navigo
A simple vanilla JavaScript router
...It also supports hash-based routing for projects that need simpler deployment or legacy compatibility. Navigo includes parameterized routes, navigation helpers, lifecycle hooks, not-found handling, default handlers, and easy integration with links through a data attribute. It is a strong fit for developers who want routing behavior without adopting a large frontend framework. -
23
Xplico
Xplico is a Network Forensic Analysis Tool (NFAT)
Xplico is a Network Forensic Analysis Tool (NFAT). The goal of Xplico is extract from an internet traffic capture the applications data contained. For example, from a pcap file Xplico extracts each email (POP, IMAP, and SMTP protocols), all HTTP contents, each VoIP call (SIP, MGCP, MEGACO, RTP), IRC, WhatsApp... Xplico is able to classify more than 140 (application) protocols. Xplico cam be used as sniffer-decoder if used in "live mode" or in conjunction with netsniff-ng. ... -
24
NetFireCoRE
Network Firewall Linux Kernel Module with Conflict Resolution Engine
We implement an open source conflict resolution framework that consists of a user-space C application that automatically resolves firewall rules anomalies, and b) a generic tree (called policy tree), implemented as a Linux kernel module which maintains the resolved firewall rules and enables the necessary hooks to netfilter for matching incoming (or outgoing) network packets. Tree-based data structures offer improved efficiency compared to traditional access control lists (e.g. iptables or nftable maps), especially for large systems with a huge number of rules. ... -
25
hexinject
Hexadecimal and raw packet injector and sniffer.
Hexadecimal and raw packet injector and sniffer. Can be easily combined with other tools to provide a powerful cmdline framework for raw network access.
