Search Results for "data collection algorithm"
Sort By:
Showing 174 open source projects for "data collection algorithm"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
Alibaba iLogtail
Fast and Lightweight Observability Data Collector
iLogtail was born for observable scenarios and has many production-level features such as lightweight, high performance, and automated configuration, which are widely used internally by Alibaba Group and tens of thousands of external Alibaba Cloud customers. You can deploy it in physical machines, Kubernetes and other environments to collect telemetry data, such as logs, traces and metrics. Supports a variety of Logs, Traces, and Metrics data collection, and is friendly to container and Kubernetes environment support. The resource cost of data collection is quite low, 5-20 times better than similar telemetry data collection Agent performance. High stability, used in the production of Alibaba and tens of thousands of Alibaba Cloud customers, and collecting dozens of petabytes of observable data every day with nearly tens of millions deployments. -
2
ThingsBoard
Device management, data collection, processing and visualization
ThingsBoard is an open-source IoT platform for data collection, processing, visualization, and device management. It enables device connectivity via industry standard IoT protocols, MQTT, CoAP and HTTP and supports both cloud and on-premises deployments. ThingsBoard combines scalability, fault-tolerance and performance so you will never lose your data. Provision, monitor and control your IoT entities in a secure way using rich server-side APIs. -
3
Zstandard
Zstandard - Fast real-time compression algorithm
Zstandard is a fast compression algorithm, providing high compression ratios. It also offers a special mode for small data, called dictionary compression. The reference library offers a very wide range of speed / compression trade-off, and is backed by an extremely fast decoder (see benchmarks below). Zstandard library is provided as open source software using a BSD license. -
4
Brotli
Brotli compression format
...This happens when "one-shot" decoding API is used (or input chunk for streaming API is not limited), input size (chunk size) is larger than 2GiB, and input contains uncompressed blocks. After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash. Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression. The specification of the Brotli Compressed Data Format is defined in RFC 7932. ... -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
Zipkin
Distributed tracing system to gather timing data
Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations failed. ... -
6
GTweak
Portable Tool for an Ideal Windows Setup
...GTweak also includes features for removing pre-installed apps, managing updates, and customizing the Windows interface. It is particularly focused on privacy, enabling users to disable tracking, data collection, and background services from Microsoft and third parties. Overall, GTweak serves as an all-in-one toolkit for debloating, securing, and optimizing Windows environments. -
7
LZ4
Extremely fast compression algorithm
LZ4 is lossless compression algorithm, providing compression speed > 500 MB/s per core (>0.15 Bytes/cycle). It features an extremely fast decoder, with speed in multiple GB/s per core (~1 Byte/cycle). A high compression derivative, called LZ4_HC, is available, trading customizable CPU time for compression ratio. LZ4 library is provided as open-source software using a BSD license. -
8
OpenNetMeter
A simple program to monitor your network/data usage
...It lives in the system tray, making it accessible and minimally intrusive for everyday use. Since it's open-source, users can inspect how data collection is done and trust that it’s not sending data elsewhere. While still evolving, it serves a practical niche for users who want more transparency than what built-in OS tools provide. -
9
nkn
Official Go implementation of NKN full node
NKN (New Kind of Network) is a blockchain-based network infrastructure that utilizes a novel consensus mechanism to facilitate decentralized data transmission. By incentivizing network participants with tokens, NKN aims to create a more open, efficient, and secure internet. Its architecture supports a wide range of applications, from messaging to content delivery. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
Netdisco
A web-based network management tool
Netdisco is a web-based network management tool suitable for small to very large networks. It collects IP and MAC address data into a PostgreSQL database using SNMP, CLI, or device APIs. -
11
Prometheus
Open source monitoring system and time series database
Prometheus is a leading open source systems and service monitoring solution. It works by collecting metrics from configured targets at given intervals, evaluating rule expressions, and then displaying the results. It can also signal an alert if a condition is observed to be true. What sets Prometheus apart from other monitoring systems is its highly dimensional data model, powerful query language, autonomous single server nodes, among many other distinguishing features. It also offers... -
12
syslog-ng
Log management solution that improves the performance of SIEM
...Instead of deploying multiple agents on hosts, organizations can unify their log data collection and management. syslog-ng Store Box provides automated archiving, tamper-proof encrypted storage, granular access controls to protect log data. The largest appliance can store up to 10TB of raw logs. -
13
Komari
A simple server monitor tool
Komari is a lightweight, self-hosted server monitoring solution designed to deliver simple and efficient infrastructure visibility with minimal resource overhead. The platform uses a lightweight agent to collect performance data from monitored nodes and presents the results through a clean web interface. Its architecture emphasizes ease of deployment and full data ownership, making it attractive for users who prefer private monitoring environments over managed services. Komari is designed to... -
14
OpenTelemetry
OpenTelemetry Go API and SDK
OpenTelemetry-Go is the Go implementation of OpenTelemetry. It provides a set of APIs to directly measure the performance and behavior of your software and send this data to observability platforms. High-quality, ubiquitous, and portable telemetry to enable effective observability. OpenTelemetry is a collection of APIs, SDKs, and tools. Use it to instrument, generate, collect, and export telemetry data (metrics, logs, and traces) to help you analyze your software’s performance and behavior. -
15
AWS IoT FleetWise Edge
AWS IoT FleetWise Edge Agent
Easily collect, transform, and transfer vehicle data to the cloud in near-real-time. AWS IoT FleetWise makes it easy and cost-effective for automakers to collect, transform, and transfer vehicle data to the cloud in near-real-time and use it to build applications with analytics and machine learning that improve vehicle quality, safety, and autonomy. Train autonomous vehicles (AVs) and advanced driver assistance systems (ADAS) with camera data collected from a fleet of production vehicles.... -
16
File Converter
Simple tool which allows you to convert and compress files
File Converter is a minimalist open‑source tool (GPL‑3.0) that lets users convert and compress one or multiple files directly via the Windows Explorer context menu. It integrates with powerful back-end utilities—FFmpeg, ImageMagick, Ghostscript—to handle a broad range of media and document transformations. File Converter is a personal open source project started in 2014. I have put hundreds of hours adding, refining and tuning File Converter with the goal of making the conversion and... -
17
ET-Optimizer
ET is a powerful application to improve performance
ET-Optimizer is a performance optimization tool designed to enhance system responsiveness and efficiency by applying targeted configurations and tweaks to operating system settings and background processes. It focuses on improving performance in specific use cases such as gaming or real-time applications where latency and system overhead are critical factors. The tool typically includes scripts or automated routines that adjust system parameters, disable unnecessary services, and optimize... -
18
Performance Co-Pilot (PCP)
Performance Co-Pilot
Performance Co-Pilot (PCP) provides a framework and services to support system-level performance monitoring and management. It presents a unifying abstraction for all of the performance data in a system, and many tools for interrogating, retrieving and processing that data. PCP is a feature-rich, mature, extensible, cross-platform toolkit supporting both live and retrospective analysis. The distributed PCP architecture makes it especially useful for those seeking centralized monitoring of... -
19
QuestDB
An open source SQL database designed to process time series data
...It includes endpoints for PostgreSQL wire protocol, high-throughput schema-agnostic ingestion using InfluxDB Line Protocol, and a REST API for queries, bulk imports, and exports. QuestDB implements ANSI SQL with native extensions for time-oriented language features. These extensions make it simple to correlate data from multiple sources using relational and time series joins. QuestDB achieves high performance from a column-oriented storage model, massively-parallelized vector execution, SIMD instructions, and various low-latency techniques. The entire codebase was built from the ground up in Java and C++, with no dependencies, and is 100% free from garbage collection. ... -
20
RyTuneX
RyTuneX is a cutting-edge optimizer built with the WinUI 3 framework
...It also offers system tweaks to improve responsiveness, reduce background overhead, and optimize system settings for gaming or heavy usage workflows. Privacy enhancements are part of its core offering: toggles for telemetry, data-collection features, background apps and more give users greater control over what their OS is tracking or doing under the hood. -
21
Grafana Agent
Vendor-neutral programmable observability pipelines
Grafana Agent is an OpenTelemetry Collector distribution with a configuration inspired by Terraform. It is designed to be flexible, performant, and compatible with multiple ecosystems such as Prometheus and OpenTelemetry. Grafana Agent is based on components. Components are wired together to form programmable observability pipelines for telemetry collection, processing, and delivery. -
22
MiniSearch
Minimalist web-searching platform with an AI assistant
...The platform supports browser-level integration so users can set it as their default search engine for quick access. Its architecture emphasizes privacy by avoiding tracking and minimizing data collection while still enabling advanced AI features. Overall, MiniSearch targets users who want a self-hosted, Perplexity-style search experience with strong control over data and models. -
23
Micrometer
App observability facade for the most popular observability tools
...Think SLF4J, but for observability. Micrometer provides vendor-neutral interfaces for timers, gauges, counters, distribution summaries, and long task timers with a dimensional data model that, when paired with a dimensional monitoring system, allows for efficient access to a particular named metric with the ability to drill down across its dimensions. Out-of-the-box instrumentation of caches, the class loader, garbage collection, processor utilization, thread pools, and more tailored to actionable insight. Micrometer is the instrumentation library powering the delivery of application observability from Spring Boot applications. -
24
Boehm-Demers-Weiser Garbage Collector
The Boehm-Demers-Weiser conservative C/C++ Garbage Collector
The Boehm-Demers-Weiser conservative garbage collector can be used as a garbage collecting replacement for C malloc or C++ new. It allows you to allocate memory basically as you normally would, without explicitly deallocating memory that is no longer useful. The collector automatically recycles memory when it determines that it can no longer be otherwise accessed. The collector is also used by a number of programming language implementations that either use C as intermediate code, want to... -
25
Sonobuoy
Sonobuoy is a diagnostic tool to understand Kubernetes cluster
Sonobuoy is a diagnostic tool that makes it easier to understand the state of a Kubernetes cluster by running a set of plugins (including Kubernetes conformance tests) in an accessible and non-destructive manner. It is a customizable, extendable, and cluster-agnostic way to generate clear, informative reports about your cluster.
