Search Results for "data collection algorithm"
Sort By:
Showing 131 open source projects for "data collection algorithm"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
Alibaba iLogtail
Fast and Lightweight Observability Data Collector
iLogtail was born for observable scenarios and has many production-level features such as lightweight, high performance, and automated configuration, which are widely used internally by Alibaba Group and tens of thousands of external Alibaba Cloud customers. You can deploy it in physical machines, Kubernetes and other environments to collect telemetry data, such as logs, traces and metrics. Supports a variety of Logs, Traces, and Metrics data collection, and is friendly to container and Kubernetes environment support. The resource cost of data collection is quite low, 5-20 times better than similar telemetry data collection Agent performance. High stability, used in the production of Alibaba and tens of thousands of Alibaba Cloud customers, and collecting dozens of petabytes of observable data every day with nearly tens of millions deployments. -
2
ThingsBoard
Device management, data collection, processing and visualization
ThingsBoard is an open-source IoT platform for data collection, processing, visualization, and device management. It enables device connectivity via industry standard IoT protocols, MQTT, CoAP and HTTP and supports both cloud and on-premises deployments. ThingsBoard combines scalability, fault-tolerance and performance so you will never lose your data. Provision, monitor and control your IoT entities in a secure way using rich server-side APIs. -
3
Zstandard
Zstandard - Fast real-time compression algorithm
Zstandard is a fast compression algorithm, providing high compression ratios. It also offers a special mode for small data, called dictionary compression. The reference library offers a very wide range of speed / compression trade-off, and is backed by an extremely fast decoder (see benchmarks below). Zstandard library is provided as open source software using a BSD license. -
4
Brotli
Brotli compression format
...This happens when "one-shot" decoding API is used (or input chunk for streaming API is not limited), input size (chunk size) is larger than 2GiB, and input contains uncompressed blocks. After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash. Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression. The specification of the Brotli Compressed Data Format is defined in RFC 7932. ... -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
5
Zipkin
Distributed tracing system to gather timing data
Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations failed. ... -
6
nkn
Official Go implementation of NKN full node
NKN (New Kind of Network) is a blockchain-based network infrastructure that utilizes a novel consensus mechanism to facilitate decentralized data transmission. By incentivizing network participants with tokens, NKN aims to create a more open, efficient, and secure internet. Its architecture supports a wide range of applications, from messaging to content delivery. -
7
Netdisco
A web-based network management tool
Netdisco is a web-based network management tool suitable for small to very large networks. It collects IP and MAC address data into a PostgreSQL database using SNMP, CLI, or device APIs. -
8
Prometheus
Open source monitoring system and time series database
Prometheus is a leading open source systems and service monitoring solution. It works by collecting metrics from configured targets at given intervals, evaluating rule expressions, and then displaying the results. It can also signal an alert if a condition is observed to be true. What sets Prometheus apart from other monitoring systems is its highly dimensional data model, powerful query language, autonomous single server nodes, among many other distinguishing features. It also offers... -
9
Komari
A simple server monitor tool
Komari is a lightweight, self-hosted server monitoring solution designed to deliver simple and efficient infrastructure visibility with minimal resource overhead. The platform uses a lightweight agent to collect performance data from monitored nodes and presents the results through a clean web interface. Its architecture emphasizes ease of deployment and full data ownership, making it attractive for users who prefer private monitoring environments over managed services. Komari is designed to... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
AWS IoT FleetWise Edge
AWS IoT FleetWise Edge Agent
Easily collect, transform, and transfer vehicle data to the cloud in near-real-time. AWS IoT FleetWise makes it easy and cost-effective for automakers to collect, transform, and transfer vehicle data to the cloud in near-real-time and use it to build applications with analytics and machine learning that improve vehicle quality, safety, and autonomy. Train autonomous vehicles (AVs) and advanced driver assistance systems (ADAS) with camera data collected from a fleet of production vehicles.... -
11
syslog-ng
Log management solution that improves the performance of SIEM
...Instead of deploying multiple agents on hosts, organizations can unify their log data collection and management. syslog-ng Store Box provides automated archiving, tamper-proof encrypted storage, granular access controls to protect log data. The largest appliance can store up to 10TB of raw logs. -
12
Performance Co-Pilot (PCP)
Performance Co-Pilot
Performance Co-Pilot (PCP) provides a framework and services to support system-level performance monitoring and management. It presents a unifying abstraction for all of the performance data in a system, and many tools for interrogating, retrieving and processing that data. PCP is a feature-rich, mature, extensible, cross-platform toolkit supporting both live and retrospective analysis. The distributed PCP architecture makes it especially useful for those seeking centralized monitoring of... -
13
OpenTelemetry
OpenTelemetry Go API and SDK
OpenTelemetry-Go is the Go implementation of OpenTelemetry. It provides a set of APIs to directly measure the performance and behavior of your software and send this data to observability platforms. High-quality, ubiquitous, and portable telemetry to enable effective observability. OpenTelemetry is a collection of APIs, SDKs, and tools. Use it to instrument, generate, collect, and export telemetry data (metrics, logs, and traces) to help you analyze your software’s performance and behavior. -
14
Grafana Agent
Vendor-neutral programmable observability pipelines
Grafana Agent is an OpenTelemetry Collector distribution with a configuration inspired by Terraform. It is designed to be flexible, performant, and compatible with multiple ecosystems such as Prometheus and OpenTelemetry. Grafana Agent is based on components. Components are wired together to form programmable observability pipelines for telemetry collection, processing, and delivery. -
15
Micrometer
App observability facade for the most popular observability tools
...Think SLF4J, but for observability. Micrometer provides vendor-neutral interfaces for timers, gauges, counters, distribution summaries, and long task timers with a dimensional data model that, when paired with a dimensional monitoring system, allows for efficient access to a particular named metric with the ability to drill down across its dimensions. Out-of-the-box instrumentation of caches, the class loader, garbage collection, processor utilization, thread pools, and more tailored to actionable insight. Micrometer is the instrumentation library powering the delivery of application observability from Spring Boot applications. -
16
MiniSearch
Minimalist web-searching platform with an AI assistant
...The platform supports browser-level integration so users can set it as their default search engine for quick access. Its architecture emphasizes privacy by avoiding tracking and minimizing data collection while still enabling advanced AI features. Overall, MiniSearch targets users who want a self-hosted, Perplexity-style search experience with strong control over data and models. -
17
Boehm-Demers-Weiser Garbage Collector
The Boehm-Demers-Weiser conservative C/C++ Garbage Collector
The Boehm-Demers-Weiser conservative garbage collector can be used as a garbage collecting replacement for C malloc or C++ new. It allows you to allocate memory basically as you normally would, without explicitly deallocating memory that is no longer useful. The collector automatically recycles memory when it determines that it can no longer be otherwise accessed. The collector is also used by a number of programming language implementations that either use C as intermediate code, want to... -
18
mtail
Extract internal monitoring data from application logs
Extract internal monitoring data from application logs for collection in a time-series database. mtail is a tool for extracting metrics from application logs to be exported into a timeseries database or timeseries calculator for alerting and dashboarding. It fills a monitoring niche by being the glue between applications that do not export their own internal state (other than via logs) and existing monitoring systems, such that system operators do not need to patch those applications to instrument them or writing custom extraction code for every such application. ... -
19
Sonobuoy
Sonobuoy is a diagnostic tool to understand Kubernetes cluster
Sonobuoy is a diagnostic tool that makes it easier to understand the state of a Kubernetes cluster by running a set of plugins (including Kubernetes conformance tests) in an accessible and non-destructive manner. It is a customizable, extendable, and cluster-agnostic way to generate clear, informative reports about your cluster. -
20
Recovery for Xiaomi devices
A collection of current recoveries in one place
TWRP (TeamWin) OFRP (OrangeFox) PBRP (PitchBlack) -
21
PatchMon
Linux Patch Monitoring Automation Platform
PatchMon is a centralized patch monitoring and management platform aimed at simplifying how administrators observe and manage package updates across diverse Linux server environments. It centralizes patch status information from many hosts into a single dashboard where users can view inventories of outdated packages, track repositories per host, and organize machines into logical groups for easier oversight. Agents installed on each server make outbound-only connections to the PatchMon... -
22
ProcDump for Linux
A Linux version of the ProcDump Sysinternals tool
ProcDump for Linux is a Linux version of Microsoft’s Sysinternals ProcDump utility for Windows. It gives developers and system administrators a practical way to generate core dumps when an application meets specific performance or diagnostic conditions. The tool is useful when a process is unstable, consumes too much CPU or memory, throws .NET exceptions, crosses thread or file descriptor thresholds, or receives selected signals. It supports immediate dumps, repeated dumps, delayed dumps,... -
23
Apache SkyWalking
Application Performance Monitoring System
Apache SkyWalking is an open source application performance monitoring system designed specifically for microservices, as well as cloud-native and container-based(Docker, Mesos, Kubernetes) architectures. It is capable of monitoring, tracing and diagnosing distributed systems in cloud native architectures. Apache Skywalking supports the collection of telemetry data from a number of different sources and in different formats, such as Java, .NET Core, PHP, LUA agent and more. It also offers a solid core features set, which includes root cause analysis, service topology map analysis, performance optimization, and many more. -
24
WGCLOUD
Visibility into servers, applications, and infrastructure
WGCLOUD is a distributed operations and maintenance monitoring platform designed to provide comprehensive visibility into servers, applications, and infrastructure through a lightweight yet highly integrated architecture. Built on a Spring Boot microservices foundation with an agent-server model, the system emphasizes rapid deployment, minimal configuration overhead, and automated operation for large-scale environments. It collects extensive host metrics such as CPU usage, temperature,... -
25
OpenSuperClone-Live
A USB bootable Linux OS designed for running OpenSuperClone
...This project is intended to serve as a modern replacement for "HDDLiveCD", the live OS that shipped with the original HDDSC project. OSC is an advanced Linux -based cloning and imaging tool intended for data recovery from faulty disks. It creates sector-by-sector clones or images that can be used in conjunction with other file recovery software. OSC employs a multipass imaging approach, an intelligent skipping algorithm, and various passthrough and direct I/O commands for drive communication. These features greatly increase the effectiveness of reading faulty and unstable devices, and reduce the amount of additional wear the drives are subjected to.
