Search Results for "data"
Sort By:
Showing 181 open source projects for "data"
View related business solutions-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
Elasticsearch
A Distributed RESTful Search Engine
...It lets you perform and combine many types of searches; it scales seamlessly, and offers answers incredibly fast with search results you can rank based on a variety of factors. Elasticsearch can be used for a wide variety of use cases, from maps and metrics to site search and workplace search, and with all data types. -
2
Logstash
Centralize, transform and stash your data
Logstash is a server-side data processing pipeline that dynamically ingests data from numerous sources, transforms it, and ships it to your favorite “stash” regardless of format or complexity. It supports and ingests data of all shapes, sizes and sources, dynamically transforms and prepares this data, and transports it to the output of your choice. Logstash is extensible, with over 200 plugins available to let you create and configure your pipeline how you choose. -
3
syslog-ng
Log management solution that improves the performance of SIEM
...Instead of deploying multiple agents on hosts, organizations can unify their log data collection and management. syslog-ng Store Box provides automated archiving, tamper-proof encrypted storage, granular access controls to protect log data. The largest appliance can store up to 10TB of raw logs. -
4
Beats
Lightweight data shippers of the Elastic Stack
Beats is a platform of lightweight, single-use data shippers written in Go. It captures all sorts of operational data from hundreds or thousands of machines and systems and sends them to Logstash or Elasticsearch. Beats is lightweight in that it has a small installation footprint, uses limited system resources and has no runtime dependencies. It consists of: Auditbeat (for audit data), Filebeat (for log files), Functionbeat (serverless shipper), Heartbeat (for uptime monitoring), Metricbeat (for metrics), Packetbeat (for monitoring network data), and Winlogbeat (for Windows Event logs), with many other Beats created by the community. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Logan
Logan is a lightweight case logging system based on mobile platform
...To put it simply, the traditional idea is to piece together the problems that appear in the logs of each system, but the new idea is to aggregate and analyze all the logs generated by the user to find the scenes with problems. In the future, we will provide a data platform based on Logan big data, including advanced functions such as machine learning, troubleshooting log solution, and big data feature analysis. -
6
fluentbit
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX
...No more OOM errors! Integration with all your technology, cloud-native services, containers, streaming processors, and data backends. Fully event-driven design leverages the operating system API for performance and reliability. All operations to collect and deliver data are asynchronous. -
7
Netdata
Open-source systems performance monitor
Netdata is a well-crafted real time performance monitor to detect anomalies in your system infrastructure. Visualize many types of data including disk activity, SQL queries, website visitors and more. This tool is useful to monitor linux servers. -
8
mtail
Extract internal monitoring data from application logs
Extract internal monitoring data from application logs for collection in a time-series database. mtail is a tool for extracting metrics from application logs to be exported into a timeseries database or timeseries calculator for alerting and dashboarding. It fills a monitoring niche by being the glue between applications that do not export their own internal state (other than via logs) and existing monitoring systems, such that system operators do not need to patch those applications to instrument them or writing custom extraction code for every such application. ... -
9
Serilog
Simple .NET logging with fully-structured events
...It is easy to set up, has a clean API, and is portable between recent .NET platforms. Unlike other logging libraries, Serilog is built with powerful structured event data in mind. Serilog message templates are a simple DSL extending .NET format strings. Parameters can be named, and their values are serialized as properties on the event for incredible searching and sorting flexibility. Serilog is a diagnostic logging library for .NET applications. It is easy to set up, has a clean API, and runs on all recent .NET platforms. ... -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
10
Grafana Loki
Multi-tenant log aggregation system inspired by Prometheus
...It does not index the contents of the logs, but rather a set of labels for each log stream. Unlike other logging systems, Loki is built around the idea of only indexing metadata about your logs: labels (just like Prometheus labels). Log data itself is then compressed and stored in chunks in object stores such as S3 or GCS, or even locally on the filesystem. A small index and highly compressed chunks simplifies the operation and significantly lowers the cost of Loki. Loki supports multi-tenancy so that data between tenants is completely separated. Multi-tenancy is achieved through a tenant ID (which is represented as an alphanumeric string). ... -
11
parseable
Parseable is a log analytics system written in Rust
Parseable is a log analytics platform, built for the modern, cloud native era. Parseable uses a index-free mechanism to organize and query data allowing low latency, and high throughput ingestion and query. -
12
Osquery
SQL operating system instrumentation and monitoring framework
...The tools make low-level operating system analytics and monitoring both performant and intuitive. Osquery exposes an operating system as a high-performance relational database. This allows you to write SQL queries to explore operating system data. With osquery, SQL tables represent abstract concepts such as running processes, loaded kernel modules, open network connections, browser plugins, hardware events or file hashes.Osquery queries your devices like a database. Osquery uses basic SQL commands to leverage a relational data-model to describe a device. Frequently, attackers will leave a malicious process running but delete the original binary on disk. ... -
13
Logbook
An extensible Java library for HTTP request and response logging
Logbook is an extensible Java library to enable complete request and response logging for different client- and server-side technologies. It satisfies a special need by a) allowing web application developers to log any HTTP traffic that an application receives or sends b) in a way that makes it easy to persist and analyze it later. This can be useful for traditional log analysis, meeting audit requirements or investigating individual historic traffic issues. Logbook is ready to use out of... -
14
PSR Log
An interface that describes a logger
The main goal is to allow libraries to receive a Psr\Log\LoggerInterface object and write logs to it in a simple and universal way. The LoggerInterface exposes eight methods to write logs to the eight RFC 5424 levels (debug, info, notice, warning, error, critical, alert, emergency). Every method accepts a string as the message, or an object with a toString() method. Implementors MAY have special handling for the passed objects. If that is not the case, implementors MUST cast it to a string.... -
15
morgan
HTTP request logger middleware for node.js
...The function is expected to return a string that will be the log line, or undefined / null to skip logging. Write log line on request instead of response. This means that a requests will be logged even if the server crashes, but data from the response (like the response code, content length, etc.) cannot be logged. To define a token, simply invoke morgan.token() with the name and a callback function. -
16
Timbre
Pure Clojure/Script logging library
...Getting even the simplest logging working can be comically hard, and it often gets worse at scale as your needs become more sophisticated. Timbre offers an all Clojure/Script alternative that's fast, deeply flexible, easy to configure with pure Clojure data, and that just works out the box. No XML. Easily filter logging calls by any combination of: level, namespace, and appended. Zero overhead compile-time level/ns elision. Useful built-in appenders for out-the-box Clj+Cljs logging. Powerful, easy-to-configure rate limits and async logging. Logs as Clojure values (v3+). Small, simple, cross-platform codebase. 3rd-party tools, appenders, etc. ... -
17
Win_Notebook_Batt_Logger
Notebook Battery Logger - Designed for Windows laptop battery tests.
...Features include live graphs of voltage, current, RSOC, OS RSOC, Full Charge Capacity (FCC), current capacity and charge cycles, delayed logging start, CSV export, automatic e-mail delivery of log files, Windows Powercfg Battery Report and Power Efficiency Diagnostics integration, raw battery driver data viewer and battery configuration options. Ideal for battery diagnostics, validation, troubleshooting, long-term battery analysis, engineering, technical support and battery performance evaluation. -
18
MyDisk
Storage and disk utility and logger
Windows storage device utility logger and info viewer. This app allows you to view, and log data about your mounted storage devices! -
19
Battery_Reader
Smart Battery Charge/Discharge Cycling Software
...Designed for battery engineers, developers, researchers, and manufacturers, it supports battery characterization, validation, production testing, fuel gauge development, and long-term aging analysis. Features include real-time monitoring of up to 125 battery parameters, live graphs, programmable data logging, CSV export, Data Flash editing, GG file import/export, firmware programming (SREC), SHA-1 authentication, SMBus command console, and advanced reporting. Compatible with Texas Instruments fuel gauges including bq40z50, bq27742, and bq27z561. Supports Aardvark I²C adapter, programmable power supplies, electronic loads, and automated battery cycling for capacity, internal resistance, cell balancing, and performance evaluation. -
20
perf2rrd
Performance Data collector for Monitoring.
perf2rrd is a program written in Java (tm) which captures performance data output by the Nagios (R) or Icinga monitoring systems and stores it in round robin database files as implememented by RRDtool. -
21
Cinemagoer
Python package to retrieve and manage data of the IMDb
Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db. -
22
DBD2
A multi-threaded, multi-database tcp-based database insertion app.
...The client sends whatever information the user puts on the command-line to the back-end daemon via TCP. Upon successful transmission, the client exits. On failure, it backs off and retries until its life-time timer expires. The back-end daemon accepts data from Syslogd2 or its own client and inserts that data (and envelope information) into one or more databases using MySql client library or dbi drivers (also on SourceForge). The client needs no configuration (all input is via command-line). It is intended for hosts to make database entries without needing database client or interface code. ... -
23
Syslogd2
High capacity syslog data collection, filtering, and management.
Syslogd2 is a syslog daemon that has been completely re-imagined specifically for use in network environments. It is multi-threaded, scalable and versatile with features designed for both network and host managers. Each Syslogd2 binary is customized from a set of over 20 features at compile-time. It can support input from text files, named-pipes, Linux kernel and user-defined Linux and (both IPv4 and IPv6) IP sockets (both UDP and TCP). It provides a pre-loadable name-cache that can... -
24
AzioEventLog Analyzer
AzioEventLog Analyzer is a monitoring and analysis tool
...Dual Operation Modes Monitoring: Track Windows Event Logs Database Mode: Browse and analyze historical logs with advanced filtering and pagination Interactive Dashboard Visual summary cards showing total logs, errors, warnings, and information events Pie chart for log level distribution Advanced Filtering & Search Filter by log source (System, Application, Security, and more) Filter by severity level (Error, Warning, Information, AuditSuccess, AuditFailure) Time-based filtering (Last hour, 24 hours, 3 days, 7 days) Filter by Event ID and Source name Session-based historical data filtering -
25
FASTER
Fast persistent recoverable log and key-value store + cache
...It supports both sync and async interfaces, handles disk errors, and supports checksums. FASTER KV is a concurrent key-value store + cache (available in C# and C++) that is designed for point lookups and heavy updates. FASTER supports data larger than memory, by leveraging fast external storage (local or cloud). It also supports consistent recovery using a new checkpointing technique that lets applications trade-off performance for commit latency.