Search Results for "data analysis"

IPAC-NG is the iptables/ipchains based IP accounting package for Linux. It collects, summarizes, and nicely displays IP accounting data. Ipchains and (preferably) iptables are supported. Logs are stored in files, a gdbm or a PostgreSQL database.

...It is a form of copying, in which specific data is gathered and copied from the web, typically into a central local database or spreadsheet, for later retrieval or analysis. Web scraping a web page involves fetching it and extracting from it.[1][2] Fetching is the downloading of a page (which a browser does when you view the page). Therefore, web crawling is a main component of web scraping, to fetch pages for later processing.

OSSIM, AlienVault’s Open Source Security Information and Event Management (SIEM) product, provides event collection, normalization and correlation. For more advanced functionality, AlienVault Unified Security Management (USM) builds on OSSIM with these additional capabilities: * Log management * Advanced threat detection with a continuously updated library of pre-built correlation rules * Actionable threat intelligence updates from AlienVault Labs Security Research Team * Rich...

This RRDTool Framework provides a central HTTP-based service for import into standard RRD DBs and graph generation. A lightweight, easily extendable agent for the data sources is pushing updates with minimal resource consumption on the master service.

Using templated message formats with customisable placeholders, run in configurable sequences that can selectively reuse data between steps, must allows more intelligent testing of syslog receivers with realistic data, as well as longer soak testing and stress testing. must was created to fill a gap found when trying to stress test Splunk as real, indexable and meaningful data was needed. must will (eventually) be provided as a standalone tool that uses XML configs (for quick use and...

This is yet another simple piece of software that extracts all the basic stats from honeyd’s text-based log files and inserts them in a MySQL database. Then you can run some queries and of course visualize the data if you want to. Many things are hardcoded or dead simple, but it does the job. The file is a modified version of “honeyd_importer” perl script originally writen by Joshua Gimer and shared through “honeypots” mailing list.

Command line LOGalyze client. logalyze-cli is a powerful command line client for managing LOGalyze engine. With LOGalyze application log analyzer, you can collect your log data from any device, analyze, normalize and parse them.

This application implement an approach for doing keyword based search over semi-structured data available in HTML pages.

The Forensics Data Identifier (FDI) is a tool which allows for large data files to be easily filtered for common forensically relevant data types.The tool was intended to speed up the ediscovery and analysis processes of the forensics investigation

System for Web usage mining and data warehouse: it allows the discovery of knowledge from data (KDD) regarding users' usage on the Web (such as unique visitors, sessions, transactions) and organise it in a RDBMS (currently PostgreSQL). Written in C++.

SNMP Network Analysis and Presentation Package (SNAPP). Allows high speed SNMP data collection and visualization through a web based interface using a RRD data storage format.

Webstats Solr is an attempt to make Apache Access log easier to Data Mine. By adding a powerful Search Engine (SOLR) as a Backend and using Java Script and HTML and maybe PHP I hope to out date AWStats.

Get and display the traffic counter of a Fritz!Box 7270 (or similar) in a human readable form on local host. The telnet daemon has to be enabled on the FritzBox to download the data file from the AVM router to local host.

ISPMan is a system to design massive ISPs using LDAP as the backend. ISPMan provides a web front end and a command line interface to create virtual domains and manages users, dns information, email infos and httpd setup data for these vhosts.

TraffStats: network Traffic Statistic - is a monitoring and traffic analysis software, using SNMP to collect data from any enabled device. - has the ability to generate graphs (using jpgraph) with the option to compare and sum up different devices.

ArrayPipeLine is a web-based Laboratory Information Management system, using MySQL, Perl CGI and R. It enables high-throughput analysis of microarray data, providing automation of data handling, and rapid creation and implementation of analysis pipelines

Comprehensive & high performance data distribution &transformation system. Features a simple, user-friendly event driven scripting interface transparently generates & execs highly efficient Perl/C code. Uses:ETL,datawarehousing,statistics,data-cleansing.

pils is Perl IRC logging system, a utility for connecting to an IRC daemon and collecting data utilizing a relational database for storage and a web interface for data retrieval, processing, and display.

csvplus is a collection of Perl-based utilities for querying csv files.

APE is a testbed for evaluation of mobile ad hoc network routing protocols. It consists of a stripped down Red Hat Linux distribution, pre-configured for easy setup, and a set of analysis tools used to evaluate data from tests.

IP Traffic Volume: Logs (counts) in- & outgoing bytes through network device(s) using kernel iptables. Highly configurable as to which bytes are logged, e.g. to/from specific ports or ip-addresses. Data displayed in html via cgi or plain ascii to console

FwPlatinum provides real time data analysis of CheckPoint FireWall-1 connection logs. Data is stored for up to 2 years, and is accessed by CGI generated graphs which can drill down to the specific time that you are interested in.

DataDivisions is an open-Source, web-based application designed for web developers working on small to mid-size business websites to assist in the communication of website statistic and error log data comparisons to their employers.

huPPPcol logs the start and end of a pppd (modem, isdn, pppoe dsl) session, and contains a program to analize the data. It was first developed to meet the hungarian telco standards, now it can be configured to other telcos as well. soon here...

The Internet Censor is a multi-platform, Internet clustering program, for which the resulting data will be used in the creation of a non-profit content-filtering Internet Search Engine for children.