Open Source Perl Data Management Systems

MRTG is a free, open-source tool designed to monitor and measure the traffic load on network links. It generates HTML pages containing graphical representations (PNG images) of network traffic, providing visual insights into bandwidth usage over time. Originally developed to monitor router traffic, MRTG has evolved to graph various network devices and other metrics.

The ggplot2-book repository contains the source for ggplot2: Elegant Graphics for Data Analysis, written by Hadley Wickham. The book explains the theory and application of the ggplot2 package in R for data visualization, guiding readers through its layered grammar of graphics approach. It serves as both a practical guide and conceptual reference for building advanced plots and mastering ggplot2.

xoscope is a digital oscilloscope using input from a sound card or EsounD and/or a ProbeScope/osziFOX and will soon support Bitscope hardware. Includes 8 signal displays, variable time scale, math, memory, measurements, and file save/load.

Flame graphs are a visualization of profiled software, allowing the most frequent code-paths to be identified quickly and accurately. They can be generated using my open source programs, which create interactive SVGs. See the Updates section for other implementations. Recently I've been helping with d3-flame-graph. The x-axis shows the stack profile population, sorted alphabetically (it is not the passage of time), and the y-axis shows stack depth, counting from zero at the bottom. Each rectangle represents a stack frame. The wider a frame is is, the more often it was present in the stacks. The top edge shows what is on-CPU, and beneath it is its ancestry. The colors are usually not significant, picked randomly to differentiate frames. Flame charts were first added by Google Chrome's WebKit Web Inspector (bug). While inspired by flame graphs, flame charts put the passage of time on the x-axis instead of the alphabet.

XMLTV is a suite of utilities to obtain, generate, and post-process TV listings data in XMLTV format. It provides tools to gather television listings, process listings data, and help organize TV viewing.

NOTE: Code commits were FROZEN on SourceForge in July of 2016, and the project no longer uses sourceforge. All new code is now at <http://github.com/Xastir/Xastir>. The version you can download here has been obsolete for over 10 years, and other than by deleting the project entirely we can't disable the "Download Now" button. Don't download from here. Go to github. Real-time tracking & messaging of stations via radio/internet APRS data streams, w/125 map formats supported. Linux/FreeBSD/Solaris/MacOSX/Windows in any of 7 languages. Can also be used for mobile mapping w/GPS. MAILING LISTS ARE AT: PROJECT->WEB SITE.

The PDL module gives standard perl the ability to COMPACTLY store and SPEEDILY manipulate the large N-dimensional data sets that are the bread and butter of scientific computing.

DVCS Ripper is a security and forensics toolkit that reconstructs source code repositories accidentally exposed on web servers. It understands multiple version-control systems—Git, Mercurial, Bazaar, and Subversion—and crawls their metadata directories to rebuild full history where possible. The utilities handle partial or blocked directory listings by guessing object paths and assembling missing pieces from loose files. Investigators and red-teamers use it to demonstrate the risk of deploying .git/ or .svn/ alongside web content, recovering not just code but also secrets committed by mistake. Outputs are normalized into usable repos so diffing, blame, and log analysis work as if you had pulled from the canonical remote. While powerful, it’s intended for legitimate testing and incident response, reinforcing best practices like build-time artifact generation and strict web server access rules.

postgresqltuner is a Perl script designed to analyze PostgreSQL database configurations and provide tuning advice. It assists database administrators in optimizing performance by offering recommendations based on the current setup.​

FlowViewer provides a convenient web-based user interface to Mark Fullmer’s flow-tools suite and CMU's netflow data capture/analyzer, SiLK. The inclusion of the underlying SiLK tool set enables FlowViewer users to continue to use the tool with the newer IPFIX netflow data protocol, which includes support for IPv6 and Cisco's v9 and FNF netflow. FlowViewer has been developed for NASA’s Earth Sciences Data and Information System (ESDIS) networks, and credit goes to NASA for their usual outstanding support of innovation. The FlowViewer tools provide additional graphing and tracking features by utilizing open source software including Thomas Boutrell’s gd, Lincoln Stein's GD, Martien Verbruggen's GD::Graph, and Tobias Oetiker’s RRDtool. FlowViewer v4.6 fixes non-UTC local time environments for FlowViewer and FlowGrapher, and $no_devices_or_exporters FlowMonitor_Collector problem. **Note: SiLK must be v3.8.0 or later. Version 3.9 handles sFlow data.

scriptLattes is an open-source system to create academic reports of groups based on curricula vitae of the Brazilian Lattes Database.

ETL Converter is a migration tool that builds open source ETL projects from existing projects made with proprietary software. The first version converts DataStage projects into Talend Open Studio projects. Other sources/targets will be available later.

g2 is an easy to use, portable and powerful 2D graphics library. It provides a comprehensive set of functions for simultaneous generation of graphical output on different types of devices.

PheMaDB is a web-based data management system to store and analyze OmniLog Phenotype Microarray data. The manuscript can be accessed here: http://www.biomedcentral.com/1471-2105/12/109. Chang WE et al. BMC Bioinformatics. 2011 Apr 20;12(1):109.

AquaTerm is a Mac OS X grahics renderer. It allows command line applications written in ObjC, C, FORTRAN, Lisp, Perl or Python to display vector graphics, text and images using a simple API. Adapters for gnuplot, PGPLOT, and PLplot exists as well.

As of 2018-06-28, this project has moved to https://github.com/AdamaJava. This copy of the code will remain but all new code updates and releases will be from the new site. Java code developed by the Australian ICGC team for operating on next-generation sequencing data. This code is currently being maintained and expanded by the QIMR Berghofer Genome Informatics team (http://www.qimrberghofer.edu.au/lab/genome-informatics/) More details and documentation can be found on the wiki: http://sourceforge.net/p/adamajava/wiki/Home/

CViT - Chromosome Viewing Tool. A collection of Perl scripts that enable quick visualizations of features on linkage groups, psuedochromosomes or cytogenetic maps. Intended for whole-genome views of data but can be used to create images of single chromosomes/linkage groups, contigs, or BACs, or even proteins -- any feature that has a location on a backbone. Handles most standard genetic/genomic coordinate systems. Reads GFF3 data and produces a PNG or SVG image.

Cap analysis of gene expression (CAGE) is a sequencing based technology to capture the 5’ ends of RNAs in a biological sample. After mapping, a CAGE peak on the genome indicates the position of an active transcriptional start site (TSS) and the number of reads correspond to its expression level. CAGE is prominently used in both the FANTOM and ENCODE project. MOIRAI is a compact yet flexible workflow system designed to carry out the main steps in data processing and analysis of CAGE data. MOIRAI has a graphical interface allowing wet-lab researchers to create, modify and run analysis workflows. Embedded within the workflows are graphical quality control indicators allowing users assess data quality and to quickly spot potential problems. MOIRAI package comes with three main workflows allowing users to map, annotate and perform an expression analysis over multiple samples.

N-Browse is a client-server package for interactive visualization of network data with heterogeneous types of links, intended for ease of use and designed using a generic database schema for data integration and visualization.

OmniGene is a set of reausable components that have been packaged into frameworks. These frameworks are used to produce domain specific services for common bioinformatics tasks including: visualization, database access, and pipeline building.

Comprehensive & high performance data distribution &transformation system. Features a simple, user-friendly event driven scripting interface transparently generates & execs highly efficient Perl/C code. Uses:ETL,datawarehousing,statistics,data-cleansing.

StateVis is a package that allows states (or groups) to create a browsable database of their Landsat holdings.

A generic geospatial analysis and viewing capability using Perl scripts that provides the foundation and structure for readily creating KML data files from disparate data sources. KML files can be read and viewed by Google Earth and other tools.

Processing of smallRNA-Seq data to gather biologically relevant information requires application of multiple statistical and bioinformatics tools from different sources, each focusing on a specific step of the analysis pipeline. The analytical workflow can be challenging for the continuous interventions by the operator, a critical factor when large numbers of datasets need to be analyzed at once. To allow a flexible and comprehensive analysis of smallRNA-Seq data we designed a novel modular pipeline, called iMir, integrating multiple open source modules and resource in an automated workflow, devising different statistical approaches to analyze data rigorously. iMir comprises also a Graphical User Interface (GUI), so that the pipeline is particularly suited for biologist and early stage bioinformaticians and produces both graphics and text outputs.

The q utility is a platform for creating and managing data analysis pipelines. It expands the value of your existing job scheduler - either Grid Engine or TORQUE PBS - through numerous functions that help you organize, submit, monitor, manage and share your informatics work. Data processing pipelines require high-level organization and parallelization of work to optimize resource utilization and decrease the time to results. q (from queue) allows complex job sequences to be efficiently assembled and managed, including dependency tracking, parallelization, and pipeline-level monitoring, error recovery, and data protection. Pipelines are constructed from modular script files, with job definitions and results stored in easily retrieved job files. A web interface facilitates job submission and monitoring, with the complete pipeline exportable for full transparency.