Search Results for "large files"
Sort By:
Showing 27 open source projects for "large files"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
DuckDB
DuckDB is an in-process SQL OLAP Database Management System
...DuckDB supports arbitrary and nested correlated subqueries, window functions, collations, complex types (arrays, structs), and more. For more information on the goals of DuckDB, please refer to the Why DuckDB page on our website. Processing and storing tabular datasets, e.g. from CSV or Parquet files. Interactive data analysis, e.g. Joining & aggregate multiple large tables. Concurrent large changes, to multiple large tables, e.g. appending rows, adding/removing/updating columns. Large result set transfer to client. For development, DuckDB requires CMake, Python3 and a C++11 compliant compiler. Run make in the root directory to compile the sources. ... -
2
Go Recipes
Collection of handy tools for Go projects
Visualize the distribution of code coverage in your project. This helps to identify code areas with high and low coverage. Useful when you have a large project with lots of files and packages. This 2D image-hash of your project should be more representative than a single number. For each module, the node representing the greatest version (i.e., the version chosen by Go's minimal version selection algorithm) is colored green. Other nodes, which aren't in the final build list, are colored grey — by the official Go team. ... -
3
Delta
A viewer for git and diff output
...Delta provides Stylable box/line decorations to draw attention to commit, file and hunk header sections. Support for Git's color-moved feature. Code can be copied directly from the diff. n and N keybindings to move between files in large diffs, and between diffs in log -p views. Commit hashes can be formatted as terminal hyperlinks to the GitHub/GitLab/Bitbucket page. Delta acts as a pager for git's output, and delta in turn passes its own output on to a "real" pager. -
4
JS Analyzer
Burp Suite extension for JavaScript static analysis
JS Analyzer is a powerful static analysis tool implemented as a Burp Suite extension that helps security researchers and web developers automatically uncover important artifacts in JavaScript files during web application testing. It parses JavaScript responses intercepted by Burp Suite and intelligently extracts API endpoints, full URLs (including cloud storage links), secrets like API keys or tokens, and email addresses while filtering out noise from irrelevant code patterns. The extension is designed to reduce manual effort when analyzing large or obfuscated JavaScript assets, helping testers find security vulnerabilities and sensitive information faster and more reliably. ... -
Error to trace to log to deploy. One click. No SSH.AppSignal links every error to the trace, the trace to the log, the log to the deploy that shipped it.
-
5
Obsidian Visual Skills Pack
Generate Canvas, Excalidraw, and Mermaid diagrams from text
LLM-TLDR is a Python-based tool designed to dramatically reduce the amount of code a large language model needs to read by extracting the essential structure and context from a codebase and presenting only the most relevant parts to the model. Traditional approaches often dump entire files into a model’s context, which quickly exceeds token limits; LLM-TLDR instead indexes project structure, traces dependencies, and summarizes code in a way that preserves semantic relevance while shrinking input size by up to 95 %. ... -
6
Apache HBase
Get random, realtime read/write access to your Big Data
...Thrift gateway and a REST-ful Web service that supports XML, Protobuf, and binary data encoding options. Support for exporting metrics via the Hadoop metrics subsystem to files or Ganglia; or via JMX. Convenient base classes for backing Hadoop MapReduce jobs with Apache HBase tables. -
7
Query.jl
Query almost anything in julia
Query is a package for querying julia data sources. It can filter, project, join and group data from any iterable data source, including all the sources supported in IterableTables.jl. One can for example query any of the following data sources: any array, DataFrames, DataStreams (including CSV, Feather, SQLite, ODBC), DataTables, IndexedTables, TimeSeries, Temporal, TypedTables and DifferentialEquations (any DESolution). The package currently provides working implementations for in-memory... -
8
MathGL
A library for scientific data visualization
A free cross-platform library of fast C++ routines for the plotting of up to 3-ranged data. It can export to bitmap and vector EPS/SVG files. There are window interfaces (GLUT/FLTK/Qt) and console tools. MathGL can be used from C/Fortran/Python/Octav/Lua -
9
Altaxo Data Processing/Plotting Program
Data manipulation and plotting program with scripting
Altaxo is a data manipulation and plotting program written in C# for MS.NET. It is featuring worksheet views and plot views, a scripting language (currently C#) for data processing and automation, import of data from ASCII files or from images, export of graphs and embedding of graphs in other documents. -
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
10
Charmol
Program for molecular graphics
Charmol is a cross-platform GUI/command-line based program for making high-quality pictures of molecular structures, nowadays working on Linux, MacOS and Windows. As output, it produces POV-Ray rendered images or files in VRML format. Charmol is capable of making pictures containing: - from small- to large-size molecules - more molecules together (different settings possible) - orbitals using molden and fchk files (GTO functions up to 'h' angular momentum supported) - surfaces using gaussian cube files (also color-mapped surfaces according to potential) - schematic representation of vibrations using arrows - user-defined arrows representing vectorial properties - measuring gauges - combinations of these features (more orbitals together, orbitals and arrows together etc.) ... -
11
PlateEditor
PlateEditor, a free web application to work with multi-well plates
PlateEditor is a free web application to work with multi-well plates, from creation of layouts to data visualization and aggregation. It is primarily designed as a tool to help scientists working in the field of biology to simplify and fasten the process of data analysis. It is fully client-side: files are never transferred to the server, ensuring complete security and privacy of research data. It doesn't require any installation. - PlateEditor is available at this... -
12
OpticSim.jl
Optical Simulation software
OpticSim.jl is a Julia package for geometric optics (ray tracing) simulation and optimization of complex optical systems developed by the Microsoft Research Interactive Media Group and the Microsoft Hardware Architecture Incubation Team (HART). It is designed to allow optical engineers to create optical systems procedurally and then to simulate and optimize them. Unlike Zemax, Code V, or other interactive optical design systems OpticSim.jl has limited support for interactivity, primarily in... -
13
WhyLogs Java Library
Profile and monitor your ML data pipeline end-to-end
This is a Java implementation of WhyLogs, with support for Apache Spark integration for large scale datasets. Understanding the properties of data as it moves through applications is essential to keeping your ML/AI pipeline stable and improving your user experience, whether your pipeline is built for production or experimentation. WhyLogs is an open source statistical logging library that allows data science and ML teams to effortlessly profile ML/AI pipelines and applications, producing log files that can be used for monitoring, alerts, analytics, and error analysis. ... -
14
wzd
Powerful storage server, designed for big data storage systems
wZD is a server written in Go language that uses a modified version of the BoltDB database as a backend for saving and distributing any number of small and large files, NoSQL keys/values, in a compact form inside micro Bolt databases (archives), with distribution of files and values in BoltDB databases depending on the number of directories or subdirectories and the general structure of the directories. Using wZD can permanently solve the problem of a large number of files on any POSIX compatible file system, including a clustered one. ... -
15
AutoAni
Compilation-free adaptive swf visualization template
AutoAni is a compilation-free adaptive visualization template designed for creating animated bar chart races and similar time-based visualizations using Flash. It focuses on ease of use for beginners by removing the need to install Flash or compile code—users simply prepare their data and images, place them in the same directory, and open the provided SWF file with any compatible player. The template comes with built-in Source Han Sans fonts, ensuring consistent text rendering without... -
16
AQUATONE
A tool for domain flyovers
Aquatone is a tool for visual inspection of websites across a large amount of hosts and is convenient for quickly gaining an overview of HTTP-based attack surface. Aquatone is designed to be as easy to use as possible and to integrate with your existing toolset with no or minimal glue. Aquatone is started by piping output of a command into the tool. It doesn't really care how the piped data looks as URLs, domains, and IP addresses will be extracted with regular expression pattern matching.... -
17
MS Data Miner
MS Data Miner - A web-based proteomics software
Data processing and analysis in proteomic studies is a significant challenge and very time consuming. MS Data Miner (MDM) is a freely available web-based software to analyze, process, validate, compare, and display output files from MS software, including Mascot (Matrix Science), Mascot Distiller (Matrix Science) and ProteinPilot (AB Sciex). It was developed to significantly decrease the data analysis time and to handle large proteomic studies. This open sourced system includes a spectra validation-system and automatically screenshot generation tool for Mascot-assigned spectra. ... -
18
xsv
A fast CSV command line toolkit written in Rust
xsv is a command line program for indexing, slicing, analyzing, splitting and joining CSV files. Commands should be simple, fast and composable. Simple tasks should be easy. Performance trade offs should be exposed in the CLI interface. Composition should not come at the expense of performance. Let's say you're playing with some of the data from the Data Science Toolkit, which contains several CSV files. Maybe you're interested in the population counts of each city in the world. ... -
19
ViTables, a GUI for PyTables
-
20
Hetionet
Hetionet: an integrative network of disease
Hetionet is a hetnet — network with multiple node and edge (relationship) types — which encodes biology. The hetnet was designed for Project Rephetio, which aims to systematically identify why drugs work and predict new therapies for drugs. The JSON and Neo4j formats contain node and edge properties, which are absent in the TSV and matrix formats, including licensing information. Therefore the recommended formats are JSON and Neo4j. Our hetio package in Python reads the JSON format, but it... -
21
Fast Neurite Tracer
Semi-automatic neurite tracing with tera-bytes of imaging data.
...FNT is designed to be * accurate in tracing (each tracing step needs your confirmation), * fast (operations using computer mouse is reduced with automatic searching), * scalable (large volume data of tera-bytes in size are supported). Other features include * the results can be exported to SWC files, * automatic detection of cycles during tracing, * support for data of multiple channels, * support for both 8-bit and 16-bit image data. -
22
Zika-RNAseq-Pipeline
An open RNA-Seq data analysis pipeline tutorial
RNA-seq analysis is becoming a standard method for global gene expression profiling. However, open and standard pipelines to perform RNA-seq analysis by non-experts remain challenging due to the large size of the raw data files and the hardware requirements for running the alignment step. Here we introduce a reproducible open source RNA-seq pipeline delivered as an IPython notebook and a Docker image. The pipeline uses state-of-the-art tools and can run on various platforms with minimal configuration overhead. The pipeline enables the extraction of knowledge from typical RNA-seq studies by generating interactive principal component analysis (PCA) and hierarchical clustering (HC) plots, performing enrichment analyses against over 90 gene set libraries, and obtaining lists of small molecules that are predicted to either mimic or reverse the observed changes in mRNA expression. -
23
BIRT Report Designer
Open Source Reporting & Data Visualization Platform
BIRT is an open source technology platform used to create data visualizations and reports that can be embedded into rich client and web applications. Developers who use BIRT Designer are able to access information from multiple data sources easily and quickly in order to create reports and applications with stunning data visualizations. Actuate now provides a free report server, BIRT iHub F-Type, to deploy BIRT content so developers don't have to build their own infrastructure. With a... -
24
Occursions
Fast customizable time series web database for big data like log files
Our goal is to create the world's fastest extendable, non-transactional time series database for big data (you know, for kids)! Log file indexing is our initial focus. For example append only ASCII files produced by libraries like Log4J, or containing FIX messages or JSON objects. Occursions was built by a small team sick of creating hacks to remotely copy and/or grep through tons of large log files. We use it to index around a terabyte of new log data per day. You can use it too. Who doesn't have `just too many' log files? ... -
25
Thinkedit is an open source web based content and data management system written in PHP. With large emphasis on databases, and specifically sql ones (mysql). It is highly extensible through simple configuration files. Not actively maintained
