Search Results for "large files"
Sort By:
Showing 30 open source projects for "large files"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
yek
Serialize repositories into LLM-ready context w/ smart prioritization
Yek is a Rust-based CLI tool designed to serialize text-based files from a repository or directory into a single structured output for large language model use. It scans projects using .gitignore rules to exclude irrelevant files and automatically filters out binary or oversized content. Yek prioritizes files based on Git history, placing more important content later in the output to align with how language models process context. -
2
SiteDorks
Automate search engine dorking across hundreds of websites
...A built-in dataset contains hundreds of websites grouped into categories such as cloud services, developer platforms, documentation sites, social platforms, and communication tools. Users can also supply custom domain lists or CSV files to tailor searches for tasks like penetration testing, bug bounty research, or OSINT investigations. -
3
Open Semantic Search
Open source semantic search and text analytics for large document sets
...It also supports optical character recognition to extract text from images and scanned documents, including images embedded inside PDF files. It integrates text mining and analytics capabilities that allow users to examine relationships, topics, and structured data within document collections. -
4
Devon
Open source AI pair programmer for coding, debugging, automation
Devon is an open source AI-powered pair programming tool designed to assist developers with software engineering tasks through natural language interaction. It operates as an agent-based system that can explore codebases, edit files, and execute development workflows with minimal manual intervention. Devon uses a client-server architecture with a Python backend and multiple user interfaces, including a terminal interface and an Electron-based desktop application. Devon integrates with multiple large language models, allowing users to choose between different providers for performance, cost, and latency considerations. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
GitDiagram
AI tool that converts GitHub repositories into interactive diagrams
...It uses an AI-powered pipeline to interpret repository structure and transform that information into system design diagrams rendered with Mermaid visualization. These diagrams provide a high-level overview of a codebase, making it easier for developers to explore unfamiliar projects or understand large and complex repositories. Users can interact with the generated diagrams by clicking components to navigate directly to related files or directories within the repository. GitDiagram combines a modern web frontend with a backend service that processes repository data and generates diagrams dynamically. -
6
asdf
Extendable version manager with support for Ruby, Node.js, Elixir, etc
...Manage each of your project runtimes with a single CLI tool and command interface. asdf is a CLI tool that can manage multiple language runtime versions on a per-project basis. It is like gvm, nvm, rbenv & pyenv (and more) all in one! Simply install your language's plugin! Large ecosystem of existing runtimes & tools. Simple API to add support for new tools as you need! Support for existing config files .nvmrc, .node-versions, .ruby-version for smooth migration! .tool-versions to manage all your tools, runtimes, and their versions in a single, sharable place. Supports Bash, ZSH, Fish & Elvish with completions available. ... -
7
DeepAnalyze
Autonomous LLM agent for end-to-end data science workflows
DeepAnalyze is an open source project that introduces an agentic large language model designed to perform autonomous data science tasks from start to finish. It is built to handle the entire data science pipeline, including data preparation, analysis, modeling, visualization, and report generation without requiring continuous human guidance. DeepAnalyze is capable of conducting open-ended data research across multiple data formats such as structured tables, semi-structured files, and unstructured text, enabling flexible and comprehensive analysis workflows. ... -
8
WeKnora
LLM framework for document understanding and semantic retrieval
WeKnora is an open source framework developed for deep document understanding and semantic information retrieval using large language models. It focuses on analyzing complex and heterogeneous documents by combining multiple processing stages such as multimodal document parsing, vector indexing, and intelligent retrieval. It follows the Retrieval-Augmented Generation (RAG) paradigm, where relevant document segments are retrieved and used by language models to generate accurate, context-aware... -
9
ASN
Command line ASN lookup, network recon, and traceroute tool
asn is a multifunctional network investigation and OSINT command line tool designed for analyzing Autonomous System (ASN) and IP-related data. It provides a comprehensive set of capabilities for inspecting network infrastructure, routing information, and security signals associated with IP addresses, hostnames, prefixes, and organizations. It aggregates data from multiple external services to present detailed information such as BGP statistics, RPKI validation status, IP reputation,... -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
Qodo Cover
AI tool that generates tests to improve code coverage quickly
Qodo Cover is an open source developer tool designed to automate the creation of unit tests using generative AI, helping teams improve code coverage with minimal manual effort. It operates as a command-line interface and can also be integrated into continuous integration workflows, making it adaptable to different development environments. It analyzes an existing codebase, identifies gaps in test coverage, and generates new tests that target uncovered or weakly tested areas. It follows an... -
11
Diplomacy Cicero
Code for Cicero, an AI agent that plays the game of Diplomacy
The project is the codebase for an AI agent named Cicero developed by Facebook Research. It is designed to play the board game Diplomacy by combining open-domain natural language negotiation with strategic planning. The repository includes training code, model checkpoints, and infrastructure for both language modelling (via the ParlAI framework) and reinforcement learning for strategy agents. It supports two variants: Cicero (which handles full “press” negotiation) and Diplodocus (a variant... -
12
Charmol
Program for molecular graphics
Charmol is a cross-platform GUI/command-line based program for making high-quality pictures of molecular structures, nowadays working on Linux, MacOS and Windows. As output, it produces POV-Ray rendered images or files in VRML format. Charmol is capable of making pictures containing: - from small- to large-size molecules - more molecules together (different settings possible) - orbitals using molden and fchk files (GTO functions up to 'h' angular momentum supported) - surfaces using gaussian cube files (also color-mapped surfaces according to potential) - schematic representation of vibrations using arrows - user-defined arrows representing vectorial properties - measuring gauges - combinations of these features (more orbitals together, orbitals and arrows together etc.) ... -
13
openSkyMatch
Matches OpenScience Observatories images with astronomical catalogs
openSkyMatch is a collection of Linux shell and Python scripts designed for the OpenScience Observatories program. It automates the identification and matching of detected celestial objects in locally captured FITS images with entries in large-scale sky catalogs, notably Pan-STARRS1 DR2 (II/389/ps1_dr2). The toolkit supports data preprocessing, coordinate correlation, and catalog-based validation of astronomical detections. All tools are open-source and optimized for reproducibility and... -
14
GitGot
Semi-automated tool for discovering exposed secrets in GitHub data
GitGot is an open source security tool designed to help users quickly search large amounts of public data on GitHub to identify potentially exposed secrets. It operates as a semi-automated, feedback-driven system that combines automated search capabilities with human guidance to refine results during investigation. GitGot leverages the GitHub Search API to perform queries across repositories, files, and gists, allowing security researchers and penetration testers to discover sensitive information that may have been unintentionally exposed in public code. ... -
15
Advanced DHCP Server Live CD (With GUI)
The Free & Popular opendhcp application for Physical & Virtual Machine
Instructions: 1. Write this .iso file to a Pen Drive, with the Free multibootusb software ( links below ) 2. Boot from the Pen Drive, after changing the BIOS Boot Order quickly on system startup 3. First startup will show some info dialogs. These can be cancelled without making any changes 4. Click on the opendhcp folder link on Desktop 5. Right click the set_eth0_static_ipaddress.sh file and choose Open as Text option. Edit the file to meet your network needs. To know about... -
16
Andronix App
This is the official repository for the back end of the Andronix app
Andronix is simple inside the hood (well not really, but most of it is simple to understand). Andronix uses PRoot to run your favorite Linux distribution on your Android devices. PRoot is a user-space implementation of chroot, mount --bind, and binfmt_misc. This means that users don't need any privileges or setup to do things like using an arbitrary directory as the new root file system, making files accessible somewhere else in the file system hierarchy, or executing programs built for... -
17
grab-site
Web crawler for archiving and backing up sites into WARC archives
grab-site is an open source web crawling tool designed to archive and back up websites by recursively downloading their content. It works by taking a starting URL and systematically following links across the site, capturing pages and resources and saving them into WARC archive files for long-term preservation. Internally, the crawler uses a fork of the wpull engine to fetch and process web pages efficiently during large-scale crawls. grab-site includes a built-in dashboard that displays real-time crawl activity, including which URLs are currently being processed and how many remain in the queue. Users can dynamically apply ignore patterns during an active crawl, allowing them to skip problematic or unnecessary URLs that could slow down or block the archiving process. grab-site also provides predefined ignore sets for common site structures such as forums and other complex web platforms. ... -
18
ievms
Automated installation of the Microsoft IE App Compat virtual machines
Microsoft provides virtual machine disk images to facilitate website testing in multiple versions of IE, regardless of the host operating system. Unfortunately, setting these virtual machines up without Microsoft's VirtualPC can be extremely difficult. The ievms scripts aim to facilitate that process using VirtualBox on Linux or OS X. With a single command, you can have IE6, IE7, IE8 and IE9 running in separate virtual machines. Install network adapter drivers by opening the drivers CD image... -
19
Hetionet
Hetionet: an integrative network of disease
Hetionet is a hetnet — network with multiple node and edge (relationship) types — which encodes biology. The hetnet was designed for Project Rephetio, which aims to systematically identify why drugs work and predict new therapies for drugs. The JSON and Neo4j formats contain node and edge properties, which are absent in the TSV and matrix formats, including licensing information. Therefore the recommended formats are JSON and Neo4j. Our hetio package in Python reads the JSON format, but it... -
20
Fast Neurite Tracer
Semi-automatic neurite tracing with tera-bytes of imaging data.
...FNT is designed to be * accurate in tracing (each tracing step needs your confirmation), * fast (operations using computer mouse is reduced with automatic searching), * scalable (large volume data of tera-bytes in size are supported). Other features include * the results can be exported to SWC files, * automatic detection of cycles during tracing, * support for data of multiple channels, * support for both 8-bit and 16-bit image data. -
21
AutoGen is designed to generate text files containing repetitive text with varied substitutions. Its goal is to simplify the maintenance of programs that contain large amounts of repetitious text, especially when needed in parallel tables.
-
22
mp3 library, advanced ID3V1 and ID3V2 tagger, player. Organize a large mp3 library, over 40,000 songs. Speech synthesis and tag backup utilities. Scripts to maintain and organize song files.
-
23
Ymap - Yeast Mapping Analysis Pipeline
Pipeline for large-scale genome changes analysis of genome datasets.
The active use repository has migrated over to: https://github.com/darrenabbey/ymap The repository here was errantly created with some large binary files included. Attempts to extract the files from the history here have failed. A copy of the history was successfully scrubbed and then hosted at github. -------- Eukaryotic pathogens have complicated and dynamic genomes. To facilitate analysis of copy number variations (CNV), single nucleotide polymorphisms (SNPs), and loss of heterozygosity (LOH) events in Candida albicans, the most common human fungal pathogen, we developed a pipeline for analyzing diverse genome-scale datasets from microarray, deep sequencing, and restriction site associated DNA sequence experiments for clinical and laboratory strains. ... -
24
NaRIBaS
Unix-based preparation and analysis toolbox for molecular simulations
...Task specific input and preparation or analysis function, are easy expandable to meet the scientific characteristic of constant changing properties. Concepts for efficiently storing and analysing large files in conjunction with graphical visualization and numerical data processing are presented in a Manual. A documented script collection that allows reproducing all simulations and analysis results presented in the Doctoral thesis of the author. -
25
Large Text File converter
Java Based Heavy-duty utilitity to process large delimited text files
TextZilla is a Multithreaded Java utility which can process huge size delimited text files to extract, convert, encode, decode, encrypt/decrypt text data from source and write it in desired output file or files. It provides fully extensible framework based on which Java classes can be created, for example it currently has MD5 conversion capability, based on same design classes for 3DES ,AES or any other Algo can be created. Another strength of this tool is in its configurability, it's...
