Search Results for "large files"
Sort By:
Showing 40 open source projects for "large files"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
changed-files
Github action to retrieve all (added, copied, modified, deleted, etc.
Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories. Effortlessly track all changed files and directories relative to a target branch, preceding commit or the last remote commit returning relative paths from the project root using this GitHub action. This action solely identifies files that have undergone changes within the context of events such as pull_request, push, and more. However, it doesn't detect pending... -
2
tus-js-client
A pure JavaScript client for the tus resumable upload protocol
tus-js-client is a JavaScript client for the tus resumable upload protocol, enabling reliable and efficient file uploads, especially for large files or unstable network conditions. -
3
diskover-community
Open source file indexing & storage analytics powered by Elasticsearch
Diskover Community Edition is an open source file system indexing and storage analytics platform designed to help organizations understand and manage large volumes of file data. It crawls file systems and indexes metadata using Elasticsearch, enabling fast search, analysis, and organization of files stored across different storage systems. It allows administrators and users to explore file structures, monitor storage usage, and gain insights into how data is distributed across infrastructure. ... -
4
news-please
Python tool for crawling and extracting structured data from news site
news-please is an open source news crawler and information extraction tool designed to collect and structure articles from online news websites. It provides an integrated pipeline that crawls news sites, retrieves article pages, and extracts structured information such as headlines, authors, publication dates, and article text. news-please can recursively follow internal links and read RSS feeds to gather both recent and archived articles from a news outlet when given only the root URL of a... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
Project X
Originates from XTLS protocol, providing a set of network tools
...The project supports multiple protocols such as VLESS, VMess, Shadowsocks, and Trojan, enabling flexible configuration for different networking scenarios. It is written primarily in Go and is optimized for high performance, making it suitable for both personal and large-scale deployments. Project X also integrates advanced features like REALITY and XTLS, which enhance encryption and disguise traffic to improve privacy and resistance to detection. The platform is highly modular, allowing developers to customize routing rules, transport layers, and proxy behaviors through configuration files or integrations. -
6
douyin
Open source Douyin crawler for collecting and downloading public data
DouyinCrawler is an open source data collection tool designed to gather publicly available information from the Douyin platform. It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages. DouyinCrawler supports both automated scraping and batch operations to process multiple targets efficiently. It... -
7
GeneoTree
Dynamic Genealogy Viewer with PHP/MySql-MariaDB
Genealogy Software. Geneotree is a gedcom files PHP viewer, full dynamic on the Web. Main features : dynamic trees, cartography & stats. Many PDF reports, statistics. Special consanguinity and cousins lists. Large files management & optimized ergonomy. -
8
XOOPS Web Application System
The world's leading content management systems (CMS) written in PHP
PLEASE NOTE: Latest XOOPS files are on http://github.com/xoops and http://github.com/xoopsmodules25x) XOOPS is a Web application platform written in PHP for the MySQL database. Its object orientation makes it an ideal tool for developing small or large community websites, intra-company and corporate portals, weblogs, and much more. XOOPS is an acronym of eXtensible Object Oriented Portal System. -
9
BaiduWP PHP
A tool to get the download link of the Baidu netdisk
baiduwp-php is a PHP-based tool that allows users to download files from Baidu Cloud (Baidu Wenku). It bypasses the Baidu Cloud download restrictions and provides a straightforward way to retrieve content hosted on Baidu's cloud storage service. It’s especially useful for users who want to download files without using the Baidu app or encountering excessive waiting times. -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
10
UFTP
Encrypted UDP based FTP with multicast
UFTP is an encrypted multicast file transfer program, designed to securely, reliably, and efficiently transfer files to multiple receivers simultaneously. This is useful for distributing large files to a large number of receivers, and is especially useful for data distribution over a satellite link (with two way communication), where the inherent delay makes any TCP based communication highly inefficient. The multicast encryption scheme is based on TLS with extensions to allow multiple receivers to share a common key. ... -
11
dirhunt
Web crawler that finds hidden web directories without brute force
Dirhunt is an open source security tool designed to discover web directories and analyze website structures without relying on brute-force techniques. Instead of sending large numbers of guess-based requests, it operates as a specialized crawler that intelligently explores websites to identify accessible or hidden directories. Dirhunt can detect directories that expose “Index Of” listings, which may reveal files and other resources that were not intended to be publicly visible. It can also identify situations where directories are intentionally hidden through empty index files or servers that return misleading responses such as fake 404 errors. ... -
12
crawlergo
Headless Chrome crawler for collecting URLs for vulnerability scans
...It also automatically fills and submits forms, helping discover hidden routes or parameters that might otherwise be missed by traditional crawlers. crawlergo includes a built-in URL de-duplication system that removes repeated or pseudo-static links while maintaining fast crawling speeds for large websites. crawlergo also analyzes page content to extract links and resources from multiple sources, including JavaScript files, comments, and configuration files. -
13
Tagbar
Vim plugin that displays tags in a window
...It opens a sidebar window that shows the tags of the current file, organised by scope—so functions, methods, classes and other symbols are grouped logically (for example, methods under their containing class). This gives you at-a-glance insight into the layout of large source files, which is especially useful for navigating unfamiliar codebases or when working on complex modules. The Tagbar sidebar also allows direct navigation: you can click on or jump to specific tags from the list, which makes it much faster to move between definitions than manually searching. Because it uses an external tags generation tool, the plugin can support many languages (C++, Java, Python, etc) with varying degrees of induction based on the tags file. ... -
14
grab-site
Web crawler for archiving and backing up sites into WARC archives
grab-site is an open source web crawling tool designed to archive and back up websites by recursively downloading their content. It works by taking a starting URL and systematically following links across the site, capturing pages and resources and saving them into WARC archive files for long-term preservation. Internally, the crawler uses a fork of the wpull engine to fetch and process web pages efficiently during large-scale crawls. grab-site includes a built-in dashboard that displays real-time crawl activity, including which URLs are currently being processed and how many remain in the queue. Users can dynamically apply ignore patterns during an active crawl, allowing them to skip problematic or unnecessary URLs that could slow down or block the archiving process. grab-site also provides predefined ignore sets for common site structures such as forums and other complex web platforms. ... -
15
csv-parser
Streaming csv parser inspired by binary-csv that aims to be faster
...It implements the stream API native to Node, allowing you to pipe a file or readable stream into the parser and process each row (as a JavaScript object or array) as soon as it's parsed — which is crucial for handling large CSV files without loading them entirely into memory. The parser handles standard CSV semantics including quoted fields, variable delimiters, escape sequences, and optional headers; this makes it robust for a variety of CSV dialects you might encounter. Because it works incrementally (row by row), it is well suited for ETL pipelines, data ingestion workflows, CSV-to-database imports, or any context where you need to process or transform large tabular data in Node.js efficiently. ... -
16
Telementality Company
Filemanager written for PHP, because it is NeXT, the future ..
..."ServerPortable.zip" is large and includes a portable server, that works now in windows 10. It's made of two other freeware products - apache server 2.4 & php 7 - plus the filemanager. This solution with a portable server is to have files kept private. The filemanager can move folders & files across servers - from local to official and back again, i suppose - and yes through the internet thus. -
17
GCDWebServer
The #1 HTTP server for iOS, macOS & tvOS
GCDWebServer is a modern and lightweight GCD based HTTP 1.1 server designed to be embedded in iOS, macOS & tvOS apps. Elegant and easy to use architecture with only 4 core classes: server, connection, request and response. Well designed API with fully documented headers for easy integration and customization. Entirely built with an event-driven design using Grand Central Dispatch for best performance and concurrency. No dependencies on third-party source code. Parser for web forms submitted... -
18
Smart Cache is a fast pure Java HTTP proxy server with offline browsing support. It has URL blocking, URL rewriting. Cached files has not headers inside and cache directory structure copies closely remote server. Supports also large caches.
-
19
XML Viewer Plus
A powerful XML Viewer - add-on for browser Firefox
A powerful XML Viewer, supports text/regex and jQuery/CSS, XPath selectors ==== Release 1.2.6 - 17.06.2019 - Added utf-8 encode for xml viewer ==== Get your XML Editor and Validator on Play Store > https://play.google.com/store/apps/details?id=com.ulm.xmleditor ==== ## Libraries and techs used 1. `Vue` 2. `Vuex` 3. `lodash/debounce` 4. `jQuery` 5. `document.querySelectorAll` 6. `document.evaluate` for `XPath` 7. `bestzip` for packaging ### Limitations - WebExtension only... -
20
Transcrypt
Python in the Browser
Lean and mean Python 3.6 to JavaScript compiler. Supports multiple inheritance, operator overloading and Python source level debugging, even of minified Javascript files. Transcrypt code is as fast and compact as its Javascript counterpart, and it is precompiled for page load speed. You can now develop your web applications completely in Python, with full access to any Javascript library. -
21
casync
Content-addressable data synchronization tool
A combination of the rsync algorithm and content-addressable storage. An efficient way to store and retrieve multiple related versions of large file systems or directory trees. An efficient way to deliver and update OS, VM, IoT and container images over the Internet in an HTTP and CDN friendly way. Let's take a large linear data stream, split it into variable-sized chunks (the size of each being a function of the chunk's contents), and store these chunks in individual, compressed files in some directory, each file named after a strong hash value of its contents, so that the hash value may be used to as key for retrieving the full chunk data. ... -
22
The Mooty Tool Kit (MTK) is a feature-rich Bash tool kit that makes it easy for you to perform High Performance Administration (HPA) task in your environment. HPA task include: * Mass-management of computers * Deployment of files * Collection of system data reports * And much, much more The MTK leverages existing Network Operating System infrastructure, so it is very light, flexible, portable and powerful. The kit comes with multiple tools that make mass management simple and...
-
23
BlockSync
Single file syncing at a block level
BlockSync is a command line tool written in Java, designed to synchronize single large files (such as virtual disk images) across networks with limited bandwidth. It makes use of MD5 hashing to only transfer the data that needs to be transferred. Ideal for use in command line scripts. -
24
PloneSearch
Quickly search and browse files in a Plone site
A desktop GUI for searching and browsing files in a Plone CMS. Allows for faster searching, browsing, downloading and uploading of files. Especially useful on large company CMS's. -
25
Log Analysis Tool Kit - LATK
A tool suite for Log File Analysis
This is a collection of command line and web based tools for use in incident response and long term analysis use as part of ongoing situational awareness. Often when responding to a security incident the only files available are web server and proxy server logs. The tools here will aid you in detecting odd traffic such as botnet beaconing and SQL Injection attempts. The large amount of data can be overwhelming and the tools in the Log Analysis Tool Kit can be used to parse these files and build a MySQL database for querying. Currently the log formats supported are: Proxy Logs: Squid Bluecoat Web Server Logs: Apache IIS Your feedback is always appreciated. ...
