Search Results for "large files"
Sort By:
Showing 49 open source projects for "large files"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
changed-files
Github action to retrieve all (added, copied, modified, deleted, etc.
Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories. Effortlessly track all changed files and directories relative to a target branch, preceding commit or the last remote commit returning relative paths from the project root using this GitHub action. This action solely identifies files that have undergone changes within the context of events such as pull_request, push, and more. However, it doesn't detect pending... -
2
tus-js-client
A pure JavaScript client for the tus resumable upload protocol
tus-js-client is a JavaScript client for the tus resumable upload protocol, enabling reliable and efficient file uploads, especially for large files or unstable network conditions. -
3
diskover-community
Open source file indexing & storage analytics powered by Elasticsearch
Diskover Community Edition is an open source file system indexing and storage analytics platform designed to help organizations understand and manage large volumes of file data. It crawls file systems and indexes metadata using Elasticsearch, enabling fast search, analysis, and organization of files stored across different storage systems. It allows administrators and users to explore file structures, monitor storage usage, and gain insights into how data is distributed across infrastructure. ... -
4
news-please
Python tool for crawling and extracting structured data from news site
news-please is an open source news crawler and information extraction tool designed to collect and structure articles from online news websites. It provides an integrated pipeline that crawls news sites, retrieves article pages, and extracts structured information such as headlines, authors, publication dates, and article text. news-please can recursively follow internal links and read RSS feeds to gather both recent and archived articles from a news outlet when given only the root URL of a... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
Project X
Originates from XTLS protocol, providing a set of network tools
...The project supports multiple protocols such as VLESS, VMess, Shadowsocks, and Trojan, enabling flexible configuration for different networking scenarios. It is written primarily in Go and is optimized for high performance, making it suitable for both personal and large-scale deployments. Project X also integrates advanced features like REALITY and XTLS, which enhance encryption and disguise traffic to improve privacy and resistance to detection. The platform is highly modular, allowing developers to customize routing rules, transport layers, and proxy behaviors through configuration files or integrations. -
6
douyin
Open source Douyin crawler for collecting and downloading public data
DouyinCrawler is an open source data collection tool designed to gather publicly available information from the Douyin platform. It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages. DouyinCrawler supports both automated scraping and batch operations to process multiple targets efficiently. It... -
7
GeneoTree
Dynamic Genealogy Viewer with PHP/MySql-MariaDB
Genealogy Software. Geneotree is a gedcom files PHP viewer, full dynamic on the Web. Main features : dynamic trees, cartography & stats. Many PDF reports, statistics. Special consanguinity and cousins lists. Large files management & optimized ergonomy. -
8
XOOPS Web Application System
The world's leading content management systems (CMS) written in PHP
PLEASE NOTE: Latest XOOPS files are on http://github.com/xoops and http://github.com/xoopsmodules25x) XOOPS is a Web application platform written in PHP for the MySQL database. Its object orientation makes it an ideal tool for developing small or large community websites, intra-company and corporate portals, weblogs, and much more. XOOPS is an acronym of eXtensible Object Oriented Portal System. -
9
Arisen Studio
Browse, Download and Install Mods for PlayStation 3 & Xbox 360
The elegant, powerful, and open-source mod manager. Arisen Studio allows you to easily browse through a regularly updated database of mods, game saves, homebrew, resources, themes, and much more for the PlayStation 3 and Xbox 360. All mods have been tested and verified in our library, which is populated by myself, a few friends, and awesome contributors. Arisen Studio can also be used as an FTP client to install and uninstall mods directly from your console. Without the need to search up old... -
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
10
BaiduWP PHP
A tool to get the download link of the Baidu netdisk
baiduwp-php is a PHP-based tool that allows users to download files from Baidu Cloud (Baidu Wenku). It bypasses the Baidu Cloud download restrictions and provides a straightforward way to retrieve content hosted on Baidu's cloud storage service. It’s especially useful for users who want to download files without using the Baidu app or encountering excessive waiting times. -
11
UFTP
Encrypted UDP based FTP with multicast
UFTP is an encrypted multicast file transfer program, designed to securely, reliably, and efficiently transfer files to multiple receivers simultaneously. This is useful for distributing large files to a large number of receivers, and is especially useful for data distribution over a satellite link (with two way communication), where the inherent delay makes any TCP based communication highly inefficient. The multicast encryption scheme is based on TLS with extensions to allow multiple receivers to share a common key. ... -
12
dirhunt
Web crawler that finds hidden web directories without brute force
Dirhunt is an open source security tool designed to discover web directories and analyze website structures without relying on brute-force techniques. Instead of sending large numbers of guess-based requests, it operates as a specialized crawler that intelligently explores websites to identify accessible or hidden directories. Dirhunt can detect directories that expose “Index Of” listings, which may reveal files and other resources that were not intended to be publicly visible. It can also identify situations where directories are intentionally hidden through empty index files or servers that return misleading responses such as fake 404 errors. ... -
13
HTML Viewer Components for Delphi, Lazarus and C++Builder The HtmlViewer component set consists of the THtmlViewer, TFrameViewer, and TFrameBrowser components. All three are HTML document display components: THtmlViewer * The basic component. * THtmlViewer displays single (non-frame) documents. * It also forms the basis for the other two components. TFrameViewer * Displays both frame and single HTML documents. * TFrameViewer is oriented more for local file system...
-
14
crawlergo
Headless Chrome crawler for collecting URLs for vulnerability scans
...It also automatically fills and submits forms, helping discover hidden routes or parameters that might otherwise be missed by traditional crawlers. crawlergo includes a built-in URL de-duplication system that removes repeated or pseudo-static links while maintaining fast crawling speeds for large websites. crawlergo also analyzes page content to extract links and resources from multiple sources, including JavaScript files, comments, and configuration files. -
15
Tagbar
Vim plugin that displays tags in a window
...It opens a sidebar window that shows the tags of the current file, organised by scope—so functions, methods, classes and other symbols are grouped logically (for example, methods under their containing class). This gives you at-a-glance insight into the layout of large source files, which is especially useful for navigating unfamiliar codebases or when working on complex modules. The Tagbar sidebar also allows direct navigation: you can click on or jump to specific tags from the list, which makes it much faster to move between definitions than manually searching. Because it uses an external tags generation tool, the plugin can support many languages (C++, Java, Python, etc) with varying degrees of induction based on the tags file. ... -
16
grab-site
Web crawler for archiving and backing up sites into WARC archives
grab-site is an open source web crawling tool designed to archive and back up websites by recursively downloading their content. It works by taking a starting URL and systematically following links across the site, capturing pages and resources and saving them into WARC archive files for long-term preservation. Internally, the crawler uses a fork of the wpull engine to fetch and process web pages efficiently during large-scale crawls. grab-site includes a built-in dashboard that displays real-time crawl activity, including which URLs are currently being processed and how many remain in the queue. Users can dynamically apply ignore patterns during an active crawl, allowing them to skip problematic or unnecessary URLs that could slow down or block the archiving process. grab-site also provides predefined ignore sets for common site structures such as forums and other complex web platforms. ... -
17
MultiThreaded TFTP Server Open Source Freeware Windows/Unix for PXEBOOT, firmware load, support tsize, blksize, timeout Server Port Ranges, Block Number Rollover for Large Files. Runs as Service/daemon. Single Port version also available. Download
-
18
Drago
Securely connect anything with WireGuard and manage all your networks
...It is designed to make secure private networking easier across servers, cloud instances, physical machines, and other heterogeneous nodes. Instead of manually maintaining separate WireGuard configuration files on every device, Drago provides a more structured way to define and distribute network settings. The project emphasizes lightweight operation, encrypted node-to-node communication, and a single-binary deployment style. It can help teams organize WireGuard networks that span multiple environments without depending on a large commercial controller. ... -
19
csv-parser
Streaming csv parser inspired by binary-csv that aims to be faster
...It implements the stream API native to Node, allowing you to pipe a file or readable stream into the parser and process each row (as a JavaScript object or array) as soon as it's parsed — which is crucial for handling large CSV files without loading them entirely into memory. The parser handles standard CSV semantics including quoted fields, variable delimiters, escape sequences, and optional headers; this makes it robust for a variety of CSV dialects you might encounter. Because it works incrementally (row by row), it is well suited for ETL pipelines, data ingestion workflows, CSV-to-database imports, or any context where you need to process or transform large tabular data in Node.js efficiently. ... -
20
Telementality Company
Filemanager written for PHP, because it is NeXT, the future ..
..."ServerPortable.zip" is large and includes a portable server, that works now in windows 10. It's made of two other freeware products - apache server 2.4 & php 7 - plus the filemanager. This solution with a portable server is to have files kept private. The filemanager can move folders & files across servers - from local to official and back again, i suppose - and yes through the internet thus. -
21
Smart Cache is a fast pure Java HTTP proxy server with offline browsing support. It has URL blocking, URL rewriting. Cached files has not headers inside and cache directory structure copies closely remote server. Supports also large caches.
-
22
XML Viewer Plus
A powerful XML Viewer - add-on for browser Firefox
A powerful XML Viewer, supports text/regex and jQuery/CSS, XPath selectors ==== Release 1.2.6 - 17.06.2019 - Added utf-8 encode for xml viewer ==== Get your XML Editor and Validator on Play Store > https://play.google.com/store/apps/details?id=com.ulm.xmleditor ==== ## Libraries and techs used 1. `Vue` 2. `Vuex` 3. `lodash/debounce` 4. `jQuery` 5. `document.querySelectorAll` 6. `document.evaluate` for `XPath` 7. `bestzip` for packaging ### Limitations - WebExtension only... -
23
Transcrypt
Python in the Browser
Lean and mean Python 3.6 to JavaScript compiler. Supports multiple inheritance, operator overloading and Python source level debugging, even of minified Javascript files. Transcrypt code is as fast and compact as its Javascript counterpart, and it is precompiled for page load speed. You can now develop your web applications completely in Python, with full access to any Javascript library. -
24
casync
Content-addressable data synchronization tool
A combination of the rsync algorithm and content-addressable storage. An efficient way to store and retrieve multiple related versions of large file systems or directory trees. An efficient way to deliver and update OS, VM, IoT and container images over the Internet in an HTTP and CDN friendly way. Let's take a large linear data stream, split it into variable-sized chunks (the size of each being a function of the chunk's contents), and store these chunks in individual, compressed files in some directory, each file named after a strong hash value of its contents, so that the hash value may be used to as key for retrieving the full chunk data. ... -
25
dream-cms
Free and Open Source Web Sites Builder
Everything for the real website DreamCMS is open and completely free web application for the construction websites of any complexity. We will provide you with all the self-creation of the site without any special knowledges, and html. Never before web development was not so simple. In your hands will be a modern, convenient and simple tool: a free online business card, online shop or the official website of the company. Focus on your business. We will do everything else. And all this is...
