Search Results for "large files"
Sort By:
Showing 29 open source projects for "large files"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
1
DuckDB
DuckDB is an in-process SQL OLAP Database Management System
...DuckDB supports arbitrary and nested correlated subqueries, window functions, collations, complex types (arrays, structs), and more. For more information on the goals of DuckDB, please refer to the Why DuckDB page on our website. Processing and storing tabular datasets, e.g. from CSV or Parquet files. Interactive data analysis, e.g. Joining & aggregate multiple large tables. Concurrent large changes, to multiple large tables, e.g. appending rows, adding/removing/updating columns. Large result set transfer to client. For development, DuckDB requires CMake, Python3 and a C++11 compliant compiler. Run make in the root directory to compile the sources. ... -
2
ClosedXML
A .NET library for reading, manipulating and writing Excel
ClosedXML is a .NET library for creating and manipulating Excel files without requiring Microsoft Excel, designed for easy integration and performance. -
3
Supabase
The open source Firebase alternative
...Every project is a full Postgres database, the world's most trusted relational database. Add user sign-ups and logins, securing your data with Row Level Security. Store, organize and serve large files. Any media, including videos and images. Write custom code and cron jobs without deploying or scaling servers. We introspect your database to provide APIs instantly. Stop building repetitive CRUD endpoints and focus on your product. Type definitions built directly from your database schema. Use Supabase in the browser without a build process. ... -
4
Supabase Realtime
Listen to your to PostgreSQL database in realtime via websockets
...Every project is a full Postgres database, the world's most trusted relational database. Add user sign ups and logins, securing your data with Row Level Security. Store, organize, and serve large files. Any media, including videos and images. Write custom code without deploying or scaling servers. Supported by a network of early advocates, contributors, and champions. We introspect your database to provide APIs instantly. Stop building repetitive CRUD endpoints and focus on your product. Type definitions built directly from your database schema. ... -
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
5
Linenoise
A small self-contained alternative to readline and libedit
Linenoise is an ultra-lightweight, self-contained C library that implements line editing (single and multi-line) for terminal applications, intended as a simpler alternative to the much larger GNU Readline or libedit libraries. The library is zero-config, meaning you just include the source file(s) and use it, without heavy dependencies or external configuration. It supports basic editing features: moving the cursor, inserting characters, handling history, tab-completion, and hints, plus a... -
6
Apache HBase
Get random, realtime read/write access to your Big Data
...Thrift gateway and a REST-ful Web service that supports XML, Protobuf, and binary data encoding options. Support for exporting metrics via the Hadoop metrics subsystem to files or Ganglia; or via JMX. Convenient base classes for backing Hadoop MapReduce jobs with Apache HBase tables. -
7
GT.M High end TP database engine
Industrial Strength NoSQL Application Development Platform
GT.M[tm] is a vetted industrial strength, transaction processing application platform consisting of a key-value database engine optimized for extreme transaction processing throughput & business continuity. Check https://fis-gtm.sourceforge.io/ for documentation -
8
Arisen Studio
Browse, Download and Install Mods for PlayStation 3 & Xbox 360
The elegant, powerful, and open-source mod manager. Arisen Studio allows you to easily browse through a regularly updated database of mods, game saves, homebrew, resources, themes, and much more for the PlayStation 3 and Xbox 360. All mods have been tested and verified in our library, which is populated by myself, a few friends, and awesome contributors. Arisen Studio can also be used as an FTP client to install and uninstall mods directly from your console. Without the need to search up old... -
9
lowdb
Small local JSON database powered by Lodash
...It supports Node, the browser and uses lodash API, so it's very simple to learn. Actually, if you know Lodash, you already know how to use lowdb. lowdb doesn't support Cluster and may have issues with very large JSON files (~200MB). A UMD build is also available on unpkg for testing and quick prototyping. Database lodash instance. Use it to add your own utility functions or third-party mixins like underscore-contrib or lodash-id. With lowdb, you get access to the entire lodash API, so there are many ways to query and manipulate data. -
Your monitoring isn't a stack. It's a pile. Fix that.Replace Datadog, New Relic, and Sentry without adding three more dashboards.
-
10
MarketStore
DataFrame server for financial timeseries data
...You can think of it as an extensible DataFrame service that is accessible from anywhere in your system, at higher scalability. It is designed from the ground up to address scalability issues around handling large amounts of financial market data used in algorithmic trading backtesting, charting, and analyzing price history with data spanning many years, and granularity down to tick-level for the all US equities or the exploding cryptocurrencies space. If you are struggling with managing lots of HDF5 files, this is perfect solution to your problem. ... -
11
Box Spout
Read and write spreadsheet files (CSV, XLSX and ODS)
Spout is an open-source PHP library for reading and writing spreadsheet files, including CSV, XLSX, and ODS formats. It is designed to handle large files efficiently, making it ideal for applications that generate or process extensive data reports. Spout is lightweight, fast, and easy to use, offering a simple API to work with rows and cells without consuming excessive memory. -
12
FreeDB2MySQL
Java-API for transferring xmcd-textfiles to MySQL.
FreeDBs metadata-collection on compact discs is stored in a tremendous large set of tiny text files. This Java-package transfers the content of all these files to only few (two or four) MySQL-tabes and provides access to the MySQL-data. -
13
ECDICT
Free English to Chinese Dictionary Database
...It aggregates headwords, phonetics, parts of speech, translations, and example information into formats that are easy to integrate. The project provides multiple distribution forms—commonly SQLite/CSV/StarDict-style files—so you can choose the right storage and query approach for your app. Because it’s offline and local, it avoids network latency and licensing hurdles that come with calling proprietary dictionary APIs. The dataset is large enough to support general-purpose lookup while being manageable to ship with desktop or mobile apps. For builders, it’s a pragmatic foundation for dictionary apps, pop-up translators, flashcard tools, or NLP preprocessing. -
14
WikiSQL
A large annotated semantic parsing corpus for developing NL interfaces
A large crowd-sourced dataset for developing natural language interfaces for relational databases. WikiSQL is the dataset released along with our work Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning. Regarding tokenization and Stanza, when WikiSQL was written 3-years ago, it relied on Stanza, a CoreNLP python wrapper that has since been deprecated. If you'd still like to use the tokenizer, please use the docker image. We do not anticipate switching... -
15
Reactantd
A general management background built with React and Ant Design
The goal is to quickly build a usable background interface, you can first look at DEMO (normal) / DEMO (TAB mode), username/password: guest/guest. Friendly reminder: This DEMO is still a bit large, and the loading may be a little slow. Pay attention to the network speed. Users only need to care about their own schema files, and they don't need to care about what the rendering looks like. Using the DBTable component, you can quickly implement CRUD on a table (in fact, it can be used not only for databases, but also for any operation mode that conforms to this). ... -
16
xlsLib
C++/C library to construct Excel .xls files in code.
A multiplatform C++ library for dynamic generation of Excel .xls files containing multiple worksheets. Unlike .csv files, these can be directly opened by Excel and thus provide an excellent way to output large data sets that require further analysis. To see the latest changes, select "Files" and view the README text displayed at the bottom of that pane. IMPORTANT: Major changes are contained in the current SVN source. -
17
OFsX
Oracle File system Extension
Problem: How can Oracle PL/SQL applications read, write, move or copy arbitrarily large files to or from arbitrary file system locations? Solution: This utility (OFsX) uses PL/SQL, Oracle AQ & Spring Integration to handle reading, writing, copying, moving & deleting of files from Oracle PL/SQL in a general way. Summary: PL/SQL is an excellent language for developing data-intensive, enterprise applications. However, it can be difficult for PL/SQL applications to interact with a file system (Fs). ... -
18
Database to CSV
"Database to CSV" project stores/loads data between database and CSVs
"Database to CSV" allows to back-up data from database(Oracle, MySQL, SQL Server) in the form of CSV files. Each table data is stored in a separate CSV file. It also allows to load data from CSV files into the database. Program can be run from UI or from command line. There's one more advanced feature which allows merging of data from CSV file to Database. It is only available from command line. (It will take foreign keys and unique keys into consideration and then try to insert... -
19
Large Text File converter
Java Based Heavy-duty utilitity to process large delimited text files
TextZilla is a Multithreaded Java utility which can process huge size delimited text files to extract, convert, encode, decode, encrypt/decrypt text data from source and write it in desired output file or files. It provides fully extensible framework based on which Java classes can be created, for example it currently has MD5 conversion capability, based on same design classes for 3DES ,AES or any other Algo can be created. Another strength of this tool is in its configurability, it's... -
20
Occursions
Fast customizable time series web database for big data like log files
Our goal is to create the world's fastest extendable, non-transactional time series database for big data (you know, for kids)! Log file indexing is our initial focus. For example append only ASCII files produced by libraries like Log4J, or containing FIX messages or JSON objects. Occursions was built by a small team sick of creating hacks to remotely copy and/or grep through tons of large log files. We use it to index around a terabyte of new log data per day. You can use it too. Who doesn't have `just too many' log files? ... -
21
Open Extract Processor
Database ETL utility
The Open Extract Processor (OEP) is a database ETL utility capable of merging/sorting/aggregating large partitioned database extracts. Native data files can be created from text files or from the accompanying MYSQL and Oracle import/export programs. -
22
DataFinder is a data management client developed in Python that primarily targets the management of scientific technical data. The system is able to handle large amounts of data and can be easily integrated in existing working environments.
-
23
Alexandria is an archive system for large data amounts. Suitable for inhomogenous collections of books, media files, art items and other artifacts. Main focus is on easy usage, small executable file and portability.
-
24
phpPgWeb is a library to create in a simple way an autoconfiguring web interface to postgresql databases. It is also manually configurable. It manage table dependences. It manage files(large object), for example images (create automatically thumbnail.
-
25
Append hundreds of different XML files into one large data document, validate, and attach a stylesheet. Stitcher is a porwerful summary reporting tool. Allows for complex file storage locations of xml data. UBL, HR-ML, LandXML ... visit stitcher.org.
