Search Results for "batch file"
Sort By:
Showing 17 open source projects for "batch file"
View related business solutions-
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
JDF.jl
Julia DataFrames serialization format
JDF is a DataFrames serialization format with the following goals, fast save and load times, compressed storage on disk, enabled disk-based data manipulation (not yet achieved), and support for machine learning workloads, e.g. mini-batch, sampling (not yet achieved). JDF stores a DataFrame in a folder with each column stored as a separate file. There is also a metadata.jls file that stores metadata about the original DataFrame. Collectively, the column files, the metadata file, and the folder is called a JDF "file". JDF.jl is a pure-Julia solution and there are a lot of ways to do nifty things like compression and encapsulating the underlying struture of the arrays that's hard to do in R and Python. ... -
2
Luigi
Python module that helps you build complex pipelines of batch jobs
...You can build pretty much any task you want, but Luigi also comes with a toolbox of several common task templates that you use. It includes support for running Python mapreduce jobs in Hadoop, as well as Hive, and Pig, jobs. It also comes with file system abstractions for HDFS, and local files that ensures all file system operations are atomic. -
3
Mage.ai
Build, run, and manage data pipelines for integrating data
Open-source data pipeline tool for transforming and integrating data. The modern replacement for Airflow. Effortlessly integrate and synchronize data from 3rd party sources. Build real-time and batch pipelines to transform data using Python, SQL, and R. Run, monitor, and orchestrate thousands of pipelines without losing sleep. Have you met anyone who said they loved developing in Airflow? That’s why we designed an easy developer experience that you’ll enjoy. Each step in your pipeline is a standalone file containing modular code that’s reusable and testable with data validations. ... -
4
Apache Hudi
Upserts, Deletes And Incremental Processing on Big Data
...Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage). Apache Hudi is a transactional data lake platform that brings database and data warehouse capabilities to the data lake. Hudi reimagines slow old-school batch data processing with a powerful new incremental processing framework for low latency minute-level analytics. Hudi provides efficient upserts, by mapping a given hoodie key (record key + partition path) consistently to a file id, via an indexing mechanism. This mapping between record key and file group/file id, never changes once the first version of a record has been written to a file. ... -
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
5
Arrow Julia
Official Julia implementation of Apache Arrow
This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code. -
6
Best-of Python
A ranked list of awesome Python open-source libraries
This curated list contains 390 awesome open-source projects with a total of 1.4M stars grouped into 28 categories. All projects are ranked by a project-quality score, which is calculated based on various metrics automatically collected from GitHub and different package managers. If you like to add or update projects, feel free to open an issue, submit a pull request, or directly edit the projects.yaml. Contributions are very welcome! Ranked list of awesome python libraries for web... -
7
Eulumdat_3D - QLumEdit2
show and edit eulumdat files
Eulumdat_3D the better Eulumdat viewer and editor. You can view ldt files as 3D ,compare two luminaires, print a simple datasheet. From given light distribution you can create different ldt files depending on light flux and CCT also as app under https://play.google.com/store/apps/details?id=com.riloc.eulumdat -
8
Harmony Data Integration
Fast, sensitive and accurate integration of single-cell data
Harmony is a general-purpose R package with an efficient algorithm for integrating multiple data sets. It is especially useful for large single-cell datasets such as single-cell RNA-seq. Harmony has been tested on R versions =4. Please consult the DESCRIPTION file for more details on required R packages. Harmony has been tested on Linux, OS X, and Windows platforms. -
9
SIVIC is an open-source, standards-based software framework and application suite for processing and visualization of DICOM MR Spectroscopy data. Through the use of DICOM, SIVIC aims to facilitate the application of MRS in medical imaging studies.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
CloverDX
Design, automate, operate and publish data pipelines at scale
Please, visit www.cloverdx.com for latest product versions. Data integration platform; can be used to transform/map/manipulate data in batch and near-realtime modes. Suppors various input/output formats (CSV,FIXLEN,Excel,XML,JSON,Parquet, Avro,EDI/X12,HL7,COBOL,LOTUS, etc.). Connects to RDBMS/JMS/Kafka/SOAP/Rest/LDAP/S3/HTTP/FTP/ZIP/TAR. CloverDX offers 100+ specialized components which can be further extended by creation of "macros" - subgraphs - and libraries, shareable with 3rd... -
11
MoCalc2012
GUI for MOPAC, DFTB+, GAMESS, Firefly, NWChem, ORCA and PSI4
MoCalc2012 is a simple, efficient Graphical User Interface for MOPAC, DFTB+, GAMESS(US), Firefly, NWChem, ORCA and PSI4. -
12
SBML2LaTeX
A documentation and report generator for systems biological models
...A convenient online version is available, which allows the user to directly generate report from SBML in form of PDF or TeX, which can be further processed to various file types including DVI, PS, EPS, GIF, JPG, or PNG. SBML2LATEX can also be downloaded and used locally in batch mode or interactively with its Graphical User Interface or several command line options. The purpose of SBML2LATEX is to provide a way to read the contents of XML-based SBML files. This is helpful and important for, e.g., error detection, proofreading and model communication. -
13
XParallax viu
Software for automated astrometry
XParallax viu is a free software tool for automated astrometric data reduction of astronomic CCD images. It helps astronomers to perform an accurate astrometric reduction of dozens ore even hundreds of images which can be used in subsequent data analysis process. Fit headers generated by this software are fully compatible with other commonly used image utilities like SAO DS9 or Aladin Sky Atlas. -
14
Visualization of Protein-Ligand Graphs
Compute protein graphs. Moved to https://github.com/MolBIFFM/PTGLtools
NOTE: Project moved to https://github.com/MolBIFFM/PTGLtools. The Visualization of Protein-Ligand Graphs (VPLG) software package computes and visualizes protein graphs. It works on the super-secondary structure level and uses the atom coordinates from PDB files and the SSE assignments of the DSSP algorithm. VPLG is command line software. If you do not like typing commands, try our PTGL web server: http://ptgl.uni-frankfurt.de/ -
15
WaveSorter
A powerful, versatile tool for offilne spike analysis and sorting
...WaveSorter is written in C++, utilizes the GNU Scientific Library for all computation, and is highly parallelized; on modern hardware it can handle files containing several 100,000s of waveforms per channel with almost no noticeable loss in GUI fluidity and <1sec lags for files with >1,000,000 waveforms per channel. It can be run in batch mode. It supports a wide array of binary file formats as well as ASCII text. -
16
DataStreamProcessor
TPL (transfer,parse,load) tool for batch files.
This is an enterprise-strength system for batch file processing, e.g. transfer, parse and load data using batch (text) files within and without the enterprise. The system is controlled through parameters and doesn't require any programming, code generation or code deployment. This is a heavy duty back end system with no GUI. Nonetheless it's very easy to use, easier than most GUI-based ETLs, even easier to install. -
17
- Previous
- You're on page 1
- Next
