Search Results for "distributed computing"
Sort By:
Showing 233 open source projects for "distributed computing"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
NumPy
The fundamental package for scientific computing with Python
Fast and versatile, the NumPy vectorization, indexing, and broadcasting concepts are the de-facto standards of array computing today. NumPy offers comprehensive mathematical functions, random number generators, linear algebra routines, Fourier transforms, and more. NumPy supports a wide range of hardware and computing platforms, and plays well with distributed, GPU, and sparse array libraries. The core of NumPy is well-optimized C code. Enjoy the flexibility of Python with the speed of compiled code. ... -
2
Dagger.jl
A framework for out-of-core and parallel execution
Dagger.jl is a framework for out-of-core and parallel computing in Julia that allows users to construct and execute dynamic task graphs. It is designed for large-scale, distributed, and memory-efficient computations. Dagger supports lazy evaluation and scheduling across multiple threads or machines, enabling high-performance workflows for data processing, scientific computing, and machine learning. -
3
DL_POLY
General purpose classical molecular dynamics (MD) simulation software
DL_POLY is a general-purpose classical molecular dynamics simulation package developed at Daresbury Laboratory. It has evolved from older replicated-memory designs into a distributed-memory code suitable for modern parallel computing. The software can be built in serial form or with MPI for larger simulations. It is used for molecular modeling in chemistry, physics, materials science, and condensed-matter research. DL_POLY provides a mature simulation environment for studying atomic and molecular systems under classical force-field descriptions. ... -
4
linuxptp
PTP IEEE 1588 stack for Linux
This project is an implementation of the Precision Time Protocol (PTP) according to IEEE standard 1588 for Linux. -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
Papers We Love
Papers from the computer science community to read and discuss
Papers We Love (PWL) is a global open source community dedicated to reading, discussing, and sharing influential computer science research papers. The repository serves as a curated directory of academic papers that have shaped the field of computing, providing a centralized location for documents that were previously scattered across various online sources. While licensing restrictions prevent hosting all papers directly, PWL offers links to their original sources and clearly marks hosted copies with an emoji. The community encourages participation through local meetups, where members gather to discuss and analyze key works spanning topics such as programming languages, distributed systems, and software engineering. ... -
6
migrid
A grid middleware with minimal user and resource requirements
[This project moved to Github and is no longer maintained here] Minimum intrusion Grid (MiG) is an attempt to design a new platform for Grid computing which is driven by a stand-alone approach to Grid, rather than integration with existing systems. The goal of the MiG project is to provide Grid infrastructure where the requirements on users and resources alike is as small as possible (minimum intrusion). MiG strives for minimum intrusion but will seek to provide a feature rich and... -
7
Bandicoot
fast C++ library for GPU linear algebra & scientific computing
* Fast GPU linear algebra library (matrix maths) for the C++ language, aiming towards a good balance between speed and ease of use * Provides high-level syntax and functionality deliberately similar to Matlab * Provides an API that is aiming to be compatible with Armadillo for easy transition between CPU and GPU linear algebra code * Useful for algorithm development directly in C++, or quick conversion of research code into production environments * Distributed under the permissive... -
8
headsort
headsort: streaming sort + 2x faster than gnu sort
...Now faster than sort(1) (in all cases tested). Using triangulation, hsort begins piped sorted output when 1st bin is done. This means it has new applications in distributed computing and in some cases makes dc un-necessary. (gnu sort must finish all bins) Well compatible with gnu sort (not perfect). other algorthms featured if menu used: bubble, selection, insertion, shell, distributive counting, straight radix, radix exchange, quick, merge. (some are by character, some by line, some both) -
9
staq
Full-stack quantum processing toolkit
staq is a modern C++ library for the synthesis, transformation, optimization and compilation of quantum circuits. staq is written in standard C++17 and has very low external dependencies. It is usable either through the provided binary tools, or as a header-only library that can be included to provide direct support for parsing & manipulating circuits written in the OpenQASM circuit description language. Inspired by Clang, staq is designed to manipulate OpenQASM syntax trees directly, rather... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
NuPIC
Numenta platform for intelligent computing
The Numenta Platform for Intelligent Computing (NuPIC) is a machine intelligence platform that implements the HTM learning algorithms. HTM is a detailed computational theory of the neocortex. At the core of HTM are time-based continuous learning algorithms that store and recall spatial and temporal patterns. NuPIC is suited to a variety of problems, particularly anomaly detection and prediction of streaming data sources. For more information, see numenta.org or the NuPIC Forum. If you want... -
11
Paddle Quantum
Paddle Quantum
Paddle Quantum (量桨) is the world's first cloud-integrated quantum machine learning platform based on Baidu PaddlePaddle. It supports the building and training of quantum neural networks, making PaddlePaddle the first deep-learning framework in China. Paddle Quantum is feature-rich and easy to use. It provides comprehensive API documentation and tutorials help users get started right away. Paddle Quantum aims at establishing a bridge between artificial intelligence (AI) and quantum computing... -
12
pycos
Python framework for concurrent, asynchronous, distributed tasks
Python framework for concurrent, asynchronous, distributed communicating tasks for broad range of use cases, including public / private / hybrid cloud computing, fog / edge computing. -
13
dimtree
Data Browser for DIM (Distributed Information Manager from CERN)
DIMTree is Tree View Browser for DIM system. The DIM is CERN designed Distributed Information Manager system, see http://dim.web.cern.ch/. DIM uses to create distributed DAQ and experiment control systems. DIMTree is browser for DIM which provides Tree View to browse DIM Servers, his published Services and it's data content. It's useful test/monitor/debug tool for DIM users. -
14
SBW (Systems Biology Workbench)
Framework for Systems Biology
The Systems Biology Workbench(SBW) is a framework for application intercommunications. It uses a broker-based, distributed, message-passing architecture, supports many languages including Java, C++, Perl & Python, and runs under Linux,OSX & Win32. It comes with a large number of modules, encompassing the whole modeling cycle: creating computational models, simulating and analyzing them, visualizing the information, in order to improve the models. All using community standards, such as... -
15
NESSIE is a modern first-principle calculation software that can adequately address the need for ever-higher levels of numerical accuracy and high-performance in large-scale electronic structure simulations, as well as pioneer the fundamental study of quantum many-body effects in a large number of emerging nanomaterials. NESSIE is an electronic structure code that uses a real-space FEM discretization and domain-decomposition (DD) to perform all-electron ground-state DFT and real-time...
-
16
Distributed MultiThreaded Checkpointing
Checkpoint/Restart functionality for Linux processes
DMTCP (Distributed MultiThreaded Checkpointing) transparently checkpoints a single-host or distributed computation in user-space -- with no modifications to user code or to the O/S. It works on most Linux applications, including Python, Matlab, R, GUI desktops, MPI, etc. It is robust and widely used (on Sourceforge since 2007). For the newest releases of DMTCP, please go to: https://github.com/dmtcp/dmtcp Among the applications supported by DMTCP are MPI (various implementations), OpenMP, MATLAB, Python, Perl, R, and many programming languages and shell scripting languages. ... -
17
Talend Spatial Module (aka Spatial Data Integrator or SDI) is an ETL tool for geospatial. Based on Talend Open Studio, input, output and transform geocomponents are available. IO components read/write GIS formats(eg.PostGIS, GeoRSS). Transformers all
-
18
AlienPupOS
LucidPup & SlackoPup 5.x.x with Wine & Bionc pre-installed
One persons quest to keep outdated hardware out of our landfills by putting them back in use with a modern lightweight Operating System. Linux LucidPup 5.2.8 and SlackoPup 5.3.3 have been used as the base OS for this project for two reasons, compact and portable. Both versions come in two flavors: "MeatyBones" basic barebones get the job done with Wine and Boinc pre-installed "BaconBits" which is the Flagship of this project and will come with "BoincTasks", "SetiMapView" and... -
19
slurm-roll
Slurm Resource Manager for Rocks Clusters
Slurm is a replacement for other resource management software and schedulers like gridengine or torque. The slurm roll integrates very well into a rocks clusters installation. In the folder addons, there are a lot of useful rolls for rocks clusters 6.1 and 6.2. These rolls do not depend on slurm. Please see Discussion for further information and support -
20
dupost
Dual Porosity Stokes model implemented with FEniCS
...Douglas, X. Hu, B. Bai, X. He, M. Wei and J. Hou, "A Data Assimilation Enabled Model for Coupling Dual Porosity Flow with Free Flow," 2018 17th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES), Wuxi, 2018, pp. 304-307. doi: 10.1109/DCABES.2018.00085 2. Hu X., Douglas C.C. (2019) An Implementation of a Coupled Dual-Porosity-Stokes Model with FEniCS. In: Rodrigues J. et al. (eds) Computational Science – ICCS 2019. ICCS 2019. Lecture Notes in Computer Science, vol 11539. ... -
21
MarDRe
MapReduce-based tool to remove duplicate DNA reads
...MarDRe is the Big Data counterpart of ParDRe (link above), which employs HPC technologies (i.e., hybrid MPI/multithreading) to reduce runtime on multicore systems. Instead, MarDRe takes advantage of the MapReduce programming model to significantly improve ParDRe performance on distributed systems, especially on cloud-based infrastructures. Written in pure Java to maximize cross-platform compatibility, MarDRe is built upon the open-source Apache Hadoop project, the most popular distributed computing framework for Big Data processing. -
22
HSRA
Hadoop spliced read aligner for RNA-seq data
...This tool allows bioinformatics researchers to efficiently distribute their mapping tasks over the nodes of a cluster by combining a fast multithreaded spliced aligner (HISAT2) with Apache Hadoop, which is a distributed computing framework for scalable Big Data processing. HSRA currently supports single-end and paired-end read alignments from FASTQ/FASTA datasets. Moreover, our tool uses the Hadoop Sequence Parser (HSP) library (link above) to efficiently read the input datasets stored on the Hadoop Distributed File System (HDFS), being able to process datasets compressed with Gzip and BZip2 codecs. -
23
GPU, a Global Processing Unit
A framework for distributed computing
An extensible framework for distributed computing on P2P grids. We support peaceful free and open research and build an internet supercomputer. We render movies, solve Eternity puzzles, predict climate and improve a ~30 GHz cluster of clients. -
24
darc
Durham Adaptive-optics Real-time Controller
darc, the Durham Adaptive optics Real-time Controller. For documentation or darctalk client only, select "View all files". For the latest bleeding-edge version, please use: git clone git://git.code.sf.net/p/darc2/code darc (no password required) (this changed May 2013 due to a sourceforge update). If you use darc, please cite with: Basden, A and Myers, R, MNRAS Vol 242, page 1483, 2012 -
25
Vappio is a framework for building virtual appliances that supports distributed data processing in cloud computing environments using Sun Grid Engine or Hadoop. The primary target application of Vappio is bioinformatics.
