Search Results for "data science"

MooseFS (MFS) is a fault tolerant, highly performing, scaling-out, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) *...

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid.

Genetic Programming Classifier is a distributed evolutionary data classification program. It uses the ensemble method implemented under a parallel co-evolutionary Genetic Programming technique.

PARUS is a data-flow parallel programming language that allows to build parallel programs for clusters and MPP multiprocessors. The data-flow graph is automatically converted to the C++/MPI source and linked with the libparus runtime library. Also there are available tools for benchmarking cluster interconnect and visualize it.

PBS Cluster Viz is a project to display information useful to admins and users about a computing cluster managed by a PBS-compatible resource manager. Information includes load and job distribution. Interactive as well as static output is available.

XDAQ is a software platform designed specifically for the development of distributed data acquisition systems. The development is carried out at CERN, the European Organization for Nuclear Research. Please visit http://xdaq.web.cern.ch

Creation of workflows that will be executed on clusters. Must be able to easily create task sequences (like Automator) and to exchange data with the cluster. Monitoring may be web-based.

A MATLAB spectral clustering package to handle large data sets (200,000 RCV1 data) on a 4GB memory general machine. We implement various ways of approximating the dense similarity matrix, including nearest neighbors and the Nystrom method.

Construct and management virtual clusters which the nodes of the clusters running on the virtual machine rather than native machine. Fast install and switch virtual clusters. Efficiently storage vm images. support variant VMMs.

This is an opensource project for the calculation of the mathematical constant Pi. If you are a mathematician or programer please contribute ideas or code for this project. Non professionals are also welcome to contribute.

A data parallel scientific programming model. Compiles efficiently to different platforms like distributed memory (MPI), shared memory multi-processor (pthreads), Cell BE processor, Nvidia Cuda, SIMD vectorization (SSE, Altivec), and sequential C++ code.

A high performance visualization tool for stars and particles able to run on Beowulfs. Rendering step is implemented separately and optimized for SSE, compatible with OpenGL. Navigation mechanism with quaternions. Ten color maps, sobel contour detect

NOD-MP stands for not another data-mining project. It is educational and scientific software to utilize data mining clustering algorithms through a user-friendly interface.

Rackview is a Perl module that assists in visualizing a Data Center\'s computer rack layouts by creating a web page with HTML tables to show a frontview of the racks. Included are brief commandline and CGI scripts to demonstrate its implementation.

NIUS allows reservation of nodes under it's control for exclusive interactive use by a group of users. This system is in use by National Center for Data Mining at University of Illinois in Chicago to reserve workstations for researchers.

JCGrid is an easy-to-use tools for real-world grid-computing. It requires only to install Java Runtime and you can easy split your cpu-intensive task among several Workstations/PC/Mac/etc. It includes support for POVRay and MandelGrid as usage examples.