Search Results for "big data" - Page 7
Sort By:
Showing 224 open source projects for "big data"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
Cosmos DB Spark
Apache Spark Connector for Azure Cosmos DB
...It also allows you to easily create a lambda architecture for batch-processing, stream-processing, and a serving layer while being globally replicated and minimizing the latency involved in working with big data. -
2
Vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python
Data science solutions, insights, dashboards, machine learning, deployment. We start at 100GB. Vaex is a high-performance Python library for lazy Out-of-Core data frames (similar to Pandas), to visualize and explore big tabular datasets. It calculates statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid for more than a billion (10^9) samples/rows per second. -
3
PanoramaServer
Open Source Panorama Server for free virtual tour of 360 degrees views
Ideal for creating virtual tours of panoramic views for all sorts including property exhibition for brokers at real estate agencies/property agents, tour guide for indoor/outdoor venues, information to public/private facilities for curators, travel journal for tourist as log book, backdrop setting for storytelling, treasure hunt like games, big data mining for pattern through computer vision in artificial intelligence, etc. It is like creating your own Google Map Street View. All is required by the user is to have photos of equirectangular format (panorama) taken from 3D cameras common for on-site premises. These images can be referenced by the PanoramaServer to create virtual travels with 360 degrees view where viewers can navigate to different locations, view information, etc. ... -
4
Numerics for Chemical Engineering
Numerical models for chemical and process engineering
NCE Calculation Framework is a library of routines, models and data applicable to chemical and process engineering calculations, written in Java. -- NEW -- www.chesolver.com *ONLINE CALCULATORS*. A set of solvers to perform calculations consistently on any device, from smart-phone to desktop. The project includes the following ready to use software all based on the same core library: * Online Calculators at www.chesolver.com * Extensions for Libreoffice/Openoffice Calc... -
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
5
Easy Machine Learning
Easy Machine Learning is a general-purpose dataflow-based system
Machine learning algorithms have become the key components in many big data applications. However, the full potential of machine learning is still far from being realized because using machine learning algorithms is hard, especially on distributed platforms such as Hadoop and Spark. The key barriers come from not only the implementation of the algorithms themselves but also the processing for applying them to real applications which often involve multiple steps and different algorithms. ... -
6
SGA Conversion and Analysis Tool
Convert SGA format multimedia files to PNG and AVI format
This program is a utility for viewing, analyzing, and converting the data in SGA format multimedia files used by Digital Pictures in their games for the Sega Mega CD, Sega Super 32X, Sega Saturn, 3DO video game systems, and Windows PCs into formats that can be read by media player software on modern PCs. -
7
DC/OS
DC/OS - The Datacenter Operating System
DC/OS (Datacenter Operating System) is an open-source distributed operating system based on the Apache Mesos kernel. It abstracts a cluster of machines into a single logical computer, simplifying the deployment and management of containerized applications and services. DC/OS provides a comprehensive platform for running modern applications with features like container orchestration, service discovery, and scalability. -
8
nervalreports
A lightweight report creation Java library
Nerval Reports is a lightweight report creation library, focused on minimal computational costs. Ideally, report creation should iterate only once through its data and minimize memory allocation and processor's use, but also restrict its dependencies only to what your specific use needs. Instead of the highly expensive way of well-known engines like Jasper Reports, where performance and data reiteration is a big and set aside problem (and also is the report design as a non-programming task), at Nerval Reports the data should be sent directly when iterating through it (ie: when using databases, one will create its report while iterating through the result set - instead of creating a bunch of collections to pass them to the library), and the design is mainly focused on programmer side. ... -
9
Voldemort
A distributed key-value storage system
Voldemort is a distributed database that’s an open source clone of Amazon’s Dynamo. It automatically replicates data over multiple servers, and automatically partitions them as well so each server only contains a subset of the total data. It offers many other features such as pluggable serialization support, data item versioning and an SSD Optimized Read Write storage engine. Voldemort is not a relational database or an object database. It is essentially a big, distributed, persistent, fault-tolerant hash table. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
Major Emacs editing mode for X12
Emacs editing mode for X12 files
Emacs editing mode for X12 files and messages. Defines X12-specific font-locking and text navigation. -
11
Neuro
The Neuro crypto currency
The Neuro NRO cryptocurrency is designed to support solutions of machine learning tasks, big data and neural networks. Neuro is a scientific-technical project uniting scientists, engineers and programmers inspired by the idea to build something big, kind and bright. From the first stages of work, we will be engaged in the development of new architectures and algorithms of neural networks. Someday we will undoubtedly enter the annual ImageNet Challenge contest to compete with such giants as GoogLeNet Inception and Microsoft ResNet. ... -
12
json-forms
JSON Schema to HTML form generator, supporting dynamic subschemas
...Extensible and customizable library with zero dependencies. Bootstrap add-ons provided. This library supports dynamic schemas, that is, subschemas that can change depending on the value of other parts of the data. This allows the creation of dynamic forms that vary their shape depending on the values entered by the user. This is extremely useful for big autogenerated schemas, that aggregate lots of subschemas and have functional bindings, given that it allows to show the user a simpler, non-error-prone form, also avoiding asking for unneeded data. -
13
H2O-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning
...H2O-3 integrates with big data technologies such as Hadoop and Apache Spark, enabling organizations to run machine learning workflows on large-scale data infrastructure. The platform also includes a web-based interface called Flow that allows users to build models interactively through notebooks and visual tools. -
14
Random Bits Forest
RBF: a Strong Classifier/Regressor for Big Data
We present a classification and regression algorithm called Random Bits Forest (RBF). RBF integrates neural network (for depth), boosting (for wideness) and random forest (for accuracy). It first generates and selects ~10,000 small three-layer threshold random neural networks as basis by gradient boosting scheme. These binary basis are then feed into a modified random forest algorithm to obtain predictions. In conclusion, RBF is a novel framework that performs strongly especially on data... -
15
json4sapnw
Another JSON extension for SAP ABAP
This is a SAP addon to handle JSON data within SAP ABAP Programs. It comes in the customer exchange namespace /CEX/ and has to be installed as an SAP transport request. The addon supports object oriented JSON methods to process deep structured JSON data. Building JSON data from SAP data objects and parsing JSON data back to SAP data objects are supported. See the WIKI for some examples. -
16
Fast Neurite Tracer
Semi-automatic neurite tracing with tera-bytes of imaging data.
Fast Neurite Tracer (FNT) is a tool for semi-automated neurite tracing. FNT can handle big imaging data such as fMOST data. It can also process other types of light imaging data in general. FNT is designed to be * accurate in tracing (each tracing step needs your confirmation), * fast (operations using computer mouse is reduced with automatic searching), * scalable (large volume data of tera-bytes in size are supported). -
17
Random Bits Regression
Random Bits Regression is a strong general predictor.
...The fast-speed nature of our method not only allows big data analysis but also enables real-time recognition and predictions. The RBR framework also hints the mechanism of brain function and leads to a "wide learning" hypothesis. We believe that this method will make a great impact and enable many downstream applications. -
18
iCubing
Several OLAP algorithms, data structures and HPC OLAP versions
OLAP technology is very useful for decision makers and data mining tools with BIG data. In this direction, we implement iCubing project with several multidimensional data cube approaches for cube indexing, querying, updating and mining. There are also several cube types, i.e. alphanumeric cubes, text cubes with unstructured data and geo cube with geo types, dimensions, measures and hierarchies, so the OLAP area continues a hard challenge after more than 20 years of the seminal paper of Jim Gray et al. in 1997. ... -
19
Spark Python Notebooks
Apache Spark & Python (pySpark) tutorials for Big Data Analysis
Spark Python Notebooks is a curated collection of example Jupyter notebooks designed to help developers and data engineers learn Apache Spark using Python in an interactive environment. Rather than only providing static code files, this project uses notebooks to teach practical data processing workflows, exposing users to real Spark programming patterns like working with RDDs, DataFrames, and distributed computations. These notebooks often demonstrate how to transform, analyze, and visualize large datasets using PySpark APIs, which mirrors many real-world big data use cases. ... -
20
XML2CSV-Generic-Converter
Flatten XML into CSV to suit your mood
Java XML to CSV (XML2CSV) generic conversion facility. Flattens one or more similar XML files into CSV projections. I made it in order to extract data from big XML files and gather them in files more easily opened with a spreadsheet because I didn't find anything adapted to my needs over the Internet when I needed to (Java + truly generic + self-contained algorithm + Unix like command line options + efficiency). It is packaged as an auto executable Jar for convenient command line execution but might as well be interfaced directly by a Java class as part of a broader [yet non commercial] software. ... -
21
Mozaik
Easily craft beautiful dashboards
...Mozaïk eases this by providing a backend, which handles API calls and pushes data to widgets through websockets. Sometimes, a single dashboard is not enough. Mozaïk allows multiple dashboards with a smooth transition. -
22
Skill Map
A visualization of programmer skill maps
Skill‑Map is an open-source, collaborative project—originating from Geekbang—offering a structured visualization of programmer skill maps across domains like AI, front-end, backend, architecture, DevOps, and more. It serves as a navigable resource to organize learning paths and essential knowledge areas. Covers areas like AI, big data, architecture, frontend, backend, DevOps, testing, etc. Visual representation of programming and IT skill domains. Encourages community collaboration and feedback via GitHub Issues. Open to content updates, additions, and evolution as a living reference. -
23
CSV Transformer
transforms xml to csv
The CSV Transformer is a data processing tool which transforms .xml-Files to comma separated values. The CSV Transformer was created in a load and performance testing project, the use case was to be able to transform 2800 configuration files of a big banking application to a single .csv-File. With this single file it was possible to compare the whole configuration between two releases with the already available tool CSV Comparator. -
24
ankus
Data Mining and Machine Learning Algorithms based on MapReduce
[The feature of ankus] * ankus is a 'web-based big data mining project and tool'. - MapReduce-based data mining/machine learning algorithms library - Hadoop-based distributed bigdata system - offering a web-based GUI for easy use [The ankus project & License] * The ankus project consists of three as an open source. * ankus has Dual licensed under the community and commercial licenses -
25
GOBIG is a toolbox that can be used for detecting genetic variations. The project is intended to handle big data. What's more important is that it be used to detect clusters of SNP variants. It is the intention to use the toolbox with common and rare variants. To use it, for example, to find the genetic map of genes causing complex diseases.
