Search Results for "data processing" - Page 9
Sort By:
Showing 418 open source projects for "data processing"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Forms
An easy way to create, parse and validate forms in node.js
...It integrates with popular Node.js web frameworks, enabling seamless handling of form submissions and data processing. The design emphasizes reusability and maintainability, allowing developers to define forms once and use them across different parts of an application. -
2
Albedo
A recommender system for discovering GitHub repos
...It treats repositories and developers as a graph of interactions and applies large-scale matrix factorization to model affinities, with Apache Spark providing the distributed data processing. The project focuses on implicit feedback—stars, watches, and other engagement metrics—so it can build useful recommendations without explicit ratings. A reproducible setup and Makefile-driven workflow streamline tasks like spinning up services, loading datasets, training models, and generating candidate lists. Because it’s built around Spark’s scalable primitives, Albedo can experiment on substantial snapshots of GitHub metadata rather than toy corpora. ... -
3
Python Crawler Tutorial Starts From Zero
Python crawler tutorial, taking you from zero to one
Python Crawler Tutorial Starts From Zero is a Chinese-language learning repository that teaches web crawling from introductory concepts through practical examples. Early lessons explain HTTP requests, request analysis, the Python Requests library, and common categories of extracted data. Separate chapters cover JSON processing and regular expressions for transforming responses into structured information. Practical exercises demonstrate crawlers for Douban movies, Baidu Tieba, and Baidu Translate. Broader project materials also address topics such as JavaScript reverse engineering, Selenium automation, OCR, MongoDB, and the Scrapy framework. ... -
4
AhoCorasickDoubleArrayTrie
An extremely fast implementation of Aho Corasick algorithm
...This makes it a strong fit for tasks like content filtering, entity/term spotting, dictionary-based annotation, or high-throughput log/text processing. In short, it’s a specialized, speed-focused library for industrial-strength multi-keyword matching in Java. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
PRMLT
Matlab code of machine learning algorithms in book PRML
...This package requires Matlab R2016b or latter, since it utilizes a new Matlab syntax called Implicit expansion (a.k.a. broadcasting). It also requires Statistics Toolbox (for some simple random number generator) and Image Processing Toolbox (for reading image data). The code is extremely compact. Minimizing code length is a major goal. As a result, the core of the algorithms can be easily spotted. Many tricks for speeding up Matlab code are applied (e.g. vectorization, matrix factorization, etc.). Usually, functions in this package are orders faster than Matlab builtin ones (e.g. kmeans). ... -
6
DSPatch
The Refreshingly Simple C++ Dataflow Framework
Webite: http://flowbasedprogramming.com DSPatch, pronounced "dispatch", is a powerful C++ dataflow framework. DSPatch is not limited to any particular domain or data type, from reactive programming to stream processing, DSPatch's generic, object-oriented API allows you to create virtually any dataflow system imaginable. *See also:* DSPatcher ( https://github.com/MarcusTomlinson/DSPatcher ): A cross-platform graphical tool for building DSPatch circuits. DSPatchables ( https://github.com/MarcusTomlinson/DSPatchables ): A DSPatch component repository. -
7
Orange
OpenResty/Nginx Gateway for API monitoring and management
...In addition, various variables in the request can be extracted for subsequent processing in two ways. -
8
TP-COBOL-DEBUGGER
A COBOL debugger for GnuCOBOL/OpenCOBOL written in GnuCOBOL
A COBOL debugger for GnuCOBOL written in GnuCOBOL. Works with both current GnuCOBOL and old GnuCOBOL/OpenCOBOL 1.1; could be used for other vendors with slightly modifications, too. Take a look at https://gnucobol.altervista.org/tp-cobol-debugger/ -
9
show-me-the-code
Python Workbook, a small program every day
Show Me the Code is a Chinese-language programming exercise collection centered on completing one small practical challenge at a time. Although presented as a Python workbook, many of the exercises can be implemented in other programming languages. The challenges intentionally avoid routine textbook exercises and instead use tasks that resemble small real-world programming problems. Examples include image manipulation, coupon-code generation, database storage, text processing, and... -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
10
JuliaFEM.jl
The JuliaFEM software library is a framework
The JuliaFEM software library is a framework that allows for the distributed processing of large Finite Element Models across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. The JuliaFEM software library is a framework that allows for the distributed processing of large Finite Element Models across clusters of computers using simple programming models. It is designed... -
11
Twint
An advanced Twitter scraping & OSINT tool written in Python
Twint is an advanced open-source Twitter scraping and OSINT tool written in Python that extracts tweets, user data, followers, likes, and more—without relying on Twitter’s API—making it highly useful for researchers, analysts, and hobbyists who want to bypass rate limits and access public Twitter data. -
12
nlp_chinese_corpus
Large Scale Chinese Corpus for NLP
nlp_chinese_corpus is a large-scale Chinese corpus collection for natural language processing research and development. It was created to make high-volume Chinese text data easier to access for students, researchers, and practitioners. The repository gathers several major datasets, including Chinese Wikipedia entries, news articles, encyclopedia-style question answering data, community question answering data, and Chinese-English translation sentence pairs. ... -
13
Django Celery
Old Celery integration project for Django
Celery is a simple, flexible, and reliable distributed system to process vast amounts of messages, while providing operations with the tools required to maintain such a system. It’s a task queue with focus on real-time processing, while also supporting task scheduling. Celery has a large and diverse community of users and contributors, you should come join us on IRC or our mailing-list. Celery is Open Source and licensed under the BSD License. A task queue’s input is a unit of work called a... -
14
X-DeepLearning
An industrial deep learning framework for high-dimension sparse data
...Complete streaming training features including feature admission, feature elimination, model incremental export, feature counting statistics, etc. Background: XDL1.0 focuses on throughput optimization and adopts the one request per thread processing model, which can significantly improve the limit throughput under ultra-high concurrency. -
15
TSA_CRAFT
Automatic command line tool for TSA data analysis
DSF is a high-throughput platform of TSA assay to screen various conditions that affect protein stability. To facilitate TSA data analysis, we developed an automatic tool "TSA-CRAFT". TSA-CRAFT was developed by integrating PERL script and Gnuplot. PERL scripts manage the entire workflow and data processing procedures of TSA data analysis. On the other hand, Gnuplot takes over the curve fitting and result presentation works. All analysed results are coded in an html file that can be easily displayed by a web browser. -
16
Highland
High-level streams library for Node.js and the browser
Highland is a JavaScript library designed to simplify working with streams and asynchronous data flows by providing a functional programming interface on top of Node.js streams. It allows developers to process data in a declarative and composable way, treating streams as sequences that can be transformed using familiar functional patterns such as map, filter, reduce, and flatMap. The library abstracts away much of the complexity of handling backpressure and asynchronous callbacks, enabling... -
17
ModularAdmin
Free Dashboard Theme Built On Bootstrap 4 | HTML Version
ModularAdmin is an open source dashboard theme built in a modular way. That makes it easy to scale, modify and maintain. We use SASS as CSS preprocessor language. Main variables are defined in the src/_variables.scss folder. For making life easier we broke down styles into components, and on build we're just merging all .scss files together and processing it to the dist/css/app.css file. There are also different theme variations located in src/_themes/ folder, where you can change the main... -
18
Duckling (Old)
Clojure library that parses text into structured data
Duckling (the “old” archived version) is a natural language processing library (in Clojure) for parsing text to structured data — specifically, recognizing quantities such as dates, times, durations, measurements, currencies, etc., from free-form text. To use Duckling in your project, you just need two functions: load! to load the default configuration, and parse to parse a string. Duckling is a Clojure library that parses text into structured data. -
19
JSVerbalExpressions
JavaScript Regular expressions made easy
VerbalExpressions is a JavaScript library that helps to construct difficult regular expressions. Methods have a return type of VerbalExpression except where mentioned otherwise. If there is no mention of a method’s parameters, it is to be assumed that it has none. VerEx is the function that is exported from within VerbalExpressions.js and is to be the first method in chains that describe verbal expressions. Construct and return a new instance of VerbalExpression. Used to support the new... -
20
Pipelines
An experimental programming language for data flow
Pipelines is a language and runtime for crafting massively parallel pipelines. Unlike other languages for defining data flow, the Pipeline language requires the implementation of components to be defined separately in the Python scripting language. This allows the details of implementations to be separated from the structure of the pipeline while providing access to thousands of active libraries for machine learning, data analysis, and processing. -
21
Kalibr Allan
IMU Allan standard deviation charts
kalibr_allan is a utility repository that provides scripts and tools for calculating IMU noise parameters for use in Kalibr and other IMU filtering systems. While manufacturers typically provide “white noise” values in IMU datasheets, the bias instability and random walk parameters must be determined experimentally. This project enables users to compute those values using Allan variance analysis from recorded IMU data. The workflow involves recording IMU measurements with the device... -
22
Wally
Distributed Stream Processing
...Provide high-performance & low-latency data processing. Be portable and deploy easily (i.e., run on-prem or any cloud). Manage in-memory state for the application. Allow applications to scale as needed, even when they are live and up-and-running. The primary API for Wally is written in Pony. Wally applications are written using this Pony API. -
23
Web Frameworks
Which is the fastest web framework?
There are many frameworks, each one comes with its own advantages and drawbacks. The purpose of this project is to identify them and attempt to measure their differences (performance is only one metric). A framework is a set of components working together. The main intention behind a framework is to facilitate (app or service) creation. The way a framework helps any developer may vary from one to another. Full-stack meaning it provides all aspects (-stacks-) from data layer to sometimes... -
24
iText®, a JAVA PDF library
PDF Library for Developers
iText is an open-source PDF library available for Java and .NET (C#). iText allows you to effortlessly generate and manipulate standards-compliant PDF documents with a powerful and feature-rich SDK. With iText, you can create archivable and accessible PDFs, split and merge documents, fill and flatten forms, digitally sign documents, and more. iText add-ons enable additional functionality, such as PDF creation from HTML templates, secure redaction, OCR, and much more. The latest... -
25
Command-line/Ant-task/embeddable text file preprocessor. Macros, flow control, expressions. Recursive directory processing. Extensible in Java to display data from any data sources (as database). Can generate complete homepages (tree of HTML-s, images, etc.)
