Search Results for "parallel"
Sort By:
Showing 28 open source projects for "parallel"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
Bifrost
Middleware for production-oriented MySQL
...Multiple data sources, multiple target library support. Both incremental and full data synchronization are supported. One Binlog parsing thread, multiple target libraries are synchronized in parallel. Automatically restore configuration after restarting after downtime, accurate control of location. Support monitoring and alarm functions such as Email and WeChat enterprise account. Provide third-party monitoring platform access interface (Http Basic authentication) HTTP API. MySQL, ClickHouse plugin supports DDL synchronization. -
2
golangci-lint
Fast linters Runner for Go
golangci-lint is a fast Go linters runner. It runs linters in parallel, uses caching, supports yaml config, has integrations with all major IDE and has dozens of linters included. ⚡ Very fast: runs linters in parallel, reuses Go build cache and caches analysis results. Yaml-based configuration. Integrations with VS Code, Sublime Text, GoLand, GNU Emacs, Vim, Atom, GitHub Actions. A lot of linters included, no need to install them. -
3
bild
Image processing algorithms in pure Go
...Package histogram provides basic histogram types and functions to analyze RGBA images. Package paint provides functions to edit a group of pixels on an image. Package parallel provides helper functions for the dispatching of parallel jobs. -
4
Numaflow
Kubernetes-native platform to run massively parallel data/streaming
Numaflow is a Kubernetes-native tool for running massively parallel stream processing. A Numaflow Pipeline is implemented as a Kubernetes custom resource and consists of one or more source, data processing, and sink vertices. Numaflow installs in a few minutes and is easier and cheaper to use for simple data processing applications than a full-featured stream processing platform. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
compress
Optimized Go Compression Packages
...Optimized deflate packages which can be used as a dropin replacement for gzip, zip and zlib. snappy is a drop-in replacement for github.com/golang/snappy offering better compression and concurrent streams. huff0 and FSE implementations for raw entropy encoding. gzhttp Provides client and server wrappers for handling gzipped requests efficiently. pgzip is a separate package that provides a very fast parallel gzip implementation. Stream decompression is now faster on asynchronous since the goroutine allocation much more effectively splits the workload. On typical streams, this will typically use 2 cores fully for decompression. When a stream has finished decoding no goroutines will be left over, so decoders can now safely be pooled and still be garbage collected. -
6
Colly
Elegant Scraper and Crawler Framework for Golang
...With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Clean API. Fast (>1k request/sec on a single core) Manages request delays and maximum concurrency per domain. Automatic cookie and session handling. Sync/async/parallel scraping. Distributed scraping. Caching, automatic encoding of non-unicode responses. Robots.txt support. Google App Engine support. -
7
Pachyderm
Data-Centric Pipelines and Data Versioning
Data-driven pipelines automatically trigger based on detecting data changes. Automatic immutable data lineage and data versioning of all data types. Autoscaling and parallel processing built on Kubernetes for resource orchestration. Uses standard object stores for data storage with automatic deduplication. Runs across all major cloud providers and on-premises installations. Automatic and intelligent versioning of even the largest data sets of unstructured and structured data. Git-like structure enables effective team collaboration. ... -
8
Starlark in Go
Starlark in Go: the Starlark configuration language, implemented in Go
...The Go-based interpreter allows developers to run or embed Starlark programs directly within Go applications, extending them with user-defined scripts and configurable logic. Unlike Python, Starlark supports parallel execution across multiple threads and maintains deterministic behavior, making it suitable for scalable and reproducible workloads. It offers familiar syntax features such as dictionaries, lists, and first-class functions with lexical scoping. -
9
Packer
Build Automated Machine Images
...Lightweight yet modern, Packer encourages the use of automated scripts to install and configure the software within your Packer-made images. It is highly performant, able to run on every major operating system and create machine images for several platforms in parallel. Packer supports a great number of platforms out of the box, and support for other platforms can be added through plugins. Any image it creates can also be easily turned into Vagrant boxes. -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
10
S5CMD
Parallel S3 and local filesystem execution tool
s5cmd is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files. There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what s5cmd has to offer that others don't. s5cmd supports wide range of object management tasks both for cloud... -
11
Turborepo
Build system optimized for JavaScript and TypeScript, written in Rust
Turborepo is a high-performance build system for JavaScript and TypeScript codebases. Turborepo reimagines build system techniques used by Facebook and Google to remove maintenance burden and overhead. Building once is painful enough, Turborepo will remember what you've built and skip the stuff that's already been computed. Turborepo looks at the contents of your files, not timestamps to figure out what needs to be built. Share a remote build cache with your teammates and CI/CD for even... -
12
mgmt
Next generation distributed, event-driven, parallel config management!
Mgmt is a real-time automation tool. It is familiar to existing configuration management software but is drastically more powerful as it can allow you to build real-time, closed-loop feedback systems, in a very safe way, and with a surprisingly small amount of our mcl code. For example, the following code will ensure that your file server is set to read-only when it's Friday. It can run continuously, intermittently, or on demand, and in the first case, it will guarantee that your system is... -
13
Argo Workflows
Workflow engine for Kubernetes
Argo Workflows is an open source container-native workflow engine for orchestrating parallel jobs on Kubernetes. Argo Workflows is implemented as a Kubernetes CRD (Custom Resource Definition). Define workflows where each step in the workflow is a container. Model multi-step workflows as a sequence of tasks or capture the dependencies between tasks using a directed acyclic graph (DAG). Easily run compute intensive jobs for machine learning or data processing in a fraction of the time using Argo Workflows on Kubernetes. ... -
14
KubeClarity
KubeClarity is a tool for detection and management of vulnerabilities
KubeClarity is a tool for detection and management of Software Bill Of Materials (SBOM) and vulnerabilities of container images and filesystems. It scans both runtime K8s clusters and CI/CD pipelines for enhanced software supply chain security. Effective vulnerability scanning requires an accurate Software Bill Of Materials (SBOM) detection. KubeClarity includes a CLI that can be run locally and especially useful for CI/CD pipelines. It allows to analyze images and directories to generate... -
15
Argo CD Image Updater
Automatic container image update for Argo CD
Argo CD Image Updater is a tool to automatically update the container images of Kubernetes workloads which are managed by Argo CD. In a nutshell, it will track image versions specified by annotations on the Argo CD Application resources and update them by setting parameter overrides using the Argo CD API. Currently, it will only work with applications that are built using Kustomize or Helm tooling. Applications built from plain YAML or custom tools are not supported yet (and maybe never... -
16
Lefthook
Fast and powerful Git hooks manager for any type of projects
...See how easy it is to install Lefthook (recently adopted by Discourse, Logux, and Openstax) for most common frontend and backend environments and ensure all your team’s developers can rely on a single flexible tool. Also, it has emojis. Fast and powerful Git hooks manager for Node.js, Ruby or any other type of projects. Fast. It is written in Go. Can run commands in parallel. Powerful. It allows to control execution and files you pass to your commands. Simple. It is single dependency-free binary which can work in any environment. Lefthook is easy to use. Once you configure and setup you can forget that it even exists and rely on the magic underneath. -
17
AWS SDK for Go v2
AWS SDK for the Go programming language
...The SDK also includes helpful utilities. For example, the Amazon S3 download and upload manager can automatically break up large objects into multiple parts and transfer them in parallel. Use the AWS SDK for Go Developer Guide to help you install, configure, and use the SDK. The guide provides configuration information, sample code, and an introduction to the SDK utilities. -
18
DevSpace
The Fastest Developer Tool for Kubernetes
...DevSpace is a very lightweight, client-only CLI tool which uses your current kube-context, just like kubectl or helm. It does not require you to install anything inside your cluster and works out of the box with every Kubernetes cluster. Builds all images in parallel using Docker, kaniko or any custom build commands (e.g. using cloud build). Tags images according to customizable tag schema and updates tags in manifests and Helm chart values. Pushes images to any public or private registry and automatically creates pull secrets if needed. If your project depends on a service which is part of a different git repository, you can add a devspace.yaml config file to each of the repositories and define dependencies between them. -
19
Helmsman
Helm Charts as Code
Helmsman is a Helm Charts (k8s applications) as Code tool that allows you to automate the deployment/management of your Helm charts from version-controlled code. Helmsman uses a simple declarative TOML file to allow you to describe a desired state for your k8s applications as in the example toml file. Alternatively YAML declaration is also an acceptable example YAML file. Helmsman sees what you desire, validates that your desire makes sense (e.g. that the charts you desire are available in... -
20
Ginkgo
BDD testing framework for Go
Ginkgo is a Go testing framework built to help you efficiently write expressive and comprehensive tests using Behavior-Driven Development (“BDD”) style. It is best paired with the Gomega matcher library but is designed to be matcher-agnostic. These docs are written assuming you’ll be using Gomega with Ginkgo. They also assume you know your way around Go and have a good mental model for how Go organizes packages under $GOPATH. Ginkgo is tested against Go v1.6 and newer To install Go, follow... -
21
protoactor-go
Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
...The Actor Model provides a higher level of abstraction for writing concurrent and distributed systems. It alleviates the developer from having to deal with explicit locking and thread management, making it easier to write correct concurrent and parallel systems. Grain abstraction, which provides a straightforward approach to building distributed interactive applications, without the need to learn complex programming patterns for handling concurrency, fault tolerance, and resource management. This allows Proto.Actor to leverage in-process performance for realtime stream processing. -
22
OK
Welcome to the future of programming languages
...The language emphasises readability and pushing logic out into functions so cases remain simple. It includes concurrency via a map function that executes callbacks in parallel. The project is illustrative of Duffield’s vision: code should feel “magical to write” by removing what is unnecessary. -
23
Graceful process restarts in Go
Graceful process restarts in Go
...No old code keeps running after a successful upgrade. The new process has a grace period for performing initialization. Crashing during initialization is OK. Only a single upgrade is ever run in parallel. -
24
Singularity
Open source container platform designed to be simple, fast, and secure
Singularity is an open-source container platform designed to be simple, fast, and secure. Many container platforms are available, but Singularity is designed for ease of use on shared systems and in high-performance computing (HPC) environments. -
25
GoSpider
Gospider - Fast web spider written in Go
...Find subdomains from the response source. Get URLs from Wayback Machine, Common Crawl, Virus Total, Alien Vault. Format output easy to Grep. Support Burp input. Crawl multiple sites in parallel.
