Search Results for "stream"
Sort By:
Showing 71 open source projects for "stream"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Watermill
Building event-driven applications the easy way in Go
...Our goal was to create a tool that is easy to understand, even by junior developers. It doesn't matter if you want to do Event-driven architecture, CQRS, Event Sourcing or just stream MySQL Binlog to Kafka. Watermill was designed to process hundreds of thousands of messages per second. Every component is built in a way that allows you to configure it for your needs. You can also implement your own middleware for the router. Watermill is using proven technologies and has a strong unit and integration tests coverage for critical areas. ... -
2
Benthos
Fancy stream processing made operationally mundane
Benthos is a high performance and resilient stream processor, able to connect various sources and sinks in a range of brokering patterns and perform hydration, enrichments, transformations and filters on payloads. It comes with a powerful mapping language, is easy to deploy and monitor, and ready to drop into your pipeline either as a static binary, docker image, or serverless function, making it cloud native as heck. -
3
progressbar
A really basic thread-safe progress bar for Golang applications
...In order to be OS agnostic I do not plan to support multi-line outputs. The progressbar implements an io.Writer, so it can automatically detect the number of bytes written to a stream, so you can use it as a progress bar for an io. Reader. A progress bar with an unknown length is a spinner. Any bar with -1 length will automatically convert it to a spinner with a customizable spinner type. For example, the above code can be run and set the resp.ContentLength to -1. There is a lot of customization that you can do - change the writer, the color, the width, the description, the theme, etc. -
4
Apache Flink
Stream processing framework with powerful stream
Apache Flink is a distributed engine for stateful computations over data streams and batches, designed for low-latency processing at scale. Its core runtime executes dataflow graphs with fine-grained backpressure and checkpointing, allowing applications to recover consistently from failures. Flink’s event-time model and watermarks enable accurate out-of-order processing, windowing, and complex time semantics that typical real-time systems struggle with. Developers program against high-level... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
SageMaker Spark Container
Docker image used to run data processing workloads
...It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing. The SageMaker Spark Container is a Docker image used to run batch data processing workloads on Amazon SageMaker using the Apache Spark framework. The container images in this repository are used to build the pre-built container images that are used when running Spark jobs on Amazon SageMaker using the SageMaker Python SDK. ... -
6
compress
Optimized Go Compression Packages
...Optimized deflate packages which can be used as a dropin replacement for gzip, zip and zlib. snappy is a drop-in replacement for github.com/golang/snappy offering better compression and concurrent streams. huff0 and FSE implementations for raw entropy encoding. gzhttp Provides client and server wrappers for handling gzipped requests efficiently. pgzip is a separate package that provides a very fast parallel gzip implementation. Stream decompression is now faster on asynchronous since the goroutine allocation much more effectively splits the workload. On typical streams, this will typically use 2 cores fully for decompression. When a stream has finished decoding no goroutines will be left over, so decoders can now safely be pooled and still be garbage collected. -
7
superfluid protocol-monorepo
Superfluid protocol specification, implementations and development kit
Superfluid is an asset streaming protocol that brings subscriptions, salaries and rewards to DAOs and crypto-native businesses. Settle employees and contributors compensation once and for all, without frictions or fees. Your tokens flow in a continuous stream to recipients, until you edit their compensation or choose to stop it. Create, modify or close streams in a single interface, even if the stream was started on other applications. The Superfluid Protocol is a framework that realizes the real-time finance vision where user accounts are connected together, and transactions can happen between user accounts instantaneously as a result. ... -
8
Netcap
A framework for secure and scalable network traffic analysis
The Netcap (NETwork CAPture) framework efficiently converts a stream of network packets into platform-neutral type-safe structured audit records that represent specific protocols or custom abstractions. These audit records can be stored on disk or exchanged over the network, and are well-suited as a data source for machine learning algorithms. Since parsing of untrusted input can be dangerous and network data is potentially malicious, a programming language that provides a garbage-collected memory-safe runtime is used for the implementation. -
9
RtspSimpleServer
ready-to-use RTSP / RTMP / LL-HLS / WebRTC server and proxy
...Proxy streams from other servers or cameras, always or on-demand. Streams are automatically converted from a protocol to another. For instance, it's possible to publish a stream with RTSP and read it with HLS. Serve multiple streams at once in separate paths Authenticate users; use internal or external authentication. Redirect readers to other RTSP servers (load balancing) Query and control the server through an HTTP API. Reload the configuration without disconnecting existing clients (hot reloading) Read Prometheus-compatible metrics. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
koa-cash
HTTP response caching for Koa. Supports Redis, in-memory store, etc.
HTTP response caching for Koa. Supports Redis, in-memory store, and more. -
11
BentoML
Unified Model Serving Framework
BentoML simplifies ML model deployment and serves your models at a production scale. Support multiple ML frameworks natively: Tensorflow, PyTorch, XGBoost, Scikit-Learn and many more! Define custom serving pipeline with pre-processing, post-processing and ensemble models. Standard .bento format for packaging code, models and dependencies for easy versioning and deployment. Integrate with any training pipeline or ML experimentation platform. Parallelize compute-intense model inference... -
12
Orleans
Orleans is a cross-platform framework for building distributed apps
Orleans builds on the developer productivity of .NET and brings it to the world of distributed applications, such as cloud services. Orleans scales from a single on-premises server to globally distributed, highly-available applications in the cloud. Orleans takes familiar concepts like objects, interfaces, async/await, and try/catch and extends them to multi-server environments. As such, it helps developers experienced with single-server applications transition to building resilient,... -
13
LunaSea
Self-hosted software controller built using Flutter
LunaSea is a fully featured, open source self-hosted controller focused on giving you a seamless experience between all of your self-hosted media software remotely on your devices. LunaSea even comes with support for webhook-based push notifications, multiple instances of applications using profiles, backup and restore functionality for your configuration, an AMOLED black theme, and more! -
14
Echo
High performance, minimalist Go web framework
...Data binding for HTTP request payload, including JSON, XML or form-data. API to send variety of HTTP response, including JSON, XML, HTML, File, Attachment, Inline, Stream or Blob. Template rendering using any template engine. Customized central HTTP error handling. Easily extendable API. -
15
Kapacitor
Open source framework for processing, monitoring, and alerting
Open source framework for processing, monitoring, and alerting on time series data. Kapacitor is a real-time data processing engine for monitoring and alerting, specifically designed to work with time-series data from InfluxDB. -
16
Motia
Multi-Language Backend Framework that unifies APIs
Motia is a large-scale, multi-language backend framework designed to unify and simplify core backend concerns — from APIs and background jobs to distributed workflows, streams, and advanced AI agent integration — through a single coherent primitive with built-in observability and state management. It provides a unified development philosophy that seamlessly bridges different backend patterns (queues, event streams, scheduled jobs) while offering integrated tools for telemetry, logging,... -
17
Laravel Wave
Painless Laravel Broadcasting with SSE
...Meet the Server-sent Events 🛜 Works seamlessly with Laravel's default Redis broadcasting driver and supports Laravel Echo. Wave seamlessly integrates with Laravel's default Redis broadcasting driver, ensuring efficient real-time data transfer. Wave intelligently resumes the event stream from the last event, ensuring no crucial data is lost in transit. -
18
Broadway
Concurrent and multi-stage data ingestion and data processing
...Developers can enrich pipelines with batching, concurrency control, and metrics reporting, simplifying the management of complex data ingestion and processing systems. Broadway is often used for event processing, stream handling, and background jobs, offering both performance and clarity in Elixir’s functional style. -
19
The Optimism Monorepo
Optimism is Ethereum, scaled
...We're trying to solve some of the most critical coordination failures facing the crypto ecosystem today. We're particularly focused on creating a sustainable funding stream for the public goods and infrastructure upon which the ecosystem so heavily relies but has so far been unable to adequately reward. We'd love for you to check out The Optimistic Vision to understand more about why we do what we do. Optimism is a fast, stable, and scalable L2 blockchain built by Ethereum developers, for Ethereum developers. -
20
Koa
Expressive middleware for node.js using ES2017 async functions
Koa is a minimal, expressive web framework for Node.js created by the team behind Express, built around modern JavaScript features. Its middleware system uses async functions and an “onion” execution model, producing clean, sequential control flow for request/response handling. Koa keeps the core small and unopinionated—there’s no built-in router or templating—so developers compose only the pieces they need. The framework exposes a refined Context object to standardize request and response... -
21
Turbo
Turbo is a framework built for LuaJIT 2
...First and foremost the framework is aimed at the HTTP(S) protocol. This means web developers and HTTP API developers are first-class citizens. But the framework contains generic nuts and bolts such as; an I/O loop, IO Stream classes, and customizable TCP (with SSL) server classes giving it value for everyone doing any kind of high-performance network application. -
22
Kubeshark
The API traffic viewer for Kubernetes providing deep visibility
...Monitors all API traffic and payloads to find API drift and API anomalies and trace them down to source. Instant service dependency mapping through real-time API traffic analysis. Store all or a subset of traffic in PCAP files. View TCP stream request-response pairs and replay requests' payloads to a destination service. -
23
ethereum.org website
Ethereum.org is a primary online resource for the Ethereum community
...Ethereum's decentralized finance (DeFi) system never sleeps or discriminates. With just an internet connection, you can send, receive, borrow, earn interest, and even stream funds anywhere in the world. -
24
Apache InLong
Apache InLong - a one-stop integration framework for massive data
Apache InLong is a one-stop integration framework for massive data that provides automatic, secure and reliable data transmission capabilities. InLong supports both batch and stream data processing at the same time, which offers great power to build data analysis, modeling and other real-time applications based on streaming data. InLong (应龙) is a divine beast in Chinese mythology who guides the river into the sea, and it is regarded as a metaphor of the InLong system for reporting data streams. InLong was originally built at Tencent, which has served online businesses for more than 8 years, to support massive data (data scale of more than 80 trillion pieces of data per day) reporting services in big data scenarios. ... -
25
graphql-upload
Middleware and an Upload scalar to add support for GraphQL multipart
Middleware and an Upload scalar to add support for GraphQL multipart requests (file uploads via queries and mutations) to various Node.js GraphQL servers. Clients implementing the GraphQL multipart request spec upload files as Upload scalar query or mutation variables. Their resolver values are promises that resolve file upload details for processing and storage. Files are typically streamed into cloud storage but may also be stored in the filesystem. Use the middleware graphqlUploadKoa or...
