Search Results for "support"

KServe provides a Kubernetes Custom Resource Definition for serving machine learning (ML) models on arbitrary frameworks. It aims to solve production model serving use cases by providing performant, high abstraction interfaces for common ML frameworks like Tensorflow, XGBoost, ScikitLearn, PyTorch, and ONNX. It encapsulates the complexity of autoscaling, networking, health checking, and server configuration to bring cutting edge serving features like GPU Autoscaling, Scale to Zero, and...

Testcontainers is a Python library that provides a friendly API to run a Docker container. It is designed to create a runtime environment to use during your automatic tests.

...Once your organization hits a certain scale, a reverse proxy or load balancer isn’t enough for traffic management. If you’re using Kubernetes, you’re probably already at that scale and need support for advanced ingress and API management solutions like blue-green deployment.

JAX Toolbox is a development toolkit designed to streamline and optimize the use of JAX for machine learning and high-performance computing on NVIDIA GPUs. It provides prebuilt Docker images, continuous integration pipelines, and optimized example implementations that help developers quickly set up and run JAX workloads without complex configuration. The project supports popular JAX-based frameworks and models, including architectures used for large-scale pretraining such as GPT and LLaMA...

Opta is an infrastructure-as-code framework. Rather than working with a low-level cloud configuration, Opta enables you to work with high-level constructs. Opta high-level constructs produce Terraform configuration files. This helps you avoid lock-in to Opta. You can write custom Terraform code or even take the Opta-generated Terraform and go your own way. Opta is a new kind of Infrastructure-as-Code (IaC) framework that lets engineers work with high-level constructs instead of getting lost...