Showing 2 open source projects for "inference"

View related business solutions
  • Host LLMs in Production With On-Demand GPUs Icon
    Host LLMs in Production With On-Demand GPUs

    NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

    Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
    Try Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 1
    pytype

    pytype

    A static type analyzer for Python code

    ...Documentation and a user guide detail configuration, supported features, and how inference interacts with modern Python idioms.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Pyright

    Pyright

    Static type checker for Python

    ...Different “execution environments” can be associated with subdirectories within a source base. Each environment can specify different module search paths, python language versions, and platform targets. Type inference for function return values, instance variables, class variables, and globals. Type guards that understand conditional code flow constructs like if/else statements. Type hinting generics in standard collections. Pyright ships as both a command-line tool and a VS Code extension that provides many powerful features that help improve programming efficiency. ...
    Downloads: 5 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next