Download Latest Version v0.5.0 source code.zip (1.0 MB)
Email in envelope

Get an email when there's a new version of Aviary

Home / v0.3.0
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2023-10-02 847 Bytes
0
v0.3.0.tar.gz 2023-10-02 911.2 kB
0
v0.3.0.zip 2023-10-02 967.4 kB
0
Totals: 3 Items   1.9 MB 0

Please note that API stability is not expected until 1.0 release. This update introduces breaking changes.

What's changed?

  • Documentation

    • Updated readme and documentation

  • API & SDK

    • Updated the format of model configuration yamls.

  • Backend

    • Completely replaced the text-generation-inference based backend with vLLM based backend. This means RayLLM now supports all models vLLM supports.
    • Improved observability and metrics.
    • Improved testing.

This update introduces breaking changes to model configuration YAMLs related to the new vLLM backend. Refer to the updated aviary/models/README.md file for details on the updated configuration file format.

In order to use Aviary, ensure you are using the official Docker image anyscale/aviary:latest.

Source: README.md, updated 2023-10-02