Pruna AI Files

The juiciest bits 🧃

Algorithm & compatibility improvements ⚙️

• feat: FA3-FP8-extension by @Marius-Graml in https://github.com/PrunaAI/pruna/pull/552
• feat: extend moe model check to multimodal ones and add block quantization parameters by @llcnt in https://github.com/PrunaAI/pruna/pull/605
• feat: moe kernel tuning by @llcnt in https://github.com/PrunaAI/pruna/pull/482

Lots of new tools for benchmarking and evaluation 📊

• feat(evaluation): Add lm-eval to Pruna Metrics by @sky-2002 in https://github.com/PrunaAI/pruna/pull/380
• feat(metrics): DINO Score v3 by @davidberenstein1957 in https://github.com/PrunaAI/pruna/pull/568
• feat: add column_map support to collate functions by @zamal-db in https://github.com/PrunaAI/pruna/pull/561
• feat: initial implementation for rapidata by @begumcig in https://github.com/PrunaAI/pruna/pull/581
• feat: add benchmark support to PrunaDataModule and implement PartiPrompts by @davidberenstein1957 in https://github.com/PrunaAI/pruna/pull/502

Python 3.13 and pytorch 2.11 support is here 🐍

• build: bump python 3.13 by @gsprochette in https://github.com/PrunaAI/pruna/pull/624

Some Bug Fixing 🐞 and Maintenance

• fix(evaluation): replace bare raises with proper exceptions and add text_generation_quality request by @zamal-db in https://github.com/PrunaAI/pruna/pull/560
• fix: protect lm-eval import to allow evaluation-agent import without extra by @gsprochette in https://github.com/PrunaAI/pruna/pull/586
• fix(torchao): update imports of quantizer by @ParagEkbote in https://github.com/PrunaAI/pruna/pull/549
• fix: wrap callable enum values with enum.member for python 3.13 by @gsprochette in https://github.com/PrunaAI/pruna/pull/583
• fix: remove pruna-pro hook from pre-commit by @ParagEkbote in https://github.com/PrunaAI/pruna/pull/572
• fix: cache handling in SmashConfig due to invalid path exception by @ParagEkbote in https://github.com/PrunaAI/pruna/pull/598
• fix: pre-download sage_attention kernel before applying backend, remove pinned fa3 kernel version by @Marius-Graml in https://github.com/PrunaAI/pruna/pull/578
• fix: ping peft >= 0.18.0, < 0.19.0 for torchao compatability issues by @davidberenstein1957 in https://github.com/PrunaAI/pruna/pull/630

We’ve made a bunch of improvements to make installing, testing, and developing locally faster and more reliable:

• ci: fix too many requests http error in the cpu tests by @begumcig in https://github.com/PrunaAI/pruna/pull/577
• ci: add uv virtual environment cache to setup-uv-project action by @davidberenstein1957 in https://github.com/PrunaAI/pruna/pull/559
• ci: separate extra installs by @begumcig in https://github.com/PrunaAI/pruna/pull/622
• build: make index pypi default and pythonanywhere explicit and setup python through uv by @gsprochette in https://github.com/PrunaAI/pruna/pull/613
• ci: restrict build to manual dispatch and version tags by @gsprochette in https://github.com/PrunaAI/pruna/pull/633
• test: explicit combo names and switch stable fast fixture by @gsprochette in https://github.com/PrunaAI/pruna/pull/582

We also updated our PR template and Readme for smoother contributions!:

• docs: update readme cta by @sdiazlor in https://github.com/PrunaAI/pruna/pull/591
• docs: updated PR template by @minettekaum in https://github.com/PrunaAI/pruna/pull/576
• docs: added comment about vibe coded solutions to pr template by @minettekaum in https://github.com/PrunaAI/pruna/pull/606

New Faces in the Garden 👩‍🌾

• @zamal-db made their first contribution in https://github.com/PrunaAI/pruna/pull/560 (and they did not stop and did another contribution right after with [#561])
• @sky-2002 made their first contribution in https://github.com/PrunaAI/pruna/pull/380 and added the entire lm-eval harness to Pruna!

Full Changelog: https://github.com/PrunaAI/pruna/compare/v0.3.2...v0.3.3