wllama Files

Biggest change in 3.4 release: Built-in stack trace for easy debugging

I engineered myself a very efficient format for mapping function ID --> function name that allow having easy-to-debug messages, with almost zero overhead to the binary size

Note: 3.4.1 patch fixed a problem related to CDN build, including the compat package.

For more info, please refer to: https://github.com/ngxson/wllama/pull/239

What's Changed

• added reasoning parameter to loadModel() params, fixed typo by @thomas-0816 in https://github.com/ngxson/wllama/pull/227
• fix missing image and warmup param by @thiswillbeyourgithub in https://github.com/ngxson/wllama/pull/230
• expose for args by @ngxson in https://github.com/ngxson/wllama/pull/236
• Add attribution by @reeselevine in https://github.com/ngxson/wllama/pull/237
• add createRerank() API by @ngxson in https://github.com/ngxson/wllama/pull/238
• Add debug stack trace by @ngxson in https://github.com/ngxson/wllama/pull/239
• sync with latest llama.cpp by @ngxson in https://github.com/ngxson/wllama/pull/243

New Contributors

• @thomas-0816 made their first contribution in https://github.com/ngxson/wllama/pull/227
• @thiswillbeyourgithub made their first contribution in https://github.com/ngxson/wllama/pull/230
• @reeselevine made their first contribution in https://github.com/ngxson/wllama/pull/237

Full Changelog: https://github.com/ngxson/wllama/compare/3.2.3...3.4.0

Previous release: Safari support is back in 3.2 release (With WebGPU support! 🚀🚀)

The 3.2 release brings back support for Safari browser via an optional @wllama/wllama-compat package.

The best part? You don't need to change anything in your application's code. The compat package will be pulled automatically from CDN! And if you want to store the compat package locally, we also support that!

Refer to this documentation for more details: https://github.com/ngxson/wllama/blob/master/compat/README.md

Looking for a demo? --> https://huggingface.co/spaces/ngxson/wllama (Work best on Chromium-based browsers)

View full release note here:

• V3.1: https://github.com/ngxson/wllama/blob/master/guides/intro-v3.1.md
• V3.0: https://github.com/ngxson/wllama/blob/master/guides/intro-v3.0.md