Name | Modified | Size | Downloads / Week |
---|---|---|---|
Parent folder | |||
README.md | 2022-06-30 | 480 Bytes | |
v0.1.1.tar.gz | 2022-06-30 | 497.9 kB | |
v0.1.1.zip | 2022-06-30 | 500.9 kB | |
Totals: 3 Items | 999.2 kB | 0 |
Important Bug Fixes - Image tokens were mistakenly being computed twice in command line script when using torch - Tokenizer was not working correctly on some machines previously (e.g. windows). Files are now read with ut8-encoding.
New Features
- is_expendable
argument reduces memory usage for command line script by loading then unloading encoder/decoder/detokenizer when needed
- simpler 4D attention_state
replacing 5D keys_values_state
and faster inference time