r4485 broke hyperminimisation builds

Status: Beta

Brought to you by: eaxelson, hardwick, klindenforge, koskenni, and 3 others

#323 r4485 broke hyperminimisation builds

Milestone: future

Status: open

Owner: Senka Drobac

Labels: None

Priority: 1

Updated: 2015-10-21

Created: 2015-10-21

Private: No

r4485 broke the build of https://victorio.uit.no/langtech/trunk/langs/kal/ when configured with --with-hfst --without-xfst --enable-hyperminimisation

When running make in src/morphology/ :

r4484 takes a minute and 1.1 GB RAM to compile lexicon.hfst
r4485 never completes and eventually grows to use all available RAM (in my case 32 GB + 32 GB swap)

Without hyperminimisation, r4485 completes in 1m45s taking 1.8 GB RAM.

sjurum - 2015-10-21

Just to emphasize the importance of fixing this bug: hyperminimisation is needed for real world applications - without it the lexical fst is 222 Mb, before r4485 and with hyperminimisation enabled, the lexical fst was just 9.3 Mb, 24x smaller.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link: