Meilisearch Files

This release introduces a new compact route on the index routes, which appends a new compaction task to the queue. Meilisearch uses an LMDB environment by index, and indexes start to fragment after some time. We have noticed that the indexes generally have 30% fragmentation. By defragmenting the environment, we've seen large (2-4x) speed-ups in terms of search and indexation. This is primarily due to the reordering of the LMDB internal pages and the removal of scattered free pages throughout the file, thereby relocating the content to the beginning.

We also worked on parallelizing the post-processing of facets. We noticed that a lot of time was spent iterating over the prefixes of the index in a single-threaded loop. We redesigned this part of the indexation to make it multi-threaded. We have seen a 4x and 6x improvement in terms of time spent on this operation.

✨ Improvements

• Introduce a task to compact an index by @Kerollmops in https://github.com/meilisearch/meilisearch/pull/5929
• Parallelize bulk facets & word prefix fid/position docids by @Kerollmops in https://github.com/meilisearch/meilisearch/pull/5307
• Change Java version in SDK CI by @curquiza in https://github.com/meilisearch/meilisearch/pull/5910
• Minor improvement in OpenAPI CI by @curquiza in https://github.com/meilisearch/meilisearch/pull/5834
• Add request uid to search routes by @ManyTheFish in https://github.com/meilisearch/meilisearch/pull/5863

🦋 Bug Fixes

• Fix ranking score bug when sort is present by @ManyTheFish in https://github.com/meilisearch/meilisearch/pull/5933
• Synonym performance fix by @ManyTheFish in https://github.com/meilisearch/meilisearch/pull/5930
• Update README.md to fix newsletter link by @EazyAl in https://github.com/meilisearch/meilisearch/pull/5911
• Try to fix GH license detection again by @dureuill in https://github.com/meilisearch/meilisearch/pull/5938

🔩 Miscellenaous

• Remove release-drafter and encourage usage of GitHub-generated notes by @curquiza in https://github.com/meilisearch/meilisearch/pull/5935
• Show Dependabot dependency upgrade in the changelog by @curquiza in https://github.com/meilisearch/meilisearch/pull/5900
• Bump actions/setup-go from 5 to 6 by @dependabot[bot] in https://github.com/meilisearch/meilisearch/pull/5912
• Bump actions/setup-dotnet from 4 to 5 by @dependabot[bot] in https://github.com/meilisearch/meilisearch/pull/5914
• Bump actions/setup-node from 4 to 5 by @dependabot[bot] in https://github.com/meilisearch/meilisearch/pull/5915
• Bump sigstore/cosign-installer from 3.9.2 to 3.10.0 by @dependabot[bot] in https://github.com/meilisearch/meilisearch/pull/5916
• Bump actions/setup-python from 5 to 6 by @dependabot[bot] in https://github.com/meilisearch/meilisearch/pull/5913

New Contributors

• @EazyAl made their first contribution in https://github.com/meilisearch/meilisearch/pull/5911

Full Changelog: https://github.com/meilisearch/meilisearch/compare/v1.22.1...v1.23.0