concordia
Powerful search library, best suited for computer-aided translation
Concordia - Roman goddess of agreement. Concordance searcher - tool for translators who need their translations to "agree" with one standard.
Concordia is a C++ library for fast text lookup in large corpora. It uses a RAM stored index, which takes up approximately 600MB of memory for a corpus of 2 million sentences. It is based on the idea of a suffix array, enhanced by the presence of other auxiliary data structures.
The effects are stunning - Concordia is able to do simple substring...