[moses-smt/mosesdecoder] 20341c: remove escape-only tokenizer. A script already ava...

[GitHub <no...@gi...>]

  Branch: refs/heads/master
  Home:   https://github.com/moses-smt/mosesdecoder
  Commit: 20341c091fb48770fd438d0ed5e97d0538746d7f
      https://github.com/moses-smt/mosesdecoder/commit/20341c091fb48770fd438d0ed5e97d0538746d7f
  Author: Hieu Hoang <fis...@gm...>
  Date:   2012-08-22 (Wed, 22 Aug 2012)

  Changed paths:
    R scripts/tokenizer/detokenizer-unescape-only.perl
    R scripts/tokenizer/tokenizer-escape-only.perl

  Log Message:
  -----------
  remove escape-only tokenizer. A script already available