[moses-smt/mosesdecoder] 7e25b2: added option -X to skip XML

[GitHub <no...@gi...>]

  Branch: refs/heads/matecat_async
  Home:   https://github.com/moses-smt/mosesdecoder
  Commit: 7e25b25c14d17fa4a855eca3ea1878596805d1e9
      https://github.com/moses-smt/mosesdecoder/commit/7e25b25c14d17fa4a855eca3ea1878596805d1e9
  Author: Christian Buck <cb...@la...>
  Date:   2012-09-25 (Tue, 25 Sep 2012)

  Changed paths:
    M scripts/tokenizer/tokenizer.perl

  Log Message:
  -----------
  added option -X to skip XML

otherwise same output