1. huntoken - tokenizer and sentence splitter Creator: Németh, László, Halácsy, Péter, and Kornai, András Publisher: Budapest Technical University Media Research Centre Type: toolService Subject: tokenizer Description: HunToken is a rule based tokenizer and sentence boundary detector for Hungarian (and English) texts. Rights: GNU Library or "Lesser" General Public License 3.0 (LGPL-3.0), http://opensource.org/licenses/LGPL-3.0, and PUB