Rights: GNU Library or "Lesser" General Public License 3.0 (LGPL-3.0) / Subject: tokenizer - LINDAT/CLARIAH-CZ Catalog Search Results

Start Over Rights GNU Library or "Lesser" General Public License 3.0 (LGPL-3.0) Subject tokenizer

1. huntoken - tokenizer and sentence splitter

Creator:: Németh, László, Halácsy, Péter, and Kornai, András
Publisher:: Budapest Technical University Media Research Centre
Type:: toolService
Subject:: tokenizer
Description:: HunToken is a rule based tokenizer and sentence boundary detector for Hungarian (and English) texts.
Rights:: GNU Library or "Lesser" General Public License 3.0 (LGPL-3.0), http://opensource.org/licenses/LGPL-3.0, and PUB