Coverage: Hungary / Creator: Kornai, András / Harvested from: LINDAT/CLARIAH-CZ repository / Original context has metadata only: false - LINDAT/CLARIAH-CZ Catalog Search Results

Start Over Coverage Hungary Creator Kornai, András Original context has metadata only false Harvested from LINDAT/CLARIAH-CZ repository

1. huntoken - tokenizer and sentence splitter

Creator:: Németh, László, Halácsy, Péter, and Kornai, András
Publisher:: Budapest Technical University Media Research Centre
Type:: toolService
Subject:: tokenizer
Description:: HunToken is a rule based tokenizer and sentence boundary detector for Hungarian (and English) texts.
Rights:: GNU Library or "Lesser" General Public License 3.0 (LGPL-3.0), http://opensource.org/licenses/LGPL-3.0, and PUB