Package org.omegat.tokenizer

Class LuceneArmenianTokenizer

java.lang.Object

org.omegat.tokenizer.BaseTokenizer

org.omegat.tokenizer.LuceneArmenianTokenizer

All Implemented Interfaces:

ITokenizer

public class LuceneArmenianTokenizer
extends BaseTokenizer

Tokenizer implementation for processing Armenian text. This class is specifically designed for tokenizing and optionally applying stemming or stop word filtering to Armenian language content.

Nested Class Summary

Nested classes/interfaces inherited from interface org.omegat.tokenizer.ITokenizer

ITokenizer.StemmingMode

Field Summary

Fields inherited from class org.omegat.tokenizer.BaseTokenizer

TOKENIZER_DEBUG_PROVIDER

Constructor Summary

Constructors

Constructor	Description
LuceneArmenianTokenizer()

Method Summary

Methods inherited from class org.omegat.tokenizer.BaseTokenizer

getSupportedLanguages, tokenizeVerbatim, tokenizeVerbatimToStrings, tokenizeWords, tokenizeWordsToStrings

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

LuceneArmenianTokenizer

public LuceneArmenianTokenizer()