Package org.omegat.tokenizer

Class LuceneSwedishTokenizer

java.lang.Object

org.omegat.tokenizer.BaseTokenizer

org.omegat.tokenizer.LuceneSwedishTokenizer

All Implemented Interfaces:

ITokenizer

public class LuceneSwedishTokenizer
extends BaseTokenizer

The LuceneSwedishTokenizer class provides functionality to tokenize Swedish text strings while optionally applying stemming and stop word filtering. This tokenizer is specifically designed to work with the Swedish language.

This class is annotated with @Tokenizer to indicate that it processes Swedish ("sv") language content, and it serves as the default tokenizer for this language.

Nested Class Summary

Nested classes/interfaces inherited from interface org.omegat.tokenizer.ITokenizer

ITokenizer.StemmingMode

Field Summary

Fields inherited from class org.omegat.tokenizer.BaseTokenizer

TOKENIZER_DEBUG_PROVIDER

Constructor Summary

Constructors

Constructor	Description
LuceneSwedishTokenizer()

Method Summary

Methods inherited from class org.omegat.tokenizer.BaseTokenizer

getSupportedLanguages, tokenizeVerbatim, tokenizeVerbatimToStrings, tokenizeWords, tokenizeWordsToStrings

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

LuceneSwedishTokenizer

public LuceneSwedishTokenizer()