All Known Implementing Classes:
StandardTokenizerTokenManager
| Field Summary | ||
|---|---|---|
| int | EOF | |
| int | ALPHANUM | |
| int | APOSTROPHE | |
| int | ACRONYM | |
| int | COMPANY | |
| int | ||
| int | HOST | |
| int | NUM | |
| int | P | |
| int | HAS_DIGIT | |
| int | ALPHA | |
| int | LETTER | |
| int | CJK | |
| int | DIGIT | |
| int | NOISE | |
| int | DEFAULT | |
| String[] | tokenImage | |
Save This Page