Skip to content

Commit

Permalink
Update classic.md
Browse files Browse the repository at this point in the history
Signed-off-by: AntonEliatra <[email protected]>
  • Loading branch information
AntonEliatra authored Sep 3, 2024
1 parent f502373 commit 962e3a8
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion _analyzers/token-filters/classic.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ nav_order: 50

The primary function of the classic token filter is to work alongside the classic tokenizer. It processes tokens by applying several common transformations. These transformations aid in text analysis and search. These include:
- Removal of possessive endings such as *'s*, for example: *John's* becomes *John*.
- Separating words on internal hyphens, making terms like *co-operate* become tokens *co* and *operate*.
- Removal of periods from acronyms, for example: *D.A.R.P.A.* becomes *DARPA*.


Expand Down

0 comments on commit 962e3a8

Please sign in to comment.