Working on advanced splitter #15
LexiestLeszek
started this conversation in
Ideas
Replies: 1 comment
-
|
I have the word one in the library currently, it would be interesting to see the use of sentences/paragraphs but I can't think of a use case personally. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi! NaturalLanguage swift library has built-in tokenizers for .paragraph / .sentence / .word
https://developer.apple.com/documentation/naturallanguage/tokenizing_natural_language_text
https://developer.apple.com/documentation/naturallanguage/nltokenunit/paragraph
https://developer.apple.com/documentation/naturallanguage/nltokenunit/sentence
https://developer.apple.com/documentation/naturallanguage/nltokenunit/word
Does it make sense to use it for text splitting instead?
Beta Was this translation helpful? Give feedback.
All reactions