stud
bud
Sign up
Log in
Home
Library
Explore
SAT
More
advance ai midterm study Flashcards | StudBud
advance ai midterm study
1 / 42
Which is a problem with character tokenization?
A
It ignores punctuation
B
It always works better than word tokenization
C
Characters don’t carry semantic meaning like words
D
It makes sequences shorter
Next
0
0
correct · 0:00