Open
Description
hello.
I user twitter analyzer with python.
And I want to make user-dictionary.
It means,
when I tokenize "섬유탈취제"
now, it makes tokens like this.
"tokens": [
"섬유(Noun: 0, 2)",
"탈취(Noun: 2, 2)",
"제(Noun: 4, 1)"
],
but, I want to make tokens like this.
"tokens": [
"섬유탈취제(Noun or Compound)"
],
is it possible?
if possible, how could I make this?
Metadata
Metadata
Assignees
Labels
No labels