next up previous contents
Next: JUMAN at Kyoto University Up: Morpho-syntactic analysis Previous: Morpho-syntactic analysis

Segmentation and morphological analysis

The segmentation task is particularly important in Japanese, as no space separates the words. This task and the morphological analysis of the text are often grouped together into one single operation, by using a lexicon that contains a list of all possible sequences of characters together with their morphological description. Given a text, i.e. a sequence of characters, that lexicon is used to obtain a list of possible segmentations and morphological analysis. Constraints are then applied to eliminate possibilities in this list, or to classify the candidates according to their probabilities.





Jean-Philippe Vert
Sun Dec 6 11:05:42 MET 1998