Tags:

Shallow Parsing with Conditional Random Fields

Fei Sha & Pereira 2003

This paper describes an implementation of a chunker using IOB encoding with a CRF.

The following table lists the features used in the chunker:

Feature Description
equation0.png The current output tag.
equation1.png The current state (current and previous output tag).
equation2.png A tuple of the current state and the previous state (current and previous two output tags).
equation3.png A tuple of the current state and the equation9.pngth word, equation4.png.
equation5.png A tuple of the current state, the current word, and the previous word.
equation6.png A tuple of the current state, the current word, and the next word.
equation7.png A tuple of the current state and the part of speech tag of the equation9.pngth word, equation4.png.
equation8.png A tuple of the current state and the two consecutive part of speech tags starting at word equation9.png, equation10.png.
equation11.png A tuple of the current state, and three consecutive part of speech tags centered on word equation9.png, equation12.png.
equation13.png A tuple of the current output tag and the equation9.pngth word, equation4.png.
equation14.png A tuple of the current output tag, the current word, and the previous word.
equation15.png A tuple of the current output tag, the current word, and the next word.
equation16.png A tuple of the current output tag and the part of speech tag of the equation9.pngth word, equation4.png.
equation17.png A tuple of the current output tag and the two consecutive part of speech tags starting at word equation9.png, equation10.png.
equation11.png A tuple of the current output tag, and three consecutive part of speech tags centered on word equation9.png, equation12.png.

Login