uk.co.cogitolearning.cogpar.Tokenizer.TokenInfo Class Reference

Internal class holding the information about a token type. More...

Collaboration diagram for uk.co.cogitolearning.cogpar.Tokenizer.TokenInfo:

Public Member Functions
	TokenInfo (Pattern regex, int token)
	Construct TokenInfo with its values.

Public Attributes
final Pattern	regex
	the regular expression to match against
final int	token
	the token id that the regular expression is linked to

Detailed Description

Internal class holding the information about a token type.

Definition at line 45 of file Tokenizer.java.

---

The documentation for this class was generated from the following file:

• Tokenizer.java