    All Packages  Class Hierarchy  This Package  Previous  Next  Index

# Class xe.xe_TokenizerAuto

    java.lang.Object
       |
       +----xe.xe_Tokenizer
               |
               +----xe.xe_TokenizerAuto

public class xe_TokenizerAuto
extends xe_Tokenizer

An xe_Tokenizer Perform which uses an approach to parsing the next token different to xe_Tokenizer. This approach uses the definition of each keyword in xe_TokenType to identify when the token has been parsed.

Auto-parsing in this way has turned out to be very slow - which is why this functionality has been relegated to a separate class. However, it can be reinstated simply by instantiating this class instead of xe_Tokenizer for low-level parsing.

##

xe_TokenizerAuto()
  Default constructor.

##

parseNextToken(boolean)
  Parse the next token.

##

xe_TokenizerAuto

     public xe_TokenizerAuto()

  Default constructor.

##

parseNextToken

     public xe_Token parseNextToken(boolean InputConsumeWhitespaceFlag) throws xm_ParseException, IOException

  Parse the next token. Overrides ParseNextToken() from xe_Tokenizer.

  Parameters:
    InputConsumeWhitespaceFlag - If true, all preceding whitespace is separated; otherwise, it is treated as part of the token itself
  Returns:
    Token representing the value parsed
  Throws: xm_ParseException
    Something was parsed which didn't fit the parse rules
  Throws: IOException
    Error reading from source reader
  Overrides:
    parseNextToken in class xe_Tokenizer

    All Packages  Class Hierarchy  This Package  Previous  Next  Index