slogo.jelan.parser
Class Tokenizer

java.lang.Object
  extended by java.io.StreamTokenizer
      extended by slogo.jelan.parser.Tokenizer

public class Tokenizer
extends java.io.StreamTokenizer

A tokenizer for the SLogo programming language. Inherits from the StreamTokenizer, which is a concrete class, but it's unlikely to change.

Author:
Sara Sprenkle

Field Summary
 
Fields inherited from class java.io.StreamTokenizer
nval, sval, TT_EOF, TT_EOL, TT_NUMBER, TT_WORD, ttype
 
Constructor Summary
Tokenizer(java.io.Reader reader)
           
 
Method Summary
 
Methods inherited from class java.io.StreamTokenizer
commentChar, eolIsSignificant, lineno, lowerCaseMode, nextToken, ordinaryChar, ordinaryChars, parseNumbers, pushBack, quoteChar, resetSyntax, slashSlashComments, slashStarComments, toString, whitespaceChars, wordChars
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, wait, wait, wait
 

Constructor Detail

Tokenizer

public Tokenizer(java.io.Reader reader)