STokenize Class Reference

Public Member Functions
	STokenize (const string s)
void	setBlock (const string &block)
const string &	getBlock ()
void	reset ()
bool	More ()
bool	Fail ()
Token	nextToken ()
	a function that return the nextToken object based if there is no Token to return gives error at mPos, determine the type of the token from char at mPos, find a Pos where the token type does not match if token is unknwon add next unknowns to Dictionary[unknown] update mPos return token, or exception More...
vector< Token >	getTokens ()

Static Public Member Functions
static void	capitalize (string &s)
	Static function that is used to capitalize external string. More...

Friends
STokenize &	operator>> (STokenize &t, string &token)

Member Function Documentation

void STokenize::capitalize ( string &  s )

static

Static function that is used to capitalize external string.

Parameters

external

string

Token STokenize::nextToken

(

)

a function that return the nextToken object based if there is no Token to return gives error at mPos, determine the type of the token from char at mPos, find a Pos where the token type does not match if token is unknwon add next unknowns to Dictionary[unknown] update mPos return token, or exception

Returns

none

---

The documentation for this class was generated from the following files:

• Tokenizer/stokenize.h
• Tokenizer/stokenize.cpp