index
plain_tokenizer<Fcn>
Defined in header file:  plain_tokenizer.hh

Description

A plain tokenizer ...

Example

    plain_tokenizer<> t("Hello, World! This is a message.");

    plain_tokenizer<>::iterator it = t.begin();
    for (; it != t.end(); ++it) {
        cout << *it << endl;
    }

    The output is:
    Hello
    World
    This
    is
    a
    message
  

Public base classes

_tokenizer_base

Template parameters

Parameter	Description	Default
Fcn		PlainTokenChar

Constructors

Constructor	Description
plain_tokenizer(const char* s)	Creates a tokenizer for the given plain text s.
plain_tokenizer(const char* s, Fcn f)	Creates a tokenizer for the given plain text s ...
plain_tokenizer(const plain_tokenizer& t)	Copy constructor.

Members

Types	Description
size_type	An unsigned integral type.
char_verify	XXX
iterator	Iterator to iterate through the tokens.
const_iterator	Const iterator to iterate through the tokens.
Methods
plain_tokenizer&  operator=(const plain_tokenizer& t)	The assignment operator.
iterator  begin()	Returns an iterator pointing to the first token.
const_iterator  begin()   const	Returns an const iterator pointing to the first token.
iterator  end()	Returns a const iterator pointing to the end.
const_iterator  end()   const	Returns a const iterator pointing to the end.

index