|

Utf8Tokenizer.hpp File Reference

Tokenizer with UTF-8 support header. More...

#include "ionflux/Utf8TokenTypeMap.hpp"
#include "ionflux/ManagedObject.hpp"

Include dependency graph for Utf8Tokenizer.hpp:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Namespaces
namespace	Ionflux
namespace	Ionflux::Tools
Classes
struct	Ionflux::Tools::Utf8Token
	A token for the UTF-8 tokenizer. More...
class	Ionflux::Tools::Utf8TokenizerClassInfo
	Class information for class Utf8Tokenizer. More...
class	Ionflux::Tools::Utf8Tokenizer
	Tokenizer with UTF-8 support. More...

---

Detailed Description

Tokenizer with UTF-8 support header.

---