Announcement: Parsing text inclusions with TextTransformer 1.1.0

Detlef Meyer-Eltz <>
27 Mar 2006 01:28:10 -0500

          From comp.compilers

Related articles
Announcement: Parsing text inclusions with TextTransformer 1.1.0 (Detlef Meyer-Eltz) (2006-03-27)
| List of all articles for this month |

From: Detlef Meyer-Eltz <>
Newsgroups: comp.compilers
Date: 27 Mar 2006 01:28:10 -0500
Organization: Compilers Central
Keywords: tools
Posted-Date: 27 Mar 2006 01:28:10 EST

TextTransformer 1.1.0 - a parser generator IDE - just has been
released. It has the new ability, to parse text inclusions. Inclusions
are sections of text, which can appear everywhere between two tokens
in the text without destroying the syntax of the whole text. Typical
examples are comments in programming languages or processing

In the previous versions of TextTransformer such inclusions only could
be recognized as a whole by complex regular expressions. Now they can
be parsed and processed in detail by a second (or third ...) parser,
which is managed in the same project as the main parser. A common
inclusion parser can be used for all productions of the main parser or
individual inclusion parsers can be set for each production. So for
the productions of an inclusion parser the same or another (start rule
of a) parser can be set for parsing inclusions of the inclusion:
inclusion parsers can be stacked, If for example a comment production
is set in itself, you get a parser for a nested comment.

Text inclusions can be parsed with token sets, which are different
from that of the main parser. So, a systematic concept for the change
of lexical states was introduced. This concept was extended to the
other uses of productions already existing in the TextTransformer.
Look-ahead productions, and productions for sub-parsers, callable in
semantic actions, also can operate on own token sets now. For more
details see: -> Algorithms -> Token

or in German -> Algorithmen ->

In the visual development environment of TextTransformer you can test
such inclusion-parsers in the same manner as used for the productions
of the main parser: you can step through the nodes of the syntax tree,
you can set breakpoints in the tree or in the source text and you can
execute text transformations on single files or on groups of files.

TextTransformer home page:



Detlef Meyer-Eltz

Post a followup to this message

Return to the comp.compilers page.
Search the comp.compilers archives again.