Re: Languages with optional spaces

On 25/02/2020 19:00, Martin Ward wrote:
> ...So any statement either starts
> with a keyword (a control character), which determines
> the statement type, or it is an assignment with the LET
> keyword omitted...




A scanner generator that supports ie "difference" operators can build a
DFA that splits ie the text FORI to FOR & I without space overhead, if
the reserved keywords are also tokens of the lexer.


The lexical rules below result ie to a DFA with 10 states. Even if I
erase the difference operator "-=" till the end of the document, the
DFA built still has 10 states but the text FORI is returned as an "id".


So, the rules below ensure that an "id" doesn't start with FOR or PRINT,
not sure though if this is what the OP really wanted once he said that
in theory FORI could be a variable (perhaps it can't be just an LHS?).




Ev. Drikos


-----------------------------------------------------------------------
token ::=
                        FOR
            | PRINT
            | id


FOR ::=
                        F O R


PRINT ::=
                        P R I N T


id ::=
                        {A..Z [{$|A .. Z|0 .. 9}...]} -= {key[{$|A .. Z|0..9}...]}


key ::=
                        FOR
            | PRINT

Return to the comp.compilers page.
Search the comp.compilers archives again.