Re: Languages with optional spaces

So it seems the most basic answer is "no, it won't do that". Perhaps this should be a feature? "Tokens are immediate terminals" or somesuch.


I originally chose flex/bison because it is widely available on almost any platform (although on Windows it is sub-optimal) and I found a reasonable BASIC starting point online.


In any event, it does seem the practical solution is to make my own lexer. Luckily there are any number that exist already in cross-platform form.


Perhaps you all have some starting points I should look at? I'm most interested in plain C although I am definitely going to look at Jerry's code.
[Writing a lexer for Basic shouldn't be very hard since the token structure is pretty straightforward. The hardest part
is being sure you detect and deal with invalid input in all the places it can occur. C lexers tend to be loops with
big switch statements on the input characters, and you need to remember to have a default in all of them. -John]

Return to the comp.compilers page.
Search the comp.compilers archives again.