On 7 Apr 2016, at 3:31, fukurokujo wrote: > The whole grammar system should really be changed to some BNF, EBNF > kinda parser system. > Regex should never be used for grammars. So how would you define a token, if not by using a regex?