Context-Sensitive Tokenization, Next Installment, Activating and De-activating Tokens
Sometimes, when you complete a major code cleanup, features that were previously pie in the sky become low-hanging fruit to pluck. The new feature that I describe here, the ability to activate and deactivate tokens is such a case. It resulted from my rewriting of the lexical code generation that I describe here. In an …
Context-Sensitive Tokenization, Next Installment, Activating and De-activating Tokens Read More »