This is a lexer implementation for a simple, C-like language, created for Rosetta Code. See http://www.rosettacode.org/wiki/Compiler/lexical_analyzer.
Direct link: http://www.rosettacode.org/wiki/Compiler/lexical_analyzer#C.2B.2B
Copyright (c) 2020 Mike Castillo
This code is licensed under the MIT License or the GNU Free Documentation License 1.2, as is most appropriate for your use. Code posted on Rosetta Code is required to use the GFDL license. See LICENSE.MIT and LICENSE.GFDL for the full terms.