Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to use custom delimiters #91

Merged

Commits on Jul 5, 2018

  1. Move and rename delimiter and comment consts to the top

    This also adds these consts to the lexer struct when calling the
    constructor.
    annismckenzie committed Jul 5, 2018
    Configuration menu
    Copy the full SHA
    b916e66 View commit details
    Browse the repository at this point in the history
  2. Add boolean run to the lexer constructor to enable delayed lexing

    In order to be able to set custom delimiters it's necessary to
    explicitly tell it to start the lexing process. This change is
    backwards compatible, albeit it's also internal because the lexer
    isn't exported.
    annismckenzie committed Jul 5, 2018
    Configuration menu
    Copy the full SHA
    f0b53fe View commit details
    Browse the repository at this point in the history
  3. Allow lexing using custom delimiters

    This includes unit tests – the same ones that were already there,
    just with different delimiters.
    annismckenzie committed Jul 5, 2018
    Configuration menu
    Copy the full SHA
    e71a709 View commit details
    Browse the repository at this point in the history
  4. Enable a Set to have custom delimiters

    This includes an integration test.
    annismckenzie committed Jul 5, 2018
    Configuration menu
    Copy the full SHA
    4e11fa6 View commit details
    Browse the repository at this point in the history