Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Differentiate multiple "internal" token types from single TokenTypes #563

Open
siggemannen opened this issue Jul 18, 2024 · 0 comments
Open

Comments

@siggemannen
Copy link

siggemannen commented Jul 18, 2024

Hello, i have been using some custom TokenMaker that parses some code and spits out a list of tokens which are then converted to RSTA's internal TokenTypes. Now, i have a need when calling getTokenListForLine to differentiate the tokens returned, for example: 'string' and N'nstring' in sql are both TokenType.LITERAL_CHAR, but i want to know if the string is nationalized or not.

This is not needed for painting things differently but rather when doing auto-completion etc, i need to get the "detailed" token types somehow. Is there a good way to do it, i don't see anything useful in TokenImpl and i'd rather not start subclassing that either, but perhaps it's the only choice?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant