Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

improve Token::List with different types: numbered, unordered #18

Closed
theiskaa opened this issue Nov 20, 2024 · 0 comments · Fixed by #20
Closed

improve Token::List with different types: numbered, unordered #18

theiskaa opened this issue Nov 20, 2024 · 0 comments · Fixed by #20
Assignees
Labels
bug Something isn't working feature New feature or request

Comments

@theiskaa
Copy link
Owner

theiskaa commented Nov 20, 2024

The current implementation of the Markdown tokenizer has limited support for parsing list items. At present, it only recognizes unordered lists that use - as the list marker. For example, the following is successfully tokenized:

- Item 1  
- Item 2  

However, the tokenizer does not support ordered lists, which are an essential feature of Markdown. This includes lists using numeric markers followed by a period, such as:

1. First item  
2. Second item  
3. Third item  

Expected Behavior

The tokenizer should be able to recognize and generate tokens for both unordered and ordered lists, ensuring consistent handling of list structures. This includes:

  • Ordered lists with numeric markers (e.g., 1., 2.).
  • Lists with varying indentation levels to support nested lists (both ordered and unordered).

Impact

Currently, ordered lists are entirely ignored or misinterpreted during tokenization. This limits the functionality and correctness of the Markdown parser, leading to incomplete rendering in downstream applications such as PDF generation or HTML rendering.

@theiskaa theiskaa added bug Something isn't working feature New feature or request labels Nov 20, 2024
@theiskaa theiskaa self-assigned this Nov 23, 2024
@theiskaa theiskaa mentioned this issue Nov 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working feature New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant