Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sphinx Doc-comments support #804

Open
wants to merge 57 commits into
base: master
Choose a base branch
from
Open

Conversation

tristanlatr
Copy link
Contributor

Fixes #800

tristanlatr and others added 15 commits May 20, 2022 02:49
This attribute was used to attach the right docstring node to the right Attribute object. Now it uses AST node navigation (with the .parent attribute) instead for fetching the docstring node for an ast.Assign.

This change might not be worth it, on the one hand it removes a attribute beeing mutated at different palces in the code, but replaces this kind of "unsafe" state tracking (meaning not with pop() and push()) by some more verbose solution that involves adding the .parent attribute on all nodes.

The zopeinferface extension needed to be adjusted as well because it relied on the docstring assigment feature in an implicit way, now it's explicit what we're doing.
…hpinx... Refactor for a better separation of docstring sources. And add a test.
@tristanlatr
Copy link
Contributor Author

@lod, this PR introduces support for doc-comments

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@tristanlatr
Copy link
Contributor Author

This code obviously has a bug (the pydoctor_primer diff makes no sens)... Still to be worked on...

@tristanlatr tristanlatr marked this pull request as draft July 8, 2024 20:55
@tristanlatr tristanlatr changed the title Doc-comments support Sphinx Doc-comments support Aug 20, 2024

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@tristanlatr tristanlatr removed the pending This ticket needs code related to another ticket not yet fixed label Sep 22, 2024
@tristanlatr tristanlatr requested a review from a team September 22, 2024 23:54
@tristanlatr
Copy link
Contributor Author

please review

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link

Diff from pydoctor_primer, showing the effect of this PR on open source code:

pydoctor (https://github.com/twisted/pydoctor)
+ /projects/pydoctor/pydoctor/epydoc/markup/restructuredtext.py:64: Existing docstring at line 31 is overriden

scrapy (https://github.com/scrapy/scrapy)
+ /projects/scrapy/scrapy/item.py:80: bad docstring: No role entry for "ref" in module "docutils.parsers.rst.languages.en".
+ Trying "ref" as canonical role name.
+ /projects/scrapy/scrapy/item.py:80: bad docstring: Unknown interpreted text role "ref".
- these 30 objects' docstrings contain syntax errors:
+ these 31 objects' docstrings contain syntax errors:
+     scrapy.Item.fields

bottle (https://github.com/bottlepy/bottle)
+ /projects/bottle/bottle.py:4603: Cannot find link target for "bottle_sqlite"
+ /projects/bottle/bottle.py:2207: Cannot find link target for "latin1"

sphinx (https://github.com/sphinx-doc/sphinx)
+ /projects/sphinx/sphinx/locale/__init__.py:220: bad docstring: No role entry for "confval" in module "docutils.parsers.rst.languages.en".
+ Trying "confval" as canonical role name.
+ /projects/sphinx/sphinx/locale/__init__.py:220: bad docstring: Unknown interpreted text role "confval".
+ /projects/sphinx/sphinx/ext/autodoc/__init__.py:69: bad docstring: Literal block expected; none found.
+ /projects/sphinx/sphinx/project.py:33: bad docstring: No role entry for "confval" in module "docutils.parsers.rst.languages.en".
+ Trying "confval" as canonical role name.
+ /projects/sphinx/sphinx/project.py:33: bad docstring: Unknown interpreted text role "confval".
+ /projects/sphinx/sphinx/transforms/post_transforms/images.py:194: bad docstring: No directive entry for "todo" in module "docutils.parsers.rst.languages.en".
+ Trying "todo" as canonical directive name.
+ /projects/sphinx/sphinx/transforms/post_transforms/images.py:194: bad docstring: Unknown directive type "todo"... todo:: This should be refactored not to store the state without class
+           variable.
+ /projects/sphinx/sphinx/ext/intersphinx/_shared.py:36: bad docstring: No role entry for "confval" in module "docutils.parsers.rst.languages.en".
+ Trying "confval" as canonical role name.
+ /projects/sphinx/sphinx/ext/intersphinx/_shared.py:36: bad docstring: Unknown interpreted text role "confval".
+ /projects/sphinx/sphinx/addnodes.py:299: Cannot find link target for "_sig_element=True"
+ /projects/sphinx/sphinx/builders/__init__.py:84: Cannot find link target for "~.Builder.write_doc" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:84: Cannot find link target for "~.Builder.write_doc" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:84: Cannot find link target for "~.Builder.write_doc" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:84: Cannot find link target for "~.Builder.write_doc" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:84: Cannot find link target for "~.Builder.write_doc" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:79: Cannot find link target for "~sphinx.application.Sphinx.set_translator" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/builders/__init__.py:70: Cannot find link target for ".SphinxPostTransform" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/domains/__init__.py:106: Cannot find link target for "self.data" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/ext/intersphinx/_shared.py:29: Cannot find link target for "~sphinx.builder.html.INVENTORY_FILENAME" (you can link to external docs with --intersphinx)
+ /projects/sphinx/sphinx/locale/__init__.py:223: Cannot find link target for "LC_ALL"
+ /projects/sphinx/sphinx/locale/__init__.py:223: Cannot find link target for "LC_MESSAGES"
- these 65 objects' docstrings contain syntax errors:
+ these 70 objects' docstrings contain syntax errors:
+     sphinx.ext.autodoc.py_ext_sig_re
+     sphinx.ext.intersphinx._shared.IntersphinxMapping
+     sphinx.locale._
+     sphinx.project.Project.source_suffix
+     sphinx.transforms.post_transforms.images.ImageConverter.available

numpy (https://github.com/numpy/numpy)
+ /projects/numpy/numpy/typing/mypy_plugin.py:118: Cannot find link target for "numpy._core.intp", resolved from "np.intp"
+ /projects/numpy/numpy/typing/mypy_plugin.py:115: Cannot find link target for "numpy._core.number", resolved from "np.number"

@tristanlatr
Copy link
Contributor Author

I’de prefer if the implementation was using ast-comments so the astbuilder code is not mixed with token processing code…

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add support for doc comments
1 participant