Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pipes] consider generating Pipes JSON schemas from Pydantic models #27449

Open
danielgafni opened this issue Jan 30, 2025 · 0 comments
Open

Comments

@danielgafni
Copy link
Contributor

What's the use case?

Pydantic has this nice feature for generating JSON schemas from models.

It sounds like it would be a very good way to define Pipes types.

To be clear, the Python dagster-pipes package won't have to depend on pydantic. It would only be used to generate the schemas, which in turn could be used to implement and validate Pipes data structures across all programming languages.

Ideas of implementation

Should be straightforward

Additional information

Currently the JSON schemas live here. They should be moved to the main repo so that we can use them inside Dagster itself.

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

cc @cmpadden @marijncv @schrockn

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant