Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove program_transformers dependency on plerkle #144

Merged
merged 6 commits into from
Mar 14, 2024

Conversation

fanatid
Copy link
Collaborator

@fanatid fanatid commented Nov 24, 2023

Goal

Enable the development of alternative ingestion engines and event sources for DAS.

How

Building on a prior PR that isolated program_transforms into a separate crate for managing business logic around account categorization, decoding, and saving, this PR extends the generalization of program_transforms. It transitions from using plerkle to native Solana structs for accounts and transactions.

Why

With program_transforms no longer dependent on plerkle, Triton can deploy a new ingester version utilizing dragonmoth, which leverages protobufs for messaging.

Changes

  • Convert program_transforms to be based on solana structs.
  • Use parsers from plerkle_serialization to transform the plerkle structs into solana struct in the ingester.
  • A recent update of blockbuster updates to solana 1.17 so doing the same here. anchor updated to 0.29.

Release Steps

There are 2 dependent PRs that must be merged and crate versions released before this PR.

#143

@fanatid fanatid force-pushed the pt-solana-structs branch 2 times, most recently from 3321cba to c13ad57 Compare December 1, 2023 13:16
@fanatid
Copy link
Collaborator Author

fanatid commented Feb 21, 2024

Updated. Required blockbuster update: metaplex-foundation/blockbuster#38

@kespinola kespinola changed the title remove plerkle from program_transformers Remove program_transformers dependency on plerkle Feb 28, 2024
@kespinola kespinola force-pushed the pt-solana-structs branch 3 times, most recently from 23cb985 to 68a9f12 Compare February 29, 2024 17:17
@WilfredAlmeida
Copy link

Thanks for this separation. We are now using the separated program_transformers in https://github.com/WilfredAlmeida/LightDAS

…allow for converting from plerkle to program transformer strcuts with TryFrom
Copy link
Contributor

@danenbm danenbm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM but left one comment

program_transformers/src/lib.rs Show resolved Hide resolved
@kespinola kespinola merged commit 65baf08 into metaplex-foundation:main Mar 14, 2024
3 checks passed
@kespinola kespinola deleted the pt-solana-structs branch March 14, 2024 20:02
@kespinola kespinola mentioned this pull request Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants