refactor(experimental): add support for variable-sized items in remainder-sized codecs

[lorisleiva]

This PR allows Array, Map and Set codecs of "remainder" size to have variable-size items (as recently updated on Umi's serializers).

These array-like codecs support the following three configurable size strategies:

• { size: 42 } means a fixed-size array of 42 items.
• { size: getU32Codec() } means the array is prefixed by a u32 number storing its number of items.
• { size: "remainder" } means the remainder of the bytes should be used to encode and/or decode the items inside the array.

Prior to this PR, we were enforcing arrays of "remainder" size to have fixed-size items. This allowed us to pre-compute the size of the array by dividing the size of what's left in the bytes by the fixed size of its item codec. If the modulo of that division was not zero, we would throw an error.

However, this restriction is not actually necessary and prevents valid use cases. This PR lifts this restriction and allows arrays of "remainder" size to have variable-size items. When decoding the bytes, instead of pre-computing the size of the array, we simply decode the rest of the bytes continuously until we've reached the end of the bytes. If anything goes wrong during that process, the item codec will throw an error as it won't get the expected number of bytes.

[lorisleiva]

Current dependencies on/for this PR:

• master
  • PR refactor(experimental): add support for variable-sized items in remainder-sized codecs #2020 👈

This stack of pull requests is managed by Graphite.

[buffalojoec]

Nice! This sheds a lot of code!

[github-actions]

🎉 This PR is included in version 1.89.0 🎉

The release is available on:

• npm package (@latest dist-tag)
• GitHub release

Your semantic-release bot 📦🚀

[github-actions]

Because there has been no activity on this PR for 14 days since it was merged, it has been automatically locked. Please open a new issue if it requires a follow up.