You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should create a take_into(array, indices, builder) compute function.
When decoding/canonicalizing a dictionary we use take(values, indices) We can do better if we have a way to store the taken values in a builder take_into(array, indices, builder).
If we have a dictionary where the codes are value are primitive and the bit_width(codes) <= bit_width(values) we could allocate bit_width(values) and widen each code into bit_width(values) and then on a second pass replace codes with value without a second allocation.
If we have a chunked of dictionary, we can unpack each chunk into the same builder, which remove the second copy when decoding a dict
The text was updated successfully, but these errors were encountered:
We should create a
take_into(array, indices, builder)
compute function.When decoding/canonicalizing a dictionary we use
take(values, indices)
We can do better if we have a way to store the taken values in a buildertake_into(array, indices, builder)
.If we have a dictionary where the codes are value are primitive and the
bit_width(codes) <= bit_width(values)
we could allocate bit_width(values) and widen each code into bit_width(values) and then on a second pass replace codes with value without a second allocation.If we have a chunked of dictionary, we can unpack each chunk into the same builder, which remove the second copy when decoding a dict
The text was updated successfully, but these errors were encountered: