You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
We will not be perfect in everything that we do, but we should be close enough that that we can enable most of from_json and json scan by default. There are still outstanding issues that prevent us from enabling all config options and all data types in all versions of Spark. There are also some odd corner cases that we need to at least document how we are different. We should also provide some configs to enable and disable data types individually.
Things that must be fixed before we can enable from_json and json scan by default
Is your feature request related to a problem? Please describe.
We will not be perfect in everything that we do, but we should be close enough that that we can enable most of from_json and json scan by default. There are still outstanding issues that prevent us from enabling all config options and all data types in all versions of Spark. There are also some odd corner cases that we need to at least document how we are different. We should also provide some configs to enable and disable data types individually.
Things that must be fixed before we can enable from_json and json scan by default
cudf::read_json
incorrectly parses invalid JSON string rapidsai/cudf#16999cudf::io::json::detail::normalize_single_quotes
outputs incorrect result when the input has\n
character rapidsai/cudf#17261Types that we do not support by default:
from_json
#9664from_json
(Spark 3.1.x only) #9724from_json
#9664from_json
(Spark 3.1.x only) #9724Configs that we do not support by default:
Things that must be documented as corner cases:
read_json
does not output null list when the input is a list with different data type than the specified schema rapidsai/cudf#17349The text was updated successfully, but these errors were encountered: