You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, I am outputting gzipped CSV files for my project using EMR Serverless and the domain maps are different than previously when I used to build the whole frame in memory with all possible domain values for a given categorical. These are predefined for some of the columns and want to retain those predefined domain values and update the categorical indexes accordingly. However, with EMR that is not the case anymore, and when building Frame from the outputted CSV file, the domain values only comprise the actual values in the CSV. So when I try to read the CSV using the ParseSetup I do set the domains for the given categoricals but even after the Frame is built, it still creates the domains from the actual values and not with the provided domains. Can I know how to do it ?? Any help would be greatly appreciated!!
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Currently, I am outputting gzipped CSV files for my project using EMR Serverless and the domain maps are different than previously when I used to build the whole frame in memory with all possible domain values for a given categorical. These are predefined for some of the columns and want to retain those predefined domain values and update the categorical indexes accordingly. However, with EMR that is not the case anymore, and when building Frame from the outputted CSV file, the domain values only comprise the actual values in the CSV. So when I try to read the CSV using the ParseSetup I do set the domains for the given categoricals but even after the Frame is built, it still creates the domains from the actual values and not with the provided domains. Can I know how to do it ?? Any help would be greatly appreciated!!
Beta Was this translation helpful? Give feedback.
All reactions