You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
A clear and concise description of what the bug is. create_report crashes for large DataFrames with almost empty string columns with the error 'Series' object has no attribute 'len'
After investigation, I found out that an error occurs in the calculation of the mean length of the elements in method _calc_nom_stats. It is caused by a partition containing only NaN values which are in the method nom_comps dropped which causes an empty Dask partition to be created. Afterward when compute is called an error is raised.
Expected behavior
A clear and concise description of what you expected to happen.
During the create_report calculations empty partitions should be handled. Particularly in method nom_comps empty partitions should be dropped after calling srs = srs.dropna()
Desktop (please complete the following information):
OS: Linux Ubuntu 22.04 LTS
Platform Python script
Python Version 3.8.16
Dataprep Version: 0.4.5
The text was updated successfully, but these errors were encountered:
Describe the bug
A clear and concise description of what the bug is.
create_report
crashes for large DataFrames with almost emptystring
columns with the error'Series' object has no attribute 'len'
After investigation, I found out that an error occurs in the calculation of the mean length of the elements in method
_calc_nom_stats
. It is caused by a partition containing onlyNaN
values which are in the methodnom_comps
dropped which causes an empty Dask partition to be created. Afterward when compute is called an error is raised.To Reproduce
Expected behavior
A clear and concise description of what you expected to happen.
During the
create_report
calculations empty partitions should be handled. Particularly in methodnom_comps
empty partitions should be dropped after callingsrs = srs.dropna()
Desktop (please complete the following information):
The text was updated successfully, but these errors were encountered: