You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
would like to know, how to use "sagemaker.workflow.quality_check_step.ModelQualityCheckConfig" for a Logistic Regression problem. In this link: sagemaker-pipeline-model-monitor-clarify-steps.ipynb, there is an example that shows how to use this class in a regression problem.
But my case is different because I'm using a XGBoost Classifier that uses binary:logistic as objective function, this model gives my the probability of having a possitive class.
The results of the batch transform step of my use cases look like the following:
The first column is the label values and the second is the inferences of the model.
So, I don't know how to use this class (ModelQualityCheckConfig) for a binary classification problem like my case. Is there a way in which I can specify a threshold for the predictions or something like that?
And of course the processing job failed because It says that the inference values have too many classes and this is because those values are the probabilities and not just 0 or 1.
I would like to know if there is a way in which I can specify a threshold for the predictions.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
would like to know, how to use "sagemaker.workflow.quality_check_step.ModelQualityCheckConfig" for a Logistic Regression problem. In this link: sagemaker-pipeline-model-monitor-clarify-steps.ipynb, there is an example that shows how to use this class in a regression problem.
Regression example
But my case is different because I'm using a XGBoost Classifier that uses binary:logistic as objective function, this model gives my the probability of having a possitive class.
The results of the batch transform step of my use cases look like the following:
Output of the batch transform step of my use case
The first column is the label values and the second is the inferences of the model.
So, I don't know how to use this class (ModelQualityCheckConfig) for a binary classification problem like my case. Is there a way in which I can specify a threshold for the predictions or something like that?
I tried something like this:
First try
And of course the processing job failed because It says that the inference values have too many classes and this is because those values are the probabilities and not just 0 or 1.
I would like to know if there is a way in which I can specify a threshold for the predictions.
Beta Was this translation helpful? Give feedback.
All reactions