Feature selection caused more overfitting2019 Community Moderator ElectionHow does SelectKBest() perform feature selection?Sklearn feature selection stopping criterion (SelectFromModel)Feature selection where adding features are deteriorating modelFeature reduction conveniencevalidation_curve differs from cross_val_score?why the RFE to select features is changing when the os or computer is changedHow can I improve my regression model?Overfitting problem in modelWhen to perform feature selection, how, and how does data affect choosing the predictive model?Manual feature engineering based on the output
Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?
Linear Path Optimization with Two Dependent Variables
Java Casting: Java 11 throws LambdaConversionException while 1.8 does not
Why is 150k or 200k jobs considered good when there's 300k+ births a month?
How does one intimidate enemies without having the capacity for violence?
Mortgage Pre-approval / Loan - Apply Alone or with Fiancée?
Languages that we cannot (dis)prove to be Context-Free
Why doesn't H₄O²⁺ exist?
What's the point of deactivating Num Lock on login screens?
What does it mean to describe someone as a butt steak?
Paid for article while in US on F-1 visa?
if condition in the past
What is the word for reserving something for yourself before others do?
Why is consensus so controversial in Britain?
Is it unprofessional to ask if a job posting on GlassDoor is real?
Can I ask the recruiters in my resume to put the reason why I am rejected?
Why does Kotter return in Welcome Back Kotter?
Alternative to sending password over mail?
Could an aircraft fly or hover using only jets of compressed air?
How to regain access to running applications after accidentally zapping X.org?
Can a vampire attack twice with their claws using multiattack?
How old can references or sources in a thesis be?
Replacing matching entries in one column of a file by another column from a different file
Can you really stack all of this on an Opportunity Attack?
Feature selection caused more overfitting
2019 Community Moderator ElectionHow does SelectKBest() perform feature selection?Sklearn feature selection stopping criterion (SelectFromModel)Feature selection where adding features are deteriorating modelFeature reduction conveniencevalidation_curve differs from cross_val_score?why the RFE to select features is changing when the os or computer is changedHow can I improve my regression model?Overfitting problem in modelWhen to perform feature selection, how, and how does data affect choosing the predictive model?Manual feature engineering based on the output
$begingroup$
What does it mean if I used sklearn.feature_selection.SelectFromModel to select features and cross-validation score went up but the testset score went down. This was even more significant compared to when I did not use feature selection.
Does this mean it's causing more overfitting?
I thought feature selection is used to reduce overfitting.
machine-learning
edited Mar 28 at 11:48
thanatoz
569319
asked Mar 27 at 23:03
edunlimitedunlimit
224
$endgroup$
add a comment |
$begingroup$
What does it mean if I used sklearn.feature_selection.SelectFromModel to select features and cross-validation score went up but the testset score went down. This was even more significant compared to when I did not use feature selection.
Does this mean it's causing more overfitting?
I thought feature selection is used to reduce overfitting.
machine-learning
edited Mar 28 at 11:48
thanatoz
569319
asked Mar 27 at 23:03
edunlimitedunlimit
224
$endgroup$
add a comment |
$begingroup$
What does it mean if I used sklearn.feature_selection.SelectFromModel to select features and cross-validation score went up but the testset score went down. This was even more significant compared to when I did not use feature selection.
Does this mean it's causing more overfitting?
I thought feature selection is used to reduce overfitting.
machine-learning
edited Mar 28 at 11:48
thanatoz
569319
asked Mar 27 at 23:03
edunlimitedunlimit
224
$endgroup$
What does it mean if I used sklearn.feature_selection.SelectFromModel to select features and cross-validation score went up but the testset score went down. This was even more significant compared to when I did not use feature selection.
Does this mean it's causing more overfitting?
I thought feature selection is used to reduce overfitting.
machine-learning
machine-learning
edited Mar 28 at 11:48
thanatoz
569319
asked Mar 27 at 23:03
edunlimitedunlimit
224
edited Mar 28 at 11:48
thanatoz
569319
asked Mar 27 at 23:03
edunlimitedunlimit
224
edited Mar 28 at 11:48
thanatoz
569319
edited Mar 28 at 11:48
thanatoz
569319
edited Mar 28 at 11:48
thanatoz
569319
569319
asked Mar 27 at 23:03
edunlimitedunlimit
224
asked Mar 27 at 23:03
edunlimitedunlimit
224
asked Mar 27 at 23:03
edunlimitedunlimit
224
224
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48115%2ffeature-selection-caused-more-overfitting%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48115%2ffeature-selection-caused-more-overfitting%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
