binary classification for time series data2019 Community Moderator ElectionHow to merge monthly, daily and weekly data?Time series data: How I measure influence of new product sales on existing product sales (statistically)?What is a better approach for cross-validation with time-related predictorsHow do I find a repeating pattern of unknown length and start within a stringTime series finance -Correlation between a sector and MSCI ACWI returnsbinary classification for counting - estimating the error on counts due to error on prediction scoreDefining Input Shape for Time Series using LSTM in KerasDe-noising/removing measurement error from time series with very few observationsMultivariate Time Series Binary ClassificationBinary classification with time-series features
How can I kill an app using Terminal?
Return the Closest Prime Number
Gears on left are inverse to gears on right?
How long to clear the 'suck zone' of a turbofan after start is initiated?
Why didn't Theresa May consult with Parliament before negotiating a deal with the EU?
A particular customize with green line and letters for subfloat
How do I find the solutions of the following equation?
What can we do to stop prior company from asking us questions?
Why escape if the_content isnt?
Implement the Thanos sorting algorithm
Is it appropriate to ask a job candidate if we can record their interview?
Large drywall patch supports
How to pronounce the slash sign
How to write papers efficiently when English isn't my first language?
How does buying out courses with grant money work?
Is this apparent Class Action settlement a spam message?
How do I rename a Linux host without needing to reboot for the rename to take effect?
Integer addition + constant, is it a group?
How does Loki do this?
Class Action - which options I have?
Unreliable Magic - Is it worth it?
System.debug(JSON.Serialize(o)) Not longer shows full string
Is exact Kanji stroke length important?
Is there a problem with hiding "forgot password" until it's needed?
binary classification for time series data
2019 Community Moderator ElectionHow to merge monthly, daily and weekly data?Time series data: How I measure influence of new product sales on existing product sales (statistically)?What is a better approach for cross-validation with time-related predictorsHow do I find a repeating pattern of unknown length and start within a stringTime series finance -Correlation between a sector and MSCI ACWI returnsbinary classification for counting - estimating the error on counts due to error on prediction scoreDefining Input Shape for Time Series using LSTM in KerasDe-noising/removing measurement error from time series with very few observationsMultivariate Time Series Binary ClassificationBinary classification with time-series features
$begingroup$
I am a new to data science and I really appreciate any feedback on this problem.
I have a dataset with 450 subjects. A binary response (yes/no) is measured every week on each subject for a total of 104 weeks and the average proportion of events is 30%. Also, about 2000 features are measured each week from each subject to predict the weekly response. My questions are:
1- What is the best model to fit this data?
My concern about using machine learning models such as Random Forest or XGboost is that those models rely on the assumption that the analyzed data are independent and identically distributed (i.i.d.) which is not the case here because of the temporal correlation.
2- How do I split my data to train/test sets? For example, do I use only 350 subjects with 104w of data for training and 100 subjects with 104w for test set? Or use only 80 weeks of data for 450 subjects for training and 24w for 450 subjects as test set?
Thanks
classification time-series
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
I am a new to data science and I really appreciate any feedback on this problem.
I have a dataset with 450 subjects. A binary response (yes/no) is measured every week on each subject for a total of 104 weeks and the average proportion of events is 30%. Also, about 2000 features are measured each week from each subject to predict the weekly response. My questions are:
1- What is the best model to fit this data?
My concern about using machine learning models such as Random Forest or XGboost is that those models rely on the assumption that the analyzed data are independent and identically distributed (i.i.d.) which is not the case here because of the temporal correlation.
2- How do I split my data to train/test sets? For example, do I use only 350 subjects with 104w of data for training and 100 subjects with 104w for test set? Or use only 80 weeks of data for 450 subjects for training and 24w for 450 subjects as test set?
Thanks
classification time-series
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
I am a new to data science and I really appreciate any feedback on this problem.
I have a dataset with 450 subjects. A binary response (yes/no) is measured every week on each subject for a total of 104 weeks and the average proportion of events is 30%. Also, about 2000 features are measured each week from each subject to predict the weekly response. My questions are:
1- What is the best model to fit this data?
My concern about using machine learning models such as Random Forest or XGboost is that those models rely on the assumption that the analyzed data are independent and identically distributed (i.i.d.) which is not the case here because of the temporal correlation.
2- How do I split my data to train/test sets? For example, do I use only 350 subjects with 104w of data for training and 100 subjects with 104w for test set? Or use only 80 weeks of data for 450 subjects for training and 24w for 450 subjects as test set?
Thanks
classification time-series
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
I am a new to data science and I really appreciate any feedback on this problem.
I have a dataset with 450 subjects. A binary response (yes/no) is measured every week on each subject for a total of 104 weeks and the average proportion of events is 30%. Also, about 2000 features are measured each week from each subject to predict the weekly response. My questions are:
1- What is the best model to fit this data?
My concern about using machine learning models such as Random Forest or XGboost is that those models rely on the assumption that the analyzed data are independent and identically distributed (i.i.d.) which is not the case here because of the temporal correlation.
2- How do I split my data to train/test sets? For example, do I use only 350 subjects with 104w of data for training and 100 subjects with 104w for test set? Or use only 80 weeks of data for 450 subjects for training and 24w for 450 subjects as test set?
Thanks
classification time-series
classification time-series
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
asked Mar 21 at 4:45
AbuSalimAbuSalim
11
11
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
AbuSalim is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
AbuSalim is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47711%2fbinary-classification-for-time-series-data%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
AbuSalim is a new contributor. Be nice, and check out our Code of Conduct.
AbuSalim is a new contributor. Be nice, and check out our Code of Conduct.
AbuSalim is a new contributor. Be nice, and check out our Code of Conduct.
AbuSalim is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47711%2fbinary-classification-for-time-series-data%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
