Decomposing R^2 into independent variables The 2019 Stack Overflow Developer Survey Results Are InQuasi-categorical variables - any ideas?How exactly dependent variable is expressed in terms of independent variables using Partial Least Square Regression Method?How to decide power of independent variables in case of non-linear polynomial regression?Using Decision Tree methodology to identify Independent Variables for Multiple RegressionTransformation of independent variables in regression (Measurement Error)How do I define my feature variablesRegression turned into classifficationRegression model for continuous dependent variable and count independent variablesReducing the dependency between variablesDistribution function of observations in the errors-in-variables model
How can I refresh a custom data tab in the contact summary?
If I can cast sorceries at instant speed, can I use sorcery-speed activated abilities at instant speed?
Outer glow on 3 sides of a rectangular shape
Why isn't the circumferential light around the M87 black hole's event horizon symmetric?
Command for nulifying spaces
Balance problems for leveling up mid-fight?
How to display lines in a file like ls displays files in a directory?
Proving Trigonometric “Definitions”
What are the motivations for publishing new editions of an existing textbook, beyond new discoveries in a field?
Did any laptop computers have a built-in 5 1/4 inch floppy drive?
What to do when moving next to a bird sanctuary with a loosely-domesticated cat?
Right tool to dig six foot holes?
How to type this arrow in math mode?
Omit the same coordinate parameters in drawing line in tikz
The phrase "to the numbers born"?
How to support a colleague who finds meetings extremely tiring?
How much of the clove should I use when using big garlic heads?
Sums of normal random variables
What does Linus Torvalds mean when he says that Git "never ever" tracks a file?
What is the motivation for a law requiring 2 parties to consent for recording a conversation
Old scifi movie from the 50s or 60s with men in solid red uniforms who interrogate a spy from the past
Why can't devices on different VLANs, but on the same subnet, communicate?
I am eight letters word. Find me who Am I?
Is an up-to-date browser secure on an out-of-date OS?
Decomposing R^2 into independent variables
The 2019 Stack Overflow Developer Survey Results Are InQuasi-categorical variables - any ideas?How exactly dependent variable is expressed in terms of independent variables using Partial Least Square Regression Method?How to decide power of independent variables in case of non-linear polynomial regression?Using Decision Tree methodology to identify Independent Variables for Multiple RegressionTransformation of independent variables in regression (Measurement Error)How do I define my feature variablesRegression turned into classifficationRegression model for continuous dependent variable and count independent variablesReducing the dependency between variablesDistribution function of observations in the errors-in-variables model
$begingroup$
Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.
I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.
One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.
My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).
I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.
regression
$endgroup$
add a comment |
$begingroup$
Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.
I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.
One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.
My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).
I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.
regression
$endgroup$
$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25
add a comment |
$begingroup$
Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.
I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.
One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.
My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).
I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.
regression
$endgroup$
Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.
I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.
One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.
My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).
I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.
regression
regression
asked Mar 29 at 17:28
Jun JangJun Jang
1224
1224
$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25
add a comment |
$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25
$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25
$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48226%2fdecomposing-r2-into-independent-variables%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48226%2fdecomposing-r2-into-independent-variables%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25