Decomposing R^2 into independent variables The 2019 Stack Overflow Developer Survey Results Are InQuasi-categorical variables - any ideas?How exactly dependent variable is expressed in terms of independent variables using Partial Least Square Regression Method?How to decide power of independent variables in case of non-linear polynomial regression?Using Decision Tree methodology to identify Independent Variables for Multiple RegressionTransformation of independent variables in regression (Measurement Error)How do I define my feature variablesRegression turned into classifficationRegression model for continuous dependent variable and count independent variablesReducing the dependency between variablesDistribution function of observations in the errors-in-variables model

How can I refresh a custom data tab in the contact summary?

If I can cast sorceries at instant speed, can I use sorcery-speed activated abilities at instant speed?

Outer glow on 3 sides of a rectangular shape

Why isn't the circumferential light around the M87 black hole's event horizon symmetric?

Command for nulifying spaces

Balance problems for leveling up mid-fight?

How to display lines in a file like ls displays files in a directory?

Proving Trigonometric “Definitions”

What are the motivations for publishing new editions of an existing textbook, beyond new discoveries in a field?

Did any laptop computers have a built-in 5 1/4 inch floppy drive?

What to do when moving next to a bird sanctuary with a loosely-domesticated cat?

Right tool to dig six foot holes?

How to type this arrow in math mode?

Omit the same coordinate parameters in drawing line in tikz

The phrase "to the numbers born"?

How to support a colleague who finds meetings extremely tiring?

How much of the clove should I use when using big garlic heads?

Sums of normal random variables

What does Linus Torvalds mean when he says that Git "never ever" tracks a file?

What is the motivation for a law requiring 2 parties to consent for recording a conversation

Old scifi movie from the 50s or 60s with men in solid red uniforms who interrogate a spy from the past

Why can't devices on different VLANs, but on the same subnet, communicate?

I am eight letters word. Find me who Am I?

Is an up-to-date browser secure on an out-of-date OS?



Decomposing R^2 into independent variables



The 2019 Stack Overflow Developer Survey Results Are InQuasi-categorical variables - any ideas?How exactly dependent variable is expressed in terms of independent variables using Partial Least Square Regression Method?How to decide power of independent variables in case of non-linear polynomial regression?Using Decision Tree methodology to identify Independent Variables for Multiple RegressionTransformation of independent variables in regression (Measurement Error)How do I define my feature variablesRegression turned into classifficationRegression model for continuous dependent variable and count independent variablesReducing the dependency between variablesDistribution function of observations in the errors-in-variables model










0












$begingroup$


Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.










share|improve this question









$endgroup$











  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25















0












$begingroup$


Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.










share|improve this question









$endgroup$











  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25













0












0








0





$begingroup$


Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.










share|improve this question









$endgroup$




Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.







regression






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 29 at 17:28









Jun JangJun Jang

1224




1224











  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25
















  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25















$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25




$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25










0






active

oldest

votes












Your Answer





StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48226%2fdecomposing-r2-into-independent-variables%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Data Science Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48226%2fdecomposing-r2-into-independent-variables%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Adding axes to figuresAdding axes labels to LaTeX figuresLaTeX equivalent of ConTeXt buffersRotate a node but not its content: the case of the ellipse decorationHow to define the default vertical distance between nodes?TikZ scaling graphic and adjust node position and keep font sizeNumerical conditional within tikz keys?adding axes to shapesAlign axes across subfiguresAdding figures with a certain orderLine up nested tikz enviroments or how to get rid of themAdding axes labels to LaTeX figures

Tähtien Talli Jäsenet | Lähteet | NavigointivalikkoSuomen Hippos – Tähtien Talli

Do these cracks on my tires look bad? The Next CEO of Stack OverflowDry rot tire should I replace?Having to replace tiresFishtailed so easily? Bad tires? ABS?Filling the tires with something other than air, to avoid puncture hassles?Used Michelin tires safe to install?Do these tyre cracks necessitate replacement?Rumbling noise: tires or mechanicalIs it possible to fix noisy feathered tires?Are bad winter tires still better than summer tires in winter?Torque converter failure - Related to replacing only 2 tires?Why use snow tires on all 4 wheels on 2-wheel-drive cars?