Decomposing R^2 into independent variables The 2019 Stack Overflow Developer Survey Results Are InQuasi-categorical variables - any ideas?How exactly dependent variable is expressed in terms of independent variables using Partial Least Square Regression Method?How to decide power of independent variables in case of non-linear polynomial regression?Using Decision Tree methodology to identify Independent Variables for Multiple RegressionTransformation of independent variables in regression (Measurement Error)How do I define my feature variablesRegression turned into classifficationRegression model for continuous dependent variable and count independent variablesReducing the dependency between variablesDistribution function of observations in the errors-in-variables model

How can I refresh a custom data tab in the contact summary?

If I can cast sorceries at instant speed, can I use sorcery-speed activated abilities at instant speed?

Outer glow on 3 sides of a rectangular shape

Why isn't the circumferential light around the M87 black hole's event horizon symmetric?

Command for nulifying spaces

Balance problems for leveling up mid-fight?

How to display lines in a file like ls displays files in a directory?

Proving Trigonometric “Definitions”

What are the motivations for publishing new editions of an existing textbook, beyond new discoveries in a field?

Did any laptop computers have a built-in 5 1/4 inch floppy drive?

What to do when moving next to a bird sanctuary with a loosely-domesticated cat?

Right tool to dig six foot holes?

How to type this arrow in math mode?

Omit the same coordinate parameters in drawing line in tikz

The phrase "to the numbers born"?

How to support a colleague who finds meetings extremely tiring?

How much of the clove should I use when using big garlic heads?

Sums of normal random variables

What does Linus Torvalds mean when he says that Git "never ever" tracks a file?

What is the motivation for a law requiring 2 parties to consent for recording a conversation

Old scifi movie from the 50s or 60s with men in solid red uniforms who interrogate a spy from the past

Why can't devices on different VLANs, but on the same subnet, communicate?

I am eight letters word. Find me who Am I?

Is an up-to-date browser secure on an out-of-date OS?



Decomposing R^2 into independent variables



The 2019 Stack Overflow Developer Survey Results Are InQuasi-categorical variables - any ideas?How exactly dependent variable is expressed in terms of independent variables using Partial Least Square Regression Method?How to decide power of independent variables in case of non-linear polynomial regression?Using Decision Tree methodology to identify Independent Variables for Multiple RegressionTransformation of independent variables in regression (Measurement Error)How do I define my feature variablesRegression turned into classifficationRegression model for continuous dependent variable and count independent variablesReducing the dependency between variablesDistribution function of observations in the errors-in-variables model










0












$begingroup$


Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.










share|improve this question









$endgroup$











  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25















0












$begingroup$


Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.










share|improve this question









$endgroup$











  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25













0












0








0





$begingroup$


Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.










share|improve this question









$endgroup$




Consider a linear regression model:
$$y = β_0 + β_1X_1 + β_2X_2 + ... + β_kX_k + ε$$
where $R^2 = 1 - (SSR/SST)$.



I would like to determine the contribution of a factor $i$ (call it $R^2_i$) into the total $R^2$ such that $R^2_1$ + $R^2_2$ + ... +$R^2_k$ = $R^2$, because I want to know the impact of each factor into the total variance.



One methodology, called Shapley-Owen Decomposition, exists that performs that. The problem is that it is very computational heavy because it takes $2^k$ number of computations for each factor. It can be done pretty fast on Python when $k$ is small, but when $k$ is large, it is impossible.



My personal application is to decompose the $R^2$ into factors when $k$ is like 15-20 AND I want to do it using rolling-basis, because I want to see how the contributions change over time (which naturally means more computations).



I am wondering what efficient methodologies are out there to achieve my goal. A reference to academic paper/application would be appreciated. Thank you very much.







regression






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 29 at 17:28









Jun JangJun Jang

1224




1224











  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25
















  • $begingroup$
    researchgate.net/post/… this might help.
    $endgroup$
    – Damini Jain
    Mar 30 at 4:25















$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25




$begingroup$
researchgate.net/post/… this might help.
$endgroup$
– Damini Jain
Mar 30 at 4:25










0






active

oldest

votes












Your Answer





StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48226%2fdecomposing-r2-into-independent-variables%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Data Science Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48226%2fdecomposing-r2-into-independent-variables%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Marja Vauras Lähteet | Aiheesta muualla | NavigointivalikkoMarja Vauras Turun yliopiston tutkimusportaalissaInfobox OKSuomalaisen Tiedeakatemian varsinaiset jäsenetKasvatustieteiden tiedekunnan dekaanit ja muu johtoMarja VaurasKoulutusvienti on kestävyys- ja ketteryyslaji (2.5.2017)laajentamallaWorldCat Identities0000 0001 0855 9405n86069603utb201588738523620927

Which is better: GPT or RelGAN for text generation?2019 Community Moderator ElectionWhat is the difference between TextGAN and LM for text generation?GANs (generative adversarial networks) possible for text as well?Generator loss not decreasing- text to image synthesisChoosing a right algorithm for template-based text generationHow should I format input and output for text generation with LSTMsGumbel Softmax vs Vanilla Softmax for GAN trainingWhich neural network to choose for classification from text/speech?NLP text autoencoder that generates text in poetic meterWhat is the interpretation of the expectation notation in the GAN formulation?What is the difference between TextGAN and LM for text generation?How to prepare the data for text generation task

Is this part of the description of the Archfey warlock's Misty Escape feature redundant?When is entropic ward considered “used”?How does the reaction timing work for Wrath of the Storm? Can it potentially prevent the damage from the triggering attack?Does the Dark Arts Archlich warlock patrons's Arcane Invisibility activate every time you cast a level 1+ spell?When attacking while invisible, when exactly does invisibility break?Can I cast Hellish Rebuke on my turn?Do I have to “pre-cast” a reaction spell in order for it to be triggered?What happens if a Player Misty Escapes into an Invisible CreatureCan a reaction interrupt multiattack?Does the Fiend-patron warlock's Hurl Through Hell feature dispel effects that require the target to be on the same plane as the caster?What are you allowed to do while using the Warlock's Eldritch Master feature?