Do batch norm makes sense for regression problems?Does Batch Normalization make sense for a ReLU activation function?Can Neural Networks be trained to smooth values / output the average?How can I improve my regression model?is Batch Norm a little bit stochastic by default?Batch norm: why the initial normalization?Can I treat text review analysis as a regression problem?How does Implicit Quantile-Regression Network (IQN) differ from QR-DQN?What should be the requirement for training data in order to obtain a good regression model using neural network?Neural Network Data Normalization SetupHow much batch effect is too much batch effect?
Would it take an action or something similar to activate the blindsight property of a Dragon Mask?
Did Ender ever learn that he killed Stilson and/or Bonzo?
Is having access to past exams cheating and, if yes, could it be proven just by a good grade?
Ban on all campaign finance?
Current sense amp + op-amp buffer + ADC: Measuring down to 0 with single supply
Giving EXEC (@Variable) a Column name and Concatenation
Do I need life insurance if I can cover my own funeral costs?
How many prime numbers are there that can't be written as a sum of two composite numbers?
Employee lack of ownership
Define, (actually define) the "stability" and "energy" of a compound
Recruiter wants very extensive technical details about all of my previous work
Declaring defaulted assignment operator as constexpr: which compiler is right?
What is this large pipe coming out of my roof?
Happy pi day, everyone!
How to deal with taxi scam when on vacation?
Why do passenger jet manufacturers design their planes with stall prevention systems?
Are all passive ability checks floors for active ability checks?
Site Collection Administrator has left the building
When do we add an hyphen (-) to a complex adjective word?
How to deal with a cynical class?
Problems with making formula look great
Professor being mistaken for a grad student
Sailing the cryptic seas
What does it mean to make a bootable LiveUSB?
Do batch norm makes sense for regression problems?
Does Batch Normalization make sense for a ReLU activation function?Can Neural Networks be trained to smooth values / output the average?How can I improve my regression model?is Batch Norm a little bit stochastic by default?Batch norm: why the initial normalization?Can I treat text review analysis as a regression problem?How does Implicit Quantile-Regression Network (IQN) differ from QR-DQN?What should be the requirement for training data in order to obtain a good regression model using neural network?Neural Network Data Normalization SetupHow much batch effect is too much batch effect?
$begingroup$
When my network is performing regression (like DQN) it makes sense to use batchnorm in network when output of my network should vary from [0, 100000]?
one way to tackle it is to normalize output but output is used for ranking choices in RL system so scaling can lead to small numerical errors that can explode after upscaling...
regression batch-normalization
$endgroup$
add a comment |
$begingroup$
When my network is performing regression (like DQN) it makes sense to use batchnorm in network when output of my network should vary from [0, 100000]?
one way to tackle it is to normalize output but output is used for ranking choices in RL system so scaling can lead to small numerical errors that can explode after upscaling...
regression batch-normalization
$endgroup$
$begingroup$
Use boosting methods :)
$endgroup$
– Aditya
yesterday
add a comment |
$begingroup$
When my network is performing regression (like DQN) it makes sense to use batchnorm in network when output of my network should vary from [0, 100000]?
one way to tackle it is to normalize output but output is used for ranking choices in RL system so scaling can lead to small numerical errors that can explode after upscaling...
regression batch-normalization
$endgroup$
When my network is performing regression (like DQN) it makes sense to use batchnorm in network when output of my network should vary from [0, 100000]?
one way to tackle it is to normalize output but output is used for ranking choices in RL system so scaling can lead to small numerical errors that can explode after upscaling...
regression batch-normalization
regression batch-normalization
edited yesterday
quester
asked yesterday
questerquester
212
212
$begingroup$
Use boosting methods :)
$endgroup$
– Aditya
yesterday
add a comment |
$begingroup$
Use boosting methods :)
$endgroup$
– Aditya
yesterday
$begingroup$
Use boosting methods :)
$endgroup$
– Aditya
yesterday
$begingroup$
Use boosting methods :)
$endgroup$
– Aditya
yesterday
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47294%2fdo-batch-norm-makes-sense-for-regression-problems%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47294%2fdo-batch-norm-makes-sense-for-regression-problems%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Use boosting methods :)
$endgroup$
– Aditya
yesterday