How is the standard deviation of VAE's obtained?How to predict the probability of an event?Behavioral Differences between Standard Autoencoder and Variational AutoencoderHow are the positions of the output nodes determined in the Kohonen - Self Organizing Maps algorithm?How do i use the Gaussian function with a Naive Bayes Classifier?Right Way to Input Text Data in Keras Auto EncoderAre the raw probabilities obtained from XGBoost, representative of the true underlying probabilties?what's the difference between autoencoder and autoassociative neural networks?How to convert an array of numbers into probability values?Help solving Bigram Model with the following probabilitiesHow to use Adaptive Rejection Sampling to Update Alpha in iGMM
What word means to make something obsolete?
Pulling the rope with one hand is as heavy as with two hands?
Do I have to worry about players making “bad” choices on level up?
Has any spacecraft ever had the ability to directly communicate with civilian air traffic control?
How does a Swashbuckler rogue "fight with two weapons while safely darting away"?
Modify locally tikzset
Help, my Death Star suffers from Kessler syndrome!
Colliding particles and Activation energy
Confusion about capacitors
Why does nature favour the Laplacian?
Can fracking help reduce CO2?
How to back up a running remote server?
Is it cheaper to drop cargo drop than to land it?
What is the strongest case that can be made in favour of the UK regaining some control over fishing policy after Brexit?
A question regarding using the definite article
A non-technological, repeating, visible object in the sky, holding its position in the sky for hours
What does YCWCYODFTRFDTY mean?
Find the coordinate of two line segments that are perpendicular
What does "rf" mean in "rfkill"?
Can a creature tell when it has been affected by a Divination wizard's Portent?
Was it really necessary for the Lunar Module to have 2 stages?
Phrase for the opposite of "foolproof"
How can Republicans who favour free markets, consistently express anger when they don't like the outcome of that choice?
Single Colour Mastermind Problem
How is the standard deviation of VAE's obtained?
How to predict the probability of an event?Behavioral Differences between Standard Autoencoder and Variational AutoencoderHow are the positions of the output nodes determined in the Kohonen - Self Organizing Maps algorithm?How do i use the Gaussian function with a Naive Bayes Classifier?Right Way to Input Text Data in Keras Auto EncoderAre the raw probabilities obtained from XGBoost, representative of the true underlying probabilties?what's the difference between autoencoder and autoassociative neural networks?How to convert an array of numbers into probability values?Help solving Bigram Model with the following probabilitiesHow to use Adaptive Rejection Sampling to Update Alpha in iGMM
$begingroup$
I am trying to build a Variational Autoencoder. I was looking at various codes online and found most of them in some way or another copy Francois Chollet (Google researchers) code.
Now my main question with this code is this part:
As you can clearly see the $log(sigma)$ is the output from a Dense layer. Where did this assumption come from (the output is $log(sigma)$ and not $sigma$? How is it possible that we generate a random normal distribution with standard deviation $sigma$ like this? Is it due to the way the computer generates Normal Distributions?
probability autoencoder gaussian
$endgroup$
add a comment |
$begingroup$
I am trying to build a Variational Autoencoder. I was looking at various codes online and found most of them in some way or another copy Francois Chollet (Google researchers) code.
Now my main question with this code is this part:
As you can clearly see the $log(sigma)$ is the output from a Dense layer. Where did this assumption come from (the output is $log(sigma)$ and not $sigma$? How is it possible that we generate a random normal distribution with standard deviation $sigma$ like this? Is it due to the way the computer generates Normal Distributions?
probability autoencoder gaussian
$endgroup$
$begingroup$
@Esmailian you can see that K_log_sigma = dense(latent_dim) which is the same as z_mean taken in the above line
$endgroup$
– DuttaA
Apr 8 at 12:28
$begingroup$
@Esmailian ok sorry..i'll edit that part out but the question will now be why is it $log(sigma)$ and not $sigma$
$endgroup$
– DuttaA
Apr 8 at 12:37
add a comment |
$begingroup$
I am trying to build a Variational Autoencoder. I was looking at various codes online and found most of them in some way or another copy Francois Chollet (Google researchers) code.
Now my main question with this code is this part:
As you can clearly see the $log(sigma)$ is the output from a Dense layer. Where did this assumption come from (the output is $log(sigma)$ and not $sigma$? How is it possible that we generate a random normal distribution with standard deviation $sigma$ like this? Is it due to the way the computer generates Normal Distributions?
probability autoencoder gaussian
$endgroup$
I am trying to build a Variational Autoencoder. I was looking at various codes online and found most of them in some way or another copy Francois Chollet (Google researchers) code.
Now my main question with this code is this part:
As you can clearly see the $log(sigma)$ is the output from a Dense layer. Where did this assumption come from (the output is $log(sigma)$ and not $sigma$? How is it possible that we generate a random normal distribution with standard deviation $sigma$ like this? Is it due to the way the computer generates Normal Distributions?
probability autoencoder gaussian
probability autoencoder gaussian
edited Apr 9 at 9:28
DuttaA
asked Apr 8 at 12:09
DuttaADuttaA
511319
511319
$begingroup$
@Esmailian you can see that K_log_sigma = dense(latent_dim) which is the same as z_mean taken in the above line
$endgroup$
– DuttaA
Apr 8 at 12:28
$begingroup$
@Esmailian ok sorry..i'll edit that part out but the question will now be why is it $log(sigma)$ and not $sigma$
$endgroup$
– DuttaA
Apr 8 at 12:37
add a comment |
$begingroup$
@Esmailian you can see that K_log_sigma = dense(latent_dim) which is the same as z_mean taken in the above line
$endgroup$
– DuttaA
Apr 8 at 12:28
$begingroup$
@Esmailian ok sorry..i'll edit that part out but the question will now be why is it $log(sigma)$ and not $sigma$
$endgroup$
– DuttaA
Apr 8 at 12:37
$begingroup$
@Esmailian you can see that K_log_sigma = dense(latent_dim) which is the same as z_mean taken in the above line
$endgroup$
– DuttaA
Apr 8 at 12:28
$begingroup$
@Esmailian you can see that K_log_sigma = dense(latent_dim) which is the same as z_mean taken in the above line
$endgroup$
– DuttaA
Apr 8 at 12:28
$begingroup$
@Esmailian ok sorry..i'll edit that part out but the question will now be why is it $log(sigma)$ and not $sigma$
$endgroup$
– DuttaA
Apr 8 at 12:37
$begingroup$
@Esmailian ok sorry..i'll edit that part out but the question will now be why is it $log(sigma)$ and not $sigma$
$endgroup$
– DuttaA
Apr 8 at 12:37
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48877%2fhow-is-the-standard-deviation-of-vaes-obtained%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48877%2fhow-is-the-standard-deviation-of-vaes-obtained%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
@Esmailian you can see that K_log_sigma = dense(latent_dim) which is the same as z_mean taken in the above line
$endgroup$
– DuttaA
Apr 8 at 12:28
$begingroup$
@Esmailian ok sorry..i'll edit that part out but the question will now be why is it $log(sigma)$ and not $sigma$
$endgroup$
– DuttaA
Apr 8 at 12:37