Various Distances between probability distributionst-SNE Python implementation: Kullback-Leibler divergenceWhat is difference between Bayesian Network and Belief Network?What is the efficient way to generate a similarity score when comparing two face images?What does it mean for the training data to be generated by a probability distribution over datasetsWhat is a policy in machine learning?Calculating an estimate of KL Divergence using the samples drawn from distributionsWhat is the top-5 error rate in ILSVRC challenge?Distance between very large discrete probability distributionsDifference between OrdinalEncoder and LabelEncoderThe Probability distribution of an Adversarial Autoencoder

Should I warn a new PhD Student?

What does the word 'upstream' mean in the context?

When should I pay my rent?

How to make a small $varhexagon$ in latex?

win_unzip does not extract file

Can I use denatured alcohol instead of isopropyl alcohol when servicing a fork?

What is this high flying aircraft over Pennsylvania?

Is this saw blade faulty?

Remove all of the duplicate numbers in an array of numbers - Javascript

Weird lines in Microsoft Word

Mimic lecturing on blackboard, facing audience

Why the "ls" command is showing the permissions of files in a FAT32 partition?

How much do grades matter for a future academia position?

Purpose of creating non root user

Adjusting bounding box of PlotLegends in TimelinePlot

The Digit Triangles

Do native speakers use "ultima" and "proxima" frequently in spoken English?

"Oh no!" in Latin

How to test the sharpness of a knife?

Pre-Employment Background Check With Consent For Future Checks

Would a primitive species be able to learn English from reading books alone?

Isometric embedding of a genus g surface

How to get directions in deep space?

Distinction between 地平線 【ちへいせん】 and 水平線 【すいへいせん】



Various Distances between probability distributions


t-SNE Python implementation: Kullback-Leibler divergenceWhat is difference between Bayesian Network and Belief Network?What is the efficient way to generate a similarity score when comparing two face images?What does it mean for the training data to be generated by a probability distribution over datasetsWhat is a policy in machine learning?Calculating an estimate of KL Divergence using the samples drawn from distributionsWhat is the top-5 error rate in ILSVRC challenge?Distance between very large discrete probability distributionsDifference between OrdinalEncoder and LabelEncoderThe Probability distribution of an Adversarial Autoencoder













1












$begingroup$


I was reading about different distribution distance - and came across Kullback-Leibler divergence, Jensen-Shannon divergence, MMD, and Wasserstein distance - the book was too abstract for me to absorb. What are the differences between them, actually?










share|improve this question







New contributor




asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$











  • $begingroup$
    Do you care about those four distances specifically or are you asking about distances in general and why there are multiple?
    $endgroup$
    – Alex L
    Mar 17 at 3:37










  • $begingroup$
    I care about the four distances specifically
    $endgroup$
    – asahi kibou
    Mar 17 at 10:00















1












$begingroup$


I was reading about different distribution distance - and came across Kullback-Leibler divergence, Jensen-Shannon divergence, MMD, and Wasserstein distance - the book was too abstract for me to absorb. What are the differences between them, actually?










share|improve this question







New contributor




asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$











  • $begingroup$
    Do you care about those four distances specifically or are you asking about distances in general and why there are multiple?
    $endgroup$
    – Alex L
    Mar 17 at 3:37










  • $begingroup$
    I care about the four distances specifically
    $endgroup$
    – asahi kibou
    Mar 17 at 10:00













1












1








1


1



$begingroup$


I was reading about different distribution distance - and came across Kullback-Leibler divergence, Jensen-Shannon divergence, MMD, and Wasserstein distance - the book was too abstract for me to absorb. What are the differences between them, actually?










share|improve this question







New contributor




asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$




I was reading about different distribution distance - and came across Kullback-Leibler divergence, Jensen-Shannon divergence, MMD, and Wasserstein distance - the book was too abstract for me to absorb. What are the differences between them, actually?







machine-learning deep-learning probability autoencoder






share|improve this question







New contributor




asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question







New contributor




asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question






New contributor




asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked Mar 17 at 0:21









asahi kibouasahi kibou

311




311




New contributor




asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






asahi kibou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











  • $begingroup$
    Do you care about those four distances specifically or are you asking about distances in general and why there are multiple?
    $endgroup$
    – Alex L
    Mar 17 at 3:37










  • $begingroup$
    I care about the four distances specifically
    $endgroup$
    – asahi kibou
    Mar 17 at 10:00
















  • $begingroup$
    Do you care about those four distances specifically or are you asking about distances in general and why there are multiple?
    $endgroup$
    – Alex L
    Mar 17 at 3:37










  • $begingroup$
    I care about the four distances specifically
    $endgroup$
    – asahi kibou
    Mar 17 at 10:00















$begingroup$
Do you care about those four distances specifically or are you asking about distances in general and why there are multiple?
$endgroup$
– Alex L
Mar 17 at 3:37




$begingroup$
Do you care about those four distances specifically or are you asking about distances in general and why there are multiple?
$endgroup$
– Alex L
Mar 17 at 3:37












$begingroup$
I care about the four distances specifically
$endgroup$
– asahi kibou
Mar 17 at 10:00




$begingroup$
I care about the four distances specifically
$endgroup$
– asahi kibou
Mar 17 at 10:00










0






active

oldest

votes











Your Answer





StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);






asahi kibou is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47439%2fvarious-distances-between-probability-distributions%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes








asahi kibou is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















asahi kibou is a new contributor. Be nice, and check out our Code of Conduct.












asahi kibou is a new contributor. Be nice, and check out our Code of Conduct.











asahi kibou is a new contributor. Be nice, and check out our Code of Conduct.














Thanks for contributing an answer to Data Science Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47439%2fvarious-distances-between-probability-distributions%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown