What does it mean when people say a cost function is something you want to minimize? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsWhat does 'contextual' mean in 'contextual bandits'?What does “linear in parameters” mean?Linear regression - LMS with gradient descent vs normal equationsWhat does “zero-meaned vector” meanBest way to normalize datasets for a linear regression model?What does it mean when we say most of the points in a hypercube are at the boundary?What does backpropagating through labels mean?What causes the Shape (convex or non-convex) of the cost function?What does “Model recursive loss convergence” mean?What does the “Loss” value given by Keras mean?

What are some likely causes to domain member PC losing contact to domain controller?

.bashrc alias for a command with fixed second parameter

What is "Lambda" in Heston's original paper on stochastic volatility models?

An isoperimetric-type inequality inside a cube

Twin's vs. Twins'

Calculation of line of sight system gain

Is a copyright notice with a non-existent name be invalid?

Why did Bronn offer to be Tyrion Lannister's champion in trial by combat?

When does a function NOT have an antiderivative?

How do Java 8 default methods hеlp with lambdas?

Adapting the Chinese Remainder Theorem (CRT) for integers to polynomials

What did Turing mean when saying that "machines cannot give rise to surprises" is due to a fallacy?

How can I prevent/balance waiting and turtling as a response to cooldown mechanics

How to ask rejected full-time candidates to apply to teach individual courses?

How to make triangles with rounded sides and corners? (squircle with 3 sides)

Found this skink in my tomato plant bucket. Is he trapped? Or could he leave if he wanted?

Vertical ranges of Column Plots in 12

In musical terms, what properties are varied by the human voice to produce different words / syllables?

Why does BitLocker not use RSA?

Why can't fire hurt Daenerys but it did to Jon Snow in season 1?

Any stored/leased 737s that could substitute for grounded MAXs?

Does a random sequence of vectors span a Hilbert space?

Pointing to problems without suggesting solutions

How do I find my Spellcasting Ability for my D&D character?



What does it mean when people say a cost function is something you want to minimize?



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsWhat does 'contextual' mean in 'contextual bandits'?What does “linear in parameters” mean?Linear regression - LMS with gradient descent vs normal equationsWhat does “zero-meaned vector” meanBest way to normalize datasets for a linear regression model?What does it mean when we say most of the points in a hypercube are at the boundary?What does backpropagating through labels mean?What causes the Shape (convex or non-convex) of the cost function?What does “Model recursive loss convergence” mean?What does the “Loss” value given by Keras mean?










7












$begingroup$


I am having a lot of trouble understanding this. Does it mean you should not use the cost function very often?










share|improve this question









$endgroup$
















    7












    $begingroup$


    I am having a lot of trouble understanding this. Does it mean you should not use the cost function very often?










    share|improve this question









    $endgroup$














      7












      7








      7





      $begingroup$


      I am having a lot of trouble understanding this. Does it mean you should not use the cost function very often?










      share|improve this question









      $endgroup$




      I am having a lot of trouble understanding this. Does it mean you should not use the cost function very often?







      machine-learning beginner linear-regression






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Jun 26 '16 at 8:05









      jame_smithjame_smith

      384




      384




















          5 Answers
          5






          active

          oldest

          votes


















          11












          $begingroup$

          No, it means you are trying to find the inputs that make the output of the cost function the smallest. It doesn't mean that you should "minimize" use of it.






          share|improve this answer











          $endgroup$












          • $begingroup$
            Lol.... thx for clearing out this confusion. :)
            $endgroup$
            – jame_smith
            Jun 26 '16 at 9:44


















          3












          $begingroup$

          A cost function is something you use to penalize high deviations from the expected results when compared to your actual predictions.



          You can think of a cost function as a sign of how bad your prediction was. A high cost function value means the prediction was really off, hence, the focus on minimizing the cost function, thereby producing an accurate prediction model.






          share|improve this answer









          $endgroup$




















            1












            $begingroup$

            Cost functions in the context of Machine Learning often calculate some kind of metric that signifies how well your model is performing. A common one is for example the mean squared error, where you look at all your test examples where you know the true value and the predicted, take the difference between that and square it. By minimizing this error (cost function) you assume your predictions will be better.






            share|improve this answer









            $endgroup$




















              0












              $begingroup$

              Consider you have some data and you want to model a function that fits the data. This function should fit well and should not have error (ideally). How do I define this error? and voila here comes the cost function.






              share|improve this answer









              $endgroup$




















                0












                $begingroup$

                Minimize a (cost) function means that you want to find good values for its parameters. Good parameters means that the function can produce the best possible outcomes, namely the smallest ones, because small values mean less errors. This is an optimization problem: the problem of finding the best solution from all possible solutions. (source)






                share|improve this answer









                $endgroup$













                  Your Answer








                  StackExchange.ready(function()
                  var channelOptions =
                  tags: "".split(" "),
                  id: "557"
                  ;
                  initTagRenderer("".split(" "), "".split(" "), channelOptions);

                  StackExchange.using("externalEditor", function()
                  // Have to fire editor after snippets, if snippets enabled
                  if (StackExchange.settings.snippets.snippetsEnabled)
                  StackExchange.using("snippets", function()
                  createEditor();
                  );

                  else
                  createEditor();

                  );

                  function createEditor()
                  StackExchange.prepareEditor(
                  heartbeatType: 'answer',
                  autoActivateHeartbeat: false,
                  convertImagesToLinks: false,
                  noModals: true,
                  showLowRepImageUploadWarning: true,
                  reputationToPostImages: null,
                  bindNavPrevention: true,
                  postfix: "",
                  imageUploader:
                  brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
                  contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
                  allowUrls: true
                  ,
                  onDemand: true,
                  discardSelector: ".discard-answer"
                  ,immediatelyShowMarkdownHelp:true
                  );



                  );













                  draft saved

                  draft discarded


















                  StackExchange.ready(
                  function ()
                  StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f12413%2fwhat-does-it-mean-when-people-say-a-cost-function-is-something-you-want-to-minim%23new-answer', 'question_page');

                  );

                  Post as a guest















                  Required, but never shown

























                  5 Answers
                  5






                  active

                  oldest

                  votes








                  5 Answers
                  5






                  active

                  oldest

                  votes









                  active

                  oldest

                  votes






                  active

                  oldest

                  votes









                  11












                  $begingroup$

                  No, it means you are trying to find the inputs that make the output of the cost function the smallest. It doesn't mean that you should "minimize" use of it.






                  share|improve this answer











                  $endgroup$












                  • $begingroup$
                    Lol.... thx for clearing out this confusion. :)
                    $endgroup$
                    – jame_smith
                    Jun 26 '16 at 9:44















                  11












                  $begingroup$

                  No, it means you are trying to find the inputs that make the output of the cost function the smallest. It doesn't mean that you should "minimize" use of it.






                  share|improve this answer











                  $endgroup$












                  • $begingroup$
                    Lol.... thx for clearing out this confusion. :)
                    $endgroup$
                    – jame_smith
                    Jun 26 '16 at 9:44













                  11












                  11








                  11





                  $begingroup$

                  No, it means you are trying to find the inputs that make the output of the cost function the smallest. It doesn't mean that you should "minimize" use of it.






                  share|improve this answer











                  $endgroup$



                  No, it means you are trying to find the inputs that make the output of the cost function the smallest. It doesn't mean that you should "minimize" use of it.







                  share|improve this answer














                  share|improve this answer



                  share|improve this answer








                  edited Apr 4 at 15:59

























                  answered Jun 26 '16 at 8:59









                  Sean OwenSean Owen

                  4,26642238




                  4,26642238











                  • $begingroup$
                    Lol.... thx for clearing out this confusion. :)
                    $endgroup$
                    – jame_smith
                    Jun 26 '16 at 9:44
















                  • $begingroup$
                    Lol.... thx for clearing out this confusion. :)
                    $endgroup$
                    – jame_smith
                    Jun 26 '16 at 9:44















                  $begingroup$
                  Lol.... thx for clearing out this confusion. :)
                  $endgroup$
                  – jame_smith
                  Jun 26 '16 at 9:44




                  $begingroup$
                  Lol.... thx for clearing out this confusion. :)
                  $endgroup$
                  – jame_smith
                  Jun 26 '16 at 9:44











                  3












                  $begingroup$

                  A cost function is something you use to penalize high deviations from the expected results when compared to your actual predictions.



                  You can think of a cost function as a sign of how bad your prediction was. A high cost function value means the prediction was really off, hence, the focus on minimizing the cost function, thereby producing an accurate prediction model.






                  share|improve this answer









                  $endgroup$

















                    3












                    $begingroup$

                    A cost function is something you use to penalize high deviations from the expected results when compared to your actual predictions.



                    You can think of a cost function as a sign of how bad your prediction was. A high cost function value means the prediction was really off, hence, the focus on minimizing the cost function, thereby producing an accurate prediction model.






                    share|improve this answer









                    $endgroup$















                      3












                      3








                      3





                      $begingroup$

                      A cost function is something you use to penalize high deviations from the expected results when compared to your actual predictions.



                      You can think of a cost function as a sign of how bad your prediction was. A high cost function value means the prediction was really off, hence, the focus on minimizing the cost function, thereby producing an accurate prediction model.






                      share|improve this answer









                      $endgroup$



                      A cost function is something you use to penalize high deviations from the expected results when compared to your actual predictions.



                      You can think of a cost function as a sign of how bad your prediction was. A high cost function value means the prediction was really off, hence, the focus on minimizing the cost function, thereby producing an accurate prediction model.







                      share|improve this answer












                      share|improve this answer



                      share|improve this answer










                      answered Jun 26 '16 at 14:27









                      Vineet JohnVineet John

                      314




                      314





















                          1












                          $begingroup$

                          Cost functions in the context of Machine Learning often calculate some kind of metric that signifies how well your model is performing. A common one is for example the mean squared error, where you look at all your test examples where you know the true value and the predicted, take the difference between that and square it. By minimizing this error (cost function) you assume your predictions will be better.






                          share|improve this answer









                          $endgroup$

















                            1












                            $begingroup$

                            Cost functions in the context of Machine Learning often calculate some kind of metric that signifies how well your model is performing. A common one is for example the mean squared error, where you look at all your test examples where you know the true value and the predicted, take the difference between that and square it. By minimizing this error (cost function) you assume your predictions will be better.






                            share|improve this answer









                            $endgroup$















                              1












                              1








                              1





                              $begingroup$

                              Cost functions in the context of Machine Learning often calculate some kind of metric that signifies how well your model is performing. A common one is for example the mean squared error, where you look at all your test examples where you know the true value and the predicted, take the difference between that and square it. By minimizing this error (cost function) you assume your predictions will be better.






                              share|improve this answer









                              $endgroup$



                              Cost functions in the context of Machine Learning often calculate some kind of metric that signifies how well your model is performing. A common one is for example the mean squared error, where you look at all your test examples where you know the true value and the predicted, take the difference between that and square it. By minimizing this error (cost function) you assume your predictions will be better.







                              share|improve this answer












                              share|improve this answer



                              share|improve this answer










                              answered Jun 26 '16 at 11:01









                              Jan van der VegtJan van der Vegt

                              6,7101839




                              6,7101839





















                                  0












                                  $begingroup$

                                  Consider you have some data and you want to model a function that fits the data. This function should fit well and should not have error (ideally). How do I define this error? and voila here comes the cost function.






                                  share|improve this answer









                                  $endgroup$

















                                    0












                                    $begingroup$

                                    Consider you have some data and you want to model a function that fits the data. This function should fit well and should not have error (ideally). How do I define this error? and voila here comes the cost function.






                                    share|improve this answer









                                    $endgroup$















                                      0












                                      0








                                      0





                                      $begingroup$

                                      Consider you have some data and you want to model a function that fits the data. This function should fit well and should not have error (ideally). How do I define this error? and voila here comes the cost function.






                                      share|improve this answer









                                      $endgroup$



                                      Consider you have some data and you want to model a function that fits the data. This function should fit well and should not have error (ideally). How do I define this error? and voila here comes the cost function.







                                      share|improve this answer












                                      share|improve this answer



                                      share|improve this answer










                                      answered Jun 27 '16 at 12:05









                                      Krishna KalyanKrishna Kalyan

                                      15410




                                      15410





















                                          0












                                          $begingroup$

                                          Minimize a (cost) function means that you want to find good values for its parameters. Good parameters means that the function can produce the best possible outcomes, namely the smallest ones, because small values mean less errors. This is an optimization problem: the problem of finding the best solution from all possible solutions. (source)






                                          share|improve this answer









                                          $endgroup$

















                                            0












                                            $begingroup$

                                            Minimize a (cost) function means that you want to find good values for its parameters. Good parameters means that the function can produce the best possible outcomes, namely the smallest ones, because small values mean less errors. This is an optimization problem: the problem of finding the best solution from all possible solutions. (source)






                                            share|improve this answer









                                            $endgroup$















                                              0












                                              0








                                              0





                                              $begingroup$

                                              Minimize a (cost) function means that you want to find good values for its parameters. Good parameters means that the function can produce the best possible outcomes, namely the smallest ones, because small values mean less errors. This is an optimization problem: the problem of finding the best solution from all possible solutions. (source)






                                              share|improve this answer









                                              $endgroup$



                                              Minimize a (cost) function means that you want to find good values for its parameters. Good parameters means that the function can produce the best possible outcomes, namely the smallest ones, because small values mean less errors. This is an optimization problem: the problem of finding the best solution from all possible solutions. (source)







                                              share|improve this answer












                                              share|improve this answer



                                              share|improve this answer










                                              answered Jun 30 '16 at 7:31









                                              IgnorantIgnorant

                                              1012




                                              1012



























                                                  draft saved

                                                  draft discarded
















































                                                  Thanks for contributing an answer to Data Science Stack Exchange!


                                                  • Please be sure to answer the question. Provide details and share your research!

                                                  But avoid


                                                  • Asking for help, clarification, or responding to other answers.

                                                  • Making statements based on opinion; back them up with references or personal experience.

                                                  Use MathJax to format equations. MathJax reference.


                                                  To learn more, see our tips on writing great answers.




                                                  draft saved


                                                  draft discarded














                                                  StackExchange.ready(
                                                  function ()
                                                  StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f12413%2fwhat-does-it-mean-when-people-say-a-cost-function-is-something-you-want-to-minim%23new-answer', 'question_page');

                                                  );

                                                  Post as a guest















                                                  Required, but never shown





















































                                                  Required, but never shown














                                                  Required, but never shown












                                                  Required, but never shown







                                                  Required, but never shown

































                                                  Required, but never shown














                                                  Required, but never shown












                                                  Required, but never shown







                                                  Required, but never shown







                                                  Popular posts from this blog

                                                  Adding axes to figuresAdding axes labels to LaTeX figuresLaTeX equivalent of ConTeXt buffersRotate a node but not its content: the case of the ellipse decorationHow to define the default vertical distance between nodes?TikZ scaling graphic and adjust node position and keep font sizeNumerical conditional within tikz keys?adding axes to shapesAlign axes across subfiguresAdding figures with a certain orderLine up nested tikz enviroments or how to get rid of themAdding axes labels to LaTeX figures

                                                  Tähtien Talli Jäsenet | Lähteet | NavigointivalikkoSuomen Hippos – Tähtien Talli

                                                  Do these cracks on my tires look bad? The Next CEO of Stack OverflowDry rot tire should I replace?Having to replace tiresFishtailed so easily? Bad tires? ABS?Filling the tires with something other than air, to avoid puncture hassles?Used Michelin tires safe to install?Do these tyre cracks necessitate replacement?Rumbling noise: tires or mechanicalIs it possible to fix noisy feathered tires?Are bad winter tires still better than summer tires in winter?Torque converter failure - Related to replacing only 2 tires?Why use snow tires on all 4 wheels on 2-wheel-drive cars?