Validation data shall be in broken down into batches or not?Cross validation when training neural network?Prime model with mock data, good idea or not?Inconsistent validation accuracy? is that expected?Validation accuracy for neural networkValidation accuracy is always close to training accuracyComputing number of batches in one epochValidation curveIs splitting the data set into train and validation applicable in unsupervised learning?Change rate of cross validation data, after trainingHow to train non image data in batches from disk?

Probably overheated black color SMD pads

Why are there no stars visible in cislunar space?

When to use snap-off blade knife and when to use trapezoid blade knife?

Calculate the frequency of characters in a string

Knife as defense against stray dogs

How could an airship be repaired midflight?

Variable completely messes up echoed string

Existence of a celestial body big enough for early civilization to be thought of as a second moon

Print last inputted byte

What should I install to correct "ld: cannot find -lgbm and -linput" so that I can compile a Rust program?

The average age of first marriage in Russia

Recruiter wants very extensive technical details about all of my previous work

Should I use acronyms in dialogues before telling the readers what it stands for in fiction?

Optimising a list searching algorithm

What does "Four-F." mean?

Do US professors/group leaders only get a salary, but no group budget?

Why didn't Héctor fade away after this character died in the movie Coco?

What exactly term 'companion plants' means?

Practical application of matrices and determinants

Why is indicated airspeed rather than ground speed used during the takeoff roll?

Geography in 3D perspective

Is honey really a supersaturated solution? Does heating to un-crystalize redissolve it or melt it?

Are dual Irish/British citizens bound by the 90/180 day rule when travelling in the EU after Brexit?

Could Sinn Fein swing any Brexit vote in Parliament?



Validation data shall be in broken down into batches or not?


Cross validation when training neural network?Prime model with mock data, good idea or not?Inconsistent validation accuracy? is that expected?Validation accuracy for neural networkValidation accuracy is always close to training accuracyComputing number of batches in one epochValidation curveIs splitting the data set into train and validation applicable in unsupervised learning?Change rate of cross validation data, after trainingHow to train non image data in batches from disk?













3












$begingroup$


I am using fit_generator to train the model. The training dataset is being read from a generator function which gives data in a constant batch size. Now I want to know what approach shall I adopt for validation data. Shall I make a generator for the validation set or load it completely into memory and use it in fit_generator?



Note: Validation dataset is fitting into memory quite easily therefore batching is an option for me.






training







share|improve this question









$endgroup$
















    3












    $begingroup$


    I am using fit_generator to train the model. The training dataset is being read from a generator function which gives data in a constant batch size. Now I want to know what approach shall I adopt for validation data. Shall I make a generator for the validation set or load it completely into memory and use it in fit_generator?



    Note: Validation dataset is fitting into memory quite easily therefore batching is an option for me.






    training







    share|improve this question









    $endgroup$














      3












      3








      3





      $begingroup$


      I am using fit_generator to train the model. The training dataset is being read from a generator function which gives data in a constant batch size. Now I want to know what approach shall I adopt for validation data. Shall I make a generator for the validation set or load it completely into memory and use it in fit_generator?



      Note: Validation dataset is fitting into memory quite easily therefore batching is an option for me.






      training







      share|improve this question









      $endgroup$




      I am using fit_generator to train the model. The training dataset is being read from a generator function which gives data in a constant batch size. Now I want to know what approach shall I adopt for validation data. Shall I make a generator for the validation set or load it completely into memory and use it in fit_generator?



      Note: Validation dataset is fitting into memory quite easily therefore batching is an option for me.






      training




      training






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked 19 hours ago









      yamini goelyamini goel

      213




      213




















          1 Answer
          1






          active

          oldest

          votes


















          0












          $begingroup$

          If validation batch size = 1 it has no difference in comparison with the case that load the data completely. But with any other value of batch size the evaluation metric will be an average of it in different batches; So, its real value will not be resulted.






          share|improve this answer









          $endgroup$












            Your Answer





            StackExchange.ifUsing("editor", function ()
            return StackExchange.using("mathjaxEditing", function ()
            StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
            StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
            );
            );
            , "mathjax-editing");

            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "557"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47452%2fvalidation-data-shall-be-in-broken-down-into-batches-or-not%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            0












            $begingroup$

            If validation batch size = 1 it has no difference in comparison with the case that load the data completely. But with any other value of batch size the evaluation metric will be an average of it in different batches; So, its real value will not be resulted.






            share|improve this answer









            $endgroup$

















              0












              $begingroup$

              If validation batch size = 1 it has no difference in comparison with the case that load the data completely. But with any other value of batch size the evaluation metric will be an average of it in different batches; So, its real value will not be resulted.






              share|improve this answer









              $endgroup$















                0












                0








                0





                $begingroup$

                If validation batch size = 1 it has no difference in comparison with the case that load the data completely. But with any other value of batch size the evaluation metric will be an average of it in different batches; So, its real value will not be resulted.






                share|improve this answer









                $endgroup$



                If validation batch size = 1 it has no difference in comparison with the case that load the data completely. But with any other value of batch size the evaluation metric will be an average of it in different batches; So, its real value will not be resulted.







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered 16 hours ago









                Alireza ZolanvariAlireza Zolanvari

                19114




                19114



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Data Science Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid …


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47452%2fvalidation-data-shall-be-in-broken-down-into-batches-or-not%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    -

                    Popular posts from this blog

                    Is there a general name for the setup in which payoffs are not known exactly but players try to influence each other's perception of the payoffs?Osborne, Nash equilibria and the correctness of beliefsIs there a name for this family of games (Binomial games?)?Perfect Bayesian EquilibriumCalculating mixed strategy equilibrium in battle of sexesPure Strategy SPNEIs there a commitment mechanism which allows players to achieve pareto optimal solutions?Extensive Form GamesAn $n$-player prisoner's dilemma where a coalition of 2 players is better off defectingTit-For-Stat Strategy Best RepliesPotential solutions of the $n$-player Prisoner's Dilemma

                    Image
                    Decoupling cap routing on a 4 layer PCB Which module had more 'comfort' in terms of living space, the Lunar Module or the Command module? Why do only some White Walkers shatter into ice chips? What are the advantages of luxury car brands like Acura/Lexus over their sibling non-luxury brands Honda/Toyota? I have a unique character that I'm having a problem writing. He's a virus! exec command in bash loop Can my company stop me from working overtime? Pressure inside an infinite ocean? PN junction band gap - equal across all devices? I'm in your subnets, golfing your code How long would it take for people to notice a mass disappearance? Will 700 more planes a day fly because of the Heathrow expansion? Introducing Gladys, an intrepid globetrotter What matters more when it comes to book covers? Is it ‘professional quality’ or relevancy? What is the most remote airport from the center of the city it supposedly serves? How do LIGO and VIRGO kn...
                    Read more

                    Is flight data recorder erased after every flight?When are black boxes used?What protects the location beacon (pinger) of a flight data recorder?Is there anywhere I can pick up raw flight data recorder information?Who legally owns the Flight Data Recorder?Constructing flight recorder dataWhy are FDRs and CVRs still two separate physical devices?What are the data elements shown on the GE235 flight data recorder (FDR) plot?Are CVR and FDR reset after every flight?What is the format of data stored by a Flight Data Recorder?How much data is stored in the flight data recorder per hour in a typical flight of an A380?Is a smart flight data recorder possible?

                    Image
                    Why are prions in animal diets not destroyed by the digestive system? How to increase the size of the cursor in Lubuntu 19.04? As matter approaches a black hole, does it speed up? Why is B♯ higher than C♭ in 31-ET? Nominativ or Akkusativ What does this colon mean? It is not labeling, it is not ternary operator Didn't attend field-specific conferences during my PhD; how much of a disadvantage is it? Applying a GPO to local users except local administrators on Workgroup computers Why has the UK chosen to use Huawei infrastructure when Five Eyes allies haven't? Using column size much larger than necessary Can my company stop me from working overtime? Will 700 more planes a day fly because of the Heathrow expansion? How to use dependency injection and avoid temporal coupling? Point of the Dothraki's attack in GoT S8E3? How I can I roll a number of non-digital dice to get a random number between 1 and 150? Validation rule Scheduled Apex I need a d...
                    Read more

                    Rank groups within a grouped sequence of TRUE/FALSE and NAGrouping functions (tapply, by, aggregate) and the *apply familyCharacters counting and subletting specific patternsWhat is the purpose of setting a key in data.table?data.table vs dplyr: can one do something well the other can't or does poorly?how to make a bar plot for a list of dataframes?How to group by unique values in a list in RPandas - Alternative to rank() function that gives unique ordinal ranks for a columnRank within group in for loop in RData transformation: from dyadic to observational data in RGetting map from purrr to work with paste0

                    Image
                    Understanding trademark infringements in a world where many dictionary words are trademarks? How to use dependency injection and avoid temporal coupling? How to write a 12-bar blues melody Can you Ready a Bard spell to release it after using Battle Magic? Why did the Apollo 13 crew extend the LM landing gear? SafeCracker #3 - We've Been Blocked As a Bard multi-classing into Warlock, what spells do I get? Multiple SQL versions with Docker Didn't attend field-specific conferences during my PhD; how much of a disadvantage is it? Copy previous line to current line from text file Would glacier 'trees' be plausible? As matter approaches a black hole, does it speed up? Find the cheapest shipping option based on item weight Python - What if the end-user didn't have the required library? Why does this derived table improve performance? Appropriate certificate to ask for a fibre installation (ANSI/TIA-568.3-D?) How can internet speed be 10 time...
                    Read more