K-fold cross validation of scikit-learn with confusion matrix of Keras The Next CEO of Stack Overflow2019 Community Moderator ElectionCross Validation in KerasK-Fold Cross validation confusion?Linear Regression and k-fold cross validationK fold cross validation algorithmHow does k fold cross validation work?k-fold cross-validation: model selection or variation in models when using k-fold cross validationQuestion about K-Fold Cross ValidationSimple prediction with KerasK-fold cross validation when using fit_generator and flow_from_directory() in KerasUsing K-fold cross-validation in Keras on the data of my model

Solving system of ODEs with extra parameter

Does soap repel water?

How to count occurrences of text in a file?

Rotate a column

What was the first Unix version to run on a microcomputer?

What can we do to stop prior company from asking us questions?

Is there a difference between "Fahrstuhl" and "Aufzug"

Why do remote US companies require working in the US?

Writing differences on a blackboard

Why does standard notation not preserve intervals (visually)

Is micro rebar a better way to reinforce concrete than rebar?

Display a text message if the shortcode is not found?

What is the difference between 翼 and 翅膀?

Received an invoice from my ex-employer billing me for training; how to handle?

How to get from Geneva Airport to Metabief?

How to scale a tikZ image which is within a figure environment

How many extra stops do monopods offer for tele photographs?

Why this way of making earth uninhabitable in Interstellar?

Do I need to write [sic] when a number is less than 10 but isn't written out?

Is this "being" usage is essential?

Unreliable Magic - Is it worth it?

If the updated MCAS software needs two AOA sensors, doesn't that introduce a new single point of failure?

Is there a way to bypass a component in series in a circuit if that component fails?

Can MTA send mail via a relay without being told so?



K-fold cross validation of scikit-learn with confusion matrix of Keras



The Next CEO of Stack Overflow
2019 Community Moderator ElectionCross Validation in KerasK-Fold Cross validation confusion?Linear Regression and k-fold cross validationK fold cross validation algorithmHow does k fold cross validation work?k-fold cross-validation: model selection or variation in models when using k-fold cross validationQuestion about K-Fold Cross ValidationSimple prediction with KerasK-fold cross validation when using fit_generator and flow_from_directory() in KerasUsing K-fold cross-validation in Keras on the data of my model










2












$begingroup$


I intend to display confusion matrix using Keras while K-fold of scikit-learn. My code using Keras is:



import numpy
import pandas
from keras.models import Sequential
from keras.layers import Dense

seed = 7
numpy.random.seed(seed)

# load dataset
dataframe = pandas.read_csv("BolMov.csv", header=None)
dataset = dataframe.values
X = dataset[:,0:24].astype(float)
Y = dataset[:,24]

model = Sequential()
model.add(Dense(16, activation='relu'))
model.add(Dense(7, activation='softmax')
model.compile('adam', 'categorical_crossentropy', metrics=['accuracy'])

y_cat = to_categorical(Y)
result = model.fit(X, y_cat, verbose=0, epochs=50)

plot_loss_accuracy(result)

y_pred = model.predict_classes(X, verbose=0)

print(classification_report(y, y_pred))
plot_confusion_matrix(model, X, y)


How should I use kfold in this code? Here the author is calling a function. What I believe is that if I do so in my code, the model.fit() will be executed twice - once for my Keras code and another time (internally) for the KerasClassifier(). I want that the model.fit() executes once only. Help from anyone is appreciated.






keras scikit-learn cross-validation







share|improve this question











$endgroup$











  • $begingroup$
    don't call model.fit() as you currently do in your code but instead wrap your model in a KerasClassifier() and apply KFold() to it
    $endgroup$
    – pcko1
    Feb 16 at 23:58











  • $begingroup$
    @pcko1 Can I write like this: result = KerasClassifier(build_fn=baseline_model, epochs=200, batch_size=5, verbose=0) and then plot_loss_accuracy(result) so that result can be used for kfold validation of scikit-learn as well as confusion matrix display of Keras?
    $endgroup$
    – PS Nayak
    Feb 18 at 14:08
















2












$begingroup$


I intend to display confusion matrix using Keras while K-fold of scikit-learn. My code using Keras is:



import numpy
import pandas
from keras.models import Sequential
from keras.layers import Dense

seed = 7
numpy.random.seed(seed)

# load dataset
dataframe = pandas.read_csv("BolMov.csv", header=None)
dataset = dataframe.values
X = dataset[:,0:24].astype(float)
Y = dataset[:,24]

model = Sequential()
model.add(Dense(16, activation='relu'))
model.add(Dense(7, activation='softmax')
model.compile('adam', 'categorical_crossentropy', metrics=['accuracy'])

y_cat = to_categorical(Y)
result = model.fit(X, y_cat, verbose=0, epochs=50)

plot_loss_accuracy(result)

y_pred = model.predict_classes(X, verbose=0)

print(classification_report(y, y_pred))
plot_confusion_matrix(model, X, y)


How should I use kfold in this code? Here the author is calling a function. What I believe is that if I do so in my code, the model.fit() will be executed twice - once for my Keras code and another time (internally) for the KerasClassifier(). I want that the model.fit() executes once only. Help from anyone is appreciated.






keras scikit-learn cross-validation







share|improve this question











$endgroup$











  • $begingroup$
    don't call model.fit() as you currently do in your code but instead wrap your model in a KerasClassifier() and apply KFold() to it
    $endgroup$
    – pcko1
    Feb 16 at 23:58











  • $begingroup$
    @pcko1 Can I write like this: result = KerasClassifier(build_fn=baseline_model, epochs=200, batch_size=5, verbose=0) and then plot_loss_accuracy(result) so that result can be used for kfold validation of scikit-learn as well as confusion matrix display of Keras?
    $endgroup$
    – PS Nayak
    Feb 18 at 14:08














2












2








2


1



$begingroup$


I intend to display confusion matrix using Keras while K-fold of scikit-learn. My code using Keras is:



import numpy
import pandas
from keras.models import Sequential
from keras.layers import Dense

seed = 7
numpy.random.seed(seed)

# load dataset
dataframe = pandas.read_csv("BolMov.csv", header=None)
dataset = dataframe.values
X = dataset[:,0:24].astype(float)
Y = dataset[:,24]

model = Sequential()
model.add(Dense(16, activation='relu'))
model.add(Dense(7, activation='softmax')
model.compile('adam', 'categorical_crossentropy', metrics=['accuracy'])

y_cat = to_categorical(Y)
result = model.fit(X, y_cat, verbose=0, epochs=50)

plot_loss_accuracy(result)

y_pred = model.predict_classes(X, verbose=0)

print(classification_report(y, y_pred))
plot_confusion_matrix(model, X, y)


How should I use kfold in this code? Here the author is calling a function. What I believe is that if I do so in my code, the model.fit() will be executed twice - once for my Keras code and another time (internally) for the KerasClassifier(). I want that the model.fit() executes once only. Help from anyone is appreciated.






keras scikit-learn cross-validation







share|improve this question











$endgroup$




I intend to display confusion matrix using Keras while K-fold of scikit-learn. My code using Keras is:



import numpy
import pandas
from keras.models import Sequential
from keras.layers import Dense

seed = 7
numpy.random.seed(seed)

# load dataset
dataframe = pandas.read_csv("BolMov.csv", header=None)
dataset = dataframe.values
X = dataset[:,0:24].astype(float)
Y = dataset[:,24]

model = Sequential()
model.add(Dense(16, activation='relu'))
model.add(Dense(7, activation='softmax')
model.compile('adam', 'categorical_crossentropy', metrics=['accuracy'])

y_cat = to_categorical(Y)
result = model.fit(X, y_cat, verbose=0, epochs=50)

plot_loss_accuracy(result)

y_pred = model.predict_classes(X, verbose=0)

print(classification_report(y, y_pred))
plot_confusion_matrix(model, X, y)


How should I use kfold in this code? Here the author is calling a function. What I believe is that if I do so in my code, the model.fit() will be executed twice - once for my Keras code and another time (internally) for the KerasClassifier(). I want that the model.fit() executes once only. Help from anyone is appreciated.






keras scikit-learn cross-validation




keras scikit-learn cross-validation






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Feb 16 at 17:46







PS Nayak

















asked Feb 16 at 17:38









PS NayakPS Nayak

134




134











  • $begingroup$
    don't call model.fit() as you currently do in your code but instead wrap your model in a KerasClassifier() and apply KFold() to it
    $endgroup$
    – pcko1
    Feb 16 at 23:58











  • $begingroup$
    @pcko1 Can I write like this: result = KerasClassifier(build_fn=baseline_model, epochs=200, batch_size=5, verbose=0) and then plot_loss_accuracy(result) so that result can be used for kfold validation of scikit-learn as well as confusion matrix display of Keras?
    $endgroup$
    – PS Nayak
    Feb 18 at 14:08

















  • $begingroup$
    don't call model.fit() as you currently do in your code but instead wrap your model in a KerasClassifier() and apply KFold() to it
    $endgroup$
    – pcko1
    Feb 16 at 23:58











  • $begingroup$
    @pcko1 Can I write like this: result = KerasClassifier(build_fn=baseline_model, epochs=200, batch_size=5, verbose=0) and then plot_loss_accuracy(result) so that result can be used for kfold validation of scikit-learn as well as confusion matrix display of Keras?
    $endgroup$
    – PS Nayak
    Feb 18 at 14:08
















$begingroup$
don't call model.fit() as you currently do in your code but instead wrap your model in a KerasClassifier() and apply KFold() to it
$endgroup$
– pcko1
Feb 16 at 23:58





$begingroup$
don't call model.fit() as you currently do in your code but instead wrap your model in a KerasClassifier() and apply KFold() to it
$endgroup$
– pcko1
Feb 16 at 23:58













$begingroup$
@pcko1 Can I write like this: result = KerasClassifier(build_fn=baseline_model, epochs=200, batch_size=5, verbose=0) and then plot_loss_accuracy(result) so that result can be used for kfold validation of scikit-learn as well as confusion matrix display of Keras?
$endgroup$
– PS Nayak
Feb 18 at 14:08





$begingroup$
@pcko1 Can I write like this: result = KerasClassifier(build_fn=baseline_model, epochs=200, batch_size=5, verbose=0) and then plot_loss_accuracy(result) so that result can be used for kfold validation of scikit-learn as well as confusion matrix display of Keras?
$endgroup$
– PS Nayak
Feb 18 at 14:08











1 Answer
1






active

oldest

votes


















0












$begingroup$

KFold() is meant for cross-validation purpose where multiple models are created over the subsets of the entire dataset and discarded after the validation procedure is over. So the model.fit() should be called explicitly to create the model for purpose. Both the tasks can be easily done through the wrapper named KerasClassifier() by packaging all the details of the model design.






share|improve this answer









$endgroup$













    Your Answer





    StackExchange.ifUsing("editor", function ()
    return StackExchange.using("mathjaxEditing", function ()
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    );
    );
    , "mathjax-editing");

    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "557"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f45698%2fk-fold-cross-validation-of-scikit-learn-with-confusion-matrix-of-keras%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0












    $begingroup$

    KFold() is meant for cross-validation purpose where multiple models are created over the subsets of the entire dataset and discarded after the validation procedure is over. So the model.fit() should be called explicitly to create the model for purpose. Both the tasks can be easily done through the wrapper named KerasClassifier() by packaging all the details of the model design.






    share|improve this answer









    $endgroup$

















      0












      $begingroup$

      KFold() is meant for cross-validation purpose where multiple models are created over the subsets of the entire dataset and discarded after the validation procedure is over. So the model.fit() should be called explicitly to create the model for purpose. Both the tasks can be easily done through the wrapper named KerasClassifier() by packaging all the details of the model design.






      share|improve this answer









      $endgroup$















        0












        0








        0





        $begingroup$

        KFold() is meant for cross-validation purpose where multiple models are created over the subsets of the entire dataset and discarded after the validation procedure is over. So the model.fit() should be called explicitly to create the model for purpose. Both the tasks can be easily done through the wrapper named KerasClassifier() by packaging all the details of the model design.






        share|improve this answer









        $endgroup$



        KFold() is meant for cross-validation purpose where multiple models are created over the subsets of the entire dataset and discarded after the validation procedure is over. So the model.fit() should be called explicitly to create the model for purpose. Both the tasks can be easily done through the wrapper named KerasClassifier() by packaging all the details of the model design.







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Feb 22 at 6:24









        PS NayakPS Nayak

        134




        134



























            draft saved

            draft discarded
















































            Thanks for contributing an answer to Data Science Stack Exchange!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid …


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f45698%2fk-fold-cross-validation-of-scikit-learn-with-confusion-matrix-of-keras%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            -

            Popular posts from this blog

            Adding axes to figuresAdding axes labels to LaTeX figuresLaTeX equivalent of ConTeXt buffersRotate a node but not its content: the case of the ellipse decorationHow to define the default vertical distance between nodes?TikZ scaling graphic and adjust node position and keep font sizeNumerical conditional within tikz keys?adding axes to shapesAlign axes across subfiguresAdding figures with a certain orderLine up nested tikz enviroments or how to get rid of themAdding axes labels to LaTeX figures

            Image
            Fear of getting stuck on one programming language / technology that is not used in my country Is there a single word describing earning money through any means? Why do we read the Megillah by night and by day? Pre-mixing cryogenic fuels and using only one fuel tank Is the U.S. Code copyrighted by the Government? Should I outline or discovery write my stories? What is this called? Old film camera viewer? Does the expansion of the universe explain why the universe doesn't collapse? Removing files under particular conditions (number of files, file age) Argument list too long when zipping large list of certain files in a folder When a Cleric spontaneously casts a Cure Light Wounds spell, will a Pearl of Power recover the original spell or Cure Light Wounds? Non-trope happy ending? Is it better practice to read straight from sheet music rather than memorize it? Do Legal Documents Require Signing In Standard Pen Colors? Does an advisor owe his/her student anyt...
            Read more

            Tähtien Talli Jäsenet | Lähteet | NavigointivalikkoSuomen Hippos – Tähtien Talli

            Image
            RaviurheiluUrheilun kunniagalleriat Suomen HippoksenravihevostenLämminverisiäsuomenhevosiaSuomen raviurheilunBrad de Veluwe Tähtien Talli on vuonna 1995 perustettu Suomen Hippoksen ylläpitämä suomalaisten ravihevosten kunniagalleria. Tähtien Tallissa on toistaiseksi yhteensä 20 hevosta. Lämminverisiä galleriassa on kymmenen ja suomenhevosia kymmenen. Ulkomailla syntyneitä hevosia on mukana kolme. Vaikka Suomen raviurheilun perinteet ulottuvat jo 1800-luvun puolelle, painottuvat Tähtien Tallien valinnat viimeisten 20-30 vuoden aikana kilpailleisiin hevosiin. Viimeisin kunnianosoituksen saanut hevonen on Brad de Veluwe joka liitettiin Tähtien Talliin vuoden 2015 Ravigaalassa. Jäsenet | Reipas vuoden 1958 Kuninkuusraveissa Lahdessa. Passionate Kemp lämminveristen Suomen mestaruuden voittoloimi yllään. Hevonen Kilpailuvuodet Kasvattaja Valinta- vuosi Charme Asserdal 1975–1981 Erik Andersson 1995...
            Read more

            Do these cracks on my tires look bad? The Next CEO of Stack OverflowDry rot tire should I replace?Having to replace tiresFishtailed so easily? Bad tires? ABS?Filling the tires with something other than air, to avoid puncture hassles?Used Michelin tires safe to install?Do these tyre cracks necessitate replacement?Rumbling noise: tires or mechanicalIs it possible to fix noisy feathered tires?Are bad winter tires still better than summer tires in winter?Torque converter failure - Related to replacing only 2 tires?Why use snow tires on all 4 wheels on 2-wheel-drive cars?

            Image
            Small nick on power cord from an electric alarm clock, and copper wiring exposed but intact Why do we say “un seul M” and not “une seule M” even though M is a “consonne”? Read/write a pipe-delimited file line by line with some simple text manipulation Free fall ellipse or parabola? Why did the Drakh emissary look so blurred in S04:E11 "Lines of Communication"? A hang glider, sudden unexpected lift to 25,000 feet altitude, what could do this? Planeswalker Ability and Death Timing Which acid/base does a strong base/acid react when added to a buffer solution? Is the 21st century's idea of "freedom of speech" based on precedent? Shortening a title without changing its meaning Man transported from Alternate World into ours by a Neutrino Detector Is it reasonable to ask other researchers to send me their previous grant applications? Find a path from s to t using as few red nodes as possible What difference does it make matching a w...
            Read more