Multi task learning with missing labels in Keras tutorial question Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsOnline machine learning tutorialHow to deal with string labels in multi-class classification with keras?Evaluating machine learning model with missing featuresMulti-task learning for Multi-label classification?Multitask learning NN only trains on a few tasksMulti task learning in KerasMulti task learning architecture for Multi-label classificationWhy is my Keras model not learning image segmentation?Training multi-label classifier with unbalanced samples in KerasApplying CNN for cross sectional data

How to recreate this effect in Photoshop?

Is a manifold-with-boundary with given interior and non-empty boundary essentially unique?

How to bypass password on Windows XP account?

What is this single-engine low-wing propeller plane?

When -s is used with third person singular. What's its use in this context?

Is it ethical to give a final exam after the professor has quit before teaching the remaining chapters of the course?

Does surprise arrest existing movement?

What do you call a phrase that's not an idiom yet?

Determinant is linear as a function of each of the rows of the matrix.

What are the pros and cons of Aerospike nosecones?

Is 1 ppb equal to 1 μg/kg?

Why is there no army of Iron-Mans in the MCU?

What is the longest distance a 13th-level monk can jump while attacking on the same turn?

Single word antonym of "flightless"

When to stop saving and start investing?

How does a Death Domain cleric's Touch of Death feature work with Touch-range spells delivered by familiars?

Bonus calculation: Am I making a mountain out of a molehill?

Proof involving the spectral radius and the Jordan canonical form

Can a non-EU citizen traveling with me come with me through the EU passport line?

Why is black pepper both grey and black?

Is the Standard Deduction better than Itemized when both are the same amount?

How can I make names more distinctive without making them longer?

What's the difference between `auto x = vector<int>()` and `vector<int> x`?

How can I fade player when goes inside or outside of the area?



Multi task learning with missing labels in Keras tutorial question



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsOnline machine learning tutorialHow to deal with string labels in multi-class classification with keras?Evaluating machine learning model with missing featuresMulti-task learning for Multi-label classification?Multitask learning NN only trains on a few tasksMulti task learning in KerasMulti task learning architecture for Multi-label classificationWhy is my Keras model not learning image segmentation?Training multi-label classifier with unbalanced samples in KerasApplying CNN for cross sectional data










0












$begingroup$


https://www.dlology.com/blog/how-to-multi-task-learning-with-missing-labels-in-keras/



I followed this tutorial to create a multi task model for binary classification with missing labels in keras. The dataset that I'm using has inputs in the form of 167 length bit strings consisting of ones and zeroes (represent chemical structures), and the output is 12 binary labels representing toxicity of assays. I pretty much copied the tutorial exactly except for replacing their data with my curated dataset, and I'm getting 11% accuracy on my test set. I'm extremely confused about how the tutorial's masked_loss_function works, and I would appreciate any input on how to improve my model:



from keras import backend as K
def masked_loss_function(y_true, y_pred):
mask = K.cast(K.not_equal(y_true, mask_value), K.floatx())
return K.binary_crossentropy(y_true * mask, y_pred * mask)

model.compile(loss=masked_loss_function, optimizer='adam', metrics=['accuracy'])


Thanks so much!










share|improve this question











$endgroup$











  • $begingroup$
    Try applying KL divergence loss with similar and dissimilar pairs. ;)
    $endgroup$
    – William Scott
    Apr 2 at 0:40















0












$begingroup$


https://www.dlology.com/blog/how-to-multi-task-learning-with-missing-labels-in-keras/



I followed this tutorial to create a multi task model for binary classification with missing labels in keras. The dataset that I'm using has inputs in the form of 167 length bit strings consisting of ones and zeroes (represent chemical structures), and the output is 12 binary labels representing toxicity of assays. I pretty much copied the tutorial exactly except for replacing their data with my curated dataset, and I'm getting 11% accuracy on my test set. I'm extremely confused about how the tutorial's masked_loss_function works, and I would appreciate any input on how to improve my model:



from keras import backend as K
def masked_loss_function(y_true, y_pred):
mask = K.cast(K.not_equal(y_true, mask_value), K.floatx())
return K.binary_crossentropy(y_true * mask, y_pred * mask)

model.compile(loss=masked_loss_function, optimizer='adam', metrics=['accuracy'])


Thanks so much!










share|improve this question











$endgroup$











  • $begingroup$
    Try applying KL divergence loss with similar and dissimilar pairs. ;)
    $endgroup$
    – William Scott
    Apr 2 at 0:40













0












0








0





$begingroup$


https://www.dlology.com/blog/how-to-multi-task-learning-with-missing-labels-in-keras/



I followed this tutorial to create a multi task model for binary classification with missing labels in keras. The dataset that I'm using has inputs in the form of 167 length bit strings consisting of ones and zeroes (represent chemical structures), and the output is 12 binary labels representing toxicity of assays. I pretty much copied the tutorial exactly except for replacing their data with my curated dataset, and I'm getting 11% accuracy on my test set. I'm extremely confused about how the tutorial's masked_loss_function works, and I would appreciate any input on how to improve my model:



from keras import backend as K
def masked_loss_function(y_true, y_pred):
mask = K.cast(K.not_equal(y_true, mask_value), K.floatx())
return K.binary_crossentropy(y_true * mask, y_pred * mask)

model.compile(loss=masked_loss_function, optimizer='adam', metrics=['accuracy'])


Thanks so much!










share|improve this question











$endgroup$




https://www.dlology.com/blog/how-to-multi-task-learning-with-missing-labels-in-keras/



I followed this tutorial to create a multi task model for binary classification with missing labels in keras. The dataset that I'm using has inputs in the form of 167 length bit strings consisting of ones and zeroes (represent chemical structures), and the output is 12 binary labels representing toxicity of assays. I pretty much copied the tutorial exactly except for replacing their data with my curated dataset, and I'm getting 11% accuracy on my test set. I'm extremely confused about how the tutorial's masked_loss_function works, and I would appreciate any input on how to improve my model:



from keras import backend as K
def masked_loss_function(y_true, y_pred):
mask = K.cast(K.not_equal(y_true, mask_value), K.floatx())
return K.binary_crossentropy(y_true * mask, y_pred * mask)

model.compile(loss=masked_loss_function, optimizer='adam', metrics=['accuracy'])


Thanks so much!







classification keras beginner multitask-learning






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Apr 1 at 22:29









oW_

3,341933




3,341933










asked Apr 1 at 22:18









scouts9scouts9

11




11











  • $begingroup$
    Try applying KL divergence loss with similar and dissimilar pairs. ;)
    $endgroup$
    – William Scott
    Apr 2 at 0:40
















  • $begingroup$
    Try applying KL divergence loss with similar and dissimilar pairs. ;)
    $endgroup$
    – William Scott
    Apr 2 at 0:40















$begingroup$
Try applying KL divergence loss with similar and dissimilar pairs. ;)
$endgroup$
– William Scott
Apr 2 at 0:40




$begingroup$
Try applying KL divergence loss with similar and dissimilar pairs. ;)
$endgroup$
– William Scott
Apr 2 at 0:40










0






active

oldest

votes












Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48382%2fmulti-task-learning-with-missing-labels-in-keras-tutorial-question%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Data Science Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48382%2fmulti-task-learning-with-missing-labels-in-keras-tutorial-question%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Marja Vauras Lähteet | Aiheesta muualla | NavigointivalikkoMarja Vauras Turun yliopiston tutkimusportaalissaInfobox OKSuomalaisen Tiedeakatemian varsinaiset jäsenetKasvatustieteiden tiedekunnan dekaanit ja muu johtoMarja VaurasKoulutusvienti on kestävyys- ja ketteryyslaji (2.5.2017)laajentamallaWorldCat Identities0000 0001 0855 9405n86069603utb201588738523620927

Which is better: GPT or RelGAN for text generation?2019 Community Moderator ElectionWhat is the difference between TextGAN and LM for text generation?GANs (generative adversarial networks) possible for text as well?Generator loss not decreasing- text to image synthesisChoosing a right algorithm for template-based text generationHow should I format input and output for text generation with LSTMsGumbel Softmax vs Vanilla Softmax for GAN trainingWhich neural network to choose for classification from text/speech?NLP text autoencoder that generates text in poetic meterWhat is the interpretation of the expectation notation in the GAN formulation?What is the difference between TextGAN and LM for text generation?How to prepare the data for text generation task

Is this part of the description of the Archfey warlock's Misty Escape feature redundant?When is entropic ward considered “used”?How does the reaction timing work for Wrath of the Storm? Can it potentially prevent the damage from the triggering attack?Does the Dark Arts Archlich warlock patrons's Arcane Invisibility activate every time you cast a level 1+ spell?When attacking while invisible, when exactly does invisibility break?Can I cast Hellish Rebuke on my turn?Do I have to “pre-cast” a reaction spell in order for it to be triggered?What happens if a Player Misty Escapes into an Invisible CreatureCan a reaction interrupt multiattack?Does the Fiend-patron warlock's Hurl Through Hell feature dispel effects that require the target to be on the same plane as the caster?What are you allowed to do while using the Warlock's Eldritch Master feature?