Trjtdtk

Is there any evidence that Cleopatra and Caesarion considered fleeing to India to escape the Romans?

Mimic lecturing on blackboard, facing audience

Is this part of the description of the Archfey warlock's Misty Escape feature redundant?

Make a Bowl of Alphabet Soup

What are some good ways to treat frozen vegetables such that they behave like fresh vegetables when stir frying them?

Do we have to expect a queue for the shuttle from Watford Junction to Harry Potter Studio?

Find the next value of this number series

What is Cash Advance APR?

Microchip documentation does not label CAN buss pins on micro controller pinout diagram

Is it allowed to activate the ability of multiple planeswalkers in a single turn?

How to preserve electronics (computers, iPads and phones) for hundreds of years

The Digit Triangles

In a multiple cat home, how many litter boxes should you have?

Can I cause damage to electrical appliances by unplugging them when they are turned on?

Biological Blimps: Propulsion

Creating two special characters

Why do ¬, ∀ and ∃ have the same precedence?

Change the color of a single dot in `ddot` symbol

Review your own paper in Mathematics

How to explain what's wrong with this application of the chain rule?

Why is the Sun approximated as a black body at ~ 5800 K?

Shouldn’t conservatives embrace universal basic income?

Why do Radio Buttons not fill the entire outer circle?

How could a planet have erratic days?

Learning with missing features (MNAR)

Supervised Learning with Necessarily Missing DataIs there any difference between feature extraction and feature learning?Missing Categorical Features - no imputationDeploying the prediction model under missing values for test dataDoes encoding missing values help?Can we look just at the other features when we have a missing vaue?Imputation missing values other than using Mean, Median in pythonDealing with NaN (missing) values for Logistic Regression- Best practices?Balance data using different criteriaHow to deal with missing data for Bernoulli Naive Bayes?

0

$begingroup$

I want to learn from features that may have some missing informations. The value of the variable that's missing is related to the reason it's missing (MNAR)

To better understand my case, here is an example :

I want to learn a model for voice recognition. When using the model I'll know who will be speaking.

I have training data for those speakers, but I also have other data with speakers that will not use the model.

I don't want to add features for those speakers, only for those that will use the model.

How can I process the inputs before training the neural network without risking to damage the performance of the end users ?

For now I intend to use this method :

Each end user, for wich I know the identity, will have a dedicated feature. When training on speaker without dedicated feature :

• A feature that represent "have dedicated identity feature" will be set to -1.


• All identity features will be put to 0.

For example :

End user 1 → [1 -1 -1 ... 1]

End user 2 → [-1 1 -1 ... 1]

End user 2 → [-1 -1 1 ... 1]

...

speakers only for training → [0 0 0 ... -1]

Is this the right thing to do ? Is there a better way ?

P.S. - I can only modify the inputs, the neural network's architecture cannot be modified, so I can't use things like dropout.

machine-learning neural-network missing-data

share|improve this question

asked Mar 18 at 23:15

Adrian B.Adrian B.

11

$endgroup$

add a comment | 

0

$begingroup$

I want to learn from features that may have some missing informations. The value of the variable that's missing is related to the reason it's missing (MNAR)

To better understand my case, here is an example :

I want to learn a model for voice recognition. When using the model I'll know who will be speaking.

I have training data for those speakers, but I also have other data with speakers that will not use the model.

I don't want to add features for those speakers, only for those that will use the model.

How can I process the inputs before training the neural network without risking to damage the performance of the end users ?

For now I intend to use this method :

Each end user, for wich I know the identity, will have a dedicated feature. When training on speaker without dedicated feature :

• A feature that represent "have dedicated identity feature" will be set to -1.


• All identity features will be put to 0.

For example :

End user 1 → [1 -1 -1 ... 1]

End user 2 → [-1 1 -1 ... 1]

End user 2 → [-1 -1 1 ... 1]

...

speakers only for training → [0 0 0 ... -1]

Is this the right thing to do ? Is there a better way ?

P.S. - I can only modify the inputs, the neural network's architecture cannot be modified, so I can't use things like dropout.

machine-learning neural-network missing-data

share|improve this question

asked Mar 18 at 23:15

Adrian B.Adrian B.

11

$endgroup$

add a comment | 

$begingroup$

I want to learn from features that may have some missing informations. The value of the variable that's missing is related to the reason it's missing (MNAR)

To better understand my case, here is an example :

I want to learn a model for voice recognition. When using the model I'll know who will be speaking.

I have training data for those speakers, but I also have other data with speakers that will not use the model.

I don't want to add features for those speakers, only for those that will use the model.

How can I process the inputs before training the neural network without risking to damage the performance of the end users ?

For now I intend to use this method :

Each end user, for wich I know the identity, will have a dedicated feature. When training on speaker without dedicated feature :

• A feature that represent "have dedicated identity feature" will be set to -1.


• All identity features will be put to 0.

For example :

End user 1 → [1 -1 -1 ... 1]

End user 2 → [-1 1 -1 ... 1]

End user 2 → [-1 -1 1 ... 1]

...

speakers only for training → [0 0 0 ... -1]

Is this the right thing to do ? Is there a better way ?

P.S. - I can only modify the inputs, the neural network's architecture cannot be modified, so I can't use things like dropout.

machine-learning neural-network missing-data

share|improve this question

asked Mar 18 at 23:15

Adrian B.Adrian B.

11

$endgroup$

share|improve this question

asked Mar 18 at 23:15

Adrian B.Adrian B.

11

share|improve this question

asked Mar 18 at 23:15

Adrian B.Adrian B.

11

asked Mar 18 at 23:15

Adrian B.Adrian B.

11

asked Mar 18 at 23:15

Adrian B.Adrian B.

11