Isolation Forest Implementationvalidation_curve differs from cross_val_score?Isolation forest results every value -1Isolation Forest Feature ImportanceWhy is my Keras model not learning image segmentation?Is there any implementation of Extended Isolation Forest algorithm in R/Python?SciKit-Learn Decision Tree OverfittingModelling a startup's funding journey with Brownian Motionpredicting loan default based on transaction historyIsolation Forest Prediction

How to assert on pagereference where the endpoint of pagereference is predefined

When and why did journal article titles become descriptive, rather than creatively allusive?

What are the spoon bit of a spoon and fork bit of a fork called?

Meaning of "individuandum"

How to creep the reader out with what seems like a normal person?

Has any spacecraft ever had the ability to directly communicate with civilian air traffic control?

Is it always OK to ask for a copy of the lecturer's slides?

How did Captain America use this power?

Can PCs use nonmagical armor and weapons looted from monsters?

How do you center multiple equations that have multiple steps?

Proof that when f'(x) < f(x), f(x) =0

If an enemy is just below a 10-foot-high ceiling, are they in melee range of a creature on the ground?

Catholic vs Protestant Support for Nazism in Germany

Attending a conference where my ex-supervisor and his collaborator are present, should I attend?

Airbnb - host wants to reduce rooms, can we get refund?

Is thermodynamics only applicable to systems in equilibrium?

What word means "to make something obsolete"?

Visa for volunteering in England

I caught several of my students plagiarizing. Could it be my fault as a teacher?

If Melisandre foresaw another character closing blue eyes, why did she follow Stannis?

Accidentally deleted the "/usr/share" folder

Unidentified items in bicycle tube repair kit

Integral of (1/100-x)

How could a planet have most of its water in the atmosphere?



Isolation Forest Implementation


validation_curve differs from cross_val_score?Isolation forest results every value -1Isolation Forest Feature ImportanceWhy is my Keras model not learning image segmentation?Is there any implementation of Extended Isolation Forest algorithm in R/Python?SciKit-Learn Decision Tree OverfittingModelling a startup's funding journey with Brownian Motionpredicting loan default based on transaction historyIsolation Forest Prediction













0












$begingroup$


I implemented Isolation Forest(Liu et al. 2008), but when testing with different datasets using 5 fold cross validation, in kddcup99 dataset(around 4.5 lakh rows), I am getting maximum of 70-72% accuracy, and one kddcup99 available with 2 lakh dataset, I am getting maximum 85-87% accuracy but the author's have given AUC 1.



For satellite I am getting avg of 65% varying subssmpling size from (1 to 96) and above 70% when subsampling size is more than 500, but they have given 71%(1 to 100).



For breast cancer dataset I am getting maximum of 75% accuracy but they have given AUC 0.97.



I have implemented exactly same but don't know why this. Can someone please help me. I can share my accuracies as well.



Thank you.










share|improve this question









$endgroup$











  • $begingroup$
    Are you working with the same tech stack as the paper ?
    $endgroup$
    – Shamit Verma
    Apr 10 at 12:27






  • 1




    $begingroup$
    why do you compare accuracy and AUC? what are your AUC results?
    $endgroup$
    – oW_
    Apr 10 at 15:07










  • $begingroup$
    Yes I have been Working on the same work. How to find the actual AUC using formulas. Is always AUC would be more?
    $endgroup$
    – Shivanya
    Apr 10 at 18:01











  • $begingroup$
    Is it not (TP+TN) / total
    $endgroup$
    – Shivanya
    Apr 10 at 18:05










  • $begingroup$
    Are you using the same feature preprocessing?
    $endgroup$
    – jonnor
    Apr 10 at 21:57















0












$begingroup$


I implemented Isolation Forest(Liu et al. 2008), but when testing with different datasets using 5 fold cross validation, in kddcup99 dataset(around 4.5 lakh rows), I am getting maximum of 70-72% accuracy, and one kddcup99 available with 2 lakh dataset, I am getting maximum 85-87% accuracy but the author's have given AUC 1.



For satellite I am getting avg of 65% varying subssmpling size from (1 to 96) and above 70% when subsampling size is more than 500, but they have given 71%(1 to 100).



For breast cancer dataset I am getting maximum of 75% accuracy but they have given AUC 0.97.



I have implemented exactly same but don't know why this. Can someone please help me. I can share my accuracies as well.



Thank you.










share|improve this question









$endgroup$











  • $begingroup$
    Are you working with the same tech stack as the paper ?
    $endgroup$
    – Shamit Verma
    Apr 10 at 12:27






  • 1




    $begingroup$
    why do you compare accuracy and AUC? what are your AUC results?
    $endgroup$
    – oW_
    Apr 10 at 15:07










  • $begingroup$
    Yes I have been Working on the same work. How to find the actual AUC using formulas. Is always AUC would be more?
    $endgroup$
    – Shivanya
    Apr 10 at 18:01











  • $begingroup$
    Is it not (TP+TN) / total
    $endgroup$
    – Shivanya
    Apr 10 at 18:05










  • $begingroup$
    Are you using the same feature preprocessing?
    $endgroup$
    – jonnor
    Apr 10 at 21:57













0












0








0





$begingroup$


I implemented Isolation Forest(Liu et al. 2008), but when testing with different datasets using 5 fold cross validation, in kddcup99 dataset(around 4.5 lakh rows), I am getting maximum of 70-72% accuracy, and one kddcup99 available with 2 lakh dataset, I am getting maximum 85-87% accuracy but the author's have given AUC 1.



For satellite I am getting avg of 65% varying subssmpling size from (1 to 96) and above 70% when subsampling size is more than 500, but they have given 71%(1 to 100).



For breast cancer dataset I am getting maximum of 75% accuracy but they have given AUC 0.97.



I have implemented exactly same but don't know why this. Can someone please help me. I can share my accuracies as well.



Thank you.










share|improve this question









$endgroup$




I implemented Isolation Forest(Liu et al. 2008), but when testing with different datasets using 5 fold cross validation, in kddcup99 dataset(around 4.5 lakh rows), I am getting maximum of 70-72% accuracy, and one kddcup99 available with 2 lakh dataset, I am getting maximum 85-87% accuracy but the author's have given AUC 1.



For satellite I am getting avg of 65% varying subssmpling size from (1 to 96) and above 70% when subsampling size is more than 500, but they have given 71%(1 to 100).



For breast cancer dataset I am getting maximum of 75% accuracy but they have given AUC 0.97.



I have implemented exactly same but don't know why this. Can someone please help me. I can share my accuracies as well.



Thank you.







python






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Apr 10 at 10:43









ShivanyaShivanya

166




166











  • $begingroup$
    Are you working with the same tech stack as the paper ?
    $endgroup$
    – Shamit Verma
    Apr 10 at 12:27






  • 1




    $begingroup$
    why do you compare accuracy and AUC? what are your AUC results?
    $endgroup$
    – oW_
    Apr 10 at 15:07










  • $begingroup$
    Yes I have been Working on the same work. How to find the actual AUC using formulas. Is always AUC would be more?
    $endgroup$
    – Shivanya
    Apr 10 at 18:01











  • $begingroup$
    Is it not (TP+TN) / total
    $endgroup$
    – Shivanya
    Apr 10 at 18:05










  • $begingroup$
    Are you using the same feature preprocessing?
    $endgroup$
    – jonnor
    Apr 10 at 21:57
















  • $begingroup$
    Are you working with the same tech stack as the paper ?
    $endgroup$
    – Shamit Verma
    Apr 10 at 12:27






  • 1




    $begingroup$
    why do you compare accuracy and AUC? what are your AUC results?
    $endgroup$
    – oW_
    Apr 10 at 15:07










  • $begingroup$
    Yes I have been Working on the same work. How to find the actual AUC using formulas. Is always AUC would be more?
    $endgroup$
    – Shivanya
    Apr 10 at 18:01











  • $begingroup$
    Is it not (TP+TN) / total
    $endgroup$
    – Shivanya
    Apr 10 at 18:05










  • $begingroup$
    Are you using the same feature preprocessing?
    $endgroup$
    – jonnor
    Apr 10 at 21:57















$begingroup$
Are you working with the same tech stack as the paper ?
$endgroup$
– Shamit Verma
Apr 10 at 12:27




$begingroup$
Are you working with the same tech stack as the paper ?
$endgroup$
– Shamit Verma
Apr 10 at 12:27




1




1




$begingroup$
why do you compare accuracy and AUC? what are your AUC results?
$endgroup$
– oW_
Apr 10 at 15:07




$begingroup$
why do you compare accuracy and AUC? what are your AUC results?
$endgroup$
– oW_
Apr 10 at 15:07












$begingroup$
Yes I have been Working on the same work. How to find the actual AUC using formulas. Is always AUC would be more?
$endgroup$
– Shivanya
Apr 10 at 18:01





$begingroup$
Yes I have been Working on the same work. How to find the actual AUC using formulas. Is always AUC would be more?
$endgroup$
– Shivanya
Apr 10 at 18:01













$begingroup$
Is it not (TP+TN) / total
$endgroup$
– Shivanya
Apr 10 at 18:05




$begingroup$
Is it not (TP+TN) / total
$endgroup$
– Shivanya
Apr 10 at 18:05












$begingroup$
Are you using the same feature preprocessing?
$endgroup$
– jonnor
Apr 10 at 21:57




$begingroup$
Are you using the same feature preprocessing?
$endgroup$
– jonnor
Apr 10 at 21:57










0






active

oldest

votes












Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49034%2fisolation-forest-implementation%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Data Science Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49034%2fisolation-forest-implementation%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Marja Vauras Lähteet | Aiheesta muualla | NavigointivalikkoMarja Vauras Turun yliopiston tutkimusportaalissaInfobox OKSuomalaisen Tiedeakatemian varsinaiset jäsenetKasvatustieteiden tiedekunnan dekaanit ja muu johtoMarja VaurasKoulutusvienti on kestävyys- ja ketteryyslaji (2.5.2017)laajentamallaWorldCat Identities0000 0001 0855 9405n86069603utb201588738523620927

Which is better: GPT or RelGAN for text generation?2019 Community Moderator ElectionWhat is the difference between TextGAN and LM for text generation?GANs (generative adversarial networks) possible for text as well?Generator loss not decreasing- text to image synthesisChoosing a right algorithm for template-based text generationHow should I format input and output for text generation with LSTMsGumbel Softmax vs Vanilla Softmax for GAN trainingWhich neural network to choose for classification from text/speech?NLP text autoencoder that generates text in poetic meterWhat is the interpretation of the expectation notation in the GAN formulation?What is the difference between TextGAN and LM for text generation?How to prepare the data for text generation task

Is this part of the description of the Archfey warlock's Misty Escape feature redundant?When is entropic ward considered “used”?How does the reaction timing work for Wrath of the Storm? Can it potentially prevent the damage from the triggering attack?Does the Dark Arts Archlich warlock patrons's Arcane Invisibility activate every time you cast a level 1+ spell?When attacking while invisible, when exactly does invisibility break?Can I cast Hellish Rebuke on my turn?Do I have to “pre-cast” a reaction spell in order for it to be triggered?What happens if a Player Misty Escapes into an Invisible CreatureCan a reaction interrupt multiattack?Does the Fiend-patron warlock's Hurl Through Hell feature dispel effects that require the target to be on the same plane as the caster?What are you allowed to do while using the Warlock's Eldritch Master feature?