Audit methodologies and standards for Big Data2019 Community Moderator ElectionHow big is big data?Is Python suitable for big dataWhat is the best Big-Data framework for stream processing?Big data and data mining for CRM?What are some challenges with big data?Dealing with big datais there big difference between data Science , big Data and database?Big data analytics referencesData brokers for market-related data, how to choose, where to look for?Big data online class

The use of multiple foreign keys on same column in SQL Server

In Japanese, what’s the difference between “Tonari ni” (となりに) and “Tsugi” (つぎ)? When would you use one over the other?

Why, historically, did Gödel think CH was false?

Watching something be written to a file live with tail

What do you call a Matrix-like slowdown and camera movement effect?

can i play a electric guitar through a bass amp?

Prove that NP is closed under karp reduction?

Show that if two triangles built on parallel lines, with equal bases have the same perimeter only if they are congruent.

Mage Armor with Defense fighting style (for Adventurers League bladeslinger)

How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?

How to write a macro that is braces sensitive?

Can I make popcorn with any corn?

How do we improve the relationship with a client software team that performs poorly and is becoming less collaborative?

How can bays and straits be determined in a procedurally generated map?

Can an x86 CPU running in real mode be considered to be basically an 8086 CPU?

What's the output of a record cartridge playing an out-of-speed record

Is it possible to do 50 km distance without any previous training?

How is it possible to have an ability score that is less than 3?

Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?

Approximately how much travel time was saved by the opening of the Suez Canal in 1869?

To string or not to string

Why was the small council so happy for Tyrion to become the Master of Coin?

What do the dots in this tr command do: tr .............A-Z A-ZA-Z <<< "JVPQBOV" (with 13 dots)

Finding angle with pure Geometry.



Audit methodologies and standards for Big Data



2019 Community Moderator ElectionHow big is big data?Is Python suitable for big dataWhat is the best Big-Data framework for stream processing?Big data and data mining for CRM?What are some challenges with big data?Dealing with big datais there big difference between data Science , big Data and database?Big data analytics referencesData brokers for market-related data, how to choose, where to look for?Big data online class










0












$begingroup$


Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?



The question is a little bit vague but let me clarify with a fictional example.



Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?



Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.



Thanks










share|improve this question











$endgroup$











  • $begingroup$
    What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
    $endgroup$
    – Shamit Verma
    Mar 27 at 8:46










  • $begingroup$
    The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
    $endgroup$
    – threeV
    Mar 27 at 8:49
















0












$begingroup$


Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?



The question is a little bit vague but let me clarify with a fictional example.



Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?



Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.



Thanks










share|improve this question











$endgroup$











  • $begingroup$
    What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
    $endgroup$
    – Shamit Verma
    Mar 27 at 8:46










  • $begingroup$
    The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
    $endgroup$
    – threeV
    Mar 27 at 8:49














0












0








0





$begingroup$


Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?



The question is a little bit vague but let me clarify with a fictional example.



Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?



Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.



Thanks










share|improve this question











$endgroup$




Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?



The question is a little bit vague but let me clarify with a fictional example.



Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?



Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.



Thanks







bigdata data






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 27 at 11:39









Blenzus

15010




15010










asked Mar 27 at 8:34









threeVthreeV

1




1











  • $begingroup$
    What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
    $endgroup$
    – Shamit Verma
    Mar 27 at 8:46










  • $begingroup$
    The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
    $endgroup$
    – threeV
    Mar 27 at 8:49

















  • $begingroup$
    What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
    $endgroup$
    – Shamit Verma
    Mar 27 at 8:46










  • $begingroup$
    The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
    $endgroup$
    – threeV
    Mar 27 at 8:49
















$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46




$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46












$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49





$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49











0






active

oldest

votes












Your Answer





StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48071%2faudit-methodologies-and-standards-for-big-data%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Data Science Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48071%2faudit-methodologies-and-standards-for-big-data%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Adding axes to figuresAdding axes labels to LaTeX figuresLaTeX equivalent of ConTeXt buffersRotate a node but not its content: the case of the ellipse decorationHow to define the default vertical distance between nodes?TikZ scaling graphic and adjust node position and keep font sizeNumerical conditional within tikz keys?adding axes to shapesAlign axes across subfiguresAdding figures with a certain orderLine up nested tikz enviroments or how to get rid of themAdding axes labels to LaTeX figures

Tähtien Talli Jäsenet | Lähteet | NavigointivalikkoSuomen Hippos – Tähtien Talli

Do these cracks on my tires look bad? The Next CEO of Stack OverflowDry rot tire should I replace?Having to replace tiresFishtailed so easily? Bad tires? ABS?Filling the tires with something other than air, to avoid puncture hassles?Used Michelin tires safe to install?Do these tyre cracks necessitate replacement?Rumbling noise: tires or mechanicalIs it possible to fix noisy feathered tires?Are bad winter tires still better than summer tires in winter?Torque converter failure - Related to replacing only 2 tires?Why use snow tires on all 4 wheels on 2-wheel-drive cars?