Audit methodologies and standards for Big Data2019 Community Moderator ElectionHow big is big data?Is Python suitable for big dataWhat is the best Big-Data framework for stream processing?Big data and data mining for CRM?What are some challenges with big data?Dealing with big datais there big difference between data Science , big Data and database?Big data analytics referencesData brokers for market-related data, how to choose, where to look for?Big data online class
The use of multiple foreign keys on same column in SQL Server
In Japanese, what’s the difference between “Tonari ni” (となりに) and “Tsugi” (つぎ)? When would you use one over the other?
Why, historically, did Gödel think CH was false?
Watching something be written to a file live with tail
What do you call a Matrix-like slowdown and camera movement effect?
can i play a electric guitar through a bass amp?
Prove that NP is closed under karp reduction?
Show that if two triangles built on parallel lines, with equal bases have the same perimeter only if they are congruent.
Mage Armor with Defense fighting style (for Adventurers League bladeslinger)
How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?
How to write a macro that is braces sensitive?
Can I make popcorn with any corn?
How do we improve the relationship with a client software team that performs poorly and is becoming less collaborative?
How can bays and straits be determined in a procedurally generated map?
Can an x86 CPU running in real mode be considered to be basically an 8086 CPU?
What's the output of a record cartridge playing an out-of-speed record
Is it possible to do 50 km distance without any previous training?
How is it possible to have an ability score that is less than 3?
Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?
Approximately how much travel time was saved by the opening of the Suez Canal in 1869?
To string or not to string
Why was the small council so happy for Tyrion to become the Master of Coin?
What do the dots in this tr command do: tr .............A-Z A-ZA-Z <<< "JVPQBOV" (with 13 dots)
Finding angle with pure Geometry.
Audit methodologies and standards for Big Data
2019 Community Moderator ElectionHow big is big data?Is Python suitable for big dataWhat is the best Big-Data framework for stream processing?Big data and data mining for CRM?What are some challenges with big data?Dealing with big datais there big difference between data Science , big Data and database?Big data analytics referencesData brokers for market-related data, how to choose, where to look for?Big data online class
$begingroup$
Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?
The question is a little bit vague but let me clarify with a fictional example.
Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?
Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.
Thanks
bigdata data
$endgroup$
add a comment |
$begingroup$
Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?
The question is a little bit vague but let me clarify with a fictional example.
Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?
Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.
Thanks
bigdata data
$endgroup$
$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46
$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49
add a comment |
$begingroup$
Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?
The question is a little bit vague but let me clarify with a fictional example.
Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?
Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.
Thanks
bigdata data
$endgroup$
Given an information system with known data sources and some software that handle the data, is there any standard methodology to assess and audit the information system with respect to efficiency in generating value from data ?
The question is a little bit vague but let me clarify with a fictional example.
Imagine that I have an information system where data comes from sensors, cameras, card readers, etc. The data is then stored in Postgres (data-warehouse) using a script that ingests the data. The data is then exploited in different ways. Imagine now I want to audit and assess this information system, how should I proceed ? is there any standard ? is there any known methodology to proceed ?
Ps: I don't know whether this is the right community to answer the question, but it seems to be the closest.
Thanks
bigdata data
bigdata data
edited Mar 27 at 11:39
Blenzus
15010
15010
asked Mar 27 at 8:34
threeVthreeV
1
1
$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46
$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49
add a comment |
$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46
$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49
$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46
$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46
$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49
$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48071%2faudit-methodologies-and-standards-for-big-data%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48071%2faudit-methodologies-and-standards-for-big-data%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
What is the purpose of Audit (E.g.: Data lineage , Data Quality , Staleness .. )
$endgroup$
– Shamit Verma
Mar 27 at 8:46
$begingroup$
The purpose is : "Usability for Analytics", this includes : Data part : Data Quality as an example. Software part : Which ecosystem is more adequate.
$endgroup$
– threeV
Mar 27 at 8:49