What kind of storage media should I use for large data storage [closed] The Next CEO of Stack Overflow2019 Community Moderator ElectionBig data case study or use case exampleWhat initial steps should I use to make sense of large data sets, and what tools should I use?What is “data science”?How to deal with version control of large amounts of (binary) dataOptimizing Weka for large data setsWhat model should I use to find a common pattern for a specific user group based on the other dimensions?What model should I choose for Jobs recommender system?What tools to manage multiple machine learning projects in python do you use?Which tool should I use for combining this large dataset?Which Kind of Machine Learning should I use for an Optimization Problem?
Which organization defines CJK Unified Ideographs?
How to be diplomatic in refusing to write code that breaches the privacy of our users
Only print output after finding pattern
How do scammers retract money, while you can’t?
Title page not generated
What benefits would be gained by using human laborers instead of drones in deep sea mining?
Inappropriate reference requests from Journal reviewers
Help understanding this unsettling image of Titan, Epimetheus, and Saturn's rings?
Why didn't Khan get resurrected in the Genesis Explosion?
How to count occurrences of text in a file?
What does "Its cash flow is deeply negative" mean?
What is the difference between Sanyaas and Vairagya?
How did people program for Consoles with multiple CPUs?
Trouble understanding the speech of overseas colleagues
Clustering points and summing up attributes per cluster in QGIS
Is HostGator storing my password in plaintext?
Monthly twice production release for my software project
Does it take more energy to get to Venus or to Mars?
Example of a Mathematician/Physicist whose Other Publications during their PhD eclipsed their PhD Thesis
What happens if you roll doubles 3 times then land on "Go to jail?"
How do I go from 300 unfinished/half written blog posts, to published posts?
Can a caster that cast Polymorph on themselves stop concentrating at any point even if their Int is low?
What was the first Unix version to run on a microcomputer?
Why did we only see the N-1 starfighters in one film?
What kind of storage media should I use for large data storage [closed]
The Next CEO of Stack Overflow2019 Community Moderator ElectionBig data case study or use case exampleWhat initial steps should I use to make sense of large data sets, and what tools should I use?What is “data science”?How to deal with version control of large amounts of (binary) dataOptimizing Weka for large data setsWhat model should I use to find a common pattern for a specific user group based on the other dimensions?What model should I choose for Jobs recommender system?What tools to manage multiple machine learning projects in python do you use?Which tool should I use for combining this large dataset?Which Kind of Machine Learning should I use for an Optimization Problem?
$begingroup$
In my hands there is a data of about 60k × 1k. This data is stored in the txt file. Because the data is large, I would like to use the hard disk capacity efficiently for what kind of data file or which technology would you recommend.
Good luck with,
machine-learning python deep-learning data-mining bigdata
asked Mar 22 at 13:47
EnginEngin
126110
$endgroup$
closed as unclear what you're asking by Esmailian, Ethan, Dawny33♦ Mar 22 at 15:52
Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
add a comment |
$begingroup$
In my hands there is a data of about 60k × 1k. This data is stored in the txt file. Because the data is large, I would like to use the hard disk capacity efficiently for what kind of data file or which technology would you recommend.
Good luck with,
machine-learning python deep-learning data-mining bigdata
asked Mar 22 at 13:47
EnginEngin
126110
$endgroup$
closed as unclear what you're asking by Esmailian, Ethan, Dawny33♦ Mar 22 at 15:52
Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
$begingroup$
Please expand on your question. Are you only storing the data or do you have an intended use for it? What are you going to do with it if so?
$endgroup$
– Dan Carter
Mar 22 at 14:07
add a comment |
$begingroup$
In my hands there is a data of about 60k × 1k. This data is stored in the txt file. Because the data is large, I would like to use the hard disk capacity efficiently for what kind of data file or which technology would you recommend.
Good luck with,
machine-learning python deep-learning data-mining bigdata
asked Mar 22 at 13:47
EnginEngin
126110
$endgroup$
In my hands there is a data of about 60k × 1k. This data is stored in the txt file. Because the data is large, I would like to use the hard disk capacity efficiently for what kind of data file or which technology would you recommend.
Good luck with,
machine-learning python deep-learning data-mining bigdata
machine-learning python deep-learning data-mining bigdata
asked Mar 22 at 13:47
EnginEngin
126110
asked Mar 22 at 13:47
EnginEngin
126110
asked Mar 22 at 13:47
EnginEngin
126110
asked Mar 22 at 13:47
EnginEngin
126110
asked Mar 22 at 13:47
EnginEngin
126110
126110
closed as unclear what you're asking by Esmailian, Ethan, Dawny33♦ Mar 22 at 15:52
Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
closed as unclear what you're asking by Esmailian, Ethan, Dawny33♦ Mar 22 at 15:52
Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
$begingroup$
Please expand on your question. Are you only storing the data or do you have an intended use for it? What are you going to do with it if so?
$endgroup$
– Dan Carter
Mar 22 at 14:07
add a comment |
$begingroup$
Please expand on your question. Are you only storing the data or do you have an intended use for it? What are you going to do with it if so?
$endgroup$
– Dan Carter
Mar 22 at 14:07
$begingroup$
Please expand on your question. Are you only storing the data or do you have an intended use for it? What are you going to do with it if so?
$endgroup$
– Dan Carter
Mar 22 at 14:07
$begingroup$
Please expand on your question. Are you only storing the data or do you have an intended use for it? What are you going to do with it if so?
$endgroup$
– Dan Carter
Mar 22 at 14:07
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
csv and pandas (Python package) are usually a good way to handle large datasets in text format. In addition, using SSD is always a good idea with large datasets.
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
csv and pandas (Python package) are usually a good way to handle large datasets in text format. In addition, using SSD is always a good idea with large datasets.
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
csv and pandas (Python package) are usually a good way to handle large datasets in text format. In addition, using SSD is always a good idea with large datasets.
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
csv and pandas (Python package) are usually a good way to handle large datasets in text format. In addition, using SSD is always a good idea with large datasets.
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
csv and pandas (Python package) are usually a good way to handle large datasets in text format. In addition, using SSD is always a good idea with large datasets.
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
answered Mar 22 at 14:00
JacoSolariJacoSolari
1
1
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
JacoSolari is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
$begingroup$
Please expand on your question. Are you only storing the data or do you have an intended use for it? What are you going to do with it if so?
$endgroup$
– Dan Carter
Mar 22 at 14:07