Argument list too long when zipping large list of certain files in a folder The Next CEO of Stack OverflowSolving “mv: Argument list too long”?How to print a range of IP addresses with Linux seq commandbash: /usr/bin/perl: Argument list too long/usr/bin/awk: Argument list too longArgument list too long with just 5000 filesAWK Using a Variable in an Equality Expressionbash array with variable in the nameReplace a long string with the sed command: Argument list too long errorAdd text to each value while looping thru and printing them in a array?Moving random files using shuf and mv - Argument list too long

Help! I cannot understand this game’s notations!

What difference does it make using sed with/without whitespaces?

Lucky Feat: How can "more than one creature spend a luck point to influence the outcome of a roll"?

"Eavesdropping" vs "Listen in on"

From jafe to El-Guest

What CSS properties can the br tag have?

Reference request: Grassmannian and Plucker coordinates in type B, C, D

Which one is the true statement?

Prepend last line of stdin to entire stdin

Can I use the word “Senior” as part of a job title directly in German?

Is it convenient to ask the journal's editor for two additional days to complete a review?

Audio Conversion With ADS1243

IC has pull-down resistors on SMBus lines?

Sulfuric acid symmetry point group

How to get the last not-null value in an ordered column of a huge table?

Players Circumventing the limitations of Wish

Do I need to write [sic] when including a quotation with a number less than 10 that isn't written out?

New carbon wheel brake pads after use on aluminum wheel?

Yu-Gi-Oh cards in Python 3

Is dried pee considered dirt?

Where do students learn to solve polynomial equations these days?

How do I fit a non linear curve?

What steps are necessary to read a Modern SSD in Medieval Europe?

Do scriptures give a method to recognize a truly self-realized person/jivanmukta?



Argument list too long when zipping large list of certain files in a folder



The Next CEO of Stack OverflowSolving “mv: Argument list too long”?How to print a range of IP addresses with Linux seq commandbash: /usr/bin/perl: Argument list too long/usr/bin/awk: Argument list too longArgument list too long with just 5000 filesAWK Using a Variable in an Equality Expressionbash array with variable in the nameReplace a long string with the sed command: Argument list too long errorAdd text to each value while looping thru and printing them in a array?Moving random files using shuf and mv - Argument list too long










4















I'm trying to zip a certain large number of files by creating an array of them. Then I tried to run the zip command but met with "Argument list too long" error.



declare -a arr=() 

fixed=5
for i in `seq 10 1 200`; do
for j in `seq $((i+fixed)) 1 200`; do
arr+=("$i_$j.xxx")
done
done

new_arr=$(printf ",%s" "$arr[@]")
new_arr=$new_arr:1

zip all_data.zip $new_arr









share|improve this question
























  • As an alternative: you can create an empty zip file at the beginning and add a file to that zip file, instead of making an array first and adding them all at once. Might save you a loop, unless you have need for the array for other reasons...

    – Henno Brandsma
    Mar 24 at 13:51
















4















I'm trying to zip a certain large number of files by creating an array of them. Then I tried to run the zip command but met with "Argument list too long" error.



declare -a arr=() 

fixed=5
for i in `seq 10 1 200`; do
for j in `seq $((i+fixed)) 1 200`; do
arr+=("$i_$j.xxx")
done
done

new_arr=$(printf ",%s" "$arr[@]")
new_arr=$new_arr:1

zip all_data.zip $new_arr









share|improve this question
























  • As an alternative: you can create an empty zip file at the beginning and add a file to that zip file, instead of making an array first and adding them all at once. Might save you a loop, unless you have need for the array for other reasons...

    – Henno Brandsma
    Mar 24 at 13:51














4












4








4








I'm trying to zip a certain large number of files by creating an array of them. Then I tried to run the zip command but met with "Argument list too long" error.



declare -a arr=() 

fixed=5
for i in `seq 10 1 200`; do
for j in `seq $((i+fixed)) 1 200`; do
arr+=("$i_$j.xxx")
done
done

new_arr=$(printf ",%s" "$arr[@]")
new_arr=$new_arr:1

zip all_data.zip $new_arr









share|improve this question
















I'm trying to zip a certain large number of files by creating an array of them. Then I tried to run the zip command but met with "Argument list too long" error.



declare -a arr=() 

fixed=5
for i in `seq 10 1 200`; do
for j in `seq $((i+fixed)) 1 200`; do
arr+=("$i_$j.xxx")
done
done

new_arr=$(printf ",%s" "$arr[@]")
new_arr=$new_arr:1

zip all_data.zip $new_arr






bash






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 24 at 3:59







Zack

















asked Mar 24 at 3:54









ZackZack

234




234












  • As an alternative: you can create an empty zip file at the beginning and add a file to that zip file, instead of making an array first and adding them all at once. Might save you a loop, unless you have need for the array for other reasons...

    – Henno Brandsma
    Mar 24 at 13:51


















  • As an alternative: you can create an empty zip file at the beginning and add a file to that zip file, instead of making an array first and adding them all at once. Might save you a loop, unless you have need for the array for other reasons...

    – Henno Brandsma
    Mar 24 at 13:51

















As an alternative: you can create an empty zip file at the beginning and add a file to that zip file, instead of making an array first and adding them all at once. Might save you a loop, unless you have need for the array for other reasons...

– Henno Brandsma
Mar 24 at 13:51






As an alternative: you can create an empty zip file at the beginning and add a file to that zip file, instead of making an array first and adding them all at once. Might save you a loop, unless you have need for the array for other reasons...

– Henno Brandsma
Mar 24 at 13:51











1 Answer
1






active

oldest

votes


















6














extract from man zip ( linux version )



 zip -@ foo
will store the files listed one per line on stdin in foo.zip.


example from the same man page



 find . -name "*.[ch]" -print | zip source -@


So steps will be :



  1. build a list off all files to be archive , format must one file name by line



  2. run zip command



    cat BIG_FILENAME_LIST.txt | zip thebigziparchive -@







share|improve this answer























    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "106"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508247%2fargument-list-too-long-when-zipping-large-list-of-certain-files-in-a-folder%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    6














    extract from man zip ( linux version )



     zip -@ foo
    will store the files listed one per line on stdin in foo.zip.


    example from the same man page



     find . -name "*.[ch]" -print | zip source -@


    So steps will be :



    1. build a list off all files to be archive , format must one file name by line



    2. run zip command



      cat BIG_FILENAME_LIST.txt | zip thebigziparchive -@







    share|improve this answer



























      6














      extract from man zip ( linux version )



       zip -@ foo
      will store the files listed one per line on stdin in foo.zip.


      example from the same man page



       find . -name "*.[ch]" -print | zip source -@


      So steps will be :



      1. build a list off all files to be archive , format must one file name by line



      2. run zip command



        cat BIG_FILENAME_LIST.txt | zip thebigziparchive -@







      share|improve this answer

























        6












        6








        6







        extract from man zip ( linux version )



         zip -@ foo
        will store the files listed one per line on stdin in foo.zip.


        example from the same man page



         find . -name "*.[ch]" -print | zip source -@


        So steps will be :



        1. build a list off all files to be archive , format must one file name by line



        2. run zip command



          cat BIG_FILENAME_LIST.txt | zip thebigziparchive -@







        share|improve this answer













        extract from man zip ( linux version )



         zip -@ foo
        will store the files listed one per line on stdin in foo.zip.


        example from the same man page



         find . -name "*.[ch]" -print | zip source -@


        So steps will be :



        1. build a list off all files to be archive , format must one file name by line



        2. run zip command



          cat BIG_FILENAME_LIST.txt | zip thebigziparchive -@








        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Mar 24 at 4:16









        EchoMike444EchoMike444

        1,0506




        1,0506



























            draft saved

            draft discarded
















































            Thanks for contributing an answer to Unix & Linux Stack Exchange!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508247%2fargument-list-too-long-when-zipping-large-list-of-certain-files-in-a-folder%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Quoting Keynes in a lectureIs differentiated instruction permitted by universities?How to make students learn prerequisitesUnsatisfactory Instructor Evaluations: balancing of expectations of engineering studentsWhat is the difference between a “statistician”, “applied statistician”, and an academic applying advanced stats within their field?Listing in reference section, but not quotingHow to efficiently use time while preparing for a class?Graduate Admissions: Teaching Emphasisstrategies for sharing teaching information with universities I don't personally have contacts withIs there an efficient way to give a large class of students feedback about their assignments?Is it unreasonable to expect students to read the lecture notes before attending the first class?

            Rank groups within a grouped sequence of TRUE/FALSE and NAGrouping functions (tapply, by, aggregate) and the *apply familyCharacters counting and subletting specific patternsWhat is the purpose of setting a key in data.table?data.table vs dplyr: can one do something well the other can't or does poorly?how to make a bar plot for a list of dataframes?How to group by unique values in a list in RPandas - Alternative to rank() function that gives unique ordinal ranks for a columnRank within group in for loop in RData transformation: from dyadic to observational data in RGetting map from purrr to work with paste0

            Are all passive ability checks floors for active ability checks?Does passive perception supersede active perception?Which skills can be used passively?Active Opposition with Free-Form Professions in Fate5E Trap/Ambush/Stealth Mechanics VS Passive Perception ConfusionInteraction between perception and stealth in obscured conditionsHow does Keen Sight affect Passive Perception?Are all d20 rolls either attacks, saves or ability checks?Can players declare that they are making a specific ability check?Can I see a Hidden creature that is not obscured at all?Can a Stealth check ever be made passively?Is this alternate version of the Observant feat balanced?What is the minimum amount of skill points per HD?