Cardinality vs width in the ResNext architectureWhat is the difference between “equivariant to translation” and “invariant to translation”Depth of the first pooling layer outcome in tensorflow documentationWhat is the state-of-the art ANN architecture for MNIST?Drawing 1D CNN architectureDoc2Vec network architectureHow design a autoencoder architectureChanges in CNN architectureAre transposed convolutions computed using the Fast Fourier Transform?ArcFace loss in siamese architecture?Best CNN architecture for binary classification of small images with a massive dataset

Stack Interview Code methods made from class Node and Smart Pointers

Is this toilet slogan correct usage of the English language?

Is there any evidence that Cleopatra and Caesarion considered fleeing to India to escape the Romans?

Why do Radio Buttons not fill the entire outer circle?

A Trivial Diagnosis

The Digit Triangles

The IT department bottlenecks progress, how should I handle this?

Why can't the Brexit deadlock in the UK parliament be solved with a plurality vote?

What is the difference between lands and mana?

How to draw a matrix with arrows in limited space

How much of a Devil Fruit must be consumed to gain the power?

What (the heck) is a Super Worm Equinox Moon?

What features enable the Su-25 Frogfoot to operate with such a wide variety of fuels?

How could a planet have erratic days?

Why the "ls" command is showing the permissions of files in a FAT32 partition?

What is Cash Advance APR?

Doesn't the system of the Supreme Court oppose justice?

Multiplicative persistence

Change the color of a single dot in `ddot` symbol

Can I cause damage to electrical appliances by unplugging them when they are turned on?

Microchip documentation does not label CAN buss pins on micro controller pinout diagram

Which Article Helped Get Rid of Technobabble in RPGs?

Does the reader need to like the PoV character?

Does "he squandered his car on drink" sound natural?



Cardinality vs width in the ResNext architecture


What is the difference between “equivariant to translation” and “invariant to translation”Depth of the first pooling layer outcome in tensorflow documentationWhat is the state-of-the art ANN architecture for MNIST?Drawing 1D CNN architectureDoc2Vec network architectureHow design a autoencoder architectureChanges in CNN architectureAre transposed convolutions computed using the Fast Fourier Transform?ArcFace loss in siamese architecture?Best CNN architecture for binary classification of small images with a massive dataset













0












$begingroup$


I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



Thanks!










share|improve this question







New contributor




JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    0












    $begingroup$


    I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



    One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



    Thanks!










    share|improve this question







    New contributor




    JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



      One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



      Thanks!










      share|improve this question







      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



      One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



      Thanks!







      neural-network deep-learning convolution






      share|improve this question







      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked Mar 18 at 20:48









      JohnDoeJohnDoe

      1011




      1011




      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes











          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47559%2fcardinality-vs-width-in-the-resnext-architecture%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.












          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.











          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47559%2fcardinality-vs-width-in-the-resnext-architecture%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Quoting Keynes in a lectureIs differentiated instruction permitted by universities?How to make students learn prerequisitesUnsatisfactory Instructor Evaluations: balancing of expectations of engineering studentsWhat is the difference between a “statistician”, “applied statistician”, and an academic applying advanced stats within their field?Listing in reference section, but not quotingHow to efficiently use time while preparing for a class?Graduate Admissions: Teaching Emphasisstrategies for sharing teaching information with universities I don't personally have contacts withIs there an efficient way to give a large class of students feedback about their assignments?Is it unreasonable to expect students to read the lecture notes before attending the first class?

          Rank groups within a grouped sequence of TRUE/FALSE and NAGrouping functions (tapply, by, aggregate) and the *apply familyCharacters counting and subletting specific patternsWhat is the purpose of setting a key in data.table?data.table vs dplyr: can one do something well the other can't or does poorly?how to make a bar plot for a list of dataframes?How to group by unique values in a list in RPandas - Alternative to rank() function that gives unique ordinal ranks for a columnRank within group in for loop in RData transformation: from dyadic to observational data in RGetting map from purrr to work with paste0

          Are all passive ability checks floors for active ability checks?Does passive perception supersede active perception?Which skills can be used passively?Active Opposition with Free-Form Professions in Fate5E Trap/Ambush/Stealth Mechanics VS Passive Perception ConfusionInteraction between perception and stealth in obscured conditionsHow does Keen Sight affect Passive Perception?Are all d20 rolls either attacks, saves or ability checks?Can players declare that they are making a specific ability check?Can I see a Hidden creature that is not obscured at all?Can a Stealth check ever be made passively?Is this alternate version of the Observant feat balanced?What is the minimum amount of skill points per HD?