Cardinality vs width in the ResNext architectureWhat is the difference between “equivariant to translation” and “invariant to translation”Depth of the first pooling layer outcome in tensorflow documentationWhat is the state-of-the art ANN architecture for MNIST?Drawing 1D CNN architectureDoc2Vec network architectureHow design a autoencoder architectureChanges in CNN architectureAre transposed convolutions computed using the Fast Fourier Transform?ArcFace loss in siamese architecture?Best CNN architecture for binary classification of small images with a massive dataset

Stack Interview Code methods made from class Node and Smart Pointers

Is this toilet slogan correct usage of the English language?

Is there any evidence that Cleopatra and Caesarion considered fleeing to India to escape the Romans?

Why do Radio Buttons not fill the entire outer circle?

A Trivial Diagnosis

The Digit Triangles

The IT department bottlenecks progress, how should I handle this?

Why can't the Brexit deadlock in the UK parliament be solved with a plurality vote?

What is the difference between lands and mana?

How to draw a matrix with arrows in limited space

How much of a Devil Fruit must be consumed to gain the power?

What (the heck) is a Super Worm Equinox Moon?

What features enable the Su-25 Frogfoot to operate with such a wide variety of fuels?

How could a planet have erratic days?

Why the "ls" command is showing the permissions of files in a FAT32 partition?

What is Cash Advance APR?

Doesn't the system of the Supreme Court oppose justice?

Multiplicative persistence

Change the color of a single dot in `ddot` symbol

Can I cause damage to electrical appliances by unplugging them when they are turned on?

Microchip documentation does not label CAN buss pins on micro controller pinout diagram

Which Article Helped Get Rid of Technobabble in RPGs?

Does the reader need to like the PoV character?

Does "he squandered his car on drink" sound natural?



Cardinality vs width in the ResNext architecture


What is the difference between “equivariant to translation” and “invariant to translation”Depth of the first pooling layer outcome in tensorflow documentationWhat is the state-of-the art ANN architecture for MNIST?Drawing 1D CNN architectureDoc2Vec network architectureHow design a autoencoder architectureChanges in CNN architectureAre transposed convolutions computed using the Fast Fourier Transform?ArcFace loss in siamese architecture?Best CNN architecture for binary classification of small images with a massive dataset













0












$begingroup$


I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



Thanks!










share|improve this question







New contributor




JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    0












    $begingroup$


    I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



    One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



    Thanks!










    share|improve this question







    New contributor




    JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



      One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



      Thanks!










      share|improve this question







      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I was recently reading the paper Aggregated Residual Transformations for Deep Neural Networks.



      One thing the author mentions in Section (5.1) is that increasing the cardinality (or, the number of branches), decreases validation error more than increasing the bottleneck width or increasing the depth. I understand the depth part, but I'm a bit confused about the width. Isn't the cardinality of a residual block the same as the bottleneck width? If not, what is the difference?



      Thanks!







      neural-network deep-learning convolution






      share|improve this question







      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked Mar 18 at 20:48









      JohnDoeJohnDoe

      1011




      1011




      New contributor




      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      JohnDoe is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes











          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47559%2fcardinality-vs-width-in-the-resnext-architecture%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.












          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.











          JohnDoe is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid …


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47559%2fcardinality-vs-width-in-the-resnext-architecture%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Are all passive ability checks floors for active ability checks?Does passive perception supersede active perception?Which skills can be used passively?Active Opposition with Free-Form Professions in Fate5E Trap/Ambush/Stealth Mechanics VS Passive Perception ConfusionInteraction between perception and stealth in obscured conditionsHow does Keen Sight affect Passive Perception?Are all d20 rolls either attacks, saves or ability checks?Can players declare that they are making a specific ability check?Can I see a Hidden creature that is not obscured at all?Can a Stealth check ever be made passively?Is this alternate version of the Observant feat balanced?What is the minimum amount of skill points per HD?

          How do we improve the relationship with a client software team that performs poorly and is becoming less collaborative? Unicorn Meta Zoo #1: Why another podcast? Announcing the arrival of Valued Associate #679: Cesar ManaraDealing with clients who want more than what's in the contractHow to prepare for a client visit?How to handle undeservedly positive feedbackSupervisor apparently making it appear that our team underperformed and we indirectly caused client not to pay fullHow to progress my skills development as both the technical lead and youngest member on my team?Under performing employee will be fired if I ask for him off my teamwhat recommendations can I give to a colleague who is not preforming as well as expectedForcing usage of clients laptops because of VPN accessIs it acceptable to e-mail a client regarding potential opportunities in their company?Am I overly concerned about a newly hired Senior Developer with low performance?

          Rank groups within a grouped sequence of TRUE/FALSE and NAGrouping functions (tapply, by, aggregate) and the *apply familyCharacters counting and subletting specific patternsWhat is the purpose of setting a key in data.table?data.table vs dplyr: can one do something well the other can't or does poorly?how to make a bar plot for a list of dataframes?How to group by unique values in a list in RPandas - Alternative to rank() function that gives unique ordinal ranks for a columnRank within group in for loop in RData transformation: from dyadic to observational data in RGetting map from purrr to work with paste0