Pytorch dynamic forward pass The 2019 Stack Overflow Developer Survey Results Are In Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsPyTorch vs. Tensorflow FoldHow to install pytorch in windows?Forward and backward process in pyTorchPytorch CapabilitiesWhat is the use of torch.no_grad in pytorch?Inseting pretrained network to pytorchHow to re-initialise batch sampling with pytorch dataloader?static graphs v.s. dynamic graphsReplicating RNN within PyTorch

Can smartphones with the same camera sensor have different image quality?

Is above average number of years spent on PhD considered a red flag in future academia or industry positions?

Did the UK government pay "millions and millions of dollars" to try to snag Julian Assange?

How to pronounce 1ターン?

Take groceries in checked luggage

Difference between "generating set" and free product?

Does the AirPods case need to be around while listening via an iOS Device?

Why did all the guest students take carriages to the Yule Ball?

Why can't devices on different VLANs, but on the same subnet, communicate?

When did F become S in typeography, and why?

How did the audience guess the pentatonic scale in Bobby McFerrin's presentation?

Are spiders unable to hurt humans, especially very small spiders?

Windows 10: How to Lock (not sleep) laptop on lid close?

Does Parliament need to approve the new Brexit delay to 31 October 2019?

First use of “packing” as in carrying a gun

How is simplicity better than precision and clarity in prose?

Would it be possible to rearrange a dragon's flight muscle to somewhat circumvent the square-cube law?

Why does the Event Horizon Telescope (EHT) not include telescopes from Africa, Asia or Australia?

The variadic template constructor of my class cannot modify my class members, why is that so?

Would an alien lifeform be able to achieve space travel if lacking in vision?

Typeface like Times New Roman but with "tied" percent sign

What's the point in a preamp?

ELI5: Why do they say that Israel would have been the fourth country to land a spacecraft on the Moon and why do they call it low cost?

How does ice melt when immersed in water



Pytorch dynamic forward pass



The 2019 Stack Overflow Developer Survey Results Are In
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsPyTorch vs. Tensorflow FoldHow to install pytorch in windows?Forward and backward process in pyTorchPytorch CapabilitiesWhat is the use of torch.no_grad in pytorch?Inseting pretrained network to pytorchHow to re-initialise batch sampling with pytorch dataloader?static graphs v.s. dynamic graphsReplicating RNN within PyTorch










1












$begingroup$


Does there exist a fast and convenient way for handling such a problem:



class MyModule(nn.Module):
def __init__(self):
super(MyModule, self).__init__()
self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

def forward(self, x, indices):
x = self.linears[indices](x)
return x


You see i want to access different layers in the network conditioned on an additional input, which is also a list. Further i want to process the whole batch at once and the output.shape != input.shape.










share|improve this question











$endgroup$
















    1












    $begingroup$


    Does there exist a fast and convenient way for handling such a problem:



    class MyModule(nn.Module):
    def __init__(self):
    super(MyModule, self).__init__()
    self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

    def forward(self, x, indices):
    x = self.linears[indices](x)
    return x


    You see i want to access different layers in the network conditioned on an additional input, which is also a list. Further i want to process the whole batch at once and the output.shape != input.shape.










    share|improve this question











    $endgroup$














      1












      1








      1





      $begingroup$


      Does there exist a fast and convenient way for handling such a problem:



      class MyModule(nn.Module):
      def __init__(self):
      super(MyModule, self).__init__()
      self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

      def forward(self, x, indices):
      x = self.linears[indices](x)
      return x


      You see i want to access different layers in the network conditioned on an additional input, which is also a list. Further i want to process the whole batch at once and the output.shape != input.shape.










      share|improve this question











      $endgroup$




      Does there exist a fast and convenient way for handling such a problem:



      class MyModule(nn.Module):
      def __init__(self):
      super(MyModule, self).__init__()
      self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

      def forward(self, x, indices):
      x = self.linears[indices](x)
      return x


      You see i want to access different layers in the network conditioned on an additional input, which is also a list. Further i want to process the whole batch at once and the output.shape != input.shape.







      pytorch






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Mar 1 at 14:44







      Andreas Look

















      asked Mar 1 at 14:37









      Andreas LookAndreas Look

      441111




      441111




















          1 Answer
          1






          active

          oldest

          votes


















          0












          $begingroup$

          Here is my understanding of your problem:



          # Import
          from torch import nn

          # Define custom class
          class MyModule(nn.Module):
          def __init__(self):
          super(MyModule, self).__init__()
          self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

          def forward(self, x, indices):
          x = self.linears[indices](x)
          return x

          # Intialize custom class
          net = MyModule()

          # Access networks layers based on additional input
          additional_input = 1
          if additional_input == 1:
          idx = 0
          print(net.linears[idx].in_features)





          share|improve this answer









          $endgroup$












          • $begingroup$
            thank you brian. i think i didnt specify my problem good enough. by accessing the layers i actually meant to make a forward pass for a whole batch at once, while i need different layers for each entry in the batch conditioned on the extra input
            $endgroup$
            – Andreas Look
            Mar 1 at 18:57











          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46471%2fpytorch-dynamic-forward-pass%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          0












          $begingroup$

          Here is my understanding of your problem:



          # Import
          from torch import nn

          # Define custom class
          class MyModule(nn.Module):
          def __init__(self):
          super(MyModule, self).__init__()
          self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

          def forward(self, x, indices):
          x = self.linears[indices](x)
          return x

          # Intialize custom class
          net = MyModule()

          # Access networks layers based on additional input
          additional_input = 1
          if additional_input == 1:
          idx = 0
          print(net.linears[idx].in_features)





          share|improve this answer









          $endgroup$












          • $begingroup$
            thank you brian. i think i didnt specify my problem good enough. by accessing the layers i actually meant to make a forward pass for a whole batch at once, while i need different layers for each entry in the batch conditioned on the extra input
            $endgroup$
            – Andreas Look
            Mar 1 at 18:57















          0












          $begingroup$

          Here is my understanding of your problem:



          # Import
          from torch import nn

          # Define custom class
          class MyModule(nn.Module):
          def __init__(self):
          super(MyModule, self).__init__()
          self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

          def forward(self, x, indices):
          x = self.linears[indices](x)
          return x

          # Intialize custom class
          net = MyModule()

          # Access networks layers based on additional input
          additional_input = 1
          if additional_input == 1:
          idx = 0
          print(net.linears[idx].in_features)





          share|improve this answer









          $endgroup$












          • $begingroup$
            thank you brian. i think i didnt specify my problem good enough. by accessing the layers i actually meant to make a forward pass for a whole batch at once, while i need different layers for each entry in the batch conditioned on the extra input
            $endgroup$
            – Andreas Look
            Mar 1 at 18:57













          0












          0








          0





          $begingroup$

          Here is my understanding of your problem:



          # Import
          from torch import nn

          # Define custom class
          class MyModule(nn.Module):
          def __init__(self):
          super(MyModule, self).__init__()
          self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

          def forward(self, x, indices):
          x = self.linears[indices](x)
          return x

          # Intialize custom class
          net = MyModule()

          # Access networks layers based on additional input
          additional_input = 1
          if additional_input == 1:
          idx = 0
          print(net.linears[idx].in_features)





          share|improve this answer









          $endgroup$



          Here is my understanding of your problem:



          # Import
          from torch import nn

          # Define custom class
          class MyModule(nn.Module):
          def __init__(self):
          super(MyModule, self).__init__()
          self.linears = nn.ModuleList([nn.Linear(10, 20) for _ in range(10)])

          def forward(self, x, indices):
          x = self.linears[indices](x)
          return x

          # Intialize custom class
          net = MyModule()

          # Access networks layers based on additional input
          additional_input = 1
          if additional_input == 1:
          idx = 0
          print(net.linears[idx].in_features)






          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Mar 1 at 18:32









          Brian SpieringBrian Spiering

          4,2681129




          4,2681129











          • $begingroup$
            thank you brian. i think i didnt specify my problem good enough. by accessing the layers i actually meant to make a forward pass for a whole batch at once, while i need different layers for each entry in the batch conditioned on the extra input
            $endgroup$
            – Andreas Look
            Mar 1 at 18:57
















          • $begingroup$
            thank you brian. i think i didnt specify my problem good enough. by accessing the layers i actually meant to make a forward pass for a whole batch at once, while i need different layers for each entry in the batch conditioned on the extra input
            $endgroup$
            – Andreas Look
            Mar 1 at 18:57















          $begingroup$
          thank you brian. i think i didnt specify my problem good enough. by accessing the layers i actually meant to make a forward pass for a whole batch at once, while i need different layers for each entry in the batch conditioned on the extra input
          $endgroup$
          – Andreas Look
          Mar 1 at 18:57




          $begingroup$
          thank you brian. i think i didnt specify my problem good enough. by accessing the layers i actually meant to make a forward pass for a whole batch at once, while i need different layers for each entry in the batch conditioned on the extra input
          $endgroup$
          – Andreas Look
          Mar 1 at 18:57

















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46471%2fpytorch-dynamic-forward-pass%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Rank groups within a grouped sequence of TRUE/FALSE and NAGrouping functions (tapply, by, aggregate) and the *apply familyCharacters counting and subletting specific patternsWhat is the purpose of setting a key in data.table?data.table vs dplyr: can one do something well the other can't or does poorly?how to make a bar plot for a list of dataframes?How to group by unique values in a list in RPandas - Alternative to rank() function that gives unique ordinal ranks for a columnRank within group in for loop in RData transformation: from dyadic to observational data in RGetting map from purrr to work with paste0

          Are all passive ability checks floors for active ability checks?Does passive perception supersede active perception?Which skills can be used passively?Active Opposition with Free-Form Professions in Fate5E Trap/Ambush/Stealth Mechanics VS Passive Perception ConfusionInteraction between perception and stealth in obscured conditionsHow does Keen Sight affect Passive Perception?Are all d20 rolls either attacks, saves or ability checks?Can players declare that they are making a specific ability check?Can I see a Hidden creature that is not obscured at all?Can a Stealth check ever be made passively?Is this alternate version of the Observant feat balanced?What is the minimum amount of skill points per HD?

          Quoting Keynes in a lectureIs differentiated instruction permitted by universities?How to make students learn prerequisitesUnsatisfactory Instructor Evaluations: balancing of expectations of engineering studentsWhat is the difference between a “statistician”, “applied statistician”, and an academic applying advanced stats within their field?Listing in reference section, but not quotingHow to efficiently use time while preparing for a class?Graduate Admissions: Teaching Emphasisstrategies for sharing teaching information with universities I don't personally have contacts withIs there an efficient way to give a large class of students feedback about their assignments?Is it unreasonable to expect students to read the lecture notes before attending the first class?