Paragraph Generator using BERT or GPT2019 Community Moderator ElectionNamed Entity Recognition: NLTK using Regular ExpressionSentiment analysis using pythonUsing Vowpal Wabbit for NERHow do “intent recognisers” work?Text comparison using word embeddingsMake a chatbot using slackResource and useful tips on Transfer Learning in NLPParagraph Vector - inference stage in the classificationWord classification (not text classification) using NLPIncrementally Train BERT with minimum QnA records - to get improved results

Is exact Kanji stroke length important?

How to prove that the query oracle is unitary?

Best way to store options for panels

What to do with wrong results in talks?

Is it okay / does it make sense for another player to join a running game of Munchkin?

How can I use the arrow sign in my bash prompt?

Print name if parameter passed to function

Hostile work environment after whistle-blowing on coworker and our boss. What do I do?

How to avoid InDesign adding pages automatically?

MaTeX, font size, and PlotLegends

Invariants between two isomorphic vector spaces

Opposite of a diet

The Riley Riddle Mine

How do I define a right arrow with bar in LaTeX?

Cynical novel that describes an America ruled by the media, arms manufacturers, and ethnic figureheads

Personal Teleportation as a Weapon

What would be the benefits of having both a state and local currencies?

Why are all the doors on Ferenginar (the Ferengi home world) far shorter than the average Ferengi?

What is the intuitive meaning of having a linear relationship between the logs of two variables?

What's the purpose of "true" in bash "if sudo true; then"

Efficiently merge handle parallel feature branches in SFDX

Star/Wye electrical connection math symbol

Curses work by shouting - How to avoid collateral damage?

Why is delta-v is the most useful quantity for planning space travel?



Paragraph Generator using BERT or GPT



2019 Community Moderator ElectionNamed Entity Recognition: NLTK using Regular ExpressionSentiment analysis using pythonUsing Vowpal Wabbit for NERHow do “intent recognisers” work?Text comparison using word embeddingsMake a chatbot using slackResource and useful tips on Transfer Learning in NLPParagraph Vector - inference stage in the classificationWord classification (not text classification) using NLPIncrementally Train BERT with minimum QnA records - to get improved results










1












$begingroup$


I am trying to generate similar sentences, called paragraph generation. For example, what is the name of eldest brother of ram? - For this paragraphs can be - who is oldest brother of ram? , Who is oldest blood brother of ram? , I want to know eldest sibling of ram. etc etc



BERT and OpenAI GPT are one of most powerful NLP systems, as per my knowledge, atleast for now. However, I heard that BERT is based on MLM so cant be used for sentence generation, but can be used for word prediction.



Can OpenAI GPT be used for this purpose? If so, please give some pointer.

If any other name is in mind which is State of Art please suggest.










share|improve this question









$endgroup$
















    1












    $begingroup$


    I am trying to generate similar sentences, called paragraph generation. For example, what is the name of eldest brother of ram? - For this paragraphs can be - who is oldest brother of ram? , Who is oldest blood brother of ram? , I want to know eldest sibling of ram. etc etc



    BERT and OpenAI GPT are one of most powerful NLP systems, as per my knowledge, atleast for now. However, I heard that BERT is based on MLM so cant be used for sentence generation, but can be used for word prediction.



    Can OpenAI GPT be used for this purpose? If so, please give some pointer.

    If any other name is in mind which is State of Art please suggest.










    share|improve this question









    $endgroup$














      1












      1








      1





      $begingroup$


      I am trying to generate similar sentences, called paragraph generation. For example, what is the name of eldest brother of ram? - For this paragraphs can be - who is oldest brother of ram? , Who is oldest blood brother of ram? , I want to know eldest sibling of ram. etc etc



      BERT and OpenAI GPT are one of most powerful NLP systems, as per my knowledge, atleast for now. However, I heard that BERT is based on MLM so cant be used for sentence generation, but can be used for word prediction.



      Can OpenAI GPT be used for this purpose? If so, please give some pointer.

      If any other name is in mind which is State of Art please suggest.










      share|improve this question









      $endgroup$




      I am trying to generate similar sentences, called paragraph generation. For example, what is the name of eldest brother of ram? - For this paragraphs can be - who is oldest brother of ram? , Who is oldest blood brother of ram? , I want to know eldest sibling of ram. etc etc



      BERT and OpenAI GPT are one of most powerful NLP systems, as per my knowledge, atleast for now. However, I heard that BERT is based on MLM so cant be used for sentence generation, but can be used for word prediction.



      Can OpenAI GPT be used for this purpose? If so, please give some pointer.

      If any other name is in mind which is State of Art please suggest.







      nlp bert






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Mar 20 at 16:22









      Sandeep BSandeep B

      1067




      1067




















          0






          active

          oldest

          votes











          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47687%2fparagraph-generator-using-bert-or-gpt%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47687%2fparagraph-generator-using-bert-or-gpt%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown