How to create a language translator from scratch?Is it possible to identify different queries/questions in sentence?How to check if sentiment analysis is required?Identifying software and version range in a sentenceCreating the optimal set of utterances to train a natural language processing engineHow to create domain rules from raw unstructured text using NLP and deep learning?word/sentence alignment for English documentHow to create clusters based on sentence similarity?Architecture for linear regression with variable input where each input is n-sized one-hot encodedsentence patterns/rules/formulas for imperative sentences …How to find similar meaning log messages in the source code?

shell script to pass values properties file in java

Know when to turn notes upside-down(eighth notes, sixteen notes, etc.)

Better performance for geohash aggregation with PostGIS

Are all passive ability checks floors for active ability checks?

Are the common programs (for example: "ls", "cat") in Linux and BSD come from the same source code?

Will a pinhole camera work with instant film?

Identifying the interval from A♭ to D♯

All function values have been reset after restarting Mathematica

My adviser wants to be the first author

Brexit - No Deal Rejection

Did CP/M support custom hardware using device drivers?

Could the Saturn V actually have launched astronauts around Venus?

Professor being mistaken for a grad student

Site Collection Administrator has left the building

newcommand: Combine (optional) star and optional parameter

What is IP squat space

Co-worker team leader wants to inject his friend's awful software into our development. What should I say to our common boss?

What does it mean to make a bootable LiveUSB?

How to explain that I do not want to visit a country due to personal safety concern?

Can I get a Visa Waiver after spending 6 months in USA with B-2 Visa?

AG Cluster db upgrade by vendor

Who is our nearest planetary neighbor, on average?

Parent theme necessary?

How could a scammer know the apps on my phone / iTunes account?



How to create a language translator from scratch?


Is it possible to identify different queries/questions in sentence?How to check if sentiment analysis is required?Identifying software and version range in a sentenceCreating the optimal set of utterances to train a natural language processing engineHow to create domain rules from raw unstructured text using NLP and deep learning?word/sentence alignment for English documentHow to create clusters based on sentence similarity?Architecture for linear regression with variable input where each input is n-sized one-hot encodedsentence patterns/rules/formulas for imperative sentences …How to find similar meaning log messages in the source code?













1












$begingroup$


I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?










share|improve this question







New contributor




Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    1












    $begingroup$


    I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?










    share|improve this question







    New contributor




    Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      1












      1








      1





      $begingroup$


      I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?










      share|improve this question







      New contributor




      Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?







      deep-learning nlp recurrent-neural-net machine-translation nlg






      share|improve this question







      New contributor




      Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked yesterday









      Isaac PatoleIsaac Patole

      61




      61




      New contributor




      Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      Isaac Patole is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          1 Answer
          1






          active

          oldest

          votes


















          1












          $begingroup$

          Google translate itself uses Deep learning to translate sentences which can be seen here.



          You can translate sentences across languages for which you need two things :



          1. A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.

          2. A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
            enter image description here
            The picture shows the Neural Machine Translation adopted by Google.

          Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.



          If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.






          share|improve this answer









          $endgroup$












            Your Answer





            StackExchange.ifUsing("editor", function ()
            return StackExchange.using("mathjaxEditing", function ()
            StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
            StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
            );
            );
            , "mathjax-editing");

            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "557"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );






            Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.









            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47278%2fhow-to-create-a-language-translator-from-scratch%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            1












            $begingroup$

            Google translate itself uses Deep learning to translate sentences which can be seen here.



            You can translate sentences across languages for which you need two things :



            1. A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.

            2. A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
              enter image description here
              The picture shows the Neural Machine Translation adopted by Google.

            Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.



            If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.






            share|improve this answer









            $endgroup$

















              1












              $begingroup$

              Google translate itself uses Deep learning to translate sentences which can be seen here.



              You can translate sentences across languages for which you need two things :



              1. A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.

              2. A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
                enter image description here
                The picture shows the Neural Machine Translation adopted by Google.

              Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.



              If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.






              share|improve this answer









              $endgroup$















                1












                1








                1





                $begingroup$

                Google translate itself uses Deep learning to translate sentences which can be seen here.



                You can translate sentences across languages for which you need two things :



                1. A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.

                2. A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
                  enter image description here
                  The picture shows the Neural Machine Translation adopted by Google.

                Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.



                If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.






                share|improve this answer









                $endgroup$



                Google translate itself uses Deep learning to translate sentences which can be seen here.



                You can translate sentences across languages for which you need two things :



                1. A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.

                2. A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
                  enter image description here
                  The picture shows the Neural Machine Translation adopted by Google.

                Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.



                If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered yesterday









                Shubham PanchalShubham Panchal

                2575




                2575




















                    Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.









                    draft saved

                    draft discarded


















                    Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.












                    Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.











                    Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.














                    Thanks for contributing an answer to Data Science Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47278%2fhow-to-create-a-language-translator-from-scratch%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Quoting Keynes in a lectureIs differentiated instruction permitted by universities?How to make students learn prerequisitesUnsatisfactory Instructor Evaluations: balancing of expectations of engineering studentsWhat is the difference between a “statistician”, “applied statistician”, and an academic applying advanced stats within their field?Listing in reference section, but not quotingHow to efficiently use time while preparing for a class?Graduate Admissions: Teaching Emphasisstrategies for sharing teaching information with universities I don't personally have contacts withIs there an efficient way to give a large class of students feedback about their assignments?Is it unreasonable to expect students to read the lecture notes before attending the first class?

                    Rank groups within a grouped sequence of TRUE/FALSE and NAGrouping functions (tapply, by, aggregate) and the *apply familyCharacters counting and subletting specific patternsWhat is the purpose of setting a key in data.table?data.table vs dplyr: can one do something well the other can't or does poorly?how to make a bar plot for a list of dataframes?How to group by unique values in a list in RPandas - Alternative to rank() function that gives unique ordinal ranks for a columnRank within group in for loop in RData transformation: from dyadic to observational data in RGetting map from purrr to work with paste0

                    Are all passive ability checks floors for active ability checks?Does passive perception supersede active perception?Which skills can be used passively?Active Opposition with Free-Form Professions in Fate5E Trap/Ambush/Stealth Mechanics VS Passive Perception ConfusionInteraction between perception and stealth in obscured conditionsHow does Keen Sight affect Passive Perception?Are all d20 rolls either attacks, saves or ability checks?Can players declare that they are making a specific ability check?Can I see a Hidden creature that is not obscured at all?Can a Stealth check ever be made passively?Is this alternate version of the Observant feat balanced?What is the minimum amount of skill points per HD?