How to create a language translator from scratch?Is it possible to identify different queries/questions in sentence?How to check if sentiment analysis is required?Identifying software and version range in a sentenceCreating the optimal set of utterances to train a natural language processing engineHow to create domain rules from raw unstructured text using NLP and deep learning?word/sentence alignment for English documentHow to create clusters based on sentence similarity?Architecture for linear regression with variable input where each input is n-sized one-hot encodedsentence patterns/rules/formulas for imperative sentences …How to find similar meaning log messages in the source code?
shell script to pass values properties file in java
Know when to turn notes upside-down(eighth notes, sixteen notes, etc.)
Better performance for geohash aggregation with PostGIS
Are all passive ability checks floors for active ability checks?
Are the common programs (for example: "ls", "cat") in Linux and BSD come from the same source code?
Will a pinhole camera work with instant film?
Identifying the interval from A♭ to D♯
All function values have been reset after restarting Mathematica
My adviser wants to be the first author
Brexit - No Deal Rejection
Did CP/M support custom hardware using device drivers?
Could the Saturn V actually have launched astronauts around Venus?
Professor being mistaken for a grad student
Site Collection Administrator has left the building
newcommand: Combine (optional) star and optional parameter
What is IP squat space
Co-worker team leader wants to inject his friend's awful software into our development. What should I say to our common boss?
What does it mean to make a bootable LiveUSB?
How to explain that I do not want to visit a country due to personal safety concern?
Can I get a Visa Waiver after spending 6 months in USA with B-2 Visa?
AG Cluster db upgrade by vendor
Who is our nearest planetary neighbor, on average?
Parent theme necessary?
How could a scammer know the apps on my phone / iTunes account?
How to create a language translator from scratch?
Is it possible to identify different queries/questions in sentence?How to check if sentiment analysis is required?Identifying software and version range in a sentenceCreating the optimal set of utterances to train a natural language processing engineHow to create domain rules from raw unstructured text using NLP and deep learning?word/sentence alignment for English documentHow to create clusters based on sentence similarity?Architecture for linear regression with variable input where each input is n-sized one-hot encodedsentence patterns/rules/formulas for imperative sentences …How to find similar meaning log messages in the source code?
$begingroup$
I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?
deep-learning nlp recurrent-neural-net machine-translation nlg
New contributor
$endgroup$
add a comment |
$begingroup$
I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?
deep-learning nlp recurrent-neural-net machine-translation nlg
New contributor
$endgroup$
add a comment |
$begingroup$
I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?
deep-learning nlp recurrent-neural-net machine-translation nlg
New contributor
$endgroup$
I want to create a translator which can translate English, Korean and Tamil sentences into English sentence, I tried googletrans but is there any way to create something better than that using DL and NLP techniques?
deep-learning nlp recurrent-neural-net machine-translation nlg
deep-learning nlp recurrent-neural-net machine-translation nlg
New contributor
New contributor
New contributor
asked yesterday
Isaac PatoleIsaac Patole
61
61
New contributor
New contributor
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Google translate itself uses Deep learning to translate sentences which can be seen here.
You can translate sentences across languages for which you need two things :
- A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.
- A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
The picture shows the Neural Machine Translation adopted by Google.
Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.
If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47278%2fhow-to-create-a-language-translator-from-scratch%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Google translate itself uses Deep learning to translate sentences which can be seen here.
You can translate sentences across languages for which you need two things :
- A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.
- A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
The picture shows the Neural Machine Translation adopted by Google.
Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.
If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.
$endgroup$
add a comment |
$begingroup$
Google translate itself uses Deep learning to translate sentences which can be seen here.
You can translate sentences across languages for which you need two things :
- A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.
- A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
The picture shows the Neural Machine Translation adopted by Google.
Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.
If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.
$endgroup$
add a comment |
$begingroup$
Google translate itself uses Deep learning to translate sentences which can be seen here.
You can translate sentences across languages for which you need two things :
- A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.
- A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
The picture shows the Neural Machine Translation adopted by Google.
Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.
If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.
$endgroup$
Google translate itself uses Deep learning to translate sentences which can be seen here.
You can translate sentences across languages for which you need two things :
- A large dataset which has pairs of translations ( like English-French ). You can find such a dataset from here.
- A sequence-to-sequence RNN model. They have Encoder-Decoder architecture which encodes the source sentence into a thought vector and then decode it to form the translation. This image may be helpful.
The picture shows the Neural Machine Translation adopted by Google.
Also, TensorFlow and Keras help in creating such deep learning models. You can refer to this blog from the author of Keras. These models ( seq2seq ) have gained popularity in text summarization, NMT, and other sequence-to-sequence tasks.
If you wish to create a full-scale production ready language translator then you will need a GPU as these models are heavy to train as well as a very large corpus of text.
answered yesterday
Shubham PanchalShubham Panchal
2575
2575
add a comment |
add a comment |
Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.
Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.
Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.
Isaac Patole is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47278%2fhow-to-create-a-language-translator-from-scratch%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown