blocks|key|819861|text|如果内容足够长，我会建议在字母上添加一些frequency+analysis。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|819862|但对于一些单词，我认为最好的办法是将它们与英语词典进行比较，如果其中一半匹配，则接受输入。|819863|entityMap|0|LINK|mutability|MUTABLE|url|http://en.wikipedia.org/wiki/Frequency_analysis^0|K|I|0|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]]|C|$]]|$1|D|3|E|5|6|7|R|8|@]|9|@]|C|$]]|$1|F|3|-4|5|6|7|S|8|@]|9|@]|C|$]]]|G|$H|$5|I|J|K|C|$L|M]]]]

If the content is long enough I would suggest some <a href="http://en.wikipedia.org/wiki/Frequency_analysis" rel="nofollow noreferrer">frequency analysis</a> on the letters. 

But for a few words I think your best bet is to compare them to an English dictionary and accept the input if half of them match.

blocks|key|819915|text|检查Language+Recognition+Chart|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|819916|entityMap|0|LINK|mutability|MUTABLE|url|http://en.wikipedia.org/wiki/Wikipedia:Language_recognition_chart^0|2|Q|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

Check the <a href="http://en.wikipedia.org/wiki/Wikipedia:Language_recognition_chart" rel="nofollow noreferrer">Language Recognition Chart</a>

blocks|key|3970495|text|我认为最有效的方法是让用户只提交英文文本:)|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3970496|您可以在文本区域上显示语言选择下拉列表，选项为英语/其他。当用户选择"Other“时，禁用文本区，并显示当前仅支持英语的消息。|3970497|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|F|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|G|8|@]|9|@]|A|$]]|$1|D|3|-4|5|6|7|H|8|@]|9|@]|A|$]]]|E|$]]

I think the most effective way would be to ask the users to submit english text only :)

You can show a language selection drop-down over your text area with English/ Other as the options. When user selects "Other", disable the text area with a message that only English language is supported [at the moment].

blocks|key|820062|text|Google有一个javascript+API，它实现了语言检测。我只对它进行了测试，从未在生产中使用过。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|820063|http://code.google.com/apis/ajaxlanguage/documentation/#Detect|offset|length|820064|entityMap|0|LINK|mutability|MUTABLE|url^0|0|0|1Q|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|N|8|@]|9|@$D|O|E|P|1|Q]]|A|$]]|$1|F|3|-4|5|6|7|R|8|@]|9|@]|A|$]]]|G|$H|$5|I|J|K|A|$L|C]]]]

Google has a javascript API that has an implementation of language detection. I've only play tested with it, never used it in production.

<a href="http://code.google.com/apis/ajaxlanguage/documentation/#Detect" rel="nofollow noreferrer">http://code.google.com/apis/ajaxlanguage/documentation/#Detect</a>

blocks|key|819949|text|尝试基于n-gram的统计语言识别。这是一个使用这种技术的算法演示的link，还有一个描述算法的论文的链接。尝试演示，即使在非常短的文本(3-4个单词)上，它也表现得很好。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|819950|entityMap|0|LINK|mutability|MUTABLE|url|http://odur.let.rug.nl/~vannoord/TextCat/Demo/^0|Y|4|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

Try n-gram based statistical language recognition. This is a <a href="http://odur.let.rug.nl/~vannoord/TextCat/Demo/" rel="nofollow noreferrer">link</a> to a demo of an algorithm using this technique, there is also a link to a paper describing the algorithm there. Try the demo, it performs quite well even on very short texts (3-4 words).

blocks|key|3970640|text|你已经在做NLP了，如果你的模块不知道文本是什么语言，那么要么模块不能工作，要么输入的语言不正确。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3970641|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|D|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|E|8|@]|9|@]|A|$]]]|C|$]]

You are already doing NLP, if your module doesn't understand what language the text was then either the module doesn't work or the input was not in the correct language.

blocks|key|5381246|text|尝试：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|5381247|http://wordlist.sourceforge.net/|offset|length|5381248|获取英语单词列表。|5381249|你需要注意名字，例如：“堪培拉”或“比尔·克林顿”这些将不会出现在单词列表中。我建议只检查第一个字母是否大写作为第一次尝试。|5381250|entityMap|0|LINK|mutability|MUTABLE|url^0|0|0|W|0|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|R|8|@]|9|@$D|S|E|T|1|U]]|A|$]]|$1|F|3|G|5|6|7|V|8|@]|9|@]|A|$]]|$1|H|3|I|5|6|7|W|8|@]|9|@]|A|$]]|$1|J|3|-4|5|6|7|X|8|@]|9|@]|A|$]]]|K|$L|$5|M|N|O|A|$P|C]]]]

Try:

<a href="http://wordlist.sourceforge.net/" rel="nofollow noreferrer">http://wordlist.sourceforge.net/</a>

For a list of English words.

You will need to be careful of names, e.g. "Canberra" or "Bill Clinton". These won't appear in the word list. I suggest just checking whether the first letter is capitalized as a first attempt.

blocks|key|819846|text|您可以将短语拆分成单词并查看字典(有一些可以下载，this可能会感兴趣)，但这需要您使用的字典足够好。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|819847|它也会被专有名词所取代(例如，我的名字不在字典里)。|819848|entityMap|0|LINK|mutability|MUTABLE|url|http://wordlist.sourceforge.net/^0|P|4|0|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]]|C|$]]|$1|D|3|E|5|6|7|R|8|@]|9|@]|C|$]]|$1|F|3|-4|5|6|7|S|8|@]|9|@]|C|$]]]|G|$H|$5|I|J|K|C|$L|M]]]]

You could break the phrase up into words and check a dictionary (there are some that you can download, <a href="http://wordlist.sourceforge.net/" rel="nofollow noreferrer">this</a> may be of interest), but that would require that the dictionary you used was good enough.

It would also fall over for proper nouns (my name isn't in the dictionary for example).

blocks|key|5381509|text|Dictionary+Switcher+Firefox扩展有一个选项，可以在我输入时检测正确的字典。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|5381510|我猜它会根据安装的字典检查单词，并选择错误较少的字典...|5381511|你不能期望文本的所有单词都在字典里:缩写，专有名词，打字错误……此外，有些单词在几种语言中都是通用的:一个法国摇滚乐队甚至制作了他们光盘的标题，使其在法语和英语中都有(不同)的含义。所以这是一个统计问题:如果在一本好的英语词典中找到了超过x%25的单词，那么很可能是用户输入了这种语言(即使有错误，比如这个答案，因为我不是以英语为母语的人)。|5381512|entityMap|0|LINK|mutability|MUTABLE|url|http://en.design-noir.de/mozilla/dictionary-switcher/^0|0|J|0|0|0|0^^$0|@$1|2|3|4|5|6|7|P|8|@]|9|@$A|Q|B|R|1|S]]|C|$]]|$1|D|3|E|5|6|7|T|8|@]|9|@]|C|$]]|$1|F|3|G|5|6|7|U|8|@]|9|@]|C|$]]|$1|H|3|-4|5|6|7|V|8|@]|9|@]|C|$]]]|I|$J|$5|K|L|M|C|$N|O]]]]

The <a href="http://en.design-noir.de/mozilla/dictionary-switcher/" rel="nofollow noreferrer" title="Dictionary Switcher">Dictionary Switcher</a> Firefox extensions has an option to detect the right dictionary as I type. 
I guess it checks words against the installed dictionaries, and selects the one giving the less errors...

You can't expect all words of the text to be in the dictionary: abbreviations, proper nouns, typos... Beside, some words are common to several languages: a French rock group even made the titles of their disks to have a (different) meaning both in French and in English. So it is a statistical thing: if more than x% of words are found in a good English dictionary, chances are the user types in this language (even if there are mistakes, like probably in this answer, since I am not native English).

blocks|key|815473|text|也许"Ensuring+that+the+user+submits+only+English+text+[PHP]“这篇文章会对你有所帮助。代码是用PHP编写的，但是很小，可以很容易地重写。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|815474|entityMap|0|LINK|mutability|MUTABLE|url|http://valums.com/a/^0|3|1I|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

Maybe "<a href="http://valums.com/a/" rel="nofollow noreferrer">Ensuring that the user submits only English text [PHP]</a>" article will help you. The code is written in PHP, but is small enough to be easily rewritten.

I am building a project involving natural language processing, since the nlp module currently only deal with english text, so I have to make sure the user submitted content (not long, only several words) is in english. Are there established ways to achieve this? Python or Javascript way preferred.

How to ensure user submit only english text

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

教程

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云智能顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云AI代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

功能1上新10个字符

功能2描述100个字符功能2描述100个字符功能2描述100个字符功能2描述100个字符功能2描述100个字符功能2描述100个字符功能2描述100个字符功能2描述100个字符功能2描述100个字符。

功能2上新100个字符功能2上新100个字符功能2上新100个字符功能2上新100个字符功能2上新100个字符功能2上新100个字符功能2上新100个字符功能2上新100个字符功能2上新100个字符。

功能5描述100个字符功能5描述100个字符功能5描述100个字符功能5描述100个字符功能5描述100个字符功能5描述100个字符

功能5上新100个字符功能5上新100个字符功能5上新100个字符功能5上新100个字符功能5上新100个字符功能5上新100个字符功能5上新100个字符功能5上新100个字符功能5上新100个字符功能5上新100个字符

功能4上新

文章&问答评论现已支持表情

全新交互，全新视觉，新增快捷键、悬浮工具栏、高亮块等功能并同时优化现有功能，全面提升创作效率和体验

社区富文本编辑器全新改版！诚邀体验～ 

精选全网热门MCP server，让你的AI更好用 🚀

💥开发者 MCP广场重磅上线！

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

聚焦“写作效率、视觉美观与运行性能”三方面进行全面升级，为您提供更高效、稳定的创作环境

社区富文本&Markdown编辑器全新改版上线，欢迎大家体验!

诚挚邀请您参与本次调研，分享您的真实使用感受与建议。您的反馈至关重要，感谢您的支持与参与！

社区新版编辑器体验调研

我正在建设一个涉及自然语言处理的项目，因为nlp模块目前只处理英文文本，所以我必须确保用户提交的内容(不长，只有几个单词)是英文的。有没有既定的方法来实现这一点？最好使用Python或Javascript方式。

问如何确保用户只提交英文文本
EN

回答 10

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何确保用户只提交英文文本EN

回答 10

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问如何确保用户只提交英文文本
EN