在AWS EC2上启动Spark集群时出错

Question

我正在尝试使用以下脚本在EC2上启动Spark集群：

spark-ec2/spark-ec2 -k keyfile.pem --identity-file=keyfile.pem --region=us-west-2 --zone=us-west-2a --copy-aws-credentials --instance-type t2.micro --worker-instances 1 launch pg-hello-cluster

我在其中配置了变量：

export AWS_SECRET_ACCESS_KEY=xxx
export AWS_ACCESS_KEY_ID=xxx

这抛出了以下错误，这似乎是urllib2库的问题？

- Downloading boto...
Traceback (most recent call last):
  File "spark-ec2/spark_ec2.py", line 169, in <module>
    setup_external_libs(external_libs)
  File "spark-ec2/spark_ec2.py", line 143, in setup_external_libs
    lib_version=lib["version"]
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 431, in open
    response = self._open(req, data)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 449, in _open
    '_open', req)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 1240, in https_open
    context=self._context)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 1197, in do_open
    raise URLError(err)
urllib2.URLError: <urlopen error [SSL: TLSV1_ALERT_PROTOCOL_VERSION] tlsv1 alert protocol version (_ssl.c:590)>

如有任何帮助，我们不胜感激！

Answer 1

出现此错误消息的原因是使用的OpenSSL版本太旧，无法支持当前的TLS协议。