建立火花时的内存问题

Question

我已经在Ubuntu12.o4客户端操作系统上安装了Scala、sbt和hadoop 1.0.3。以link - Ubuntu-12.04为例，尝试建立space，得到了与预留空间相关的误差.

以下是我想要运行的内容：

hduser@vignesh-desktop:/usr/local/spark-1.1.0$ SPARK_HADOOP_VERSION=1.1.0 sbt/sbt assembly

输出有以下错误：

Using /usr/lib/jvm/java-6-openjdk-i386/ as default JAVA_HOME.
Note, this will be overridden by -java-home if it is set.
Error occurred during initialization of VM
Could not reserve enough space for object heap
Could not create the Java virtual machine.

Answer 1

我通过使用sbt命令传递mem属性来解决这个问题，如下所示(对于4GB的RAM系统)

SPARK_HADOOP_VERSION=1.1.0 sbt/sbt assembly -mem 1024