我正在尝试运行ignite basic example,但由于spark TaskNotSerializable错误而失败。你能帮帮我吗?
val ignite = Ignition.start("/usr/local/ignite/config/example-ignite.xml");
val cfg = ignite.configuration()
val ic = new IgniteContext[Integer, Integer](sc, () => cfg)
Ignition.setClientMode(true);
val sharedRdd = ic.fromCache("example")
val x = sqlContext.sparkContext.parallelize(1 to 10000, 10).map(i => (new Integer(i), new Integer(i)))
sharedRdd.savePairs(x)发布于 2017-07-29 18:47:44
如果您的类没有实现为Serializable,那么上述异常也会由于spark而发生。要避免此异常,请使您的类可序列化(实现Serializable)
https://stackoverflow.com/questions/34236333
复制相似问题