org.apache.spark.network.BlockTransferService.fetchBlockSync(BlockTransferService.scala:98) at org.apache.spark.broadcast.TorrentBroadcast$$anonfun$org$apache$spark
$$anonfun$doGetRemote$2.apply(BlockManager.scala:594) at org.apache.spark.storage.BlockManager.getRemoteBytes(BlockManager.scala我猜发生了什么,星火正在将BlockManager的地址记录为local
23 22:22:03 INFO Executor: Finished task 0.3 in stage 4.0 (TID 13). 124969484 bytes result sent via BlockManager22:22:10 INFO CassandraConnector: Disconnected from Cassandra cluster: DataMonitor
看起来,当结果足够大时,它会被“通过BlockManager
public void erase() for (int i = 0; i < BlockManager.length; i++) Block block = BlockManager.blocks[BlockManager.erased[i][0]][BlockManager.erased[i][1]];
BlockManager.blocks[BlockManager.erased[BlockManager</em
$$anonfun$doPutIterator$1.apply(BlockManager.scala:935)at org.apache.spark.storage.BlockManager.doPut(BlockManager.scala:866)
at org.apache.spark.storage.
$$anonfun$doPutIterator$1$$anonfun$apply$7.apply(BlockManager.scala:1101) at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1.apply(BlockManager.scala:1099)
at org.apache.spark.