在安装Hadoop时使用"jps“时不使用Namenode、datanode

Question

我试图在我的macbook m1中安装hadoop，但是当我输入jps它没有显示所有的节点时，我只会发送所有节点的屏幕截图。

下面的代码是我运行hdfs namenode -format时得到的-没有完全上传，因为最多有30000个字符

 NameNodeRetryCache
2022-11-11 19:33:22,044 INFO util.GSet: VM type       = 64-bit
2022-11-11 19:33:22,044 INFO util.GSet: 0.029999999329447746% max memory 1.8 GB = 559.3 KB
2022-11-11 19:33:22,044 INFO util.GSet: capacity      = 2^16 = 65536 entries
Re-format filesystem in Storage Directory root= /tmp/hadoop-vignesh/dfs/name; location= null ? (Y or N)

我不知道我应该按Y/N键，但我尝试了这两种方法，但都没有用。

当我分别按Y和N的时候，我会显示出来

2022-11-11 19:38:13,905 INFO namenode.FSImage: Allocated new BlockPoolId: BP-409547403-127.0.0.1-1668175693876
 2022-11-11 19:38:13,907 INFO common.Storage: Will remove files: [/tmp/hadoop-vignesh/dfs/name/current/fsimage_0000000000000000000, /tmp/hadoop-vignesh/dfs/name/current/VERSION, /tmp/hadoop-vignesh/dfs/name/current/fsimage_0000000000000000000.md5, /tmp/hadoop-vignesh/dfs/name/current/seen_txid]
2022-11-11 19:38:13,938 INFO common.Storage: Storage directory /tmp/hadoop-vignesh/dfs/name has been successfully formatted.
2022-11-11 19:38:13,981 INFO namenode.FSImageFormatProtobuf: Saving image file /tmp/hadoop-vignesh/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
2022-11-11 19:38:14,067 INFO namenode.FSImageFormatProtobuf: Image file /tmp/hadoop-vignesh/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 402 bytes saved in 0 seconds .
2022-11-11 19:38:14,075 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
2022-11-11 19:38:14,093 INFO namenode.FSNamesystem: Stopping services started for active state
2022-11-11 19:38:14,093 INFO namenode.FSNamesystem: Stopping services started for standby state
2022-11-11 19:38:14,097 INFO namenode.FSImage: FSImageSaver clean checkpoint: txid=0 when meet shutdown.
2022-11-11 19:38:14,097 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at Vigneshs-MacBook-Air.local/127.0.0.1

和N

Format aborted in Storage Directory root= /tmp/hadoop-vignesh/dfs/name; location= null
2022-11-11 19:41:56,728 INFO namenode.FSNamesystem: Stopping services started for active state
2022-11-11 19:41:56,729 INFO namenode.FSNamesystem: Stopping services started for standby state
2022-11-11 19:41:56,737 INFO util.ExitUtil: Exiting with status 1: ExitException
2022-11-11 19:41:56,746 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at Vigneshs-MacBook-Air.local/127.0.0.1

当我按下"start-all.sh“键时

WARNING: Attempting to start all Apache Hadoop daemons as vignesh in 10 seconds.
WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [Vigneshs-MacBook-Air.local]
Starting datanodes
Starting secondary namenodes [Vigneshs-MacBook-Air.local]
2022-11-11 19:44:45,167 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting resourcemanager
Starting nodemanagers

当"jps“

43457 Jps
43284 ResourceManager
43386 NodeManager

我试着安装hadoop，我希望最本地的:9870能工作。

Answer 1

，但我尝试了这两种方法，但都不起作用

两者都如预期的那样工作。你按Y-上面写着has been successfully formatted.；你按N- Format aborted。

不要使用start-all。这是不可取的。您可以使用start-dfs，但它可能具有相同的行为。在这两种情况下，您都必须找到namenode守护进程日志文件并打开它，以查找进程为什么没有启动的真正错误。

但是，稍后您可能会遇到在ARM上运行Hadoop的其他问题。