XGBoost培训持续失败

Question

我试图使用Spark运行任何XGBoost代码，但都没有成功。我也尝试过复制粘贴的例子，但这些也不起作用。假设我们有下面的示例代码：静态/笔记本/xgboost-simple-example.html

每当我运行XGBoost.trainWithDataFrame方法时，当我使用二进制:逻辑目标时总是会得到这个错误：

Check failed: base_score > 0.0f && base_score < 1.0f base_score must be in (0,1) for logistic loss

我总是在每个火车数据中得到这个错误，而且改变其他参数也没有任何帮助。

当使用不推荐的XGBoost.train时，我会得到这些错误(我增加了轮数以产生更多这样的错误)：

[INFO] [06/25/2018 10:30:46.399] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [17] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:46.560] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [18] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:46.720] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [19] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2[10:30:46] /xgboost/src/tree/updater_prune.cc: pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:46.879] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [20] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.040] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [21] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.199] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [22] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0

[INFO] [06/25/2018 10:30:47.359] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [23] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
0
[INFO] [06/25/2018 10:30:47.519] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [24]    train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.679] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [25] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.839] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [26] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.001] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [27]    train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:48] /xgboost/src/tree/updater_prune.cc74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0:74: tree pruning end, 1 roots, 
0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.160] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [28] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:4874: tree pruning end, 1 roots, ] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.319] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [29] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.479] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [30] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 274: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth= pruned nodes, max_depth=0
0
[INFO] [06/25/2018 10:30:48.639] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [31] train-error:0.538462
[10:30:48[10:30:48] /xgboost/src/tree/updater_prune.cc:] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 174: tree pruning end,  roots, 0 extra nodes, 2 pruned nodes, max_depth=0
1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.799] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [32] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
0
[INFO] [06/25/2018 10:30:48.960] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [33] train-error:0.538462
[10:30:49] [10:30:49] /xgboost/src/tree/updater_prune.cc:/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:49.119] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [34] train-error:0.538462
[10:30:49] /xgboost/src/tree/updater_prune.cc:[10:30:49] 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:49.279] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [35] train-error:0.538462
[10:30:49] /xgboost/src/tree/updater_prune.cc:[10:30:49] 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0

在SPark 2.1.0、2.2.0、2.3.0、Scala2.11上进行了测试。

我使用的是xgboost的0.72版本。

我找不到任何解决我的问题的办法。我做错了什么？

Answer 1

你在用Mac吗？我在Mac上的也有同样的问题。

下面是关于这个的更多信息：用于JVM的xgboost在OS上有测试失败

我手动应用了建议的修补程序删除浮点/双解析的专门化，它起了作用。

1. 克隆回购
2. 按照修补程序中的建议更改include/dmlc/parameter.h
3. 再次编译xgboost代码