私はUbuntu仮想マシンにHadoop 2.7.1をインストールしました。私はHiBenchで関数kmeansアルゴリズムを実行したいが、私は、スクリプトprepare.shを実行したときに、私は次のエラーを持っている:HiBench Benchmarスイートエラー:INPUT_HDFS:バインドされていない変数
patching args=
Parsing conf: /home/hduser/HiBench/conf/00-default-properties.conf
Parsing conf: /home/hduser/HiBench/conf/01-default-streamingbench.conf
Parsing conf: /home/hduser/HiBench/conf/10-data-scale-profile.conf
Parsing conf: /home/hduser/HiBench/conf/20-samza-common.conf
Parsing conf: /home/hduser/HiBench/conf/30-samza-workloads.conf
Parsing conf: /home/hduser/HiBench/workloads/kmeans/conf/00-kmeans-default.conf
Parsing conf: /home/hduser/HiBench/workloads/kmeans/conf/10-kmeans-userdefine.conf
Probing spark verison, may last long at first time...
probe sleep jar: /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.2-tests.jar
Traceback (most recent call last):
File "/home/hduser/HiBench/bin/functions/load-config.py", line 556, in <module>
load_config(conf_root, workload_root, workload_folder, patching_config)
File "/home/hduser/HiBench/bin/functions/load-config.py", line 165, in load_config
check_config()
File "/home/hduser/HiBench/bin/functions/load-config.py", line 172, in check_config
assert HibenchConf.get(prop_name, None) is not None, "Mandatory configure missing: %s" % prop_name
AssertionError: Mandatory configure missing: hibench.hdfs.master
/home/hduser/HiBench/bin/functions/workload-functions.sh: line 39: .: filename argument required
.: usage: . filename [arguments]
start HadoopPrepareKmeans bench ./prepare.sh: line 25: INPUT_HDFS: unbound variable
私はファイル99-user_defined_properties.conf.template
上の構成を設定しています。構成は次のとおりです。
# Hadoop home
hibench.hadoop.home /usr/local/hadoop/bin
# Spark home
hibench.spark.home /PATH/TO/YOUR/SPARK/ROOT
# HDFS master, set according to hdfs-site.xml
hibench.hdfs.master hdfs://localhost:54310
# Spark master
# standalone mode: `spark://xxx:7077`
# YARN mode: `yarn-client`
# unset: fallback to `local[1]`
hibench.spark.master yarn-client
これをどのように解決できますか?