Big Data
Spark-Shell에서 Initial job has not accepted.. 장애 해결
kogun82
2018. 4. 3. 13:40
장애 로그
Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
조치 요령:
spark-env.conf를 수정하여 worker 노드에서 가용 가능한 CPU와 Memory 자원을 설정한다.
export SPARK_WORKER_INSTANCES=1
export SPARK_WORKER_MEMORY=8192m
export SPARK_WORKER_CORES=8
export SPARK_MASTER_OPTS="-Dspark.deploy.defaultCores=5"