Spark-Shell에서 Initial job has not accepted.. 장애 해결

장애 로그

Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

조치 요령: 
spark-env.conf를 수정하여 worker 노드에서 가용 가능한 CPU와 Memory 자원을 설정한다.

export SPARK_WORKER_INSTANCES=1
export SPARK_WORKER_MEMORY=8192m
export SPARK_WORKER_CORES=8
export SPARK_MASTER_OPTS="-Dspark.deploy.defaultCores=5"