[Error] HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment
HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment 상황 airflow에서 master을 yarn으로 spark-submit job 실행 해결 spark...
Recent posts
[Docker] Docker Container to Image
Docker Container to Image
[Docker] DevContainer
DevContainer SSH to EC2(Mac 기준) Script to Install Docker on EC2(Ubuntu) VSCode DevContainer CLI to remote Docker
[Web Crawling] Scrapy to S3
Scrapy to S3 Install Packages settings.py
[Cloud] AWS S3
AWS S3 S3 Overview Buckets Objects Versioning Encryption