Dask Cluster
Follow below steps to set up Dask Cluster OS - Ubuntu 16.04 Cloud - AWS # Install pip sudo apt-get update # Install pip sudo apt-get install python-pip # Install Docker $ curl -fsSL https://get.docker.com -o get-docker.sh $ sh get-docker.sh # Add your user to the docker group. sudo usermod -aG docker $USER # install git # clone https://github.com/dask/dask-docker $ git clone https://github.com/dask/dask-docker #go to cd dask-docker/ directory # install docker compose $ sudo curl -L "https://github.com/docker/compose/releases/download/1.23.1/docker-compose- $( uname -s ) - $( uname -m ) " -o /usr/local/bin/docker-compose sudo chmod +x /usr/local/bin/docker-compose # executable permission given # test installation docker-compose --version # docker-compose up # Run shceduler docker run -it --network host daskdev/dask # run worker docker run -it --network host daskdev/dask dask-worker 10.0.0.60:8786 #create notebook im