HDInsight Cluster Maintenance
An initial cluster was created when you used the
Deploy button from Azure AI Gallery. Along with the cluster, a storage account was created. This is where all data is stored.
When you are finished using the entire solution, you can delete all your resources on the Azure AI Gallery Deployments page.
If you would like to continue using the solution, you can delete the cluster while keeping the storage account. You can then re-use the storage account later on a new cluster.
Deleting the Cluster
HDInsight Spark cluster billing starts once a cluster is created and stops when the cluster is deleted. Billing is pro-rated per minute, so you should always delete your cluster when it is no longer in use.
Before you delete the cluster, login to RStudio on the cluster edge node and save your files.
- In the Files tab on the bottom right, check the checkbox to select all files.
Morebutton to find the
Export...to save the files.
Once you’ve saved your files you can use these steps to delete your cluster.
Re-Using the Storage Account on a New Cluster
You can use the Azure portal to create a new cluster by following these steps. Make sure you select your existing storage account instead of creating a new one, and you can pick up where you left off.
Once your cluster is ready, go to RStudio and Import the files by with the
Upload button. Select the zip file that you exported prior to deleting the original cluster.