Archive for October 17, 2019

EMR Config for Big cluster to create Many Paritions in Hive

Written by mannem on . Posted in AWS BIG DATA, EMR || Elastic Map Reduce

EMR Configuration :

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html

 

 

 

 

Create Cluster CLI Command :

https://docs.aws.amazon.com/cli/latest/reference/emr/create-cluster.html

In below command, search for <code>replace</code> and replace them with relevant parameters like your own security groups, ssh key , IAM Roles, EMR Log bucket etc.

 

scratch