Increase Spark Driver memory using PySpark session from EMR Notebooks
1 2 3 4 5 |
%%configure -f {"driverMemory":"5G","executorMemory": "10G", "executorCores": 4} Current session configs: {'driverMemory': '5G', 'executorMemory': '10G', 'executorCores': 4, 'kind': 'pyspark'} |
Tags: driver, emr, jupyter, memory, notebook, spark
Trackback from your site.