How Do I Connect to Spark Shell from MRS?
- Log in to the Master node in the cluster as user root.
- Run the following command to configure environment variables:
source Client installation directory/bigdata_env
- If Kerberos authentication is enabled for the cluster, authenticate the user. If Kerberos authentication is disabled, skip this step.
Run the kinit MRS cluster user command.
Examples:
- For a machine-machine user, run the kinit -kt user.keytab sparkuser command.
- For a human-machine user, run the kinit sparkuser command.
- Run the following command to connect to Spark shell:
spark-shell
Parent topic: Big Data Service Development