How Do I Connect to Spark Beeline from MRS?
- Log in to the master node in the cluster as user root.
- Run the following command to configure environment variables:
source Client installation directory/bigdata_env
- If Kerberos authentication is enabled for the cluster, authenticate the user. If Kerberos authentication is disabled, skip this step.
Run the kinit MRS cluster user command.
Examples:
- For a machine-machine user, run the kinit -kt user.keytab sparkuser command.
- For a human-machine user, run the kinit sparkuser command.
- Run the following command to connect to Spark Beeline:
spark-beeline
- Run commands on Spark Beeline. For example, create the table test in the obs://mrs-word001/table/ directory.
create table test(id int) location 'obs://mrs-word001/table/';
- Query all tables.
show tables;
If the table test is displayed in the command output, OBS is successfully accessed.
Figure 1 Returned table name
- Press Ctrl+C to exit the Spark Beeline.
Parent topic: Big Data Service Development