Creating an Enhanced Datasource Connection

Scenario

Notes and Constraints

Process

Figure 1 Enhanced datasource connection creation flowchart

Prerequisites

• An elastic resource pool or queue has been created.
• You have obtained the VPC, subnet, private IP address, port, and security group information of the external data source.
• The security group of the external data source has allowed access from the CIDR block of the elastic resource pool or queue.

Procedure

1. Create an Enhanced Datasource Connection
   1. Log in to the DLI management console.
   2. In the navigation pane on the left, choose Datasource Connections.
   3. On the displayed Enhanced tab, click Create.

      Set parameters based on Table 2.

      Table 2 Parameters

      Parameter	Description
      Connection Name	Name of the created datasource connection. Only letters, numbers, and underscores (_) are allowed. The parameter must be specified. A maximum of 64 characters are allowed.
      VPC	VPC used by the data source.
      Subnet	Subnet used by the data source.
      Host Information	In this text field, you can configure the mapping between host IP addresses and domain names so that jobs can only use the configured domain names to access corresponding hosts. This parameter is optional. For example, when accessing the HBase cluster of MRS, you need to configure the host name (domain name) and IP address of the ZooKeeper instance. Enter one record in each line in the format of IP addressHost name/Domain name. Example: 192.168.0.22 node-masterxxx1.com 192.168.0.23 node-masterxxx2.com For details about how to obtain host information, see How Do I Obtain MRS Host Information?.

   4. Click OK.

      After the creation is complete, the enhanced datasource connection is in the Active state, indicating that the connection is successfully created.

2. Security Group Where the Data Source Belongs Allows Access from the CIDR Block of the Elastic Resource Pool
   1. On the DLI management console, obtain the network segment of the elastic resource pool or queue.

      Choose Resources > Queue Management from the left navigation pane. On the page displayed, locate the queue on which jobs are running, and click the button next to the queue name to obtain the CIDR block of the queue.

   2. Log in to the VPC console and find the VPC the data source belongs to.
   3. On the network console, choose Virtual Private Cloud > Network Interfaces. On the Network Interfaces tab page displayed, search for the security group name, click More in the Operation column, and select Change Security Group.
   4. In the navigation pane on the left, choose Access Control > Security Groups.
   5. Click the name of the security group to which the external data source belongs.
   6. Click the Inbound Rules tab and add a rule to allow access from the CIDR block of the queue.

      Configure the inbound rule parameters according to Table 3.

      Table 3 Inbound rule parameters

      Parameter	Description	Example Value
      Priority	Priority of a security group rule. The priority value ranges from 1 to 100. The default value is 1, indicating the highest priority. A smaller value indicates a higher priority of a security group rule.	1
      Action	Action of the security group rule.	Allow
      Protocol & Port	Network protocol. The value can be All, TCP, UDP, ICMP, or GRE. Port: Port or port range over which the traffic can reach your instance. The port ranges from 1 to 65535.	In this example, select TCP. Leave the port blank or set it to the data source port.
      Type	Type of IP addresses.	IPv4
      Source	Allows access from IP addresses or instances in another security group.	In this example, enter the obtained queue CIDR block.
      Description	Supplementary information about the security group rule. This parameter is optional.	_

3. Test the Connectivity Between the DLI Queue and the Data Source
   1. Obtain the private IP address and port number of the data source.

      Take the RDS data source as an example. On the Instances page, click the target DB instance. On the page displayed, locate the Connection Information pane and view the private IP address. In the Connection Information pane, locate the Database Port to view the port number of the RDS DB instance.

   2. In the navigation pane of the DLI management console, choose Resources > Queue Management.
   3. Locate the queue bound with the enhanced datasource connection, click More in the Operation column, and select Test Address Connectivity.
   4. Enter the data source connection address and port number to test the network connectivity.

      Format: IP address:Port number

      Caution

      Before testing the connection, ensure that the security group of the external data source has allowed access from the CIDR block of the queue.