Advanced
Тема интерфейса

(Optional) Creating a DataArts Studio Incremental Package

Язык статьи: Английский
Перевести

DataArts Studio provides basic and incremental packages. If the basic package cannot meet your requirements, you can create an incremental package. Before you create an incremental package, ensure that you have a DataArts Studio instance.

DataArts Studio provides the following types of incremental packages:

  • DataArts Migration incremental package

    CDM clusters can migrate data to the cloud and integrate data into the data lake. It provides wizard-based configuration and management and can integrate data from a single table or an entire database incrementally or periodically. The DataArts Studio instance has no CDM cluster. To use CDM functions, you must create a DataArts Migration incremental package.

  • DataArts DataService incremental package

    DataArts DataService is a platform where you can develop, test, and deploy your data services. DataArts DataService ensures agile response to data service needs, easier data retrieval, better experience for data consumers, higher efficiency, and better monetization of data assets. To use DataArts DataService Exclusive, you need to purchase an exclusive cluster incremental package in addition to the DataArts Studio basic package.

Background

  • If you create a DataArts Migration incremental package, the system automatically creates a CDM cluster based on the specifications you select.
  • If you create a DataArts DataService incremental package, the system automatically creates a DataArts DataService cluster based on the specifications you select.
  • You can choose More > View Packages to view incremental packages.

Creating a CDM Cluster

  1. Locate an enabled instance and click Create.
  1. On the displayed page, set parameters based on Table 1.
    Table 1 Parameters for the CDM incremental package

    Parameter

    Description

    Package

    Select DataArts Migration.

    AZ

    When you a DataArts Studio instance or incremental package for the first time, there is no requirement on the AZ.

    When you create a new DataArts Studio instance or incremental package, determine whether to select the same AZ as the existing one based on your DR and network latency demands.

    • If your application requires good DR capability, deploy resources in different AZs in the same region.
    • If your application requires a low network latency between instances, deploy resources in the same AZ.

    Workspace

    Select the workspace where the DataArts Migration incremental package will be used. The CDM cluster can only be used in this workspace.

    Enterprise Project

    If the CDM cluster is associated with multiple workspaces, you need to specify an enterprise project for the CDM cluster.

    Cluster

    Customize the cluster name.

    Instance

    The following CDM cluster flavors are available:

    • cdm.large: 8 vCPUs and 16 GB of memory. The maximum and assured bandwidths are 3 Gbit/s and 0.8 Gbit/s. Up to 16 jobs can be executed concurrently.
    • cdm.xlarge: 16 vCPUs and 32 GB of memory. The maximum and assured bandwidths are 10 Gbit/s and 4 Gbit/s. Up to 32 jobs can be executed concurrently. This flavor is suitable for migrating terabytes of data that requires a bandwidth of 10GE.
    • cdm.4xlarge: 64 vCPUs and 128 GB of memory. The maximum and assured bandwidths are 40 Gbit/s and 36 Gbit/s. Up to 128 jobs can be executed concurrently.
    • The free ECS with 4 vCPUs and 8 GB memory provided by DataArts Studio can run only one job.

    VPC

    VPC to which the CDM cluster in the DataArts Studio instance belongs. A VPC is a secure, isolated, and logical network environment.

    If you want to connect the DataArts Studio instance or CDM cluster to a cloud service (such as DWS, MRS, and RDS), ensure that the CDM cluster can communicate with the cloud service. If the CDM cluster and the cloud service are in the same region, VPC, subnet, and security group, they can communicate with each other by default. If the CDM cluster and the cloud service are in the same VPC but in different subnets or security groups, you must configure routing rules and security group rules.

    For details about the operations on VPCs, subnets, and security groups, see Virtual Private Cloud User Guide.

    NOTE:

    After the CDM instance is created, the VPC cannot be changed.

    Subnet

    Subnet to which the CDM cluster in the DataArts Studio instance belongs. A subnet provides dedicated network resources that are isolated from other networks, improving network security.

    If you want to connect the DataArts Studio instance or CDM cluster to a cloud service (such as DWS, MRS, and RDS), ensure that the CDM cluster can communicate with the cloud service. If the CDM cluster and the cloud service are in the same region, VPC, subnet, and security group, they can communicate with each other by default. If the CDM cluster and the cloud service are in the same VPC but in different subnets or security groups, you must configure routing rules and security group rules.

    For details about the operations on VPCs, subnets, and security groups, see Virtual Private Cloud User Guide.

    NOTE:

    After the CDM instance is created, the VPC cannot be changed.

    Security Group

    Security group to which the CDM cluster in the DataArts Studio instance belongs. A security group is a set of ECS access rules. It provides access policies for ECSs that have the same security protection requirements and are mutually trusted in a VPC.

    If you want to connect the DataArts Studio instance or CDM cluster to a cloud service (such as DWS, MRS, and RDS), ensure that the CDM cluster can communicate with the cloud service. If the CDM cluster and the cloud service are in the same region, VPC, subnet, and security group, they can communicate with each other by default. If the CDM cluster and the cloud service are in the same VPC but in different subnets or security groups, you must configure routing rules and security group rules.

    For details about the operations on VPCs, subnets, and security groups, see Virtual Private Cloud User Guide.

    NOTE:

    After the CDM instance is created, the security group cannot be changed.

    IPv6 Dual Stack

    If you enable this function, both private IPv4 and IPv6 addresses can be used to access the cluster.

    NOTE:
    • If you enable this function, you can only select subnets for which IPv6 CIDR blocks are enabled. If you want to select a subnet for which IPv6 CIDR blocks are disabled, enable IPv6 CIDR blocks for the subnet in the VPC service.
    • IPv6 dual stack can be enabled for private IP addresses, but not for public IP addresses.
    Notice

    You cannot modify the specifications of an existing cluster. If you need higher specifications, create another cluster.

  2. Click Create Now, confirm the specifications, and click Next.
  3. View the CDM cluster in the corresponding workspace.

Creating a DataArts DataService Exclusive Cluster

  1. Locate an enabled instance and click create.
  2. On the displayed page, set parameters based on Table 2.

    Table 2 Parameters for creating an exclusive DataArts DataService instance

    Parameter

    Description

    Package

    Select DataArts DataService.

    Workspace

    The workspace for which you want to use the incremental package. For example, if you want to use DataArts DataService Exclusive in workspace A of the DataArts Studio instance, select workspace A. After you create an exclusive DataArts DataService cluster, you can view it in workspace A.

    AZ

    When you create a DataArts Studio instance or incremental package for the first time, you can select any available AZ.

    When you create another DataArts Studio instance or incremental package, determine whether to deploy your resources in the same AZ based on your DR and network latency demands.

    • If your application requires good DR capability, deploy resources in different AZs in the same region.
    • If your application requires a low network latency between instances, deploy resources in the same AZ.

    Name

    N/A

    Description

    A description of the exclusive DataArts DataService cluster.

    Version

    Cluster version of the exclusive DataArts DataService cluster.

    Cluster Details

    The number of concurrent API requests supported varies depending on the instance specifications.

    Enabling public IP address

    If you select Enabling public IP address, external services can call the APIs created in exclusive instances through the Internet address.

    Bandwidth

    Bandwidth range on the Internet.

    VPC

    A VPC is a secure, isolated, and logical network environment.

    Cloud resources (such as ECSs) within the same VPC can call APIs using the private IP address of DataArts DataService Exclusive.

    Deploy the DataArts DataService Exclusive instance in the same VPC as your other services to facilitate network configuration and secure network access.

    NOTE:

    After the DataArts DataService instance is created, the VPC cannot be changed.

    Subnet

    A subnet provides dedicated network resources that are logically isolated from other networks for network security.

    Deploy the DataArts DataService Exclusive instance in the same subnet of the same VPC as your other services to facilitate network configuration and secure network access.

    NOTE:

    After the DataArts DataService instance is created, the subnet cannot be changed.

    Security Group

    A security group is used to set port access rules, define ports that can be accessed by external services, and determine the IP addresses and ports that can be accessed externally.

    For example, if the backend service is deployed on an external network, configure security group rules to allow access to the IP address and listening port of the backend service.

    NOTE:
    1. If Enabling the public IP address is selected, the security group must allow access from ports 80 (HTTP) and 443 (HTTPS) in the inbound direction.
    2. After the DataArts DataService instance is created, the security group cannot be changed.

    Managing Cluster Resources Using an Enterprise Project

    Enterprise project associated with the exclusive DataArts DataService cluster. An enterprise project facilitates management of cloud resources. For details, see Enterprise Management User Guide.

  3. Click create Now, confirm the settings, and click Next.