Viewing Flink Job Details

After creating a Flink job, you can check the basic information, job details, task list, and execution plan of the job on the DLI console.

This section describes how to check information about a Flink job.

Table 1 Viewing Flink job information
Type	Description	Instruction
Basic information	Includes the job ID, job type, job execution status, and more.	Viewing Basic Information
Job details	Includes SQL statements and the parameter settings for Flink Jar jobs.	Viewing Details
Job monitoring	You can use Cloud Eye to check job data input and output details.	Viewing Monitoring Information
Task list	You can view details about each task running on a job, including the task start time, number of received and transmitted bytes, and running duration.	Viewing the Task List
Execution plan	You can understand the operator flow direction of a running job.	Viewing the Execution Plan

Viewing Basic Information

In the navigation pane of the DLI console, choose Job Management > Flink Jobs. The Flink Jobs page displays all Flink jobs. You can check basic information about any Flink jobs in the list.

Table 2 Basic information about a Flink job
Parameter	Description
ID	ID of a submitted Flink job, which is generated by the system by default.
Name	Name of the submitted Flink job.
Type	Type of the submitted Flink job, which includes: Flink SQL Flink Jar
Status	Job status, which is subject to the console.
Description	Description of the submitted Flink job.
Username	Name of the user who submits the job.
Created	Time when the job was created.
Started	Time when the Flink job started to run.
Duration	Time consumed by job running.
Operation	Edit: Edit a created job. Start: Start and run a job. More FlinkUI: Selecting this will display the Flink job execution page. NOTE: If you select FlinkUI immediately after submitting a job to a new queue, an empty projectID will be cached and the FlinkUI page cannot be displayed as it takes about 10 minutes to create a cluster in the background. You are advised to use a dedicated queue to ensure immediate availability of clusters for your jobs. Alternatively, select FlinkUI when the job is in the Running state. Stop: Stop a Flink job. If it is grayed out, jobs in the current state cannot be stopped. Delete: Delete a job. NOTE: Deleted jobs cannot be restored. Modify Name and Description: You can modify the name and description of a job. Import Savepoint: Import the data exported from the original Cloud Stream Service (CS) job. Trigger Savepoint: You can select this operation for jobs in the Running state to save the job status. Permissions: You can view the user permissions corresponding to the job and grant permissions to other users. Runtime Configuration: You can enable Alarm Generation on Job Exception and Auto Restart on Exception.

Viewing Details

This section describes how to view job details. After you create and save a job, you can click the job name to view job details, including SQL statements and parameter settings. For a Jar job, you can only view its parameter settings.

In the left navigation pane of the DLI management console, choose Job Management > Flink Jobs. The Flink Jobs page is displayed.
Click the name of your desired job.
On the displayed page, you can view the job details, SQL statements, job configuration information, task list, execution plan, commit logs, run logs, log list, and job tags.

Viewing Monitoring Information

You can use Cloud Eye to view details about job data input and output.

In the left navigation pane of the DLI management console, choose Job Management > Flink Jobs. The Flink Jobs page is displayed.

Click the name of the job you want. The job details are displayed.

Click Job Monitoring in the upper right corner of the page to switch to the Cloud Eye console.

The following table describes monitoring metrics related to Flink jobs.

Table 3 Monitoring metrics related to Flink jobs
Name	Description
Flink Job Data Read Rate	Displays the data input rate of a Flink job for monitoring and debugging. Unit: record/s.
Flink Job Data Write Rate	Displays the data output rate of a Flink job for monitoring and debugging. Unit: record/s.
Flink Job Total Data Read	Displays the total number of data inputs of a Flink job for monitoring and debugging. Unit: records
Flink Job Total Data Write	Displays the total number of output data records of a Flink job for monitoring and debugging. Unit: records
Flink Job Byte Read Rate	Displays the number of input bytes per second of a Flink job. Unit: byte/s
Flink Job Byte Write Rate	Displays the number of output bytes per second of a Flink job. Unit: byte/s
Flink Job Total Read Byte	Displays the total number of input bytes of a Flink job. Unit: byte
Flink Job Total Write Byte	Displays the total number of output bytes of a Flink job. Unit: byte
Flink Job CPU Usage	Displays the CPU usage of Flink jobs. Unit: %
Flink Job Memory Usage	Displays the memory usage of Flink jobs. Unit: %
Flink Job Max Operator Latency	Displays the maximum operator delay of a Flink job. The unit is ms.
Flink Job Maximum Operator Backpressure	Displays the maximum operator backpressure value of a Flink job. A larger value indicates severer backpressure. 0: OK 50: low 100: high

Viewing the Task List

You can view details about each task running on a job, including the task start time, number of received and transmitted bytes, and running duration.

Note

If the value is 0, no data is received from the data source.

In the left navigation pane of the DLI management console, choose Job Management > Flink Jobs. The Flink Jobs page is displayed.
Click the name of the job you want. The job details are displayed.

On Task List and view the node information about the task.

View the operator task list. The following table describes the task parameters.

Table 4 Parameter descriptions
Parameter	Description
Name	Name of an operator.
Duration	Running duration of an operator.
Max Concurrent Jobs	Number of parallel tasks in an operator.
Task	Operator tasks are categorized as follows: The digit in red indicates the number of failed tasks. The digit in light gray indicates the number of canceled tasks. The digit in yellow indicates the number of tasks that are being canceled. The digit in green indicates the number of finished tasks. The digit in blue indicates the number of running tasks. The digit in sky blue indicates the number of tasks that are being deployed. The digit in dark gray indicates the number of tasks in a queue.
Status	Status of an operator task.
Back Pressure Status	Working load status of an operator. Available options are as follows: OK: indicates that the operator is in normal working load. LOW: indicates that the operator is in slightly high working load. DLI processes data quickly. HIGH: indicates that the operator is in high working load. The data input speed at the source end is slow.
Delay	Duration from the time when source data starts being processed to the time when data reaches the current operator. The unit is millisecond.
Sent Records	Number of data records sent by an operator.
Sent Bytes	Number of bytes sent by an operator.
Received Bytes	Number of bytes received by an operator.
Received Records	Number of data records received by an operator.
Started	Time when an operator starts running.
Ended	Time when an operator stops running.

Viewing the Execution Plan

You can view the execution plan to understand the operator stream information about the running job.

In the left navigation pane of the DLI management console, choose Job Management > Flink Jobs. The Flink Jobs page is displayed.
Click the name of the job you want. The job details are displayed.
Click the Execution Plan tab to view the operator flow direction.
Click a node. The corresponding information is displayed on the right of the page.
- Scroll the mouse wheel to zoom in or out.
- The stream diagram displays the operator stream information about the running job in real time.

Parent topic: Managing Flink Jobs

Предыдущая статья

Managing Flink Jobs

Следующая статья

Querying Logs for Flink Jobs

Была ли эта статья полезна?

Поддержка Юридические документы