Resource Monitoring
Log in to FusionInsight Manager, choose Cluster > Name of the desired cluster > Services, and click Resource. The resource monitoring page is displayed.
Some services in the cluster provide service-level resource monitoring metrics. By default, the monitoring data of the latest 12 hours is displayed. You can click to customize a time range. Time range options are 12h, 1d, 1w, and 1m. You can click
to export the corresponding report information. If a monitoring item has no data, the report cannot be exported. Table 1 lists the services and monitoring items that support resource monitoring.
Service | Metrics | Description |
---|---|---|
HDFS | Resource Usage (by Tenant) |
|
Resource Usage (by User) |
| |
Resource Usage (by Directory) |
| |
Resource Usage (by Replica) |
| |
Resource Usage (by File Size) |
| |
Recycle Bin (by User) |
| |
Operation Count |
| |
Automatic Balancer |
| |
NameNode RPC Open Connections (by User) |
| |
Slow DataNodes | Displays DataNode that transmits or processes data slowly in the cluster. | |
Slow Disks | Displays the disk that processes data slowly on the DataNode in the cluster. | |
HBase | Operation Requests in Tables | Displays the number of PUT, DELETE, GET, SCAN, INCREMENT, and APPEND operation requests in all tables on all RegionServers. |
Operation Requests on RegionServers | Displays the number of PUT, DELETE, GET, SCAN, INCREMENT, and APPEND operation requests and number of all operation requests in RegionServer. | |
Operation Requests for Service | Displays the number of PUT, DELETE, GET, SCAN, INCREMENT, and APPEND operation requests in all regions on RegionServers. | |
HFiles on RegionServers | Displays the number of HFiles in all RegionServers. | |
Hive | HiveServer2-Background-Pool Threads (by IP) | Displays the number of HiveServer2-Background-Pool threads of top users. These threads are measured and displayed in a measurement period. |
HiveServer2-Handler-Pool Threads (by IP) | Displays the number of HiveServer2-Handler-Pools of top users collected and displayed in a period. | |
Used MetaStore Number (by IP) | Collects statistics on and displays the MetaStore usage of top users in a period. | |
Number of Hive jobs | Displays the number of user-related jobs collected by Hive in a period. | |
Number of Files Accessed in the Split Phase | Displays the number of files accessed by the underlying file storage system (HDFS by default) in the Split phase in a period. | |
Hive Basic Operation Time | Collects time for creating a directory (mkdirTime), creating a file (touchTime), writing a file (writeFileTime), renaming a file (renameTime), moving a file (moveTime), deleting a file (deleteFileTime), and deleting a directory (deleteCatalogTime) in a period of time. | |
Table Partitions | Displays the number of partitions in all Hive tables, which is displayed in the following format: database # table name, number of table partitions. | |
HQL Map Count | Collects statistics on HQL statements executed in a period and the number of Map statements invoked during the execution. The displayed information includes users, HQL statements, and the number of Map statements. | |
HQL Access Statistics | Displays the number of HQL access times in a period. | |
Kafka | Kafka Disk Usage Distribution | Displays the disk usage distribution statistics of the Kafka cluster. |
Spark/Spark2x | HQL Access Statistics | Collects HQL access statistics in a period, including the username, HQL statement, and HQL statement execution times. |
Yarn | Used resources (by task) |
|
Resource usage (by tenant) |
| |
Resource usage ratio (by tenant) |
| |
Task Duration Ranking | Displays Yarn tasks sorted by time consumption. | |
ResourceManager RPC Open Connections (by User) | Displays the number of client RPC connections to ResourceManager by user. | |
Operation Count | Collects statistics on the number and proportion of operations corresponding to each Yarn operation type. | |
Ranking of Tasks in a Queue by Resource Usage |
| |
Ranking of Users in a Queue by Resource Usage |
| |
ZooKeeper | Used Resources (By Second-Level Znode) |
|
Number of Connections (by Client IP Address) | Displays the ZooKeeper client connection resource status. |