Doris Cluster Monitoring Metrics
Description
Monitoring is critical to ensure CloudTable reliability, availability, and performance. You can monitor the running status of CloudTable servers. This section describes the metrics that can be monitored by Cloud Eye as well as their namespaces and dimensions.
Namespace
SYS.CloudTable
FE node monitoring metrics
Table 1 lists the FE node monitoring metrics.
Metric ID | Metric | Description | Value Range | Unit | Conversion Rule | Monitored Object (Dimension) | Monitoring Interval (Raw Data) | Namespace |
|---|---|---|---|---|---|---|---|---|
cmdProcessMem | Memory utilization rate | Memory utilization rate of the monitored object | 0 ~100 | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
cmdProcessCPU | CPU utilization rate | CPU utilization rate of the monitored object | 0 ~100 | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
cmdForUsedStorageRate | Used storage rate | Ratio of the used storage space to the total storage space in the cluster | 0 ~100 | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_image_clean_failed | Failed historical metadata image clearing | The operation should not fail. If it fails, contact O&M engineers. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_image_clean_success | Successful Historical Metadata Image Clearing | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_image_push_success | Successful metadata image pushes to FE nodes | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_image_write_failed | Failed metadata image generation | The operation should not fail. If it fails, contact O&M engineers. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_image_write_success | Successful metadata image generation | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_max_journal_id | Maximum metadata log ID of the FE node | For the master frontend node, this value indicates the maximum ID of the metadata log that is being written. For other frontend nodes, the value indicates the maximum ID of the metadata log that is being replayed. If the ID difference between these frontend nodes is too much, metadata synchronization is abnormal. | ≥ 0 | N/A | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_max_tablet_compaction_score | Maximum compaction score of all BE nodes | The maximum compaction score of the current cluster. If the score is too high, there may be query or write latency. | ≥ 0 | N/A | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_qps | FE node QPS (query requests only) | QPS | ≥ 0 | Count/s | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_query_err | Total failed queries | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_query_err_rate | Number of error queries per second | - | ≥ 0 | Count/s | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_query_latency_ms_99 | 99th percentile query latency | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_query_latency_ms_999 | 999th percentile query latency | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_query_olap_table | Query requests to an internal table (OLAPTable) | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_query_total | Number of all query requests | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_report_queue_size | Queue length of BE periodic report tasks on the FE node | This value indicates the number of report tasks waiting on the master FE node. A large value indicates a poor FE processing capability. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_request_total | Operation requests (query and other statements) received through the MySQL port | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_routine_load_error_rows | Total error rows of all Routine Load jobs in the cluster | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_routine_load_receive_bytes | Size of data received by all Routine Load jobs in the cluster | - | ≥ 0 | Byte | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_routine_load_rows | Number of data rows received by all Routine Load jobs in the cluster | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_rps | FE Node QPS (Query and Other Statements) | This metric is used together with QPS to monitor the number of requests processed by the cluster. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_scheduled_tablet_num | Tablets being scheduled by the master FE node | Copies being repaired and balanced are included. This value reflects the number of tablets that are being migrated in the current cluster. If there always are such tablets, the cluster is unstable. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_tablet_status_count_added | Number of tablets scheduled on the master FE node | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_tablet_status_count_in_sched | Number of tablets that are repeatedly scheduled on the master FE node | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_tablet_status_count_not_ready | Number of tablets that do not meet the scheduling triggering conditions on the master FE node | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_tablet_status_count_total | Number of tablets that have been checked on the master FE node | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_tablet_status_count_unhealthy | Unhealthy tablets on the master FE node | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_counter_begin | Number of submitted transactions | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_counter_failed | Number of failed transactions | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_counter_reject | Number of rejected transactions | If the number of running transactions exceeds the threshold, new transactions will be rejected. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_counter_success | Number of successful transactions | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_exec_latency_ms_99 | 99th percentile transaction execution duration | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_exec_latency_ms_999 | 999th percentile transaction execution duration | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_publish_latency_ms_99 | 99th percentile publish operation duration | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_txn_publish_latency_ms_999 | 999th percentile publish operation duration | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_heap_size_bytes_max | Maximum heap memory | The metric is used for observing the JVM memory usage. | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_heap_size_bytes_committed | Allocated heap memory | The metric is used for observing the JVM memory usage. | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_heap_size_bytes_used | Used heap memory | The metric is used for observing the JVM memory usage. | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_non_heap_size_bytes_committed | Allocated off-heap memory | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_non_heap_size_bytes_used | Used off-heap memory | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_old_gc_count | Old generation GC | This metric is used to check whether Full GC persists for a long time. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_old_gc_time | Old generation GC duration | This metric is used to check whether Full GC persists for a long time. | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_old_size_bytes_used | Old generation memory usage | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_old_size_bytes_peak_used | Peak memory usage of the old generation | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_old_size_bytes_max | Maximum old generation memory | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_thread_new_count | Peak thread count | This metric is used to check whether there are too many JVM threads. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_thread_new_count | Number of threads in the new state | This metric is used to check whether there are too many JVM threads. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_thread_runnable_count | Number of threads in the runnable state | This metric is used to check whether there are too many JVM threads. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_thread_blocked_count | Number of threads in the blocked state | This metric is used to check whether there are too many JVM threads. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_thread_waiting_count | Number of threads in the waiting state | This metric is used to check whether there are too many JVM threads. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_thread_terminated_count | Number of threads in the terminated state | This metric is used to check whether there are too many JVM threads. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_young_gc_count | Young generation GC count | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_young_gc_time | Young generation GC duration | Cumulative value | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
jvm_young_size_bytes_used | Young generation memory usage | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_young_size_bytes_peak_used | Peak memory usage of the young generation | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
jvm_young_size_bytes_max | Maximum young generation memory | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_cache_added_partition | New partition caches | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_cache_added_sql | New SQL caches | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_cache_hit_partition | Hit partition caches | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_cache_hit_sql | Hit SQL caches | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_connection_total | FE MySQL port connections | This metric is used to monitor the number of query connections. If the number of connections exceeds the upper limit, new connections cannot be established. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_counter_hit_sql_block_rule | Queries intercepted by SQL block rule | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_edit_log_clean_failed | Failed historical metadata log clearing | The operation should not fail. If it fails, contact O&M engineers. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_edit_log_clean_success | Successful historical metadata log clearing | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_edit_log_read | Metadata log reads | The slope indicates the metadata read frequency. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_edit_log_write | Metadata log writes | The slope indicates the metadata read frequency. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_fe_image_push_failed | Failed metadata image pushes to FE nodes | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
BE node monitoring metrics
Table 2 lists the BE node monitoring metrics.
Metric ID | Metric | Description | Value Range | Unit | Conversion Rule | Monitored Object (Dimension) | Monitoring Interval (Raw Data) | Namespace |
|---|---|---|---|---|---|---|---|---|
doris_be_active_scan_context_count | Scanners enabled externally | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_add_batch_task_queue_size | Queue size of the thread pool for receiving batches | - | ≥ 0 | N/A | N/A | CloudTable instance node | 60s | SYS.CloudTable |
cmdForUsedStorageRate | Used storage rate | Ratio of the used storage space to the total storage space in the cluster | 0 ~100 | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_brpc_endpoint_stub_count | Created brpc stubs (BE nodes) | These stubs are used for interactions between BE nodes. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_brpc_function_endpoint_stub_count | Created brpc stubs (remote RPCs) | These stubs are used for interactions between remote RPCs. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_usage_LastestSuccessChannelCache | LRU ChannelCache usage | LRU DataPageCache usage | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_usage_ratio_DataPageCache | LRU DataPageCache utilization | - | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_usage_ratio_IndexPageCache | LRU IndexPageCache utilization | - | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_usage_ratio_SegmentCache | LRU SegmentCache Utilization | - | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_hit_ratio_DataPageCache | LRU DataPageCache hit ratio | The data cache directly affects the query efficiency. | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_hit_ratio_IndexPageCache | LRU IndexPageCache hit ratio | The index cache directly affects the query efficiency. | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_hit_ratio_LastestSuccessChannelCache | LRU ChannelCache hit ratio | - | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_cache_hit_ratio_SegmentCache | LRU SegmentCache hit ratio | - | [0,100] | % | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_chunk_pool_local_core_alloc_count | Memory allocation by ChunkAllocator from the bound core | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_chunk_pool_other_core_alloc_count | Memory allocation by ChunkAllocator from other cores | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_chunk_pool_reserved_bytes | Reserved memory size for ChunkAllocator | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_chunk_pool_system_alloc_cost_ns | SystemAllocator memory application duration | Accumulated value. The slope indicates the memory allocation duration. | ≥ 0 | ns | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_chunk_pool_system_alloc_count | SystemAllocator memory application count | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_chunk_pool_system_free_cost_ns | SystemAllocator memory release duration | The slope indicates the memory release duration. | ≥ 0 | ns | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_chunk_pool_system_free_count | SystemAllocator memory release count | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_compaction_bytes_total_base | Base Compaction data volume | Cumulative value | ≥ 0 | Byte | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_compaction_bytes_total_cumulative | Cumulative Compaction data volume | Cumulative value | ≥ 0 | Byte | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_compaction_deltas_total_base | Rowsets processed by Base Compaction | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_compaction_deltas_total_cumulative | Rowsets processed by cumulative compaction | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_compaction_waitting_permits | Tokens waiting for compaction | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_data_stream_receiver_count | Number of receivers | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_data_stream_receiver_count | Number of receivers | Same as doris_be_data_stream_receiver_count | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_fragment_request_duration_us | Execution duration of all fragment instances | Accumulated value. The slope indicates the execution duration. | ≥ 0 | us | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_fragment_requests_total | Executed fragment instances | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_load_channel_count | Load channels | A larger value indicates that more import tasks are being executed. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_mem_consumption_tablet_meta | Total memory overhead of the tablet_meta module | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_mem_consumption_load | Total memory overhead of the load module | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_memory_allocated_bytes | Virtual memory occupied by TcMalloc | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_memory_pool_bytes_total | Memory occupied by all MemPools. | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_memtable_flush_duration_us | Time required for writing memtables to disks | Accumulated value. The slope indicates the write latency. | ≥ 0 | us | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_memtable_flush_total | Number of memtables written to disks | Accumulated value. The slope can be used to calculate the file writing frequency. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_meta_request_duration_read | Time required for reading RocksDB meta | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_meta_request_duration_write | Time required for writing RocksDB meta | - | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_meta_request_total_read | RocksDB meta reads | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_meta_request_total_write | RocksDB meta writes | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_plan_fragment_count | Received fragment instances | This metric is used to check whether instances are stacked. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_process_fd_num_limit_hard | Hard limit of backend process file handles | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_process_fd_num_limit_soft | Soft limit of backend process file handles | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_process_fd_num_used | File handles used by the backend process | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_process_thread_num | Threads used by the backend process | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_query_cache_memory_total_byte | Bytes occupied by query cache | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_query_cache_partition_total_count | Partition caches | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_query_cache_sql_total_count | SQL caches | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_query_scan_bytes | Read data volume | Only the amount of data read from the OLAP table is counted. | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_query_scan_bytes_per_second | Read rate | - | ≥ 0 | Byte/s | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_query_scan_rows | Read rows | Accumulated value. Only data read from the OLAP table is counted. The slope indicates the query rate. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_result_block_queue_count | Fragment instances in the query result cache | This queue is used only when it is directly read by external systems. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_result_buffer_block_count | Queries in the current query result cache | This metric indicates the number of backend query results waiting for frontend consumption. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_routine_load_task_count | Routine load tasks being executed | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_rowset_count_generated_and_in_use | New rowset IDs being used since startup | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_scanner_thread_pool_queue_size | Queue length of OLAPScanner thread pool | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_segment_read_segment_read_total | Read segments | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_segment_read_segment_row_total | Read segment rows | Accumulated value, which also contains the rows searched by index | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_send_batch_thread_pool_queue_size | Queue length of the thread pool for importing data | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_send_batch_thread_pool_thread_num | Threads of the thread pool for importing data | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_small_file_cache_count | Small files cached on BE nodes | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_streaming_load_current_processing | Running stream loading tasks | Only tasks sent by the curl command are included. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_streaming_load_duration_ms | Execution duration of all stream loading tasks | Cumulative value | ≥ 0 | ms | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_streaming_load_requests_total | Stream loading tasks | Accumulated value. The slope indicates the task submission frequency. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_stream_load_pipe_count | Stream loading pipelines | Stream loading and routine loading tasks are included. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_stream_load_load_rows | Rows imported by stream loading | Stream loading and routine loading tasks are included. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_stream_load_receive_bytes | Bytes received by stream loading | Data received by stream loading from HTTP and data read by routine loading from Kafka are included. | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_tablet_base_max_compaction_score | Maximum base compaction score | The value changes in real time, and peak data may be lost. A larger value indicates a heavier compaction accumulation. | ≥ 0 | N/A | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_tablet_cumulative_max_compaction_score | Maximum cumulative compaction score | - | ≥ 0 | N/A | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_thrift_connections_total_heartbeat | Total heartbeat service connections | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_thrift_connections_total_backend | Connections of the backend service | Cumulative value | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_thrift_current_connections_heartbeat | Current connections of the heartbeat service | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_thrift_current_connections_backend | Current connections of the backend service | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_timeout_canceled_fragment_count | Fragment instances canceled due to timeout | This value may be recorded repeatedly. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_stream_load_txn_request_begin | Stream loading start transactions | Stream loading and routine loading tasks are included. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_stream_load_txn_request_commit | Successful stream loading transactions | Stream loading and routine loading tasks are included. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_stream_load_txn_request_rollback | Failed stream loading transactions | Stream loading and routine loading tasks are included. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_unused_rowsets_count | Discarded rowsets | These rowsets are deleted periodically. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_load_bytes | Messages sent via tablet sink | Accumulated value, which can be used to calculate the amount of imported data. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_load_rows | Rows sent via tablet sink | Accumulated value, which can be used to calculate the amount of imported data. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_fragment_thread_pool_queue_size | Queue length of query execution thread pool | - | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_compaction_used_permits | Tokens used by the compaction tasks | This metric indicates the resource consumption of Compaction. | ≥ 0 | Count | N/A | CloudTable instance node | 60s | SYS.CloudTable |
doris_be_upload_total_byte | Total rowset data | - | ≥ 0 | Byte | 1024(IEC) | CloudTable instance node | 60s | SYS.CloudTable |
Dimension
Key | Value |
|---|---|
cluster_id | CloudTable cluster ID. |
instance_name | Name of a CloudTable cluster node. |
- Description
- Namespace
- FE node monitoring metrics
- BE node monitoring metrics
- Dimension