Using CarbonData
- Overview
  - CarbonData Overview
  - Main Specifications of CarbonData
- Common CarbonData Parameters
- CarbonData Operation Guide
- CarbonData Performance Tuning
- CarbonData Access Control
- CarbonData Syntax Reference
- CarbonData Troubleshooting
  - Filter Result Is not Consistent with Hive when a Big Double Type Value Is Used in Filter
  - Query Performance Deterioration
- CarbonData FAQ
Using CDL
- CDL Usage Instructions
- Using CDL from Scratch
- Creating a CDL User
- Preparing for Creating a CDL Job
- Creating a CDL Job
- CDL Log Overview
- CDL FAQs
Using ClickHouse
- Using ClickHouse from Scratch
- ClickHouse Permission Management
  - ClickHouse User and Permission Management
  - Configuring the Password of the Default Account of a ClickHouse Cluster (MRS 3.1.2-LTS)
  - Configuring the Passwords of Default Users for a ClickHouse Cluster (MRS 3.3.0-LTS or later)
  - Clearing the Passwords of the Default and ClickHouse Users
  - Interconnecting ClickHouse With OpenLDAP for Authentication
- ClickHouse Multi-Tenancy
  - Overview
  - Enabling the CPU Priority Feature
  - Managing ClickHouse Tenants
  - Modifying the Memory Limit of ClickHouse on a ClickHouseServer Node
- ClickHouse Data Type
- ClickHouse Table Engine Overview
- Creating a ClickHouse Table
- Enabling the Read-Only Mode of the ClickHouse Table
- Collecting Dumping Logs of the ClickHouse System Tables
- Migrating ClickHouse Data
  - Using ClickHouse to Import and Export Data
  - Synchronizing Kafka Data to ClickHouse
  - Using the ClickHouse Data Migration Tool
  - Using the Migration Tool to Quickly Migrate ClickHouse Cluster Data
  - ClickHouse Batch Data Import
- Backing Up and Restoring ClickHouse Data Using a Data File
- Configuring Interconnection Between ClickHouse and HDFS
- Configuring Interconnection Between ClickHouse and Kafka
  - Interconnecting with Kafka Using a Username and Password
  - Interconnecting with Kafka Through Kerberos Authentication
  - Interconnecting with Kafka in Normal Mode
- Configuring Strong Data Consistency Between ClickHouse Replicas
- Configuring the Support for Transactions on ClickHouse
- Enabling the mysql_port Configuration for ClickHouse
- Pre-Caching ClickHouse Metadata to the Memory
- Configuring ClickHouse Cold and Hot Data Separation
- Using the ClickHouse Recycle Bin
- Using ClickHouseKeeper
  - Using ClickHouseKeeper
  - Using the ClickHouseKeeper Client
  - Switching to ClickHouseKeeper
- Monitoring of Slow ClickHouse Query Statements and Replication Table Data Synchronization
  - Slow Query Statement Monitoring
  - Replication Table Data Synchronization Monitoring
- Common ClickHouse SQL Syntax
  - CREATE DATABASE: Creating a Database
  - CREATE TABLE: Creating a Table
  - INSERT INTO: Inserting Data into a Table
  - DELETE: Lightweight Deleting Table Data
  - SELECT: Querying Table Data
  - ALTER TABLE: Modifying a Table Structure
  - ALTER TABLE: Modifying Table Data
  - DESC: Querying a Table Structure
  - DROP: Deleting a Table
  - SHOW: Displaying Information About Databases and Tables
  - UPSERT: Writing Data
- ClickHouse Log Overview
- ClickHouse Performance Tuning
  - Solution to the "Too many parts" Error in Data Tables
  - Accelerating Merge Operations
  - Accelerating TTL Operations
- ClickHouse FAQ
  - How Do I Do If the Disk Status Displayed in the System.disks Table Is fault or abnormal?
  - How Do I Migrate Data from Hive/HDFS to ClickHouse?
  - An Error Is Reported in Logs When the Auxiliary ZooKeeper or Replica Data Is Used to Synchronize Table Data
  - How Do I Grant the Select Permission at the Database Level to ClickHouse Users?
  - What Should I Do If the Abnormal ClickHouse Instance Cannot Be Restored After the Full Disk Space Error Is Rectified?
  - How Do I Quickly Restore ClickHouse When Concurrent Requests Are Stacked for a Long Time?
Using DBService
- Configuring SSL for the HA Module
- Restoring SSL for the HA Module
- Configuring the Timeout Interval of DBService Backup Tasks
- DBService Log Overview
Using Doris
- Installing a MySQL Client
- Using Doris from Scratch
- Permission Management
  - Doris Permissions Management
  - Column Permission Management
- Multi-Tenancy
  - Overview
  - Managing Doris Tenants
  - Multi-Tenancy Alarms
- Accessing the Doris Native Web Page
- Introduction to the Doris Data Model
- Doris Cold and Hot Data Separation
  - Introduction
  - Configuring Cold and Hot Data Separation
- Data Operations
  - Data Import
  - Exporting Data
    - Exporting data from HDFS to OBS
    - Exporting the Query Result Set
- Common SQL Syntax of Doris
  - Creating a database
  - Creating a Table
  - Used for inserting data
  - Modify the table structure.
  - Deleting tables
- Backing Up and Restoring Doris Data
  - Backing Up Doris Data
  - Restoring Doris Data
- Hive Data Source Analysis
  - Multi-Catalog
  - Hive as the Data Source
- Hudi Data Analysis
- Creating a Doris UDF
- JDBC Catalog
- Doris Slow Query Detection
- Ecosystem Expansion
  - Spark Doris Connector
  - Flink Doris Connector
- Table of Audit Logs
- Configuring Doris Materialized Views
- Automatic Doris Data Balancing
- Using the Impala-to-Doris Conversion Tool to Import Data
- Doris Performance Tuning
  - Improving the Query Performance of Doris Wide Tables with Aggregation Keys
  - Doris Supports Table-Level Compaction Tuning
- Doris FAQs
  - What Should I Do If "Failed to find enough host with storage medium and tag" Occasionally Occurs During Table Creation Due to the Configuration of the SSD and HDD Data Directories?
  - What Should I Do If a Query Is Performed on the BE Node Where Some Copies Are Lost or Damaged and an Error Is Reported?
  - What Should I Do If RPC Timeout Error Is Reported When Stream Load Is Used?
  - How Do I Restore the FE Service from a Fault?
  - What Do I Do If the Error Message "plugin not enabled" Is Displayed When the MySQL Client Is Used to Connect to the Doris Database?
  - How Do I Handle the FE Startup Failure?
  - How Do I Handle the Startup Failure Due to Incorrect IP Address Matching for the BE Instance?
  - What Should I Do If Error Message "Read timed out" Is Displayed When the MySQL Client Connects to the Doris?
  - What Should I Do If an Error Is Reported When the BE Runs a Data Import or Query Task?
  - What Should I Do If a Timeout Error Is Reported When Broker Load Imports Data?
  - What Should I Do If the Data Volume of a Broker Load Import Task Exceeds the Threshold?
  - What Should I Do If an Error Message Is Displayed When Broker Load Is Used to Import Data?
- Introduction to Doris Logs
- Viewing and Modifying Doris Variables
Using Flink
- Using Flink from Scratch
- Viewing Flink Job Information
- Configuring Flink Service Parameters
- Configuring Flink Security Features
- Configuring and Developing a Flink Visualization Job
- Configuring Interconnection Between FlinkServer and Other Components
- Configuring the Function of Deleting Residual Task Running Information
- Flink Log Overview
- Flink Performance Tuning
- Common Flink Shell Commands
- Flink Restart Policy
- Open-Source Flink Features
- Enhancements to Flink SQL
- Enhanced Flink Monitoring and O&M
Using Flume
- Using Flume from Scratch
- Overview
- Installing the Flume Client
  - Installing the Flume Client
- Viewing Flume Client Logs
- Stopping or Uninstalling the Flume Client
- Using the Encryption Tool of the Flume Client
- Flume Service Configuration Guide
- Flume Configuration Parameter Description
- Using Environment Variables in the properties.properties File
- Non-Encrypted Transmission
- Encrypted Transmission
  - Configuring the Encrypted Transmission
  - Typical Scenario: Collecting Local Static Logs and Uploading Them to HDFS
- Viewing Flume Client Monitoring Information
- Connecting Flume to Kafka in Security Mode
- Connecting Flume with Hive in Security Mode
- Configuring the Flume Service Model
  - Overview
  - Service Model Configuration Guide
- Introduction to Flume Logs
- Flume Client Cgroup Usage Guide
- Secondary Development Guide for Flume Third-Party Plug-ins
- Common Issues About Flume
Using Guardian
- Setting Common Guardian Parameters
- Guardian Log Overview
Using HBase
- Using HBase from Scratch
- Using the HBase and Phoenix Clients
  - Using an HBase Client
  - Connecting to PhoenixQueryServer Using Lightweight Phoenix Client
- Creating HBase Roles
- Configuring HBase Replication
- Enabling Cross-Cluster Copy
- Using the ReplicationSyncUp Tool
- In-House Enhanced Phoenix
  - CsvBulkloadTool Supports Parsing User-Defined Delimiters in Data Files
- Using HIndex
  - Introduction to HIndex
  - Loading Index Data in Batches
  - Using an Index Generation Tool
- Using a Global Secondary Indexes
  - Introduction to Global Secondary Indexes
  - Restrictions on Global Secondary Indexes
  - Using the Global Secondary Index Tool
  - Introduction to Global Secondary Index APIs
  - Querying Data Based on Indexes
- Configuring an RSGroup
- Configuring HBase DR
- Configuring HBase Data Compression and Encoding
- Performing an HBase DR Service Switchover
- Performing an HBase DR Active/Standby Cluster Switchover
- Community BulkLoad Tool
- Using the Spark BulkLoad Tool to Synchronize Data to HBase Tables
- Configuring Secure HBase Replication
- Configuring Region In Transition Recovery Chore Service
- Enabling the HBase Compaction
- Using a Secondary Index
- Viewing Slow and Oversized HBase Requests
- Hot-Cold Data Separation
  - Overview
  - Enabling the Hot-Cold Data Separation
  - Cold-Hot Separation Commands
- Configuring HBase Table-Level Overload Control
- Enabling the HBase Multicast Function
- Configuring Automatic Termination of HBase Slow Queries
- HBase Log Overview
- HBase Performance Tuning
  - Improving the BulkLoad Efficiency
  - Improving Put Performance
  - Optimizing Put and Scan Performance
  - Improving Real-time Data Write Performance
  - Improving Real-time Data Read Performance
  - Optimizing JVM Parameters
  - Optimization for HBase Overload
  - Enabling CCSMap Functions
  - Enabling Succinct Trie
- Common Issues About HBase
  - Why Does a Client Keep Failing to Connect to a Server for a Long Time?
  - Operation Failures Occur in Stopping BulkLoad On the Client
  - Why May a Table Creation Exception Occur When HBase Deletes or Creates the Same Table Consecutively?
  - Why Other Services Become Unstable If HBase Sets up A Large Number of Connections over the Network Port?
  - Why Does the HBase BulkLoad Task (One Table Has 26 TB Data) Consisting of 210,000 Map Tasks and 10,000 Reduce Tasks Fail?
  - How Do I Restore a Region in the RIT State for a Long Time?
  - Why Does HMaster Exits Due to Timeout When Waiting for the Namespace Table to Go Online?
  - Why Does SocketTimeoutException Occur When a Client Queries HBase?
  - Why Modified and Deleted Data Can Still Be Queried by Using the Scan Command?
  - Why "java.lang.UnsatisfiedLinkError: Permission denied" exception thrown while starting HBase shell?
  - When does the RegionServers listed under "Dead Region Servers" on HMaster WebUI gets cleared?
  - Why Are Different Query Results Returned After I Use Same Query Criteria to Query Data Successfully Imported by HBase bulkload?
  - What Should I Do If I Fail to Create Tables Due to the FAILED_OPEN State of Regions?
  - How Do I Delete Residual Table Names in the /hbase/table-lock Directory of ZooKeeper?
  - Why Does HBase Become Faulty When I Set a Quota for the Directory Used by HBase in HDFS?
  - Why HMaster Times Out While Waiting for Namespace Table to be Assigned After Rebuilding Meta Using OfflineMetaRepair Tool and Startups Failed
  - Why Messages Containing FileNotFoundException and no lease Are Frequently Displayed in the HMaster Logs During the WAL Splitting Process?
  - Insufficient Rights When a Tenant Accesses Phoenix
  - What Can I Do When HBase Fails to Recover a Task and a Message Is Displayed Stating "Rollback recovery failed"?
  - How Do I Fix Region Overlapping?
  - Why Does RegionServer Fail to Be Started When GC Parameters Xms and Xmx of HBase RegionServer Are Set to 31 GB?
  - Why Does the LoadIncrementalHFiles Tool Fail to Be Executed and "Permission denied" Is Displayed When Nodes in a Cluster Are Used to Import Data in Batches?
  - Why Is the Error Message "import argparse" Displayed When the Phoenix sqlline Script Is Used?
  - How Do I Deal with the Restrictions of the Phoenix BulkLoad Tool?
  - Why a Message Is Displayed Indicating that the Permission is Insufficient When CTBase Connects to the Ranger Plug-ins?
  - How Do I View Regions in the CLOSED State in an ENABLED Table?
  - How Can I Quickly Recover the Service When HBase Files Are Damaged Due to a Cluster Power-Off?
  - How Do I Disable HDFS Hedged Read on HBase?
  - How Do I Quickly Restore HBase After HDFS Enters the Safe Mode and the HBase Service Is Abnormal?
Using HDFS
- Using Hadoop from Scratch
- Configuring Memory Management
- Creating an HDFS Role
- Using the HDFS Client
- Running the DistCp Command
- Overview of HDFS File System Directories
- Changing the DataNode Storage Directory
- Configuring HDFS Directory Permission
- Configuring NFS
- Planning HDFS Capacity
- Configuring ulimit for HBase and HDFS
- Configuring HDFS DataNode Data Balancing
- Configuring Replica Replacement Policy for Heterogeneous Capacity Among DataNodes
- Configuring the Number of Files in a Single HDFS Directory
- Configuring the Recycle Bin Mechanism
- Setting Permissions on Files and Directories
- Setting the Maximum Lifetime and Renewal Interval of a Token
- Configuring the Damaged Disk Volume
- Configuring Encrypted Channels
- Reducing the Probability of Abnormal Client Application Operation When the Network Is Not Stable
- Configuring the NameNode Blacklist
- Optimizing HDFS NameNode RPC QoS
- Optimizing HDFS DataNode RPC QoS
- Configuring Reserved Percentage of Disk Usage on DataNodes
- Configuring HDFS NodeLabel
- Configuring HDFS Mover
- Using HDFS AZ Mover
- Configuring HDFS DiskBalancer
- Configuring the Observer NameNode to Process Read Requests
- Performing Concurrent Operations on HDFS Files
- Configuring Fine-Grained Locks of HDFS
- Closing HDFS Files
- Configuring HDFS Hedged Read
- HDFS Auto Recovery from Cluster Power-off
- Using the HDFS Tool to Check for Disk Faults
- Configuring the HDFS Read-Only Mode
- Configuring the O&M Mode of the HDFS Node
- Interconnecting HDFS of Mutually Trusted Clusters
- Collecting Statistics on HDFS File Changes Using the FsImage File
- Introduction to HDFS Logs
- HDFS Performance Tuning
  - Improving Write Performance
  - Improving Read Performance Using Client Metadata Cache
  - Improving the Connection Between the Client and NameNode Using Current Active Cache
  - Asynchronously Deleting HDFS Data
- FAQ
  - NameNode Startup Is Slow
  - DataNode Is Normal but Cannot Report Data Blocks
  - HDFS WebUI Cannot Properly Update Information About Damaged Data
  - Why Does the Distcp Command Fail in the Secure Cluster, Causing an Exception?
  - Why Does DataNode Fail to Start When the Number of Disks Specified by dfs.datanode.data.dir Equals dfs.datanode.failed.volumes.tolerated?
  - Failed to Calculate the Capacity of a DataNode when Multiple data.dir Directories Are Configured in a Disk Partition
  - Standby NameNode Fails to Be Restarted When the System Is Powered off During Metadata (Namespace) Storage
  - Why Data in the Buffer Is Lost If a Power Outage Occurs During Storage of Small Files
  - Why Does Array Border-crossing Occur During FileInputFormat Split?
  - Why Is the Storage Type of File Copies DISK When the Tiered Storage Policy Is LAZY_PERSIST?
  - The HDFS Client Is Unresponsive When the NameNode Is Overloaded for a Long Time
  - Can I Delete or Modify the Data Storage Directory in DataNode?
  - Blocks Miss on the NameNode UI After the Successful Rollback
  - Why Is "java.net.SocketException: No buffer space available" Reported When Data Is Written to HDFS
  - Why are There Two Standby NameNodes After the active NameNode Is Restarted?
  - When Does a Balance Process in HDFS, Shut Down and Fail to be Executed Again?
  - "This page can't be displayed" Is Displayed When Internet Explorer Fails to Access the Native HDFS UI
  - NameNode Fails to Be Restarted Due to EditLog Discontinuity
  - The Standby NameNode Fails to Be Started Because It Is Not Started for a Long Time
Using HetuEngine
- Using HetuEngine from Scratch
- HetuEngine Permission Management
- Creating a HetuEngine User
- Creating a HetuEngine Compute Instance
- Managing HetuEngine Compute Instances
- Using the HetuEngine Client
- Using the HetuEngine Cross-Source Function
- Using the HetuEngine Cross-Domain Function
- Configuring Data Sources
- Using HetuEngine Materialized Views
- Using HetuEngine SQL Diagnosis
- Developing and Applying Functions and UDFs
- HetuEngine Logs
- HetuEngine Performance Tuning
- HetuEngine FAQ
Using Hive
- Using Hive from Scratch
- Configuring Hive Parameters
- Hive SQL
- Permission Management
  - Hive Permission
  - Creating a Hive Role
  - Configuring Permissions for Hive Tables, Columns, or Databases
  - Configuring Permissions to Use Other Components for Hive
- Using a Hive Client
- Using HDFS Colocation to Store Hive Tables
- Using the Hive Column Encryption Function
- Customizing Row Separators
- Configuring Hive on HBase in Across Clusters with Mutual Trust Enabled
- Deleting Single-Row Records from Hive on HBase
- Configuring HTTPS/HTTP-based REST APIs
- Enabling or Disabling the Transform Function
- Access Control of a Dynamic Table View on Hive
- Specifying Whether the ADMIN Permissions Is Required for Creating Temporary Functions
- Using Hive to Read Data in a Relational Database
- Supporting Traditional Relational Database Syntax in Hive
- Creating User-Defined Hive Functions
- Enhancing beeline Reliability
- Viewing Table Structures Using the show create Statement as Users with the select Permission
- Writing a Directory into Hive with the Old Data Removed to the Recycle Bin
- Inserting Data to a Directory That Does Not Exist
- Creating Databases and Creating Tables in the Default Database Only as the Hive Administrator
- Disabling of Specifying the location Keyword When Creating an Internal Hive Table
- Enabling the Function of Creating a Foreign Table in a Directory That Can Only Be Read
- Authorizing Over 32 Roles in Hive
- Restricting the Maximum Number of Maps for Hive Tasks
- HiveServer Lease Isolation
- Hive Supports Isolation of Metastore instances Based on Components
- Switching the Hive Execution Engine to Tez
- Hive Supporting Reading Hudi Tables
- Hive Supporting Cold and Hot Storage of Partitioned Metadata
- Hive Supporting ZSTD Compression Formats
- Hive Partitioned Tables Support OBS and HDFS Storage Sources
- Configuring MetaStore Encryption for Sensitive Table Attributes
- Locating Abnormal Hive Files
- Using the ZSTD_JNI Compression Algorithm to Compress Hive ORC Tables
- Load Balancing for Hive MetaStore Client Connection
- Data Import and Export in Hive
  - Importing and Exporting Table/Partition Data in Hive
  - Importing and Exporting Hive Databases
- Enabling Hive Interception of Concurrent Overwrite
- Interconnecting Hive with External LDAP
- Detecting Statements That Overwrite a Table with Its Own Data
- Configuring Hive Dynamic Data Masking
- Storing SQL Execution Metrics in Hive Tables
- Configuring Hive to Display Only Databases and Tables that the Current User Has Permission to Access
- Configuring the JDK Version Used During Hive Job Running
- Configuring Username-Password Authentication on the Hive Client to Connect to HiveServer
- Blocking Requests from Older MetaStore Clients
- Configuring Database and Table Visibility When Hive Is Connected to LakeFormation
- Hive Log Overview
- Hive Performance Tuning
  - Creating Table Partitions
  - Optimizing Join
  - Optimizing Group By
  - Optimizing Data Storage
  - Optimizing SQL Statements
  - Optimizing the Query Function Using Hive CBO
- Common Issues About Hive
  - How Do I Delete UDFs on Multiple HiveServers at the Same Time?
  - Why Cannot the DROP operation Be Performed on a Backed-up Hive Table?
  - How to Perform Operations on Local Files with Hive User-Defined Functions
  - How Do I Forcibly Stop MapReduce Jobs Executed by Hive?
  - Table Creation Fails Because Hive Complex Fields' Names Contain Special Characters
  - How Do I Monitor the Hive Table Size?
  - How Do I Prevent Key Directories from Data Loss Caused by Misoperations of the insert overwrite Statement?
  - Why Is Hive on Spark Task Freezing When HBase Is Not Installed?
  - Error Reported When the WHERE Condition Is Used to Query Tables with Excessive Partitions in FusionInsight Hive
  - Why Cannot I Connect to HiveServer When I Use IBM JDK to Access the Beeline Client?
  - Description of Hive Table Location (Either Be an OBS or HDFS Path)
  - Why Cannot Data Be Queried After the MapReduce Engine Is Switched After the Tez Engine Is Used to Execute Union-related Statements?
  - Why Does Hive Not Support Concurrent Data Writing to the Same Table or Partition?
  - Why Does Hive Not Support Vectorized Query?
  - Why Does Metadata Still Exist When the HDFS Data Directory of the Hive Table Is Deleted by Mistake?
  - How Do I Disable the Logging Function of Hive?
  - Why Hive Tables in the OBS Directory Fail to Be Deleted?
  - Hive Configuration Problems
Using Hudi
- Getting Started
- Common Hudi Parameters
- Basic Operations
- Hudi SQL Syntax Reference
- Hudi Schema Evolution
- Setting Default Values for Hudi Columns
- Partial Update
- Aggregate Functions in Hudi
- Hudi Performance Tuning
- Common Issues About Hudi
Using Hue
- Using Hue from Scratch
- Accessing the Hue Web UI
- Hue Common Parameters
- Using HiveQL Editor on the Hue Web UI
- Using the SparkSql Editor on the Hue Web UI
- Using the Metadata Browser on the Hue Web UI
- Using File Browser on the Hue Web UI
- Using Job Browser on the Hue Web UI
- Using HBase on the Hue Web UI
- Using the HetuEngine SQL Editor on the Hue web UI
- Typical Scenarios
- Hue Log Overview
- Common Issues About Hue
Using Iceberg
- Using Iceberg from Scratch
- Functions and Table Configurations Supported by Iceberg
- Using Iceberg Based on Spark
Using Impala
- Using the Impala Client
- Accessing the Impala Web UI
- Using Impala to Operate Kudu Tables
- Interconnecting Impala with External LDAP
- Enabling and Configuring a Dynamic Resource Pool for Impala
- Using the Impala Query Management Page
- Typical Impala Configurations
- Impala FAQ
Using IoTDB
- Using IoTDB from Scratch
- Using the IoTDB Client
- Configuring IoTDB Parameters
- Data Types and Encodings Supported by IoTDB
- IoTDB Permission Management
  - IoTDB Permissions
  - Creating an IoTDB Role
- IoTDB Log Overview
- UDFs
  - UDF Overview
- IoTDB Data Import and Export
  - Importing IoTDB Data
  - Exporting IoTDB Data
- Planning IoTDB Capacity
- IoTDB Performance Tuning
Using JobGateway
- Using JobGateway from Scratch
- Configuring JobGateway Parameters
- Manually Updating the Service Client of JobGateway
- JobGateway Logs
- FAQs
  - What Should I Do If Jobs Fail to Be Submitted to YARN After JobGateway Is Started for the First Time
Using Kafka
- Using Kafka from Scratch
- Managing Kafka Topics
- Querying Kafka Topics
- Managing Kafka User Permissions
- Managing Messages in Kafka Topics
- Synchronizing Binlog-based MySQL Data to the MRS Cluster
- Creating a Kafka Role
- Kafka Common Parameters
- Safety Instructions on Using Kafka
- Kafka Specifications
- Using the Kafka Client
- Configuring Kafka HA and High Reliability Parameters
- Changing the Broker Storage Directory
- Checking the Consumption Status of Consumer Group
- Kafka Balancing Tool Instructions
- Kafka Token Authentication Mechanism Tool Usage
- Kafka Balancing Tool Instructions
- Configuring Alarms for Abnormal Kafka Production Traffic
- Deleting Data from Kafka Disk Partitions
- Using Kafka UI
  - Accessing Kafka UI
  - Kafka UI Overview
  - Creating a Topic on Kafka UI
  - Migrating a Partition on Kafka UI
  - Managing Topics on Kafka UI
  - Viewing Brokers on Kafka UI
  - Viewing a Consumer Group on Kafka UI
  - Using Kafka UI to View and Configure Lag Alarm Rules
- Introduction to Kafka Logs
- Performance Tuning
  - Kafka Performance Tuning
- Kafka Feature Description
- Migrating Data Between Kafka Nodes
- Configuring Intranet and Extranet Access for Kafka
- Common Issues About Kafka
  - How Do I Solve the Problem that Kafka Topics Cannot Be Deleted?
Using Kudu
- Using Kudu from Scratch
- Accessing the Kudu Web UI
Using Loader
- Common Loader Parameters
- Creating a Loader Role
- Managing Loader Links
- Preparing a Driver for MySQL Database Link
- Importing Data
- Exporting Data
- Managing Jobs
- Operator Help
- Client Tools
- Loader Log Overview
- Common Issues About Loader
Using MapReduce
- Configuring the Log Archiving and Clearing Mechanism
- Reducing Client Application Failure Rate
- Transmitting MapReduce Tasks from Windows to Linux
- Configuring the Distributed Cache
- Configuring the MapReduce Shuffle Address
- Configuring the Cluster Administrator List
- Introduction to MapReduce Logs
- MapReduce Performance Tuning
- Common Issues About MapReduce
Using MemArtsCC
- Setting Typical MemArtsCC Parameters
- Configuring the Connection Between HetuEngine and MemArtsCC
- Configuring the Connection Between Hive and MemArtsCC
- Configuring the Connection Between Spark and MemArtsCC
- MemArtsCC Logs
Using MemArtsStore
- Interconnecting Spark with MemArtsStore
- MemArtsStore logs
Using Oozie
- Using Oozie from Scratch
- Using the Oozie Client
- Enabling Oozie High Availability (HA)
- Checking ShareLib
- Using Oozie Client to Submit an Oozie Job
- Using Hue to Submit an Oozie Job
- Oozie Log Overview
- Common Issues About Oozie
Using Paimon
- Configuring Component Interconnection with Paimon
- Creating a Paimon Table
  - Creating a Paimon Primary Key Table
  - Creating a Paimon Append-Only Table
- Clearing Outdated Paimon Data
- Querying Data Based on Paimon System Tables
Using Ranger
- Logging In to the Ranger Web UI
- Enabling Ranger Authentication
- Configuring Component Permission Policies
- Viewing Ranger Audit Information
- Configuring a Security Zone
- Viewing Ranger Permission Information
- Adding a Ranger Access Permission Policy for CDL
- Adding a Ranger Access Permission Policy for HDFS
- Adding a Ranger Access Permission Policy for HBase
- Adding a Ranger Access Permission Policy for Hive
- Adding a Ranger Access Permission Policy for Yarn
- Adding a Ranger Access Permission Policy for Spark2x
- Adding a Ranger Access Permission Policy for Kafka
- Adding a Ranger Access Permission Policy for MirrorMaker
- Adding a Ranger Access Permission Policy for HetuEngine
- Adding a Ranger Access Permission Policy for OBS
- Hive Tables Supporting Cascading Authorization
- Configuring Ranger Specifications
- Configuring Multi-Instance for RangerKMS
- Using the RangerKMS Native UI to Manage Permissions and Keys
- Ranger Log Overview
- Common Issues About Ranger
  - Why Ranger Startup Fails During the Cluster Installation?
  - How Do I Determine Whether the Ranger Authentication Is Used for a Service?
  - Why Cannot a New User Log In to Ranger After Changing the Password?
  - When an HBase Policy Is Added or Modified on Ranger, Wildcard Characters Cannot Be Used to Search for Existing HBase Tables
  - How Do I Rectify the Problem that RangerKMS Authentication Fails and the KMS Tab Is Not Displayed on the Ranger Management Page?
  - What Should I Do If I Cannot View the Created MRS User on the Ranger Management Page?
  - What Should I Do If MRS Users Failed to Be Synchronized to the Ranger Web UI
Using Saprk/Spark2x
- Name Change Description
- Basic Operation
- Spark2x Logs
- Obtaining Container Logs of a Running Spark Application
- Small File Combination Tools
- Using CarbonData for First Query
- Configuring Spark Security Auditing
- Configuring the JDK Version Used During Spark Job Running
- Spark2x Performance Tuning
- Common Issues About Spark2x
Using Tez
- Common Tez Parameters
- Accessing TezUI
- Log Overview
- Common Issues
Using YARN
- Common YARN Parameters
- Creating Yarn Roles
- Using the YARN Client
- Configuring Resources for a NodeManager Role Instance
- Changing NodeManager Storage Directories
- Configuring Strict Permission Control for Yarn
- Configuring Container Log Aggregation
- Using CGroups with YARN
- Configuring the Number of ApplicationMaster Retries
- Configure the ApplicationMaster to Automatically Adjust the Allocated Memory
- Configuring the Access Channel Protocol
- Configuring Memory Usage Detection
- Configuring the Additional Scheduler WebUI
- Configuring Yarn Restart
- Configuring ApplicationMaster Work Preserving
- Configuring the Localized Log Levels
- Configuring Users That Run Tasks
- Configuring HA for TimelineServer
- Configuring YARN Big Job Scanning
- Yarn Log Overview
- Yarn Performance Tuning
  - Preempting a Task
  - Setting the Task Priority
  - Optimizing Node Configuration
- Common Issues About Yarn
  - Why Mounted Directory for Container is Not Cleared After the Completion of the Job While Using CGroups?
  - Why the Job Fails with HDFS_DELEGATION_TOKEN Expired Exception?
  - Why Are Local Logs Not Deleted After YARN Is Restarted?
  - Why the Task Does Not Fail Even Though AppAttempts Restarts for More Than Two Times?
  - Why Is an Application Moved Back to the Original Queue After ResourceManager Restarts?
  - Why Does Yarn Not Release the Blacklist Even All Nodes Are Added to the Blacklist?
  - Why Does the Switchover of ResourceManager Occur Continuously?
  - Why Does a New Application Fail If a NodeManager Has Been in Unhealthy Status for 10 Minutes?
  - Why Does an Error Occur When I Query the ApplicationID of a Completed or Non-existing Application Using the RESTful APIs?
  - Why May A Single NodeManager Fault Cause MapReduce Task Failures in the Superior Scheduling Mode?
  - Why Are Applications Suspended After They Are Moved From Lost_and_Found Queue to Another Queue?
  - How Do I Limit the Size of Application Diagnostic Messages Stored in the ZKstore?
  - Why Does a MapReduce Job Fail to Run When a Non-ViewFS File System Is Configured as ViewFS?
  - Why Do Reduce Tasks Fail to Run in Some OSs After the Native Task Feature is Enabled?
Using ZooKeeper
- Using ZooKeeper from Scratch
- Common ZooKeeper Parameters
- Using a ZooKeeper Client
- Configuring the ZooKeeper Permissions
- ZooKeeper Log Overview
- Common Issues About ZooKeeper
Appendix
- Modifying Cluster Service Configuration Parameters
- Accessing Manager
  - Accessing FusionInsight Manager
- Using an MRS Client
  - Installing a Client
  - Updating a Client
Change History

Overview