Uneven Data Distribution Due to Non-HDFS Data Residuals
Symptom
Data distribution is uneven. A disk is full while other disks have sufficient space.
The data storage directory of HDFS DataNode is set to /export/data1/dfs--/export/data12/dfs. A large volume of data is stored to /export/data1/dfs but data is evenly distributed to other disks.
Cause Analysis
The customer's disk is reinstalled. However, a directory is not thoroughly deleted during disk uninstallation, that is, the added disk is unformatted and historical junk data remains.
Solution
Manually delete data residuals.
Parent topic: Using HDFS
- Symptom
- Cause Analysis
- Solution