CSS Logstash is a data ingestion service that ingests data from designated data sources on the public network and writes it to designated storage systems. The data is subsequently used for purposes such as big data analytics and log management. An NAT gateway and return routes need to be configured to ensure proper data ingestion, storage, and processing across networks.
Table 1 describes the key parameters. Set other parameters based on service requirements.
Parameter | Description |
|---|---|
Region | Use the region of the Logstash cluster. |
Specifications | Select a value based on the needed bandwidth. The maximum number of connections supported by SNAT varies depending on the specifications you choose. |
VPC | Select the VPC recorded in 1. |
Subnet | Select the subnet recorded in 1. |
Table 2 describes the key parameters. Set other parameters based on service requirements.
Parameter | Description |
|---|---|
Scenario | Select VPC. |
CIDR Block | Select Existing, and then select the VPC recorded in 1. |
Public IP Address Type | Select EIP, and then select an IP address that meets your requirements. If no EIP is available, click View EIP to go to the EIP console and . You are advised to configure the EIP as follows:
|
Configure a return route for the Logstash cluster to make sure the Logstash nodes can connect to the IP addresses of data sources on the public network. The return route must cover all these IP addresses.
Parameter | Description |
|---|---|
IP Address | Enter the IP address (or a CIDR block) of a data source, for example, 10.10.1.0. If the IP addresses of data sources are scattered, configure multiple routes for them. |
Subnet Mask | Enter the subnet mask used with the IP address. The subnet mask must align with the network part of the IP address. That is: The subnet mask should not cover too wide a range, avoiding unnecessary IP address exposure or waste of the address space. 255.255.255.0 (that is, /24) is recommended, which applies to most internal networking scenarios. |
After the route is added, click View Route to check the route information. You can click Add Route to add another route; or click Delete Route to delete one—In the Delete Route dialog box, select a route, enter DELETE manually, and then click OK.
Test the connectivity between the Logstash cluster and the data sources.
If Available is displayed, the network between the Logstash cluster and the data source is connected.
You can test a maximum of 10 IP addresses at a time. Click Add to add multiple IP addresses and click Test at the bottom to test connectivity to all these IP addresses at the same time.