Skip to main content

Create a Kafka cluster

  1. In the Dashboard, on the top menu click Products and select Managed Databases.

  2. Click Create cluster.

  3. Enter the cluster name.

  4. Select a location. You cannot change the location after creation.

  5. Select the DBMS — Kafka.

  6. Select a Kafka version. You cannot change the version after creation.

  7. Fill in the blocks:

  8. Check the cluster price.

  9. Click Create cluster.

Node configuration

  1. Select a configuration line.

  2. If you selected a line with custom configurations, select the disk type, specify the number of vCPUs, RAM size, and disk size.

  3. If you selected a line with fixed configurations, select a configuration.

After creating the cluster, you can change the node configuration — scale the cluster.

Optional: Logging

To have access to cluster logs, enable logging. Logging consumes some of the cluster's computing resources.

  1. Select the Collect technical cluster logs into the log service checkbox.

  2. Select a log group or create a new one.

  3. If you selected a new group, enter its name.

Network

A Kafka cluster can be connected:

  • to a private subnet — with no internet access. A public IP address cannot be used;

  • or a public subnet — where all addresses are accessible from the internet.

You can create a new subnet or add the cluster to an existing one.

  1. To add the cluster to an existing private subnet, in the Subnet field, select an existing subnet. At least one address must be available in the subnet. Once the cluster is created, the subnet cannot be changed.

  2. To create a new private subnet:

    2.1. In the Subnet field, select New private subnet. Once the cluster is created, the subnet cannot be changed.

    2.2. Optional: change the subnet CIDR.

    2.3. Optional: change the network where the subnet will be created — you can select an existing network or create a new one. Once the cluster is created, the network cannot be changed.

Optional: Security

Select security groups to filter inbound and outbound cluster traffic.

If the Security block is missing, traffic filtering (port security) is disabled in the cluster network. If traffic filtering is disabled, all traffic will be allowed.

Optional: DBMS settings

To view default values of the DBMS settings or change them, click Edit. We recommend changing setting values only if necessary — incorrectly configured values may cause cluster failure or decrease its performance.