Kafka 安装

Docker Compose 安装 Kafka 3.4.0

本文将会介绍一下，基于 Docker Compose 安装单机的 Kafka

yaml 配置文件

# docker compose 部署 kafka
# 本示例中宿主机IP: 8.142.110.11
version: "3.9"

services:
  zookeeper:
    image: 'bitnami/zookeeper:3.8'
    container_name: zookeeper
    ports:
      - '2181:2181'
    environment:
      - ALLOW_ANONYMOUS_LOGIN=yes # 匿名登录
    volumes:
      - "$PWD/data/kafka/zk-data:/bitnami"
    networks:
      kafka:
        aliases:
          - zookeeper
  # kafka
  kafka:
    image: 'bitnami/kafka:3.4.0'
    container_name: kafka
    ports:
      - '9092:9092'
      - '9093:9093'
    environment:
      - KAFKA_ENABLE_KRAFT=yes
      - KAFKA_CFG_PROCESS_ROLES=broker,controller
      - KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
      - KAFKA_CFG_LISTENERS=PLAINTEXT://:9092,CONTROLLER://:9093 # 定义 Kafka Broker 的 Listener 的配置项，配置外部访问和内部访问
      - KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
      - KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://8.142.110.11:9092  # 传递回客户端的元数据，填写宿主机IP地址
      - KAFKA_BROKER_ID=1 # 配置 broker id
      - KAFKA_HEAP_OPTS=-Xmx512m -Xms256m
      - KAFKA_CFG_CONTROLLER_QUORUM_VOTERS=1@127.0.0.1:9093
      - ALLOW_PLAINTEXT_LISTENER=yes
      - TZ=Asia/Shanghai # 时区
    depends_on:
      - zookeeper
    # 挂在到 当前路径下的 data/kafka/kafka-data 中
    volumes:
      - "$PWD/data/kafka/kafka-data:/bitnami"
    networks:
      kafka:
        aliases:
          - kafka
  # ui 管理界面
  kafka-ui:
    image: provectuslabs/kafka-ui
    container_name: kafka-ui
    ports:
      - "9999:8080"
    restart: always
    # 更多环境配置参考 https://github.com/provectus/kafka-ui#-environment-variables
    environment:
      - KAFKA_CLUSTERS_0_NAME=local
      - KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS=kafka:9092
      - KAFKA_CLUSTERS_0_ZOOKEEPER=zookeeper:2181
      - KAFKA_CLUSTERS_0_READONLY=false # 是否以只读模式运行，只读的话，就不能增删改 topic 等
    depends_on:
      - zookeeper
      - kafka
    networks:
      kafka:
        aliases:
          - kafka-ui


networks:
  kafka:
    driver: bridge

启动

执行执行指令如下！ 注意：在启动脚本同级下的 data 文件夹，一定要赋予读写权限，不然会启动失败

[root@bulk kafka]# ll
总用量 8
drwxrwxrwx 2 root root 4096 3月   9 10:41 data
-rw-r--r-- 1 root root 2035 3月   9 10:41 docker-compose-kafka-single.yml
# 注意 这里一定要 设置读写权限 ！！ 负责会启动失败 
[root@bulk kafka]# chmod -R 777 data/

[root@bulk kafka]# docker-compose -f docker-compose-kafka-single.yml up -d
Creating network "kafka_kafka" with driver "bridge"
Pulling zookeeper (bitnami/zookeeper:3.8)...
3.8: Pulling from bitnami/zookeeper
503dda889fb7: Pull complete
Digest: sha256:42ab7f4f441011df57b4cd86b9bb04be58ae79712e41d2ce99d5d7fd2da85b88
Status: Downloaded newer image for bitnami/zookeeper:3.8
Pulling kafka (bitnami/kafka:3.4.0)...
3.4.0: Pulling from bitnami/kafka
55154658374f: Pull complete
Digest: sha256:659549c08f8a1cfce344d31b608ec2d039a66a9b610423c4bc390c486a8cebbd
Status: Downloaded newer image for bitnami/kafka:3.4.0
Pulling kafka-ui (provectuslabs/kafka-ui:)...
latest: Pulling from provectuslabs/kafka-ui
59bf1c3509f3: Pull complete
f3449ca82c13: Pull complete
c631eae86696: Pull complete
Digest: sha256:69d612ddf1ce38e9c5f59c47a8430247aa40da1822c32c6857cad48570bad791
Status: Downloaded newer image for provectuslabs/kafka-ui:latest
Creating zookeeper ... done
Creating kafka     ... done
Creating kafka-ui  ... done

[root@bulk kafka]# docker ps
CONTAINER ID   IMAGE                                        COMMAND                  CREATED          STATUS          PORTS                                                                                                                                                 NAMES
125e53e46700   provectuslabs/kafka-ui                       "/bin/sh -c 'java $J…"   10 minutes ago   Up 10 minutes   0.0.0.0:9999->8080/tcp, :::9999->8080/tcp                                                                                                             kafka-ui
b64138b87c5e   bitnami/kafka:3.4.0                          "/opt/bitnami/script…"   10 minutes ago   Up 18 seconds   0.0.0.0:9092-9093->9092-9093/tcp, :::9092-9093->9092-9093/tcp                                                                                         kafka
17f6c56fbea2   bitnami/zookeeper:3.8                        "/opt/bitnami/script…"   10 minutes ago   Up 18 seconds   2888/tcp, 3888/tcp, 0.0.0.0:2181->2181/tcp, :::2181->2181/tcp, 8080/tcp                                                                               zookeeper

部署好了之后，访问你的宿主机ip:9999,就可以访问的到 Kafka UI 的界面了