Kafka 快速入门

官网quickstart (opens new window)

1. 获取kafka

kafka官网地址

http://kafka.apache.org/ (opens new window)

kafka下载地址

https://www.apache.org/dyn/closer.cgi?path=/kafka/2.6.0/kafka_2.13-2.6.0.tgz (opens new window)

镜像下载地址

https://mirrors.tuna.tsinghua.edu.cn/apache/kafka/2.6.0/kafka_2.13-2.6.0.tgz (opens new window)

解压

$ tar -xzf kafka_2.13-2.6.0.tgz
$ cd kafka_2.13-2.6.0

2. 启动服务

# Start the ZooKeeper service
# Note: Soon, ZooKeeper will no longer be required by Apache Kafka.
$ bin/zookeeper-server-start.sh config/zookeeper.properties

# Start the Kafka broker service
$ bin/kafka-server-start.sh config/server.properties

3. 创建topic

可以把topic理解为一个文件夹,事件(可以理解为记录或者消息)存放在文件夹(topic)中

$ bin/kafka-topics.sh --create --topic quickstart-events --bootstrap-server localhost:9092

kafka-topics.sh不带任何参数可以打印出该命令的用法

$ bin/kafka-topics.sh --describe --topic quickstart-events --bootstrap-server localhost:9092

4. 发送事件到topic中

$ bin/kafka-console-producer.sh --topic quickstart-events --bootstrap-server localhost:9092
This is my first event
This is my second event

5. 消费消息

$ bin/kafka-console-consumer.sh --topic quickstart-events --from-beginning --bootstrap-server localhost:9092
This is my first event
This is my second event

6. 使用 Kafka Connect 导入/导出数据

参见 Kafka Connect (opens new window)

7. 使用 kafka stream 处理事件

参见 Kafka Streams demo (opens new window)

8. 停止服务

1. Ctrl-C停止生产者和消费者.
2. Ctrl-C停止Kafka服务器
3. Ctrl-C停止zookeeper.

删除kafka运行产生的文件

$ rm -rf /tmp/kafka-logs /tmp/zookeeper