benthos 通过rest api 配置 stream 说明
stream 模式，我们可以通过rest api 进行控制
使用方法
- 启动
benthos --streams- 进行流的配置（rest api）
curl http://localhost:4195/streams/foo -X POST --data-binary @- <<EOF
input:
type: http_server
buffer:
type: memory
pipeline:
threads: 4
processors:
- type: jmespath
jmespath:
query: "{id: user.id, content: body.content}"
output:
type: http_server
EOF- 查询配置
- 添加另外一个stream 配置
curl http://localhost:4195/streams/bar -X POST --data-binary @- <<EOF
input:
type: kafka
kafka:
addresses:
- localhost:9092
topic: my_topic
buffer:
type: none
pipeline:
threads: 1
processors:
- type: sample
sample:
retain: 10
output:
type: elasticsearch
elasticsearch:
urls:
- http://localhost:9200
EOF- 获取单个流配置信息(rest api)
curl http://localhost:4195/streams/foo | jq '.'- 更新配置(api)
以下移除 memery buffer
curl http://localhost:4195/streams/foo -X PUT --data-binary @- <<EOF
input:
type: http_server
buffer:
type: none
pipeline:
threads: 4
processors:
- type: jmespath
jmespath:
query: "{id: user.id, content: body.content}"
output:
type: http_server
EOF- 删除配置的stream
curl http://localhost:4195/streams/foo -X DELETE参考资料
https://github.com/Jeffail/benthos/blob/HEAD/docs/streams/using_REST_API.md