This tutorial shows how to integrate Upstash Kafka with Timeplus
input
, since we are going to stream from this topic to Timeplus. The name of the second topic can be output
. This one is going to receive the stream from Timeplus.
Data Ingestion
in the menu bar. Click on Add Data
Apache Kafka
source.
<name>-<region>-kafka.upstash.io:9092
. Enable all security options and choose SASL SCRAM 256
and type the username and password.
Next
button. In the dropdown list, you should be able to see all available Kafka topics. Choose the input
topic. Leave the JSON
as the Read As
option. Choose Earliest
if you already create messages in the topic. Otherwise use the default value Latest
.
Next
button, it will start loading messages in the input
topic.
Let’s go to Upstash UI and post a JSON message in input
topic:
input
and accept the default options.
Next
button to review the settings. Finally, click the Create the source
button.
Query
menu on the left and type the streaming SQL as:
Send as Sink
button. Use the default Kafka
output type and specify the broker, topic name(output
), user name and password.
Send
button to create the sink.
Go back to the Upstash UI. Create a few more messages in input
topic and you should get them available in output
topic with raw IP addresses masked.