https://nryanov.com/tags/kafka/Recent content in Kafka on Nikita RyanovHugoen-usTue, 11 Jul 2023 04:30:00 +0300https://nryanov.com/kafka/kafka-connect-overview/Tue, 11 Jul 2023 04:30:00 +0300https://nryanov.com/kafka/kafka-connect-overview/<h1 id="kafka-connect-overview">Kafka-connect: overview <!-- raw HTML omitted --><!-- raw HTML omitted --></h1> <p>Imagine you have a task where you need to fetch some data from a database and incrementally store it in kafka or read the consumed data from kafka and store it in the database. You can solve both tasks using plain kafka consumer/producer API or even use kafka streams library, but if you don&rsquo;t need comprehensive data transformations (e.g. enrichment, stream joining) then you can use Kafka connect for it.</p>