Breaking News: Grepper is joining You.com. Read the official announcement!

topology in kafka streams

Pragya Keshap answered on February 28, 2023 Popularity 4/10 Helpfulness 1/10

answer topology in kafka streams

topology in kafka streams

Comment

Step By Step Processing Logic

public class AppTopology {
    private static final Logger logger = LogManager.getLogger();

    static void withBuilder(StreamsBuilder builder) {
        KStream<String, AdImpression> KS0 = builder.stream(AppConfigs.impressionTopic,
            Consumed.with(AppSerdes.String(), AppSerdes.AdImpression()));

        KTable<String, Long> adImpressionCount = KS0.groupBy((k, v) -> v.getCampaigner(),
            Grouped.with(AppSerdes.String(), AppSerdes.AdImpression()))
            .count();

        KStream<String, AdClick> KS1 = builder.stream(AppConfigs.clicksTopic,
            Consumed.with(AppSerdes.String(), AppSerdes.AdClick()));

        KTable<String, Long> adClickCount = KS1.groupBy((k, v) -> v.getCampaigner(),
            Grouped.with(AppSerdes.String(), AppSerdes.AdClick()))
            .count();

        KTable<String, CampaignPerformance> campaignPerformance = adImpressionCount.leftJoin(
            adClickCount, (impCount, clkCount) -> new CampaignPerformance()
                .withAdImpressions(impCount)
                .withAdClicks(clkCount))
            .mapValues((k, v) -> v.withCampaigner(k),
                Materialized.<String, CampaignPerformance, KeyValueStore<Bytes, byte[]>>
                    as(AppConfigs.stateStoreNameCP)
                    .withKeySerde(AppSerdes.String())
                    .withValueSerde(AppSerdes.CampaignPerformance()));

        campaignPerformance.toStream().to(AppConfigs.outputTopic,
            Produced.with(AppSerdes.String(), AppSerdes.CampaignPerformance()));
    }
}

Popularity 4/10 Helpfulness 1/10 Language java

Source: Grepper

Tags: java topology

Link to this answer
Share Copy Link

Contributed on Feb 28 2023

Pragya Keshap

0 Answers Avg Quality 2/10

topology in kafka streams

Contents

More Related Answers

topology in kafka streams

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.