Hi.. could you please refer me if there are any vacancies in your company.. I got affected by layoffs in my company. I only have a few days to leave the company. Even in naukri there are not many calls from any company.
Hi @JavaTechie , Thanks for all the courses with detailed explanations. I have a suggestion after completion of some topic end to end kindly try to make a interview question on it. A single video comprising of all interview questions would be sufficient.
Today i have follow all the examples and very clear to this topic. Thanks alot. One question incase , if broker/kafka server is down in that case how we can manage the things, in the upcoming video could you please describe those aspect as well
@@Javatechie 1.In this series can you also share how production ready code will be. 2. Since you are using latest version can also mention KRaft instead Zookeeper. And last have learnt a lot from you specially. Thank you
@@Javatechie "When some event msg failed in prod and we need to debug it by putting it again on a particular partition". Thats for debug purpose but is there any functional purpose as well? Very nice tutorial all in all!
Hi Sir I need to work with Kafka consumer side, just get the data from the topic/producer (MMS services) then read the data and perform curd operation on DB at consumer side as Spring boot application with Azure cloud database please make a one video
Hi Basant sir , I have a question, I am sending a Jason object to Kafka and consumer consumes it by key and stores it in mysql , but how would I let my producer know that if comsumer raises any exception like usernotfound or primary key is missing or any exception that I want to raise to user
Hi, could you please make one full end to end Kafka Streamming project with springboot, I have seen your other Kafka video was made on kafka client API, but if you make Stream API, then it will very helpful becuase these days company are using streams API rather than client API . please make such video 🙏🙏
Hi @Javatechie If the copy of the same message is available in 3 different partitions(P-0,P-1,P-2) in 3 kafka brokers(KafkaBroker-1,KafkaBroker-2,KafkaBroker-3) in cluster, in case of replication, the duplicacy(same message/record) of the message will be consumed ? If the copy of the same message is available 3 different partitions(P-0,P-1,P-2) in 3 kafka brokers(KafkaBroker-1,KafkaBroker-2,KafkaBroker-3) in cluster, then let's say, I have three consumer's same instance, these three consumer's instance will consume the same messages from three different partitions ? Duplicated record will be consumed, means, same record will be consumed thrice ? please shed some light, Basant, thanks!!
Hi JT... really great series. Thanks ! If I want to scale up dynamically - for high volume of messages, how to do this ? dynamically increase partition or consumers ? is this something that would be controlled by K8 when deployed ? thanks
Hi JT... I'm using Spring Batch in a multi-threaded context and getting concurrency issues. I want to write my messages (using KafkaItemWriter) to send them to a partition based on the ThreadNumber to prevent concurrency conflicts. I think I set this using KafkaTemplate. I s that right ? if you get some time can you direct me ? tks - so Thread `1 send message to Kafka Topic A, Partition 1, Thread 2 to Topic A Partition 2 etc
@Java tech- I have 10 consumer replicas and 5 partitions. How to handle this scenario? 1 partition should point to 2 replicas and same is true for remaining replicas
I was able to crack two product based mnc interview using your content . Thank you so much for creating such videos .
You're in which company now?
Hi.. could you please refer me if there are any vacancies in your company.. I got affected by layoffs in my company. I only have a few days to leave the company. Even in naukri there are not many calls from any company.
Hi @JavaTechie , Thanks for all the courses with detailed explanations. I have a suggestion after completion of some topic end to end kindly try to make a interview question on it. A single video comprising of all interview questions would be sufficient.
Whole Kafka series was awesome
Appreciate Basant your efforts. God bless you. 🙂🙏👍
You are gem.. Keep creating such good videos.. You explain in simple words 👌👌
I love your videos which are very clear and good demonstrations as well. Keep it up
Please upload content on Kafka streams within microservices
Thank you so much sir for your awesome tutorials ❤🙏 from bangalore
Gold content ⭐ Whole playlist ❤️
Today i have follow all the examples and very clear to this topic. Thanks alot.
One question incase , if broker/kafka server is down in that case how we can manage the things, in the upcoming video could you please describe those aspect as well
Make latest full understanding video on jenkins with all details like how to work, flow, CICD pipeline, sonarqube, testings, deploying.....
Best course for Kafka
Thanks Amit many more concepts on Kafka on the way. Will publish soon
@@Javatechie 1.In this series can you also share how production ready code will be.
2. Since you are using latest version can also mention KRaft instead Zookeeper.
And last have learnt a lot from you specially. Thank you
good job
Hi, How do we identify the no.of partitions we need for a particular use case ?
Hi Basant, thank you for this tutorial. Can you please share what tool you are using to view the offsets. Thank you!
Offset explorer
Thank you so much sir 🙏
Hi basant , can you help with real time use case for these type of scenario's .
I have mentioned the usecase buddy
@@Javatechie "When some event msg failed in prod and we need to debug it by putting it again on a particular partition".
Thats for debug purpose but is there any functional purpose as well?
Very nice tutorial all in all!
Hi Sir I need to work with Kafka consumer side, just get the data from the topic/producer (MMS services) then read the data and perform curd operation on DB at consumer side as Spring boot application with Azure cloud database please make a one video
Hi Basant sir , I have a question, I am sending a Jason object to Kafka and consumer consumes it by key and stores it in mysql , but how would I let my producer know that if comsumer raises any exception like usernotfound or primary key is missing or any exception that I want to raise to user
You need to implement acknowledgement both in producer and consumer by disabling auto.offset.commit
It's good explanation... Hey can you plz make the Video on webhook integration. With kafka please
I have to check it buddy haven't tried it before will update you
Thank you
Hi, could you please make one full end to end Kafka Streamming project with springboot, I have seen your other Kafka video was made on kafka client API, but if you make Stream API, then it will very helpful becuase these days company are using streams API rather than client API . please make such video 🙏🙏
Please make a video how to integerate sonarqube with jacoco using spring boot I am getting error tried lot of times. Please bro
I heard that by default Kafka doesn't have UI, may I know how to get the UI ?
Hi @Javatechie
If the copy of the same message is available in 3 different partitions(P-0,P-1,P-2) in 3 kafka brokers(KafkaBroker-1,KafkaBroker-2,KafkaBroker-3) in cluster, in case of replication, the duplicacy(same message/record) of the message will be consumed ?
If the copy of the same message is available 3 different partitions(P-0,P-1,P-2) in 3 kafka brokers(KafkaBroker-1,KafkaBroker-2,KafkaBroker-3) in cluster, then let's say, I have three consumer's same instance, these three consumer's instance will consume the same messages from three different partitions ?
Duplicated record will be consumed, means, same record will be consumed thrice ? please shed some light, Basant, thanks!!
Hi JT... really great series. Thanks ! If I want to scale up dynamically - for high volume of messages, how to do this ? dynamically increase partition or consumers ? is this something that would be controlled by K8 when deployed ?
thanks
Scaling required from both ends
Hi JT... I'm using Spring Batch in a multi-threaded context and getting concurrency issues. I want to write my messages (using KafkaItemWriter) to send them to a partition based on the ThreadNumber to prevent concurrency conflicts. I think I set this using KafkaTemplate. I s that right ? if you get some time can you direct me ? tks - so Thread `1 send message to Kafka Topic A, Partition 1, Thread 2 to Topic A Partition 2 etc
Hello buddy since you are a paid member of Javatechie i am happy to help you in person please drop an email to javatechie4u@gmail.com
I have 100 messages, 3 partitions and how to add each partition get all 100 messages, ?
@Java tech- I have 10 consumer replicas and 5 partitions. How to handle this scenario? 1 partition should point to 2 replicas and same is true for remaining replicas
No it will be point to 5 only so rest 5 consumers will nothing to do instead waiting
🙏👍
Instead of 100 its 101
Why ?
709+100= 809
But its 810