Kafka installation using Docker and Docker Compose | Kafka | Docker | Docker Compose

Поделиться
HTML-код
  • Опубликовано: 11 сен 2024
  • We will be installing Kafka on our local machine using docker and docker compose. when we use docker to run any service like Kafka, MySQL, Redis etc then it becomes platform independent. This gives us the flexibility to run our services on any operating system without doing any changes or installing new dependencies to the Operating system that you are using
    If you follow the following tutorial then you can run Kafka on below operating system
    Windows
    Mac
    Any flavour/Distribution of Linux
    Docker Ports:
    • Port configuration in ...
    Article link

Комментарии • 86

  • @ironside915
    @ironside915 3 года назад +7

    Thanks a lot! Very detailed and well paced, you made me fall in love with docker again!

  • @suyunovjasurbek
    @suyunovjasurbek Год назад +1

    Onalarini emsin blin ishqilib bir nima qilib ishlatdim, Malades Hindistaniskiy Englishni yorivirdungiz lekin , oma omadingni bersin , Rahmat

  • @yanuaryusufadika7045
    @yanuaryusufadika7045 4 года назад +1

    Don't be mad, but you're Indian person that I can listening you clearly rather than any other Indian. In this point, you're the best. Thanks for the tutorial dude

    • @richJinny
      @richJinny 4 года назад

      Yes thank you so much, chutiya.

  • @amaanmohammad1190
    @amaanmohammad1190 9 месяцев назад

    Clear - Concise and to the point. Great Work

  • @anikethdeshpande8336
    @anikethdeshpande8336 Год назад +1

    detailed explanation! best for beginners!

    • @amaanmohammad1190
      @amaanmohammad1190 9 месяцев назад +2

      Aniketh bhai aap yahan kaise ? What a crazy coincidence XD

    • @anikethdeshpande8336
      @anikethdeshpande8336 9 месяцев назад

      @@amaanmohammad1190 we will have many co incidences I think 😄😄

  • @tanmoydattagupta4718
    @tanmoydattagupta4718 4 года назад

    Simple and concise what I need to quickly setup Kafka.. Thanks and I really appreciate the video.

  • @kalhanpamuditha1695
    @kalhanpamuditha1695 4 года назад +15

    Could you please do a tutorial about how we can implement two simple independent micro services one is producer and the other one is consumer, with docker
    Thanks appreciate this video

    • @richardbravix8145
      @richardbravix8145 3 года назад +1

      did u find any good tutorial doing that ??

    • @piyushtyagi7653
      @piyushtyagi7653 3 года назад

      Looking for the same

    • @piyushtyagi7653
      @piyushtyagi7653 3 года назад

      Here is what i found -
      ruclips.net/video/fCt0L4LwB9w/видео.html
      ruclips.net/video/NjHYWEV_E_o/видео.html
      ruclips.net/video/IncG0_XSSBg/видео.html

  • @sanjeetbehera5620
    @sanjeetbehera5620 3 года назад

    Thanks a lot! Nice tutorial. I followed the steps and successfully able to run kafka on docker.

  • @geekthegeek730
    @geekthegeek730 4 года назад +1

    Thanks for these amazing tutorials

  • @aleksandrkurilov2599
    @aleksandrkurilov2599 Год назад

    Thank you a lot! I've been looking exactly for this.

  • @aniketpatel3994
    @aniketpatel3994 3 года назад

    Amazing content!! Only 9.63k subscribers are not fair.

  • @rohitkrishnamoorthy334
    @rohitkrishnamoorthy334 3 года назад

    thanks a lot your explanation is so easy to understand.

  • @khalifathullahkhan8873
    @khalifathullahkhan8873 3 года назад

    Great Explanation !... appreciate your efforts to explain it so beautifully. thanks

  • @jayav3137
    @jayav3137 2 года назад

    Excellent and Simple Explanation. Helped me a lot. Thank Youu :)

  • @Hitesh-Salgotra
    @Hitesh-Salgotra 3 года назад

    simply amazing to the point explanation !! i love it i access your whole playlist

  • @satendrapal9275
    @satendrapal9275 2 месяца назад

    Very useful video

  • @joaocsv
    @joaocsv 4 года назад

    Thanks, simple, and objective.

  • @vkg.codefactory
    @vkg.codefactory 3 года назад

    Nice work, a very good video, keep it up, thanks for creating and sharing it

  • @nazgulzholmagambetova1198
    @nazgulzholmagambetova1198 2 года назад

    Brilliant video ! Thank you so much !

  • @kirasteph5480
    @kirasteph5480 2 года назад

    Thank you man! You helped me a lot

  • @amitabhranjan2815
    @amitabhranjan2815 3 года назад

    Thank you sir. This was really helpful

  • @thanhtungvu423
    @thanhtungvu423 4 года назад +1

    very useful video, thanks sir

  • @vuongphamquan9417
    @vuongphamquan9417 4 года назад +1

    thanks for your sharing :)) I'm very grateful.

  • @michawodarkiewicz371
    @michawodarkiewicz371 4 года назад +1

    Thanks, informative video!

  • @ayaanandamaansworld6706
    @ayaanandamaansworld6706 3 года назад +2

    Thank you for the awesome tutorial and the explanation.
    Question :
    Is it safe to use the images directly in docker file ?
    Could you please provide an alternate and secure way without pointing to images ?
    What if these images goes wrong ? how to safely recover ?

  • @_SoundByte_
    @_SoundByte_ 3 года назад

    beautiful. simple and clear

  • @zishanshaikh3068
    @zishanshaikh3068 4 года назад

    Thank you.. great work.. please make a video on kubernetes

  • @shayta_
    @shayta_ 4 года назад

    Very good tutorial, keep up with your work!

  • @hamedsoleimanian7958
    @hamedsoleimanian7958 3 года назад

    it was soooo informative mate , tnx

  • @charbelsadaka4034
    @charbelsadaka4034 4 года назад

    Thank you very much. Perfect!!!

  • @Marceliino1
    @Marceliino1 4 года назад +2

    Excelent video...but could you please talk a little more slowly?

  • @rahdartus8942
    @rahdartus8942 Год назад

    great work 👍

  • @yuriikoval2453
    @yuriikoval2453 3 года назад

    Great tutorial!

  • @TravelwithVedanshi
    @TravelwithVedanshi 2 года назад

    Very nice

  • @anutpat
    @anutpat 4 года назад

    great tutorial. Thank you.

  • @nandiprasad.madikeri
    @nandiprasad.madikeri 2 года назад

    Osm explaination

  • @ajay-lu5gh
    @ajay-lu5gh Год назад

    Thanks a lot!

  • @amitabhranjan9668
    @amitabhranjan9668 3 года назад

    Great video. Thanks for sharing. Can you make one for docker+hadoop+spark using intellij

  • @precisionist8568
    @precisionist8568 3 года назад +1

    it does not run kafka(zookeper work) now

  • @marianmereuta6307
    @marianmereuta6307 3 года назад

    thanks,very useful

  • @R-Kannada-DevOps
    @R-Kannada-DevOps 2 года назад

    Fantastic

  • @munibafirdos6585
    @munibafirdos6585 3 года назад

    Thanks brother :)

  • @VM-yp2rl
    @VM-yp2rl Год назад

    Question: what is the best practice to run consumer.php file so that it reads constantly and processes kafka messages. Simply, if the server reboots, etc., then you need to make sure that the consumer.php file is running? I must run it with cron or exist some more elegant solutions? And if possible, please explain the best way to do this in docker

  • @bodyakov4483
    @bodyakov4483 2 года назад

    amazing

  • @kamala481
    @kamala481 3 года назад

    Good session. Can you provide a session to install Kafka confluent platform in Kubernetes/docker?

  • @kalhanpamuditha1695
    @kalhanpamuditha1695 4 года назад +1

    Thanks

  • @minemoviesss
    @minemoviesss 4 года назад +1

    Can we deploy datascience models using docker?

  • @mohamedreda6299
    @mohamedreda6299 Год назад

    thank you sir, you help me so much

  • @jaykhimani
    @jaykhimani 4 года назад +1

    Any specific reason to use wurstmeister image and not the official zookeeper image?

  • @eduardocruz1882
    @eduardocruz1882 3 года назад

    Just a question, If Im using pypkafka , should i use 'localhost:9092' or 'kafka:9092'

  • @himanshujani5758
    @himanshujani5758 2 года назад

    great

  • @adityaroy4745
    @adityaroy4745 4 года назад

    thanks a lot

  •  4 года назад

    thank you

  • @hacker007theone6
    @hacker007theone6 2 года назад

    @SelfTuts Please tell the fonts name you are using in ubuntu and intellij.

  • @user-qm8ft4nh7o
    @user-qm8ft4nh7o Год назад

    My docker compose version is v2.18.1. So when i created the yml file and tried to run it gives me an error docker-compose.yml: (root) Additional property Version is not allowed. Can you please help me resolve this

    • @horsthorstmann7921
      @horsthorstmann7921 Год назад

      You do not need docker-compose anymore as compose is now a subcommand of docker.

  • @krishnachaitanya4675
    @krishnachaitanya4675 Год назад

    I'm trying to do the same in widows but I'm getting an error:
    missing mandatory config: KAFKA_ZOOKEEPER_CONNECT
    Can anyone help me on this?
    Thanks in advance.

  • @weitanglau162
    @weitanglau162 3 года назад

    Do you know how to deploy kafka cluster on kubernetes?

  • @Amarnath-ik4fy
    @Amarnath-ik4fy 2 года назад

    Getting unauthorised incorrect password or username while pulling the Zookeeper image

  • @sisuser4150
    @sisuser4150 4 года назад

    Hi, how do you setup sasl plaintext authentication under this?

  • @doctorag1135
    @doctorag1135 Год назад

    how come you ar eusing version 3 for docker-compose becuae the latest is v2.18.1??? how and why

    • @horsthorstmann7921
      @horsthorstmann7921 Год назад

      You do not need docker-compose anymore as compose is now a subcommand of docker.

  • @MyBinaryLife
    @MyBinaryLife Год назад

    article link doesnt work

  • @raptyaxa5771
    @raptyaxa5771 Год назад

    no need docker network to connect kafka and zookeeper?

    • @horsthorstmann7921
      @horsthorstmann7921 Год назад

      When you look at 14:38 you see that a common network is started. The name of this network is combined from the directory name and "default".

  • @johnn1950
    @johnn1950 4 года назад

    After ./bin/kafka-topics.sh --create --zookeeper zookeeper=2181 --replication-factor 1 --partitions 1 --topic events
    I get the following error msg:
    ERROR Unable to resolve address: zookeeper=2181:2181 (org.apache.zookeeper.client.StaticHostProvider)
    java.net.UnknownHostException: zookeeper=2181: Name does not resolve.....
    Any idea what to do?

    • @johnn1950
      @johnn1950 4 года назад

      Problem was a typo :/ (see below correct version):
      ./bin/@t --create --zookeeper zookeeper=2181 --replication-factor 1 --partitions 1 --topic events
      Thanks for the great video!!!

    • @codewithrajranjan
      @codewithrajranjan  4 года назад

      Thanks man

  • @kenchang3456
    @kenchang3456 4 года назад

    Looks like selftuts.com is down.

  • @nitishkr1993
    @nitishkr1993 4 года назад

    Please help i am unable to go inside opt folder..getting error permission denied

    • @codewithrajranjan
      @codewithrajranjan  4 года назад

      Use root user to go inside opt folder

    • @nitishkr1993
      @nitishkr1993 4 года назад

      @@codewithrajranjan Can you give example...how?..Thanks for valuable reply

    • @jason87789
      @jason87789 4 года назад +1

      1 month ago
      $ docker exec -it kafka /bin/sh
      the input device is not a TTY. If you are using mintty, try prefixing the command with 'winpty'
      @SelfTuts: I am also not able to go inside . Getting message as above

    • @jason87789
      @jason87789 4 года назад +3

      My issue is resolved if i use powershell instead of bash shell. Hope it helps someone

    • @minemoviesss
      @minemoviesss 4 года назад +1

      @@jason87789 most of the command not working in normal prompt, power shell should be used

  • @swapnakumari1884
    @swapnakumari1884 2 года назад

    It is better to show all dependency softwares installations instead of showing only kafka installation. So This video is not for the beginners. We need Virutal box, and any type of linux operating system , docker, docker compose installation before we follow this video of kafa installation. I wish you give the viewers complete prerequisite software installations tutorial before you proceed to showing kafka installation.

  • @happy0911080522
    @happy0911080522 3 года назад

    thanks