RabbitMQ : Message Queues for beginners
HTML-код
- Опубликовано: 7 фев 2025
- Subscribe to show your support! goo.gl/1Ty1Q2 .
Patreon 👉🏽 / marceldempers
Folks! Today we'll be taking a look at Message Queues, what they are, why you may want to use a message queue, and how RabbitMQ helps offer message broker functionality.
In this video, we take a look at the basics, how to run RabbitMQ, some of the features.
We will also build and application that produces messages in a queue, and another that consumes the messages.
Checkout the source code below and follow along :)
In an upcoming video, we'll cover HA and replication so be sure to stay tuned for that!
We'll also learn how to run all of this on Kubernetes.
Also if you want to support the channel further, become a member 😎
marceldempers....
Checkout "That DevOps Community" too
marceldempers....
Source Code
--------------------------------------------------------------
github.com/mar...
If you are new to Kubernetes, check out my getting started playlist on Kubernetes below :)
Kubernetes Guide for Beginners:
---------------------------------------------------
• Kubernetes development...
Kubernetes Monitoring Guide:
-----------------------------------------------
• Kubernetes Monitoring ...
Kubernetes Secret Management Guide:
--------------------------------------------------------------
• Kubernetes Secret Mana...
Like and Subscribe for more :)
Follow me on socials!
marceldempers.dev
Twitter | / marceldempers
GitHub | github.com/mar...
Facebook | thatdevop...
LinkedIn | / marceldempers
Instagram | / thatdevopsguy
Music:
Track: INOSSI - Sunset Eyes (Free download) | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / sunset-eyes-free-download
Track: LiQWYD - Bridges (Free download) | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / bridges-free-download
Track: Amine Maxwell - Le Soir | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / le-soir
Track: souKo - souKo - Parallel | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / parallel
![Felix "Unfair" | [Stray Kids : SKZ-PLAYER]](http://i.ytimg.com/vi/Oswujxm2Ag0/mqdefault.jpg)
Rabbit MQ : High Availability and Replication 👉🏽ruclips.net/video/FzqjtU2x6YA/видео.html
Very nice video...small Query wrt Rabbitmq Linux vulnerability on default port 5672..how to remove this vulnerability...change the port or firewalld rules?
Hi Bud, Thank you for the great videos. I need to set up a high availability RabbitMQ with 3 nodes and then need to have a load balancer like nginx or haproxy for it. I am trying nginx but I don't know how to make the connections persistent. Do you have any info or exaples for that?
@@crimzin2180 I dont have much experience in that area especially the persistence. I would think that your client would establish a connection which would remain open whilst subscribing to the queue. HA or NGINX would have that connection open to an upstream until the client closes the connection.
Here is an example book showing a basic HA proxy config with Rabbit
livebook.manning.com/book/rabbitmq-in-action/chapter-6/35
Love your tutorials! You also look like you could bench press a node_modules folder.
XDDDDDD
LoL
lmaoo
Lol
I'm transitioning from a senior system admin position to a devops position in my company and I can't tell you how valuable your content is to me. Best Devops channel on youtube.
go heels
Bro, I subscribed within the first 2 minutes, never having seen or heard of you before, you're the man.
Very cool, thank you for this!! Your video was very easy to understand and follow
BTW if anyone is running into the message "Stats in management UI are disabled on this node" when accessing the Management dashboard, use the following command when starting up the RabbitMQ container:
docker run -d --rm --net rabbits -p 8080:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3-management
The reason is that the default image disables metrics collector in the management_agent plugin
I was some troubles understanding the message queue logic until I watched this video. Thanks a lot man, greeting from Mexico.
I came here for more understanding for rabbit, and ended up seeing a GO app in action :D very nice!
Excellent video, thank you for going straight to the point and even editing out all the pauses! I came for RabbitMQ but I'm staying for more Go and Kubernetes.
Just wanna thank you for the great videos and content!
Trying to get into DevOps myself and it has been a struggle, and your videos has always been helpful in understanding some concepts I struggle with.
Always excited for your content as it explains modern tech in an understandable format.
Appreciate it and keep up the good work!
Thanks so much 💪🏽Good luck out there.
My advice:
Build up a good understanding of using Linux, learn docker, use docker to run everything (like i do in all my videos) It will powerlevel and fast track your learning especially when running open source stuff locally.
Learn the basics of Kubernetes. Try apply your docker learning, to K8s.
Then learn how to run it locally on Kubernetes.
Create trial AWS\Azure account, try running kubernetes in the cloud.
This will give you a good foothold and foundation to build on.
That's probably one of the best and most coherent technical presentations I have seen on youtube!
I don't understand any of this, but I can tell that if I watch it more carefully and several more times, I would get it eventually. You explained it so thoroughly and clearly that I subscribed to your channel.
Glad you enjoyed it. Feel free to checkout my community page for the Discord server. Friendly folks happy to answer questions you may have 💪🏽👊🏽
wow man, very nicely done. Ive just finished learning Go and now getting into RabbitMQ and Kafka. Your docker stuff was brilliant. Learnt heaps. Just subscribed.
🙏🏽
Best tutorials I ever watched. Explaining what counts and not going into what does not matter. Also I like that it is a little fast paced (at least for me). Kindly make more of this gold :) Thanks
Marcel , Good Morning :) ( for me ). Thanks Very much for wonderful content. I am more visible kind of guy , cant thank you enough for explaining clearly about architecture on a white board. I have learned a lot from your videos.
I think you should definitely know that, you are doing a great great work for the community. Thank you. And please keep doing.
Thanks so much! this means a lot 💪🏽
No only squat, deadlift too) thank you for your work!
You saved my bacon here, need to set up a rabbitmq cluster so this in combination with your next video are really helping me out!
The best video about RabbitMQ ever! Thank's a lot!
Truly love your channel. You're a great teacher and I love the way you present information! Keep making great videos please :)
SUPER high quality video! Thanks Marcel!
The arms on this guy. I feel compelled to trust his instruction.
You are really doing great work man for everyone. Great stuff, easy explanation, demos are always awesome. Thanks and keep doing great work.
One of the best youtuber for Golang community
I decided to register for membership after watching fewer than 10 of your videos :)) Can't wait until I become a real DevOps Engineer. Imma upgrade my Level then :)))
🙏🏽
Helped me so much! Thank you :) All the content on your channel is fantastic. Thanks for the great work
Very concise, very well explained. Your pace is excellent to follow!
This camera format always has me expecting him to drop a freestyle
Yes man your channel is really underrated
Hey man, I love you. Thanks for all your videos. ❤️💙💜
I love your tutorial. Subscribed.
Just discovered your channel, it's amazing, thank you!
🙏🏼
Love you work, would like to see you cover about Apache Kafka next time.
I’m here for this topic 😃, really looking forward to more thank you for this.
I agree with @Ray Statham, very nice easy intro to Rabbit MQ. Thank you very much.
Absolutely underrated channel. Besides beginner videos, are you also planning some deep dives?
Really nice walk through there Marcel :)
Great intro to using RabbitMQ in Docker, it is a bit confusing the consumer part with loops consuming but you need to learn Go language. Otherwise it was easy to follow.
Thanks, could you show us the RPC pattern :)
This is a brilliant tutorial.
Many thanks for the video! Worth the 22 minutes!
This is a great video. It's inspiring. Thanks for the content!
Your videos are awesome and really useful! Thanks so much for this excellent work!
It was kinda hard to keep my eyes off your triceps XD...Excellent Video btw...cleared my doubts 🧡
This is a great intro to RabbitMQ
Great video Marcel, one thing I didn't understand was how you passed the Ack false as the consumer, also isn't the queue supposed to retain a message when it doesn't receive an Ack?
really great tutorial that I looking for. thanks best grads.
Awesome Explanation !!! Looking forward for some administration video on the same. Thanks !! Great work !!
Hi Marcel. When I run the rabbitmq docker container and look at the logs it seems to start in maintenance mode and when I look at the web management I see the node name, but I don't see any of the node status information, like file descriptors, memory or disk space etc.
I used the following command to start the container docker run -d --rm --net rabbits -p 8090:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3.8
Here are the end of the logs
2021-05-23 11:14:30.499 [info] Running boot step direct_client defined by app rabbit
2021-05-23 11:14:30.500 [info] Resetting node maintenance status
2021-05-23 11:14:30.502 [info] Application rabbit started on node 'rabbit@rabbit-1'
2021-05-23 11:14:30.502 [info] Application cowlib started on node 'rabbit@rabbit-1'
2021-05-23 11:14:30.504 [info] Application cowboy started on node 'rabbit@rabbit-1'
2021-05-23 11:14:30.515 [info] Application rabbitmq_management_agent started on node 'rabbit@rabbit-1'
2021-05-23 11:14:30.566 [info] Application prometheus started on node 'rabbit@rabbit-1'
2021-05-23 11:14:30.568 [info] Application rabbitmq_web_dispatch started on node 'rabbit@rabbit-1'
2021-05-23 11:14:30.586 [info] Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2021-05-23 11:14:30.586 [info] Application rabbitmq_prometheus started on node 'rabbit@rabbit-1'
2021-05-23 11:14:30.586 [info] Ready to start client connection listeners
2021-05-23 11:14:30.598 [info] started TCP listener on [::]:5672
completed with 3 plugins.
2021-05-23 11:14:31.784 [info] Server startup complete; 3 plugins started.
* rabbitmq_prometheus
* rabbitmq_web_dispatch
* rabbitmq_management_agent
2021-05-23 11:14:31.787 [info] Resetting node maintenance status
Thank you!!! Great video and amazing explanation!
Tapped like on 0:05 second durring intro. Great)
Bro, the way that you provide the content is awesome and make me laugh. thousand likes please)
1:10 I believe that you mean HTTP not TCP, when you say about synchronous calls between services. TCP itself is asynchronous. Some higher-level protocols like HTTP, that rely on TCP make commnication synchronous, but not TCP itself. I just discovered your channel and I love it. You're doing a great work! Keep going :)
Hey man, you are the best.
Love that VSCode theme!
Maybe an refresh of the series rabbit on kubernetes with rabbitmq/cluster-operator? It's an game changer on how things (could) work ...
Awesome video! Very helpful. Thanks
Super interesting content, Thank you
Thanks a lot for this fantastic video!!!
Best. Thank you
Thank you, clear and concise
Respect 🖖.
Thank you so much
Excellent vídeo folk!
thank you explain it very well
How one can consume some messages, not acknowledge them immediately, close the channel/connection, and later on, in a new process acknowledge a few selected consumed message? The selection is based on some side processes on the consumed messages.
Great job, have gone through most of the videos, all are fantastic. Can you make a series of Tekton and Integare with argo CD
Man you are an absolute chad
Thank you SO MUCH!!!
Very useful video,Thank you!!
Subscribed.. amazing work
great video
07:00 I think you can still run rabbitMQ as deployment just create a service with the specified name and dirrect traffic to the pods in the deployment
If you need replication setup, each pod needs to be individually addressable, so load balancing between multiple pods wont be sufficient for that need.
This is why a headless service with a statefulset is used instead.
Nice, useful and easy to understand video. I have a question, once consumer recieves a message from queue, queue is empty, so lets say during the day there were 1000 messages sent/received, how, from admin perspective I can see the history of messages and their details? Thanks in advance
More power to you 💪
very clear thanks !
What is the VS Code theme you're using? I wish VS Code would implement a feature that shows the theme name small at the bottom somewhere. Also, really great content my friend. Very clear and easy to follow instruction.
Thanks for the kind words 🙏
I used to use "Amethyst Dark", Now I use "Reloaded Dark [Darker]"
Very cleary. Thank so mucho.
Good one. Thanks.
Failed to establish message queue error I m getting....Any suggestions 🙏
Very interesting, thanks marcel
Thanks a lot for sharing this!
Awesome video! I copied the code, but had to rework the dockerfile and add the go.mod and go.sum files, and add the installation of the modules command (go mod download), because running like it was there, didn't work for me.
Great stuff 💪🏽
Some of my guides are still using older versions of Go
Do you mind submitting a PR?
@@MarcelDempers Not all! 👍
Thank you. Great video.
Thanks 🙏🏻🙏🏻🙏🏻
How can publish message to rabbitmq using django without celery can you help me please?
I didn’t know Arnold was a Dev Ops guy in parallel universe!
he is the buffed programmer
nice video..
one question though: at 7:00 you said hostname is required for `rabbitmq` instances to find and talk to each other. Why do multiple rabbitmq instances need to communicate? Isn't it that the other application services (producer and consumers) require communication with each other?
In most software, to achieve high availability, the software runs multiple copies and forms a leader\worker topology, traditionally known as master/slave. They need to communicate in order to up hold high availability. Producers and consumers in message broker technology dont communicate with one another and talk to the queue itself, in this case, they talk to RabbitMQ
Hello, What if we setup the rabbitmq on EC2 instance not with containerization (k8s) for serving all the microservices on kubernetes cluster, is it possible?
thanks again!
I have two broker from different device and create queue when publish msg , So I want if i publish msg it will be retain and show in both broker subscribe . it will manage only configuration no use predefined queue because my msg will be published by device . so how can i achieve this replication of msg . i use client tool for subscribe is mqttbox . please give me solution 🙏
How can I connect to my organization rabbitmq ?
In other words,
How can I connect to a host other than localhost?
Thanks in advance!
Love it , thanks
great work. Thank you!
Can you create queue type as Quorum and publish the image ? this is creating classic queue
7:43 RabbitMQ CLI
8:31 plugins
11:03 producer
14:05 put message into a queue
This is sooo great content. You have way too few subscribers.
good work ma man
Harry Enfield running out of ideas XD
Nice video
awesome!!.. thank you.
thank you!
random question: would you mind sharing how you make your commandline arguments/options in grey? that's pretty nice!
I have no idea to be honest 😀
I believe this may just be a VSCode theme that does it
@@MarcelDempers You don't have this in your normal terminal? only in VSCode?
That's pretty nite tho!
Thank you!
excellent