How to Build an Awesome Kubernetes Cluster using Proxmox Virtual Environment

Поделиться
HTML-код
  • Опубликовано: 22 ноя 2024

Комментарии • 188

  • @psybuck2002us
    @psybuck2002us 2 года назад +61

    Thank you for this straight-forward, easy to understand tutorial! I have tried setting up many Kubernetes clusters on my own following online documentation and It has never worked correctly for me. Now that I have watched your tutorial, I realize there were so many mis-steps I was making.

  • @TristanSmith
    @TristanSmith Год назад +19

    I love how you even go over the painful steps that are obvious to intermediate users just looking for a leg up, but not for beginners.
    Wonderful teaching methods. I absolutely love to see it.

  • @LorenAman-o1k
    @LorenAman-o1k Год назад +13

    At around 46:00, when you are adding the first node to the cluster, I think the reason why it didn't work was because you used the join command for the control-plane instead of the worker node. It didn't appear to be because the time was too long. When you regenerated the join, it provided the correct join for a worker node.

    • @gelukken5246
      @gelukken5246 Год назад +2

      You are absolutely right, it also caught my eye when I viewed the video for a second time and saw that there are two commands for adding nodes to the cluster, one for control-plane nodes and one for worker nodes. The one in this video initially takes the control-plane node command in stead of the worker node command.

  • @nightmarenova6748
    @nightmarenova6748 4 месяца назад +1

    THANK YOU! Honestly the best guide on YT. As someone who's versed in Docker i found Kubernetes to require a lot of stuff based on what other RUclipsr's were doing and i would constantly be overwhelmed! This was very simple , all requirements were said at the beginning of the video and only those things were used for the video. Simple, to the point and just awesome!
    Sending much love and many thanks

  • @plogaet9032
    @plogaet9032 3 месяца назад +1

    Nice video for learning Kubernetes, I am thankful I can watch this. I tried to learn it once by myself, long time a ago, but the tutorials back then were so confusing to follow. I am glad to have this and get my foot into Kubernetes. I finally know what it is and why its so popular. I have finish the whole video and proof the setup in the video still valid today.
    I had trouble with the command to install kubelet kubeadm kubectl, maybe just my mistake, but it was not hard to resolve. The kubelet kubeadm kubectl weren't found in the default ubuntu repo. I managed to follow the official kubernetes guide and used the commands in section "Install using native package management", and successfully install the three packages.

  • @MrShiffles
    @MrShiffles 2 года назад +1

    took me a few days of frustration but finally got a working 3-node kubernetes cluster using Hyper-V instead of proxmox lol...thank you Jay!

  • @BigFourHead
    @BigFourHead Год назад +12

    @31:16 - your. echo "deb .... command is not in the build doc" or am I missing something?

  • @Gordolone
    @Gordolone 2 года назад +27

    This series is golden. I wish I could contribute more, my budget is too tight this month, but I felt bad watching the series without giving something more than a like back. Fantastic job

    • @LearnLinuxTV
      @LearnLinuxTV  2 года назад +3

      That was plenty and appreciated. Thank you so much!

  • @blevenzon
    @blevenzon 2 года назад +6

    The timing is impeccable! I’ve just began my CKA journey and was about to roll a lab out to my proxmox. Can’t wait to see this

  • @michaelgraff6978
    @michaelgraff6978 2 года назад

    Last week I tore down my bare metal kubernetes cluster and installed proxmox on the amd64 nodes. I set up two VMs on each, one for control pane and one for worker. I also wiped the arm64 nodes.
    I used talos for each VM and amd64 node. It’s quite handy.

  • @hondokenway
    @hondokenway Месяц назад

    I can always rely on your videos. I never have a tough time following your videos. Super great job always, thank you for all the time and effort you put into teaching.
    I am new to sys admin and homelabbing and i have learned so much from you. Thank you again

  • @thegreyfuzz
    @thegreyfuzz 2 года назад +4

    Awesome timing! We were just discussing k8s at work last week, and the need to start prep work to set up a development lab at the office to support new projects coming in Jan. Great walkthrough. Noticed a few typo's on the blog (missing the echo "deb..... command, the pod.yml has some extraneous Chapter 18 25, and in service-nodeport.yaml missing the the indent the last line) but easy enough to sort through. Can't wait for more k8s magic!
    Thanks for all you do!

  • @mbrav
    @mbrav 2 года назад +8

    Jay, thank you so much for this timely tutorial! I have been trying to find a tutorial on how setup Kubernetes in Proxmox for the past couple weeks. And now you released this big guy, which is just as great as the rest of Proxmox related and other videos. Thanks!

    • @hamidouz31
      @hamidouz31 2 года назад

      Me toi Jay is a beast

  • @cs0576
    @cs0576 Год назад

    Helped me a lot, minor suggestions:
    Since the worker node becomes a template, 901 would be a more logical ID.
    Setting the time zone for the template would have taken care of another tedious to do
    In the Blog post make sure that copy paste does not inlude additional line breaks.
    Eventually you may want to fix the sudo typo (instead of suod chown)
    There seems to be a long command missing in the process of the GPG rings...

  • @alex1383
    @alex1383 Год назад +3

    Always appreciate the clear and detailed explanations in your videos and the nicely judged pace. Thank you for all of them.

  • @mrwadams
    @mrwadams Год назад +5

    Hi Jay,
    Great walkthrough, thank you. One thing to note is that there's currently an issue when running kubeadm init after installing v1.26 of kubeadm, kubectl and kubelet. For some reason when using that version kubelet fails to start. A workaround is to specify v1.25.5-00 when installing those components via apt.

    • @KaMZaTa
      @KaMZaTa Год назад

      Just updated and I've found that issue too

  • @RajaseelanGaneswaran
    @RajaseelanGaneswaran 2 года назад

    First I was against the template cloud instnace, but after following your tutorial, I can;'t believe I wasn't doing this earlier on

  • @Jaabaa_Prime
    @Jaabaa_Prime 2 года назад +2

    Great stuff, nice run through getting a cluster up and running. The reason your 1st attempt didn't work was because you copied the "--control-plane" option which means that certificates and keys from the first node have to be copied over before it can also become a controller.

    • @LearnLinuxTV
      @LearnLinuxTV  2 года назад

      I realized that afterwards, and forgot I left that in. But thank you so much for noticing though, comments like those are very helpful 😃

  • @julianhamann4925
    @julianhamann4925 2 года назад +2

    I've literally been thinking about doing this for the past month. Thank you very much :)

  • @VallimeenalSubramanian
    @VallimeenalSubramanian Год назад +2

    To see the IP address in the k8s-ctrlr and k8s-node will be available after qemu-guest-agent "start" and "enable".

  • @gary4158
    @gary4158 Год назад

    Cannot wait for the next instalment to the series on Kubernetes

  • @jasonm2477
    @jasonm2477 2 года назад +3

    I'd love to see a follow up to add a load balancer and additional control plane nodes

  • @dsb2
    @dsb2 2 года назад +14

    Hey Jay, thanks for the awesome content. However I noticed there is a command missing on your blog post (after curl gpg) for installing the repository.

  • @vladimirkulakov6126
    @vladimirkulakov6126 Месяц назад

    Great work! Thank you! It would be nice to see your video on creating HA k8s-cluster with 3 cp-nodes!

  • @al_mayonnaise
    @al_mayonnaise 2 года назад +2

    This is exactly the kind of detailed walkthrough I've been hoping for, thank you!

  • @LampJustin
    @LampJustin 2 года назад +2

    Step 2 would be to get MetalLB and a PVC provisioner ;) Most would recommend Longhorn but actually I'd like to suggest something else. The Piraeus Operator uses DRBD9 and is much faster, especially on 1Gig connections as reads always happen locally if possible. Longhorn just tanks when having to write a lot and will eventually fall behind in replication. Also don't use the NFS Ganesha server provisioner unless you absolutely have to. It's a chore and highly unmaintained. If you do, be sure to build the image to run it from my MR. That's at least a little more up to date

  • @devin.n
    @devin.n 2 года назад +3

    This is EXACTLY the series I have been waiting for. Thanks so much for content.

  • @dandreani
    @dandreani 2 года назад

    thanks for the nice tutorial. On the written version, you are missing the step to add the k8s repo, it jumps from adding the gpg key to installing the kubeadm... packages

  • @pndungu1
    @pndungu1 Год назад

    Wow, this is an amazing video. Followed it step by step and am very very contended. THank you Jay

  • @Sheyk871
    @Sheyk871 2 года назад

    This data Is gold!
    You are the best Jay!

  • @ericneba970
    @ericneba970 2 года назад

    good stuff. K8S is the future and I'm really excited learning it. Thanks Jay

  • @aliebada
    @aliebada 2 года назад

    Awesome peaceful and positive energy ! I enjoyed your video, was such a quick way to overview Kubernetes.

  • @escanorsama7922
    @escanorsama7922 5 месяцев назад

    Hello sir, really thanks for the video, it's saved my life. I ran it on Ubuntu 24.04 and it works like a charm. But here is my question: I want to add high availability for my cluster with HAProxy.
    Do I need to use the same command for my other control planes, or do I need another command?
    thanks a lot
    have a nice day

  • @chrispanagapko
    @chrispanagapko Год назад

    Thanks a lot for this, Jay. Very helpful. On a side note, I was sitting here getting completely triggered by your pronunciation of sudo and lib. After thinking about it, your way actually seems more correct. My entire Linux career has been a lie 😂

  • @1over137
    @1over137 Год назад

    DHCP with DynDNS updates make the early parts so much easier. As soon as I give my temlate clone a hostname and boot it, it gets a DNS entry. I still did give them static assignments too.

  • @thegoldengriffin6377
    @thegoldengriffin6377 5 дней назад +1

    Does anyone have experience utilizing Rancher with Proxmox? I have been having difficulties. Would love the centralized manhement of kubernetes that rancher provides.

  • @jeffsmith8569
    @jeffsmith8569 2 года назад +1

    Just so you know the blog post is missing the step to add the k8s repository. You have the step to get the key but do not actually add the repo.

  • @ArniesTech
    @ArniesTech 2 года назад +5

    I absolutely love your style of presentation. Always enjoyable to watch and a huge inspiration for me! 💪

  • @mursalinkabir
    @mursalinkabir 10 месяцев назад

    Thanks a lot for this valuable tutorial. However, part of it needs to be fixed or updated as I have faced various errors on the way still this helped me to set up my first Kubernetes cluster!!

  • @underlyingglitch926
    @underlyingglitch926 6 месяцев назад

    The issue wasn't that the token expired, but you tried to add the other nodes as control planes. This only works if you copied the right CA certificates first. You should've used the 2nd join command which didn't include the --control-plane argument

  • @petermuia9519
    @petermuia9519 Год назад

    Hi Jay, this Kubernetes video is straight-forward & to the point. I was wondering if you have pointers on how to perform your steps but using Oracle VirtualBox. If I have 3 Ubuntu 22.04 VMs on VirtualBox with similar specs to your VMs & use /etc/hosts to network them. Is this a good starting point?

  • @RonaldChmara
    @RonaldChmara 2 года назад

    The step to modify netplan requires nano, which is not part of ubuntu-22.04-minimal-cloudimg-amd64.img (used in the recommended/prior video) 'sudo apt install -y nano' works, just noting it here for folks who might get confused (and for any notes on a future version of this video).

  • @asmi06
    @asmi06 2 года назад +5

    I have a question - what's the advantage of going the route you're describing, as opposed to just installing microk8s from the distribution and calling it a day?

    • @whiskerjones9662
      @whiskerjones9662 10 месяцев назад

      you get vanilla k8s vs an opinionated/OEM based version of Kubernetes - both have their pros and cons

  • @SanaagSomaliland
    @SanaagSomaliland Год назад +1

    Thanks mate. This was a really good guide. It helped me build my setup. I also followed your other tutorial about creating templates. Thanks again.

  • @josel82
    @josel82 Год назад

    This was a master class. Thank you Jay.

  • @MrNoBSgiven
    @MrNoBSgiven 2 года назад +2

    Jay, why not k3s favour of kubernetes, espacially for home/lab environment? People say K3S requires much less resources.

    • @Dough296
      @Dough296 2 года назад

      same question here 😉

  • @georgelza
    @georgelza 15 дней назад

    ... loving this... curious, have you looked at doing this using ansible ? thinking i might want to try that... take the base ubuntu image and do all prep/deployment using a ansible cookbook.

  • @gurvinderpalsingh4817
    @gurvinderpalsingh4817 2 года назад +1

    As usual, your videos are fantastic from the fact that you are a great teacher. If I have to be picky, in this video audio is a bit out of sync. ;) . Also, in the blog you forgot to add a command to update k8s packages. Would you consider doing a video on Ansible -AWX at levels 200-300?

    • @davidkamaunu8734
      @davidkamaunu8734 2 года назад

      Idk if it is desynchronized audio and video streams. He has a cadence and delivery that can seem delayed or belated .

  • @pjhandle
    @pjhandle Год назад

    Extremely well explained

  • @patrykpetryszen4306
    @patrykpetryszen4306 Год назад

    Have you added Ingress to this setup so that you can access the cluster from outside from your network? Setting this up in AWS is simple you just add LB. What about home network? Have you used Nginx deployed in proxmox as well or maybe metallb?

  • @ViktorZavadskyi
    @ViktorZavadskyi 25 дней назад

    Great video, got one question for you, you used VMs for cluster nodes, is it posible to use proxmox containers for this purpose ?

  • @chrisumali9841
    @chrisumali9841 Год назад

    thanks for the demo and info, have a great day

  • @firewall6810
    @firewall6810 2 года назад +1

    Hello Jay, what about the database and a second ctrl-node? is there a possibility for a video (for the integraded db shared on different nodes, not with an extra host with my-sql)

  • @jasonharper6765
    @jasonharper6765 10 месяцев назад

    Thanks for the video. Love your content. However, the blog post does not match the commands in the video at the point where you need to add the repos for apt. It does not work. Gives me errors that the key is not matching and that the release has no release file. At this point, I am not able to install the kube utils with apt install. Tried using SNAP but that didn't work either. Could you update your blog and video to get us back up to current workings?

  • @ArnaudVAUTHIER
    @ArnaudVAUTHIER Год назад

    So many thanks for these videos !!! That works so fine.

  • @blevenzon
    @blevenzon 2 года назад

    Jay can’t thank you enough for this video. Brilliant

  • @mshahomar
    @mshahomar 2 года назад +1

    Great video ❤! I'd like to know if anyone has opinion on MaaS + K8 vs PVE + K8. Which one is better for production based on your experience?

  • @leanghengkh
    @leanghengkh 2 года назад

    Thank you very much for your offered training.

  • @kenmurphy4259
    @kenmurphy4259 2 года назад

    Great demo Jay. Can you cover ingress in a future video?

  • @bartvanlienen3715
    @bartvanlienen3715 2 года назад

    Awesome. The only comment I have is that you forgat to add the command to link the kubernetes repositories in the blogpost writeup. Other than that, continue the great work!

  • @dimaj1
    @dimaj1 Год назад +2

    Thanks for a great video!!!
    I did, however, run into a problem, where I could not create my cluster. As it turns out, the issue lies with an incompatibility between kubernetes version 1.26 and containerd version 1.5.9. The error would look like: "command failed err=failed to run Kubelet: validate service connection : CRI v1 runtime API is not implemented for endpoint...."
    The fix is quite easy: downgrade to kuberenetes 1.25 (sudo apt remove --purge kubelet && sudo apt install -y kubeadm kubelet=1.25.5-00) or to manually upgrade containerd to 1.6.0
    Take a look at question "failed to run Kubelet: validate service connection: CRI v1 runtime API is not implemented for endpoint" on ServerFault.

    • @kmedleiss
      @kmedleiss Год назад +1

      thank you!

    • @dimaj1
      @dimaj1 Год назад

      @@kmedleiss of course!

    • @amitmalhotra4706
      @amitmalhotra4706 Год назад +1

      thank you so much for mentioning the same.

  • @terbeest
    @terbeest Год назад +1

    Is this guide now OBE? The xenial keyring is no longer signed and the kubeadm/kubectl/kubelet install commands suggest installing as snaps. Thoughts?

  • @androiddevice1881
    @androiddevice1881 Год назад

    Nice sharing a lot of knowledge here

  • @trissylegs
    @trissylegs Год назад

    Thanks for this. It was really helpful.

  • @meroxdev
    @meroxdev Год назад +1

    Awesome explanations! Do you plan in any time soon to release a video with loadbalancer setup for k8s cluster too ? And maybe a nextcloud server in the k8s cluster? Would be great for sure! 🤝♥️

  • @mathieuleclerc4136
    @mathieuleclerc4136 2 года назад +1

    please start a playlist from there :D

  • @federicoacosta6184
    @federicoacosta6184 2 года назад

    Hello, I would like to have a TrueNas course. I really enjoyed this Proxmox course, especially for its didactic and methodical nature, and the way of explaining and organizing the topics and each of the relevant aspects. While I've heard your recommendations about other channels that deal with TrueNas, they clearly don't deal with it in the same way or as extensively as you do. Thank you very much.

    • @LearnLinuxTV
      @LearnLinuxTV  2 года назад

      The main issue with covering TrueNAS is that it's BSD and not Linux. But now we have TrueNAS Scale, so there's no reason not to consider covering it. I'll definitely consider that and it does sound like a great idea!

    • @federicoacosta6184
      @federicoacosta6184 2 года назад

      ​@@LearnLinuxTV You're awesome. Thank you very much. I'm waiting for my paid to support you.

  • @dugumayeshitla3909
    @dugumayeshitla3909 Год назад

    Thank you for this wonderful content.

  • @lordmegatron2015
    @lordmegatron2015 2 года назад

    Hi There! Love your channel! Any plans to do a Gentoo install. I have been trying to install it on an Asus VivoBook 1TB NVME set up and can’t get it to boot because it gives an error saying it “block device is invalid”. Makes me think there is a specialized driver that need to be loaded by initramfs before loading the kernel. Very weird… Thanks!

  • @DCODev
    @DCODev 2 года назад +6

    Great tutorial and fantastic content! Thank you!

  • @niharpatel2631
    @niharpatel2631 2 года назад

    how about using talos VMs? it does the same thing, way quicker and easier to manage

  • @Elrevisor2k
    @Elrevisor2k Год назад

    Is it possible to run all config of the nodes and controller usin Ansible or Terraform?

  • @RicardoWagner
    @RicardoWagner Год назад

    Hi Jay, I bought your book first edition. Is it possible to update to the newest 22.04 version?

  • @rayjames7360
    @rayjames7360 2 года назад

    Jay, thanks for all your videos and your book. I have learnt a lot from you.
    But one question:
    Why do you double the amount of work up until the point where you make a template of the worker node?
    The steps are identical for the worker node and the control node up until that point, so the template can be used to generate all four nodes.
    I have actually recreated the control node from this template and it works perfectly.

    • @josemercado1674
      @josemercado1674 Год назад

      Me too!!! This is by far the best kubernetes setup around. All others can be a little unreliable. Can't get k3sup to work for anything.

  • @kylelaker539
    @kylelaker539 4 месяца назад

    I've noticed you needn't to mark a hold on kubectl and all the required plugin for kubernetes? is that important? holding the versions?

  • @zippi777
    @zippi777 Год назад

    Hi Jay, thanks for this usefull guide! It's awesome for a noob like me that are learning!
    Is it possible to manage and view the K8s cluster with an interface like for example OpenLens or something similar? Can it possibly be installed on a dedicated VM or in a Docker container?
    Thank you!!

  • @DrewMarold
    @DrewMarold 7 месяцев назад

    Do you have anything that talks about storage and persistent volumes in Kubernetes? I followed this and have a working cluster, but some of the things I want to run like redis require persistent volumes, and I'm struggling to figure out the secret sauce.

  • @MelroyvandenBerg
    @MelroyvandenBerg 4 месяца назад

    Maybe explain why we needed to edit the SystemdCgroup? Maybe that would be handy to say why we need this to true?..

    • @MelroyvandenBerg
      @MelroyvandenBerg 20 дней назад

      To answer myself, it containerd will use systemd cgroups under Linux (for access control and alike).

  • @goonbreathfpv
    @goonbreathfpv 28 дней назад

    This is a great video and a great channel

  • @joshhardin666
    @joshhardin666 Год назад

    This is a fantastic introduction, but i'm confused as to why you would want multiple k8s nodes on the same vm server? isn't the point fault tolerance and resource distribution? I assumed that it would be best practices to have a single k8s node per physical server, disable HA for those particular VMs (because k8s does HA internally)... keeping HA on for the controller because I don't think the controller is fault tolerant if i'm not mistaken. I admit I'm a total noob with this stuff, but Id like to know more.

    • @herrchoksondik5735
      @herrchoksondik5735 11 месяцев назад

      As far as I know, distributing the workload on a single physical machine with virtual machines is a valid approach. Like that you have virtual redundancy and scalability. If you want physical redundancy, you could replicate the virtual cluster on a second, third, and so on, physical machine. With this setup, you can distribute the application workload over multiple clusters on physical machines. So if one cluster should fail, you still have additional clusters which will handle the workload of the failed cluster. This multi cluster architecture would also enable running your services on hybrid cloud, multi-cloud, and other infrastructure models.

  • @ktipr
    @ktipr 2 года назад

    Very nice tutorial. I will definitely give it another go after running into some issues in the past. Any idea if the same steps (with some minor changes) work on Debian as well?

    • @ktipr
      @ktipr 2 года назад

      Can confirm that it works for the most part. The only real difference is that the version of containerd was slightly different (1.4), so the option for systemd cgroup is slightly different, problem is that there is one that looks like it, but it has to be the one that is in the runc.options section.
      Thanks again for the awesome video

  • @michaelplaczek9385
    @michaelplaczek9385 2 года назад +1

    Once I start being a System Admin for Ubuntu Servers, I would like to order your book then

  • @mzs114
    @mzs114 Год назад +1

    Can k8s be setup on LXC instead of KVM nodes?

    • @RayZde
      @RayZde Год назад

      I don't see why not. I'm about to set one up.

  • @georgelza
    @georgelza 15 дней назад

    ... do you have a video that discusses qemu... why do i need it ?

  • @konstantin-ytb
    @konstantin-ytb Год назад

    Dude, you are awesome! Thank you a lot!

  • @TheAlphahot1
    @TheAlphahot1 Год назад

    This is great man thank you!

  • @AdamLinkous
    @AdamLinkous 2 года назад

    The blog article is missing the steps for adding the repository

  • @rraymakers
    @rraymakers 2 года назад

    any chance you do a proxmox with ceph hyper-converged tutorial?

  • @Daixtrose
    @Daixtrose Год назад

    I remain unclear whether the Proxmox VMs are paravirtualized and if the k8s cluster can then use the full power of the underlying hardware. Can you elaborate on that?

  • @caseyknolla8419
    @caseyknolla8419 2 года назад +1

    Can we get a link to where you got that shirt from?

  •  9 месяцев назад

    somethinks not working correctly can you make a update if it is conviniet for you

  • @nicor.6006
    @nicor.6006 Год назад +1

    Unfortunately it's not working anymore :( Got stuck at initializing the cluster, which results in "[ERROR CRI]: container runtime is not running". Seems like there are some issues with the current versions. Just a heads-up for everyone following this tutorial! I am 50 minutes in and kinda need to restart from the beginning.
    Not the fault of Jay, good tutorial in general! But to everyone trying this in Mar 2023: You might need to look for another guide.
    Also be aware that some commands are just in the video and NOT in the linked blog article!

  • @selmac59
    @selmac59 Месяц назад

    Thank you so much

  • @KaMZaTa
    @KaMZaTa 2 года назад

    Why should I choose Kubernetes over Docker Swarm?

  • @jasonm2477
    @jasonm2477 2 года назад

    There is a typo in the pod.yml section on the blog right after metadata:

  • @skytree21
    @skytree21 Год назад

    great tutorial !!

  • @CyberFinSciGuy
    @CyberFinSciGuy 2 года назад

    Your join command failed at 46:35 because you saved 42:04 the command for joining additional controllers (--control-plane) instead of the worker node join was below (and same command obtain later at 47:04)

  • @Breckdareck
    @Breckdareck 2 года назад

    Great video! Keep up the great work!

  • @TheKingofparis148
    @TheKingofparis148 5 месяцев назад

    hello Im having some issues SSH into my VM for the master and nodes. Keep getting error : No supported authentication methods available ( server sent: publickey). Ive google this and tired a few things with no luck what did I do wrong, Im using putty to ssh?

  • @mrteladi
    @mrteladi 2 года назад

    I followed the tutorial and works great between the host machine and the cluster. However if I try to curl the URL (subnet:30080) from another Proxmox VM on the same subnet it is very slow, around 1.5minutes. curl from the host machine or any of the nodes takes less than 1s. Does anyone know what could this be? Thanks in advance