Configuring Storage in ProxMox
HTML-код
- Опубликовано: 13 сен 2024
- Commands Used:
------------------
fdisk /dev/your_disk
fdisk /dev/sdb
g
w
zfs create pool_name/data_set_name -o mountpoint=/mnt_point
zfs create ZFS01/Data01 -o mountpoint=/zfsdata
Referenced videos
------------------
Installing ProxMox: • How to install Proxmox...
ProxMox Initial Configuration: • ProxMox 7.0 Post Insta...
---------
Facebook - / h2dc-how-to-do-compute...
Twitter - / how2docomputers
Instagram - / howtodocomputers NEW H2DC Discord - / discord
Best video I have found on setting up proxmox storage. Simple, clear, and to the point. Thanks
Thank you! Let me know if there's any other specific content you're interested in seeing!
Hands down the best video I could find explaining this to new Proxmox admins. Thank you so much.
You're very welcome!
Concise and very specific to details. Couldn't have asked for a better tutorial!
Thank you!
LVM-Thin is just for local storage, but I always use it if not using ZFS. And I love ZFS, but it is slow and troublesome in old and/or weaker hardware. It will also consume a lot of resources even in recent hardware. The main thing about LVM-Thin is setting the metadata partition correctly (which depends on the chunk and disk sizes). It can be confusing and overwhelming when doing it the first time, but it is well worth the hassle, since it enables snapshots and gives you an easy way to expand your storage pools. Also, I tend to use XFS if not using ZFS. It is fast and reliable.
Could you recommend a video for the lvm, I need to expand it?
How can I set up a raid 5(want 1 driver failure protection) in proxmox such a way so that I can keep adding HDDS to that raid 5 for storage expansion? could you suggest me a tutorial?
@@whocares3132 ZFS is great, but expansion is not as easy as traditional RAID. If expanding frequently is important, you may want to use traditional RAID with another filesystem (ext4, xfs, etc). I would probably have a look on how unRAID does it and apply that to Proxmox.
Yay, someone with a setup similar to mine!
Using a Dell R720 as a homelab. Flashed the H710p mini raid controller to IT mode, as I want to use ZFS instead to learn it. I have 7x 3tb drives and 1x 14tb. I want to use the 14tb as a NAS/back up location for many other things. This video has exactly the information that I needed. Already looking forward to the next suggested video as well.
Thanks, exactly what I needed. I'm using all three of your examples, added disk, a mirror pair of other disks in ZFS, and an NFS mount to my NAS.
Por fin, alguien que enseña lo que necesitaba, gran video.
Thank you. Have been struggling with this for sometime. Very informative.
Glad it was helpful!
7:20 thank you for explaining datasets under ZFS pools
You betcha!
I love these Proxmox tutorials. Best one's ive seen so far!!!
With LVM, you can resize flawlessly. Easier to manage multiple drives and partitions.
Yes, and how about ZFS?
Thank you, you are easy to listen to and your instructional videos are very well done, Thanks for taking the time to do this.
Great video!! I was having trouble adding storage after watching this awesome video I should have no issue. Thank you 🙏🏽
Great video, just one clarification, ext4 is NOT limited to 2TB while under GPT, only when using MBR.
Subscribed. Thanks for sharing in such concise way.
Thank you so much!
I noticed proxmox 8 is installed on LVM so it's good you explained it some. Also there is a disk wipe utility on the disks page but you didn't mention it. Maybe you don't like it? Now I see it isn't on the version you are using 2 years ago. Thank you for your video!
Thank you so much for taking the time to create these fantastic Proxmox videos! How did you convert that p420i to HBA mode? Did you have to use the ssacli?
update: I found a repo to get hpssacli :-) - so all good on that
Hi, glad you found it!
OMG This was Golden. Thank you
Great Video! Thanks for the help!
Great video! Very helpful for my newbie self. Much appreciated!
Great to hear! Let me know what else you're interested in seeing!
Great video just what I needed thanks
Excellent Video, Thanks a lot
You are welcome!
Since I have one M2.SSD Samsung I selected ZFS single drive for that drive.
Thanks! Great guide :)
Many thanks for the video! I set up a 4tb mirror RAID storage in Proxmox. What's the fastest way to transfer the media from my NAS to that Proxmox storage? I would like to use my LAN to do this. Many thanks.
Thank you so much
You're most welcome
How to do computers 😂 yeahhh babyyy ❤
Great video. But how can i now create a folder under the created ZFSData? it don't show up under Disk!
Amazing content and Nice channel. 👍
Excelent video, but i'm confused on the reason why you create the ZFS dataset as a directory on the datacenter level and note at the node level, where the ZFS pool is hosted. As you only have a single node, why not create it at the node level? As I understand it, items create at the datacenter level is to be shared for all the nodes... And suppose you had many nodes, there is no indication in the datacenter directory entry who specifies on which node this mountpoint is. This add to my confusion. I will continue my research.
Really appreciate this video, I have so.many issues with lvm and why the default proxmox install, could you cover more on a Video!!
Hi,
with ZFS directory: The current guest configuration does not support taking new snapshots
It sounds like you're running a storage that doesn't support snapshots. Check out this list for disk/storage types that support snapshots:
pve.proxmox.com/pve-docs/chapter-pvesm.html#_storage_types
Thanks. very well explained.
You are welcome!
Would love to know how u install the boot partition on a seperate drive like you did here 2:03
I like your video. Just wondering how I can pass some of my drives natively, though. Any suggestions ?
Thank you very much. Do you have a video that talks about HA storage in Proxmox? Can I use the local storage in all my VM's in a cluster to replicate to allow for some sort of HA storage cluster?
I did exactly how you mentioned in the video, but how do I add that folder to the scrypted NVR?
it gives me a field to add the directory location.
Hello, could you make a tutorial on how to spin-down hdd in Proxmox? thanks in advance!
Are these disk storages created a physical or a virtual one?
What would you recommend for a homelab environment of 3 PCs with internal storage, for storage setup if there's an existing NAS for bulk storage? I.e one SSD internal drive per node, only to be used for VM / CT storage and backupsz etc. ZFS / CEPH the three internal drives (one drive per machine)?
It really depends on what you want out of them, there's so much you can do! You could install one of the big 3 hypervisors (ESXi, Hyper-V, and ProxMox) on each and practice setting up the same environment in each. Maybe pick up a cheap router from a thrift store and flash dd-wrt on it and put them on different subnets and practice having them talk to each other. Or you you could try clustering in ProxMox which requires 3 nodes and set up an environment with high availability. Or you could set up 1 for "production" for services you'll use, 1 for backup, and 1 for crazy testing sandbox. Really such a broad question, the sky is the limit!
The Proxmox web GUI has the capability to "wipe disk" and "initialize disk with GPT" with the two buttons shown at the top of the "Disks" page. Why did you use the command line instead of the GUI?
When you know the command. You will likely to use the CLI instead of GUI. CLI is like 10 times faster. It did look weird in this video because creater had to show us all the steps.
I used a proxmox backup server, which I would now like to run as a virtual machine. I would like to mount the ZFS pool from the backup server in proxmox and use it there in the virtual backup server machine. I have mounted the ZFS pool with zfspool import command and can see it on the left in the overview. Unfortunately, I can't use it in PBS and I don't know what to do, I don't want to delete all my backups and start over.
How did you put the OS on an SD card and delete the default data stores that come pre configured? I want to have proxmox on the SD card to boot off of and then put all ISO, images, etc on another drive.
Pardon the question, I'm not a professional and I just got into this. You mentioned it is possible to install virtual machines on the same storage that Proxmox is installed to. I'm having trouble finding information or steps for doing this. Perhaps I'm not using the correct terminology while searching. Any tips?
Hi there! I should do a video separately on that subject, but for now I can link you to this:
ruclips.net/video/R0Zn0bdPwcw/видео.html
This is a video I did on some post-install configurations I like to do.
If you go to timestamp 1:18 in that video, you should see the steps on how to set this up!
How can I set up a raid 5(want 1 driver failure protection) in proxmox such a way so that I can keep adding HDDS to that raid 5 for storage expansion?
Thank you for the video, I understand usually what can I do to add more storage in the proxmox.
After I do the tutorial on my machine, I see I have selected creation for new pool with both hard disk who is a sample size
and selecting by mirror option equalise not add proof artist to equalise.
Example, I have selected both hard disk a 512 GB must equalise one terabyte?
can you help me to understand what the problem are?
and how do I delete the directory that was created by /dev/sdb?
6:15 Is single disk same as RAID 0?
Not necessarily. A single drive can be set up as a standalone drive, but if you have a server with an onboard cache, it may need to be configured in your RAID controller to take advantage of that.
For more community discussion, check out the new H2DC Discord Server! - discord.gg/cvSj2QGXqw
Hi thanks for the video, I’m setting up prox mox now to boot to mirrored 64g SSD’s. I got it created a question is is it normal to have three partitions on a boot disk? So for each 64 GB disk I have three partitions. Thanks, Mark
That sounds about right. On eht ProxMox boot drive, there should be one labeled BIOS Boot, one EFI, and one LVM. At least that's how my installs turn out.
@@h2dc Yes that’s the names of the three partitions. thanks for confirming I thought I was doing something wrong. Another question is it wise to over provision that drive so for example it’s 64 gig I’m mainly using for OS should I shrink it to 50 ?
I've personally not encountered any issues giving proxmox the entire drive, as long as there is room for the other required partitions.
If possible to Migrate VM from VirtualBox or Physical PC to Promox, if possible and how to do that Step by Step.
I don't have a video on how to do this, but I have had success doing this with Clonezilla before, perhaps look into that?
I keep getting "storage "ISO" is not online (500)". I checked the forums, but everyone's problem is very specific.
For whatever reason, ProxMox isn't able to reach the storage, is it a networked drive?
What happens when you try removing the storage and re-adding it?
@@h2dc I'm not an IT professional. Just a noob so go easy on me.
I was following your steps. Up to that point you talked about setting up a network share and doing a different video for that topic.
I went and looked for documentation and couldn't find anything.
Removing and re-adding has the same effect.
Sorry about the late reply. And no worries, we all have to start somewhere.
Going back to the original question, Is the storage you're trying to connect a SMB/NFS Network share or is it a local drive on the machine itself?
If so, is it on a domain, and are you using an IP address or DNS address to try to connect to it?
can i boot iso directly from network share?
Does Proxmx support IT Mode RAID controller ?
command line font is to small
Can we not passthrough a disk to a vm? Reason I ask is to allow the testing of proxmox without whipping out data from doner system.
Not sure if I'm understanding the question correctly, but it's not necessary to pass through any disk to a VM if you don't need to.
Hello, I am using proxmox. suddenly it has gone emergency maintenance mode and showing i/o error sda. how can I resolve it?
A few questions:
1. Is this a single disk, or part of a RAID volume?
2. How much free space is there on the disk?
3. Have you made any recent configuration changes that may affect the hard disk
4. Have you had any power failures, or has the drive or drives been taken offline unexpectedly?
5. How many other disks are there on the machine, or is it just the one?
That issue often points to a drive failure of some sort, but a few things can cause this issue.
Pardon my question, so if my ssd is attached in sata, I'm fine to create zfs pool? And what is hbp mode? Thanks
You should be good to use ZFS with an SSD attached via SATA. HBA Mode is a mode on some RAID controllers that allow the hard drives to be handles by the operating system rather than by the firmware on the RAID Card. Usually applicable only to server hardware, or is you have a SAS/RAID controller installed in your build.
Any chance you could cover sharing a local usb drive connected to Proxmox via Samba? I'm trying to make a Plex media drive available to HA. - Thanks!
Hi Nick,
Unsure I'm interpreting this correctly, but are you requesting a video on taking a hard drive that is physically attached the ProxMox host, creating a network share from it, and then adding that into Plex on HomeAssistant?
@@h2dc spot on. That is exactly what I am looking at doing.
I'll definitely add that to the list. I apologize, as I haven't had much spare time recently to work on uploads.
Hi! Can you help me? Why useing ZFS system too much storage? I have nine HDD. Twelve terabyte a raw.(6x1TB and 3x2TB). I make two RAIDZ(1) in a ZFS.
In the end a have 9 TiB usable space.(5TiB and 4TiB) That's fine.
When i create new virtual machnine and add 2500 GiB sized HDD-s, the system is use 95% or more from the array. The 4660 GiB sized array is gone. Why?
I have never encountered anything close to this, so I'm afraid I don't have much to offer. I would try asking the guys over on r/ZFS or r/ProxMox if anyone has encountered this before. Sorry I can't help more here.
Raid is the issue, not ZFS. I’m raid the array will mimic the smallest and slowest disk. You use 1TB and put in 9 disk, thus you have 9TB.
I heard p420 so it is a gen8 380p?
It is Gen8, but this machine is a 360p. Although I do have a Gen8 380p as a file server in my homelab environment!
@@h2dc ive got the same in my LAB ;) The one with 768gb capable RAM and 2port SFP+ card - the original 4port Gigabit card is laying around if you need it. Whats interesting on them is that the expansion cages have only lanes to one of the two cpu-slots. They have also lanes between but if you install the os on a pci-e slot (per nvme or ssd expanders) it can only use half the power. First i installed my os on a ssd that gets power by pci-e but is cabled into the odd-port. But I think about buying a cage for the second expansion slot or are the 2 pci-e ports for the cage also without cage useable? Did you test that once? With that i could install one Proxmox at each half to carry the redundancy of the hardware on software lvl. I also thought about installing two proxmox on the oddport by using another OS - but i dont want to loose the abilty to use energy modes and stuff in proxmox. The nice thing would be that i only have to run one more maschine to get HA running. What do you think about that idea?
@DigitEgal Thank you, however I have a lot of unused network hardware lying around as is, I've been trying to clear things out. As far as running several instances of ProxMox on one machine, that's something I really haven't played around with too much aside from a bit of nested virtualization (which might be a possible solution for you?). I know on one of my other machines (DL360e) I have a PCI adapter that does 1 port m.2 sata and 1 port NVMe, but I had to install GRUB on the SD slot since those machines won't allow you to boot from the PCI slots. It's currently running ProxMox on the NVMe slot, with the VMs stored on the m.2 SATA drive attached via the onboard SATA slot. You shouldn't be having power issues if all the discs you're using are m.2, or really at all. Sorry I can't be more help on this one. Just out of curiosity, are the PSUs in your machine the 460 watt or the 750 watt ones?
I am setting this up now for about the 10th time I can’t seem to get the storage configured right for my hardware. So I have 2 64g Sata doms which I want to configure in a ZFS mirror for the OS.
Then I have 2 NVMe 1tb drives that I want to mirror in a ZFS to run The VMs ect.
Then I have four Samsung 860s 1tb that I want to use for storage, run VM‘s ect not sure yet but possibly set up in a raid 10.
Then I have a couple of 14 TB That I want to mirror for mainly storage. Not sure if I want to install on the same machine I may install these on a freenas box.
Thanks and I would appreciate any input in on the best way to configure a set up like this. Looking for the best combination of speed and redundancy. Thanks again.
Hi mark. I think I understand the sort of configuration you're going for here, but what is the exact issue that you're running into?
You guys have no clue how this is changing my life. I am new to Proxmox, Hypervisors and containers. Just getting my lab setup now. If I have got this far, it is only and only because of this channel. I am having a hard time setting up the storage. I am newbie and please excuse my lame questions. Below are what I see in the disk section. And when I go to the directory, to create directory, it is empty. I am sure there is something I am missing. I have SAS drives and I have set up RAID 5 on this machine. Any advice is greatly appreciated.
/dev/sda unknown partitions 12.00 TB Yes PERC_H710P
/dev/sda1 partition BIOS boot 1.03 MB Yes
/dev/sda2 partition EFI 536.87 MB Yes
/dev/sda3 partition LVM 12.00 TB Yes
Hi, sorry to get to this so late. I'm glad to hear that the channel is helping out! If you like, you can join the Discord and we can discuss this in the tech-support channel and hopefully get this resolved!
discord.gg/cvSj2QGXqw
I hate lvm , honestly I'd rather have btrfs for prime o/s storage..as I'd like proxmox to be able to do snapshots for the os itself...
then zfs for for etc..
sorry im a noob. i have hardwaree raid with 1 boot +5 hdds, if not zfs then how can i use them? could someone atleast point me in the right direction? justt bought a custom 4u server and trying to work all the kinks outt so i dont screw it up after i upgrade it and max it out. Great video btw im subscribing!
Personally, if you have 5 HDDs to work with, assuming they're all the same size, I would try out a RAIDZ1 configuration and keep the 4th as a backup/spare. But there are a bunch of different ways you can configure this hardware setup. Good luck!
Makes a storage video to explain storage, totally ignores LVM :/
Uh, no he didn't.
hello... so fast !!! i can not follow you thanks a lot
Maybe start with telling people that your knowledge about LVM is limited, before you start talking about it. As LVM a Volume Manager which can do many interesting things including snapshort and dynamic volume resizing.
Including what? Snapshort? What is that for? Snapping and shorting I guess 😁
"Limited Knowledge-itis" is an everlasting universally suffered incurable condition. Unfortunately, our bodies lack the ability to create antibodies.
Pro tip:
Assume this every time you click a link and save the world from a hellscape of redundantly prefacing every last utterance with the obvious.