hi,, might be worth mentioning that fio can destroy data in disk if not used properly. cutting an pasting commands makes it too easy to do harm on a running system.
Great how to video. I take it that since true-nas is open source platform you can run these scripts you highlighted. When it comes to synology nas systems you have to use their built in tool sets. Which would make true-nas better in the sense that you can generate reports unique to your system setup. Is my understanding here correct?
Lately I'm pretty frustrated with TrueNAS, having it virtualized (proxmox) and attached/passthrough my SAS controller, I only manage to get 20-30Mbps of transfer speed (13x 10TB Raidz2 setup) and I don't know whats going on. My 12 old Synology keeps a steady +-100Mbps transfer speed. I know it's very vague and all, but do you - or the community have an Idea what I'm doing wrong, how I could speed up my NAS? Thanks
@@AngryElPresidente I stupidly didn't bother testing my homelabs performance thoroughly and set my mind to use Proxmox so now that my homelab is running, including my firewall I'd have a bad time explaining to the misses that the internet will be down for a given time lol But what would you suggest I test? XCP-NG or even ESXI?
@@didjeri If possible I'd run TrueNAS on baremetal and check the performance there. Could help find out if the problem is the VM configuration or your physical system
@@AngryElPresidente Oh right! I might try TrueNAS Scale baremetal once it gets more stable. So that could probably work out great! Thanks for the idea
Run iperf between the host and destination. That will tell you if it's a network issue. You may not be using VirtIO for your network adapters in proxmox.
An old video but I m going to give it a shot. So ...... I am running fio with other parameters and engine (not even sure are the correct ones but its not the point here) like fio --directory=/mnt/test/ --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G My issues are: where do I run fio? If the VM storage I want to test is in HHproxVM for instance, should I fist cd to that storage cd /HHproxVM and then run fio from there or run it from the boot-pool and specify as directory=/HHproxVM/mnt/test instead of /mnt/test I had very weird results by changing only the directory option like below fio --directory=/mnt/test/ --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G Result: WRITE: bw=149MiB/s (156MB/s), 149MiB/s-149MiB/s (156MB/s-156MB/s), io=1024MiB (1074MB), run=6884-6884msec fio --directory=/HHproxVM/mnt/test --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G Result (didn t even finish after 30 min!!! and the bw and iops are wayyyyyyyy less) async_randwrite: Laying out IO file (1 file / 1024MiB) Jobs: 1 (f=1): [w(1)][63.1%][w=428KiB/s][w=107 IOPS][eta 12m:56s What am I missing here?
Unrelated to this. But question, could you do a guide some time about how to get things like streaming devices to work across different vlans? I put my iot devices on a different vlan using your guide. But now if I want to cast to the streaming device from my phone I have to switch the wifi network on my phone to the iot vlan, then switch back after I’m done. Has to be a better way.
@@LAWRENCESYSTEMS I’ve never heard anyone say a phone is an IoT device before. But in either case, I use my phone to connect to things on the normal lan network too, so either way I’d have to switch it back and forth between wifi networks then.
I use pfSense to manage the VLANs across my network. I actually have like 6 VLANS and several of my MikroTik switches are working great with it. Don't try do anything fancy in creating the VLANs in pfSense. Just treat them as a separate network with it's own DHCP server and DNS. Create the rules to allow access or block access to the WAN / LAN. Creating VLANs in Mikrotik is a bit daunting at first but once you've done it a couple of times it's not too bad. Plenty RUclips videos explaining how to set one up.
Why not make a video on ZFS data set tuning on truenas?
hi,, might be worth mentioning that fio can destroy data in disk if not used properly. cutting an pasting commands makes it too easy to do harm on a running system.
Great how to video. I take it that since true-nas is open source platform you can run these scripts you highlighted. When it comes to synology nas systems you have to use their built in tool sets. Which would make true-nas better in the sense that you can generate reports unique to your system setup. Is my understanding here correct?
Latency of storage is big for end users.
Lately I'm pretty frustrated with TrueNAS, having it virtualized (proxmox) and attached/passthrough my SAS controller, I only manage to get 20-30Mbps of transfer speed (13x 10TB Raidz2 setup) and I don't know whats going on. My 12 old Synology keeps a steady +-100Mbps transfer speed.
I know it's very vague and all, but do you - or the community have an Idea what I'm doing wrong, how I could speed up my NAS?
Thanks
Do you experience the same kind of performance if you try testing on another system on baremetal?
@@AngryElPresidente I stupidly didn't bother testing my homelabs performance thoroughly and set my mind to use Proxmox so now that my homelab is running, including my firewall I'd have a bad time explaining to the misses that the internet will be down for a given time lol
But what would you suggest I test? XCP-NG or even ESXI?
@@didjeri If possible I'd run TrueNAS on baremetal and check the performance there. Could help find out if the problem is the VM configuration or your physical system
@@AngryElPresidente Oh right! I might try TrueNAS Scale baremetal once it gets more stable.
So that could probably work out great!
Thanks for the idea
Run iperf between the host and destination. That will tell you if it's a network issue. You may not be using VirtIO for your network adapters in proxmox.
An old video but I m going to give it a shot. So ...... I am running fio with other parameters and engine (not even sure are the correct ones but its not the point here) like
fio --directory=/mnt/test/ --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G
My issues are:
where do I run fio? If the VM storage I want to test is in HHproxVM for instance, should I fist cd to that storage cd /HHproxVM and then run fio from there or run it from the boot-pool and specify as directory=/HHproxVM/mnt/test instead of /mnt/test
I had very weird results by changing only the directory option like below
fio --directory=/mnt/test/ --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G
Result:
WRITE: bw=149MiB/s (156MB/s), 149MiB/s-149MiB/s (156MB/s-156MB/s), io=1024MiB (1074MB), run=6884-6884msec
fio --directory=/HHproxVM/mnt/test --name=async_randwrite --rw=randwrite --bs=4k --direct=1 --sync=0 --numjobs=1 --ioengine=psync --iodepth=1 --refill_buffers --size=1G
Result (didn t even finish after 30 min!!! and the bw and iops are wayyyyyyyy less)
async_randwrite: Laying out IO file (1 file / 1024MiB)
Jobs: 1 (f=1): [w(1)][63.1%][w=428KiB/s][w=107 IOPS][eta 12m:56s
What am I missing here?
can you plz create a video how to use gpu related ioengines in fio
Unrelated to this. But question, could you do a guide some time about how to get things like streaming devices to work across different vlans? I put my iot devices on a different vlan using your guide. But now if I want to cast to the streaming device from my phone I have to switch the wifi network on my phone to the iot vlan, then switch back after I’m done. Has to be a better way.
Your phone is an IoT devices and it should be on the same VLAN as the other IoT devices.
@@LAWRENCESYSTEMS I’ve never heard anyone say a phone is an IoT device before. But in either case, I use my phone to connect to things on the normal lan network too, so either way I’d have to switch it back and forth between wifi networks then.
@@slipknottin I'm using PFSENSE at home and I've got the same issue. I tried both avahi and pimd along with igmp proxy to no avail.
@@slipknottinI don't understand. Why don't you just set up access control lists to allow your phone to traverse VLAN's without issue?
I use pfSense to manage the VLANs across my network. I actually have like 6 VLANS and several of my MikroTik switches are working great with it. Don't try do anything fancy in creating the VLANs in pfSense. Just treat them as a separate network with it's own DHCP server and DNS. Create the rules to allow access or block access to the WAN / LAN. Creating VLANs in Mikrotik is a bit daunting at first but once you've done it a couple of times it's not too bad. Plenty RUclips videos explaining how to set one up.
how do i do it on windows