I come to the hardware from the perspective of a database-developer; how do I break 100k TPS? How do I break 10GB/sec? These questions lead me back to the hardware, and videos like this have helped cement the notion I'm on the right track. Cheers and thank-you.
I have several of the Dell PERC H310 cards running in HBA (IT) mode. These are the same as the popular IBM M1015 but have the SAS connectors at the short side opposite of the slot bracket. So they can be used in height restricting cases easier and would not have caused the cable length issue shown in the video. 😉 With some luck you get the card with both the full and half height bracket included on ebay.
Flashing these cards is easy, you can flash back too, I run 8 SAS drives on mine, they run both SAS and SATA with the correct cables....brilliant cards in my opinion. I install them into NAS boxes, they are visible in synology, VMware, freenas amd xpenology.
i bought a cheaper version of a SAS card and it runs HOTT. I got myself a 40mm noctua fan to try and reduce the heat. And i have some expensive thermal pads for the onboard memory chips ect. Does any of you have any issues with heat and how have you mitigated it? Thanks
(18:04) There's a newer version of the utility (released after the video was uploaded) that would run in the EFI shell. I tried to explain, but RUclips kept flagging my comment as spam, probably because its AI thought the file names were Web domains.
Those cards are expensive, but they are server grade, and hardly EVER fail. Theyre's a reason why they are expensive. Server grade cards need to be able to operate 24/7 and not fail when moving around lots of data on RAID arrays, like the LSI i have in my fileserver. That was very nice of her to give u that. It should last you quite a LONG time.
I've had a Dell-branded LSI fail under very benign load in a Dell-built server in 2010. Of course courier brought a new one a few hours later, but fail is fail.
It wouldn't be a bad idea to put a fan on the heat sink on the SAS control card. I have an HP server that has support for both SATA 3 and SAS type drives, but I use the SATA drives. I also use Toshiba NAS HDD's they are very cheaply priced for the quality. Even cheaper than Segate and I have had some problems with Segate drives so I use WD Gold, Red or the Raptor type HDD's if I go mechanical rather than SSD.
Any problems with those SATA connectors staying snug? I noticed that cable doesn't seem to have metal clips on the SATA connectors. I hastily bid on and won a similar cable on ebay (3ft, longer than I need) and just noticed it doesn't have the clips either. Hopefully it's works ok.
basically same hw as mine 9220-8i. I just installed LSI MR SAS 9260-8i (yes MR stands for MegaRAID) with full feature set (RAID5, RAID6 and SSD caching enabled). I would be using it for RAID6 as RAID6 over BTRFS is unsafe, but BTRFS over RAID6 is double safe (double parity on RAID6 plus checksums on BTRFS)
I have been searching for a SATA SAS and found some older cards PCI-e 8X made for 1st & 2nd generation PCI-e slots 12 years old. Is there anything newer with built in memory cache and battery backup for the SAS cards only so I don't loose a RAID or acidentally drop a drive from power surges or losses. I will most likely use Windows 10 or 11. and or Ubuntu 20.4 P.S Loved your video looking for more so I "Subscribed ", clicked the "Bell" and chose "ALL" hoping to see more videos from you. Thank You, I'll be hoping for more
Great video, thanks! I'll try and get one of those boards myself. I really liked your case, which one is it? And how did you get all those drive cages in there?
I bought an IBM M1015 that I want to cross-flash to IT mode for use with FreeNAS, which runs on ZFS. Question 1: What firmware version should I use with FreeNAS? Question 2: Is the Serve The Home Guide compatible with using the M1015 with FreeNAS? Any additional resources? I'm a crossflashing newb, so it can't be explained too slowly! :D Thanks for any pointers!
So when an HBA like the following "supports up to 240 devices as a HBA in IT mode", how exactly do you attach 240 devices? From what I've found you can only use a forward-breakout cable in one layer. So for 4 "ports" I can only get 16 devices. Surely there is a way to at least double this... www.supermicro.com/en/products/accessories/addon/AOC-S3216L-L16iT.php
It depends on whether the files are in cache or not. The best sequential reads from the disks are about 800MB/s. If the files are in cache, its limited by the network (about 12GB/s).
I haven't played about with ZFS for well over 8 years as RAID10 via my (AMD/Promise) motherboard's SATA controller was giving me much better sequential performance than ZFS, the ZFS gurus with high performing systems seem to require a sperate PC/Server with 64GB+ of RAM to get this level of performance, at the time 64GB+ RAM was a pipe dream for me let alone the expense of running a separate system. I'm a Windows Server guy (know a bit about Linux too) I run a single Windows Hypev-V Server as my Storage and Virtualisation (home lab) platform and to this day second hand RAID controllers (Mainly Adaptec in my case) have been the way to go. Lastly I work with SANs Netapp, 3PAR etc.. personally I don't believe that "Server" disks (Excluding SSDs) are significantly better life time wise than Desktop Disks, certainly not the 15K SAS versions. Its the better (loud) cooling and PSUs in Server/SAN kit that might give the impression higher reliability. Lastly I'd bet the SATA card would last at least as long LSI HBA, as one prolonged fan failure and the HBA might be toast, RAID and HBA cards/controllers require active cooling the SATA card doesn't... basically I wouldn't believe a lot of the marketing hype when it comes to enterprise reliability.
any experience with the asmedia 106x controller ? the sas controller.. also under the name stlab a-590 . mine does a 3 time loop under boot. kinda annoying..
Tho only reason we are searching for for these videos is to follow along the flashing process. It is LITERALLY the single piece if added value which the video could have provided.
Moon spells sas. Expand driver with expander card. Still everything goes through 2x12gbs so as long as they are not ssd, you may be ok. 6gbs is around 1ssd.. hmmm, bandwidth get severely limited severely fast.
Great Video Sir, Question for you . How better is that SAS HBA vs the cheap chinese ASM1061 ? for a PC used et home as a VMWare server ( old HP z800 workstation). what would you recommend ? or maybe would you just continue using the motherboard ports that are just SATA II ?
Hi, I recently found your channel and I am enjoying the content. I was wondering if you have a video explaining your zfs setup? Anyways keep up the good work.
I'm not a fan of LSI controllers. Had very bad experiences with a few of them. I can't trust them. I've had bad experiences with other controllers but none of them beat my hard drives to death like the LSI brand tends to.
Yay great to see you got it and its up and running
Kewl Chick . . . gives expensive gifts
. . . understands man
I come to the hardware from the perspective of a database-developer; how do I break 100k TPS? How do I break 10GB/sec? These questions lead me back to the hardware, and videos like this have helped cement the notion I'm on the right track. Cheers and thank-you.
Underrated channel is underrated, you deserve way more subs mate!
If your vdevs are mirrored, you can spread the disks across the two HBAs to gain some redundancy that way also.
The Dell Perc h200 is also a good cheap raid card which can be flashed as a HBA
I have several of the Dell PERC H310 cards running in HBA (IT) mode. These are the same as the popular IBM M1015 but have the SAS connectors at the short side opposite of the slot bracket. So they can be used in height restricting cases easier and would not have caused the cable length issue shown in the video. 😉
With some luck you get the card with both the full and half height bracket included on ebay.
learned a lot new things about this card. thank you!
Flashing these cards is easy, you can flash back too, I run 8 SAS drives on mine, they run both SAS and SATA with the correct cables....brilliant cards in my opinion. I install them into NAS boxes, they are visible in synology, VMware, freenas amd xpenology.
i bought a cheaper version of a SAS card and it runs HOTT. I got myself a 40mm noctua fan to try and reduce the heat. And i have some expensive thermal pads for the onboard memory chips ect. Does any of you have any issues with heat and how have you mitigated it? Thanks
Bookmarking this... is this information still valid for a windows install?
(18:04) There's a newer version of the utility (released after the video was uploaded) that would run in the EFI shell. I tried to explain, but RUclips kept flagging my comment as spam, probably because its AI thought the file names were Web domains.
Those cards are expensive, but they are server grade, and hardly EVER fail. Theyre's a reason why they are expensive. Server grade cards need to be able to operate 24/7 and not fail when moving around lots of data on RAID arrays, like the LSI i have in my fileserver. That was very nice of her to give u that. It should last you quite a LONG time.
I've had a Dell-branded LSI fail under very benign load in a Dell-built server in 2010. Of course courier brought a new one a few hours later, but fail is fail.
Aren't those the kind of drive cages that you can pull out and turn so the ports face the back of the machine?
It wouldn't be a bad idea to put a fan on the heat sink on the SAS control card. I have an HP server that has support for both SATA 3 and SAS type drives, but I use the SATA drives. I also use Toshiba NAS HDD's they are very cheaply priced for the quality. Even cheaper than Segate and I have had some problems with Segate drives so I use WD Gold, Red or the Raptor type HDD's if I go mechanical rather than SSD.
Any problems with those SATA connectors staying snug? I noticed that cable doesn't seem to have metal clips on the SATA connectors.
I hastily bid on and won a similar cable on ebay (3ft, longer than I need) and just noticed it doesn't have the clips either. Hopefully it's works ok.
@17:16 - My guy... putting the motherboard on carpet. No fear of static electricity. None.😂
With the right expansion cards and daisy chaining. Technically that card can handle 256 HDDs
It's like LTT but without fucking everything up!
and no tunnel bear ads
and no over the top voice, stupid faces and shitty explainations.
Sooooo... it's just a tech channel that has nothing at all otherwise in common with LTT.
You didn't leave the link you promised at roughly 1:00 in the description :(
It's 2021 and MSI still needs to get there shit together.
Most (if not ALL) SAS RAID HBAs are using PowerPC processors
This DOES use PowerPC processor as it is LSI
basically same hw as mine 9220-8i. I just installed LSI MR SAS 9260-8i (yes MR stands for MegaRAID) with full feature set (RAID5, RAID6 and SSD caching enabled). I would be using it for RAID6 as RAID6 over BTRFS is unsafe, but BTRFS over RAID6 is double safe (double parity on RAID6 plus checksums on BTRFS)
I would not trust Btrfs (especially RAID 5 or 6), yet. I am running my desktop on Btrfs, but my main storage is on a RAIDZ3.
I have been searching for a SATA SAS and found some older cards PCI-e 8X made for 1st & 2nd generation PCI-e slots 12 years old. Is there anything newer with built in memory cache and battery backup for the SAS cards only so I don't loose a RAID or acidentally drop a drive from power surges or losses. I will most likely use Windows 10 or 11. and or Ubuntu 20.4 P.S Loved your video looking for more so I "Subscribed ", clicked the "Bell" and chose "ALL" hoping to see more videos from you. Thank You, I'll be hoping for more
please more detail videos about this sas drives.. i have many sas drives at home. i plan to use them. Like this.
Thank you so much.
Checked out Lexi channel in 2024 and still only 3 videos.
Great video, thanks! I'll try and get one of those boards myself.
I really liked your case, which one is it? And how did you get all those drive cages in there?
I bought an IBM M1015 that I want to cross-flash to IT mode for use with FreeNAS, which runs on ZFS.
Question 1: What firmware version should I use with FreeNAS?
Question 2: Is the Serve The Home Guide compatible with using the M1015 with FreeNAS? Any additional resources? I'm a crossflashing newb, so it can't be explained too slowly! :D
Thanks for any pointers!
can be used with 4 ssd's in raid 0 ?
So when an HBA like the following "supports up to 240 devices as a HBA in IT mode", how exactly do you attach 240 devices? From what I've found you can only use a forward-breakout cable in one layer. So for 4 "ports" I can only get 16 devices. Surely there is a way to at least double this...
www.supermicro.com/en/products/accessories/addon/AOC-S3216L-L16iT.php
You hook up expansion cards to those 4 ports.
Mark if you had the money would you upgrade to SAS drives on a business stand point?
Finally...someone who actually knows their stuff.
Aren't you having temperature issues?
What kind of speeds do you get when copying files from your file server?
It depends on whether the files are in cache or not. The best sequential reads from the disks are about 800MB/s. If the files are in cache, its limited by the network (about 12GB/s).
Nicely done.
I haven't played about with ZFS for well over 8 years as RAID10 via my (AMD/Promise) motherboard's SATA controller was giving me much better sequential performance than ZFS, the ZFS gurus with high performing systems seem to require a sperate PC/Server with 64GB+ of RAM to get this level of performance, at the time 64GB+ RAM was a pipe dream for me let alone the expense of running a separate system. I'm a Windows Server guy (know a bit about Linux too) I run a single Windows Hypev-V Server as my Storage and Virtualisation (home lab) platform and to this day second hand RAID controllers (Mainly Adaptec in my case) have been the way to go. Lastly I work with SANs Netapp, 3PAR etc.. personally I don't believe that "Server" disks (Excluding SSDs) are significantly better life time wise than Desktop Disks, certainly not the 15K SAS versions. Its the better (loud) cooling and PSUs in Server/SAN kit that might give the impression higher reliability. Lastly I'd bet the SATA card would last at least as long LSI HBA, as one prolonged fan failure and the HBA might be toast, RAID and HBA cards/controllers require active cooling the SATA card doesn't... basically I wouldn't believe a lot of the marketing hype when it comes to enterprise reliability.
What is max physical Drive size I'm looking for something for 12TB
I am not aware of any limits. I have successfully connected WD Red 10TB to an IBM M1015 which has the latest IT firmware.
Hey Mark, a little ot, but I was wondering if an IBM 10 gig fiber card would work within windows, specifically this model: 00E0839
any experience with the asmedia 106x controller ? the sas controller.. also under the name stlab a-590 . mine does a 3 time loop under boot. kinda annoying..
Tho only reason we are searching for for these videos is to follow along the flashing process.
It is LITERALLY the single piece if added value which the video could have provided.
Moon spells sas. Expand driver with expander card. Still everything goes through 2x12gbs so as long as they are not ssd, you may be ok. 6gbs is around 1ssd.. hmmm, bandwidth get severely limited severely fast.
Upvote and sub for the Linux usage. Excellent.
how hot does the card get?
About to do this very thing. Were you afraid of losing your data when reinstalling your drives onto the HBA? Did Freenas throw a fit?
Shouldn't have issues with Freenas. Make sure you copy your Freenas config and your encryption key along with drive keys. No data should be lost
You can get those cables cheap on Aliexpress.
Cool to see that you were using Linux. :)
hey how did you map with it showing the serial number? i'd love that feature.
Use /dev/disk/by-id when creating the pool. You might be able to force a switchover by importing the pool with the -d flag giving that directory.
Great Video Sir, Question for you . How better is that SAS HBA vs the cheap chinese ASM1061 ? for a PC used et home as a VMWare server ( old HP z800 workstation). what would you recommend ? or maybe would you just continue using the motherboard ports that are just SATA II ?
Are these cards recognised by xpenology?
thanks Lexi, I didn't have any laying around or I would have sent him one...
what is the case model?
Looks like a Corsair 750D
running mobo on carpet...a genius...
motherboard directly on probably the greatest static electric generating source in a house, the carpet? WTF!
Hi, I recently found your channel and I am enjoying the content. I was wondering if you have a video explaining your zfs setup? Anyways keep up the good work.
I LOVE your videos there amazing. Keep up the great work.
what motherboard is that?
What is the maximum sata drive size this controller can address?
It can see drives over 2TB. Max I've used is 4TB.
well explained and very useful video
Allan Orozco true
Dat intro, DAMN
Wow,sas :) Yes CMedia is not server grade stuff
pfsense? we need ya brah
Thank U. :)
Running it on carpet ... eek
The case is grounded.. carpet is irrelevant.
@@Triple88a bonding and grounding are different.
Seagate xD Reliable xD
I'm not a fan of LSI controllers. Had very bad experiences with a few of them. I can't trust them. I've had bad experiences with other controllers but none of them beat my hard drives to death like the LSI brand tends to.
Which do you prefer?
paving is NEVER fun
He said ballz......🤣
Oh no, please stop touching, fingering the screen!
Thanks, even it was a very old video, I've got some ideas and helpful info.
This is unacceptable LCD abuse. It's physically painful to watch someone gouge and poke at an LCD panel like that.
Seagate more reliable than Western Digital ? 🤣🤣🤣🤣🤣🤣🤣
However they are more trustworthy considering they don't lie to you about whether you are getting a SMR drive or not.
17 mins of useless rambling geeze... please summarize