I'll mention my Powershell remark here to clarify it a bit. For Windows, Powershell is a massive improvement and has made some great changes. Linux/UNIX/POSIX was already there though. There's no reason to switch when what you have is already very good. It's not a "grass is greener on the other side" situation. Both fields have green grass, so why climb the fence? Also, it turns out the file I converted with ffmpeg was originally 8GB, not ~600MB. That seems much more like the encoding differences I've seen in the past.
Modern powershell does have some deep functionality that I don't see from POSIX. Powershell takes the "everything is a file" philosophy to a "everything is an object". A lot of unixy shell operations that necessitate grep,awk, or find are much simplified by this, since rather than commands passing in and out raw text information (e.g. tab or space separated fields, grouped by newlines), they output real objects with named fields. So rather than awking the 4th tabbed element of every line, you can say $output.Filename or similar. Not necessarily grass is greener, but there may be more at play than many linux centric admins realize. (I'm certainly not knocking linux/unix, I prefer it myself for most things, but I am occasionally forced to use Windows for work and am surprised by how right they get certain things)
Well if Powershell is an option, it obviously means someone wanted a powershell option enough to have one. So there's at least one person in the world that prefers managing Linux using powershell rather than some linux shell interface. Maybe they were taught using powershell, or maybe they have used powershell for a longtime, and it's what they enjoy. Or maybe Powershell has some feature that isn't present in linux shells and they consider it essential. In any case: user preference. (edit: corrected typos)
gigaherz I don’t know if it’s more because for the user experience but it’s useful to have the same build script or something for both developing on Windows and deploying on a Linux server. But it’s funny that PS has both ls and dir aliases to the same command.
Hey AkBKukU, I just want to say, thank you for doing these videos! Watching this video inspired me to ditch FreeNAS, grab a more powerful motherboard and CPU, and use my "server" as a real server using Ubuntu. Now I'm on my way to compressing a bunch of absurdly encoded files with FFMPEG at super speeds! :D
It's hard to think about numbers like that. Nearly 2 million people have watched one of my videos? That's just crazy. As of right now, 353,792 of those views are from the US. So out of around every 1000 people I walk past, 1 of them has watched that video. It's also crazy that 82% of the views are international! That is the part I was least expecting but it's awesome! I love that the internet lets you instantly share stuff like this around the globe!
@@TechTangents Oh wow, that one in 1,000 stat is amazing to think of. It was a great video and you certainly earned those views! Hi from Australia by the way :P I've been meaning to send you something since before the first mail time but I need to figure out some logistics and setup stuff first. Still the same address as the one you DM'd on Twitter in July? Or should I DM again for a new one?
That's no problem! Take all the time you need. It's actually a bit relieving to hear you hadn't sent anything yet. I've got other people's mail in my box a few times and I was concerned that the letter you wanted to send may have been mixed up and lost. It is the same address, today is actually the day I need to renew my PO box as well, I should go do that right now...
I know Linux/Unix guys like to hate on Powershell. But it is pretty decent. It can be a bit verbose but there are default sensible aliases and you can make your own. However I come from a Java / C# / Python programming background and had to write some powershell. So I think it is pretty decent.
It's pretty awesome that you're going to LTX and doing some stuff with Linus. Can't wait to see what you bring. I've been watching you and druaga for a couple years now and didn't see this coming lol
I know it’s been over 8months since this video came out. I also guess not a lot of people ask about LTO tape drives as it’s old tech, but I have a big interest in it and would love to see an in-depth look at LTO tape drives. Like setting them up, installing them in OS and in general the commanding. I have a LTO-2 drive and a LTO-5 drive just waitIng for some life, I don’t know if you’ve looked at all at LTFS but perhaps a future video into that field would be greatly appreciated! Keep up the fantastic work 👍🏻
I've been using software raid 1 on a Debian home web server/file server for quite a while without any issues. I did have to replace one of the drives a while back due to failure which was pretty straight forward. Personally I don't think software raid deserves the bad reputation some seem to give it. I get that a proper raid card will offer battery powered (or flash) backup, cache etc... but out of the cheap options I'd pick software raid over fake raid any day. I do have servers with battery backed raid cards but opted to use an old workstation for the home server as it's cheap enough to leave running 24/7 without any surprise electric bills.
Fedora is also a great option too if you want inbetween semi-latest packages of ubuntu and the stability of centos. Also it comes with Cockpit out of the box.
The Tape reader, the caddy you can take the metal bracket off thats blocking the front of your tape reader, I've had 3 of these cases I got from work, I used 1 of them for a while, parted them out and sold them.
Have you seen the SwissMicros clones of classic HP calculators? Also just a guess and probably already been solved but the caddy that holds the tape drive it looked like the metal part thats in the way had screws on its side to remove it then turn the caddy around to make the the drive sit flush with the front.
I have seen those, I would love one, but they're pretty much just as expensive as tracking down an original one. The screws are only there to hold the metal in place, it's all one stamped piece. I could cut it, but really it's not worth the effort unless later on the tape door clearance becomes an issue. I see a lot of drives with the door removed on ebay. I wonder if this is why.
Is it maybe a defective piece? I can imagine that that lip should be bent down flush with the bottom of the drive as a support piece. It could easily be remedied with two pieces of flat steel, a vice, and a hammer.
Does this board support PCI passthrough? If you are going to install Windows you might be able to run the Linux part headless and have Windows use the GPU directly. You could also virtualize FreeNAS for your storage but you will need to use the passthrough in your controller card so it has direct access. BTW, I prefer software raid because it is easier to recover from a failed controller card and because I don't trust raid controllers to tell the truth to the OS about flushing buffers.
Before you throw money on a consumer grade 1000W PSU look for a server-dedicated used one made by Delta Electronics (they're the most reliable). It's not as easy to find, but you can get one for 100$ or less because it's a niche product with very limited market and companies usually prefer to buy new parts, not used. Providing you dust it off every now and then it will last for a lifetime, I've never seen one failing except for catastrophic events like a huge power surge and even then the server itself will survive. Regarding splitters: why don't you make one that fits your needs? It's just a 4 wire connector, you can easily build one with as many output connectors you want using parts from other splitters or even from a dead PSU.
You can probably find used OEM workstation/server PSUs cheaper, and they are very cheap, sometimes less then 50$, especially if someone offloads them together with an old case. They are very reliable as well
@@TheRailroad99 OEM parts are fine providing they're fully compatible with other platforms, which not all of them are. Generally speaking Dell, Compaq and Fujitsu servers tend to have custom connectors and dedicated PSUs that you can't easily swap on other systems. IBM and Intel servers usually come with the best quality and universally compatible OEM power supplies (often manufactured by Delta as well). You can also find decent PSUs inside NEC and Telekom workstations.
@@griffin8062 For ssds not that much, but for hdds possibly. They draw more power. If the divider has a too flimsy and thin cable it may limit the current, and maybe make some setups not work propperly.
@VideoCommenter With ssds it probably isnt the issue. The biggest one wich i didnt think of initially is the bad connection, that with a vibration of airflow, could lead up to a failure in the connection for a brief moment and maybe cause data corruption. This happened to me, well i had the cable basicallt dangling down of a opened case, but you get it.
Heh. I'm really enjoying this video series. I would have taken a nibbler to that flap on the 5 1/4 bay ages ago. Can it be unscrewed? There do appear to be screws around it.
Thanks for sharing that build. I'm, starting with the tapes myself and really enjoy it. It's a shame You lost ipmi, but with all the convenience, it's only a nice bonus.
I don't know how it's going to play out. I'm going to be in my booth answering questions all day. So I don't know if I'll even get to walk around and see stuff let alone have time to set up a camera and film. But I will be bringing it just in case I do. I would love to get some footage while I'm there.
Usually, LTO tape drives are able to read/write to the last generation and read the generation before that. So my drive can read/write LTO4 and LTO3 as well as being able to just read LTO2.
Random boring kinda related anecdote. The boot drive for my old server was a hard drive hot glued to the top of the remote management card. It's much better now though, I've modified the bracket for the PCIe riser on my new server so I can mount a hard drive to it. I don't need any expansion cards in the server so it doesn't matter that it's in the way of the slots. I apologise for the incredibly boring nature of this anecdote.
Great content. If you wanted to do some video shorts, you could cover some of the linux commands, utilities you use. Watching this series, I stopped and checked out several of the utilities you used/scripted. Or maybe I'm just a noob.
Isnt that weir bracket interfiering with the tape drive's cover as well?? Like the top of it is blocking it or it's the case? I just want to see that bracket burn tbh
Do you have any tips for getting an LTO5 or newer drive for a decent price?.. I'd like to have long term storage of infrequently accessed data, and LTO seems like the best bet. But the initial cost kind of sucks...
Not sure if this will help, but the 1100w PSU in my T7500 is actually ATX. Your cable requirements may still require some soldering, but at least you’ll know it has the grunt to back it up. And I’m sure you can find (probably the whole machine) dirt cheap.
So, something to know about ZFS is there are recommended limitations for vdevs. Multiple of 9. Though most people recommend avoiding RAIDZ and using mirrors if you want speed. I'd do a bit of research before moving fully over. I setup 12 8TB drives, though I used RAIDz2 as its archive only. 6 per vdev.
if i had remembered this sooner i would have mentioned it sooner, but you can dremel out the back of one of the pcie 8x slots for a video card if you wanted to. most (if not all) video cards will not be bottlenecked by an 8x connection. putting the video card right up against the side of the case will choke the card :(
How come your using LTO-3 Tapes where LTO-4 Tapes have twice the storage and a much faster transfer speed for archiving footage? For almost the same price. Only curious...I got a LTO-5 Drive recently and looking forward to archiving everything I have.
@@TechTangents Any chance of that tutorial on setting up the LTO Tape Drive? It would be so interesting to see how this is done. I have a LTO 2 and 5 drive but just finding it complicating to even set one up. Just the basics of the software configuration and then the installation of the drive would be fantastic. Keep up the good work!
Just a little question : why not using ESX, Hyper-V, Xen or whatever as an OS? I think it's a little weird to use that type of server as a standalone, it's usually used as a virtualization server to have as many VM as you want, it's a little limiting to install Ubuntu Server and only that. Ubuntu Server, Windows Server or whatever are usually in the realm of VM or cheap 1U server with 1 CPU, at least in more "professional" context, not beasty 4U server with dual-CPU, a shitload of RAM and that many SAS ports. (Yeah, ok, I guess if you use it as a rendering server, a VM won't have the same performance, but the difference is now almost non-existent, especially with GPU rendering since you can assign GPU to a VM and it can use it directly).
I love Samsung SSDs. They come in a metal case instead of plastic like most other manufacturers ones. Temperatures always seem to be lower due to that.
You actually can use the text installer for a desktop install. It’s the netboot/mini iso. Slightly obscure, but it exists and IMO it’s the only iso you should ever use to install Ubuntu because it downloads the latest of the packages you want to install rather than including outdated versions in the initial download that you then need to upgrade after you install. Plus you can pick other packages to install while you’re at it so you can walk away and come back with everything you need installed. help.ubuntu.com/community/Installation/MinimalCD
Just make a two mirrored pool, raid5 is expensive in *everything* except space efficiency and also unusable in production class boots for systems, I have never had a problem with a good raid10 like "MBOD" or mirrored bunch of disks via zfs. If this thing has even halfway viable efi then you can put grub inside the efi part and boot right off of a near enough raid10. Just prep the pool; sgdisk -n:0:+512M -t1:EF00 -n2:0:0 (-n2:BF00 optional imo) /dev/sda,b,c,d zpool create -o ashift=12(explicit is always good with this) -O mountpoint=none (for inheritance reasons as mount points don't play nice under linux as with solaris) -O compression=on (its free real estate) goodname mirror /dev/disk/by-partuuid/sda,b mirror /dev/disk/by-partuuid/sdc,d There is a lot of problems with races and zfs and systemd, there are a many complex solutions that don't light my fire so I just set the rootfs as legacy mount and fstab is fine.
I also have so many efi parts of course to have redundant backups of both grub and the efi loaders to boot my pool even if it's TWO disk degraded and I'm lucky enough to have it be the two disks that still enable operation.
Yep! It happen with the iMac video. With this server being done I'm getting close to ready to do a video on my setup. It's taken me a couple months to catch up all my computer hardware with the camera because it is crazy when it comes to the bitrates.
@@TechTangents why not just shoot 2k raw? I mean 4k is kinda overrated and I still watch videos between 480p (on my phone) and 1080p on my desktop. It's even worse when it's running at 60fps for no real reason, my computers are powerful enough to process 60fps but RUclips constantly freezes anyway. It still makes sense to have that hardware even if you shoot 2k but you could save some time and money on backing up if you just shoot 2k/2.5k since your camera if I remember can still do that.
@@coolduder1001 I was pretty sure but I double checked, the camera can only shoot 1920x1080, 3840x2160, and 4096x2160. So no 2k. But I want to shoot at 4k. I agree 4k is overkill. But I see that as a good thing. This is it, I will never want a higher resolution camera and I'll never wish my prior footage was in higher resolution. There is something to shooting in a higher res but delivering in a lower one. But I'm happy with this setup. I don't even have a 4k display for this. With the re-encoding the storage requirements aren't that bad. So I'm fine with that part. And I have all the hardware to work with footage of this quality(well aside from a monitor) so I'm ready to produce 4k content. I might as well do it.
@@retroretiree2086 This is different. RAM is a resource. Resolution is an interface. You don't need a keyboard with 1000 keys. Sure, you could have all the macros you ever want, but there is a point where more keys no longer help. Well, there is a point where the resolution of a display is "sufficient" because it has to be used by an imperfect human. I see 4k as unnecessary, in a lot of cases it isn't going to be significantly different than 1080p. But 8k is dumb. At that point you are wasting resources on benefits you cannot appreciate. Sure, 8k > 4k, but that doesn't mean you can use it. So I see 4k being the last real resolution. It is too much in some cases, so it's going to be good enough to cover just about every possible scenario. As a camera operator, you can treat resolution as a resource. So there are instances where it could make sense. Blackmagic has a 4.6k camera and that exists for a reason. It can allow you to reframe an image after shooting, apply digital image stabilization, or do mild digital zooms while potentially maintaining a 4k base resolution. An 8k camera could offer even more flexibility. But for home sized screens, the drawbacks to 8k delivery vastly out weigh any possibly benefit.
So it works out of the case, but mounted in the case, IPMI and onboard vga doesn't work.... Looks like something in the case shorting something maybe ?
at 7:22 that is one of the safe sata molex splitters as apposed to to the ones that catch fire at 8:23 that female sata plug looks like the fire starter kind
I'd be interested to see what kind of dual/hotswap power supply configurations are available on this case, it looks like the ATX PSU mounting bracket is removable. Depending on the case/mounting style, old server PSUs can be pretty cheap on eBay (not that you're itching to spend more money on this ;))
Something to watch out for: apparently some Norco cases have a hardware problem that can fry hard drives, but there's a workaround: wsyntax.com/cs/killer-norco-case/
you may have done this already bur if not try a bios update on the main board to see if it fixes the remote management also see if their is a way to default the settings on it.
Your "benchmark" with ffmpeg is flawed, if you didn't want to know the singlecore performane. You aren't using all threads. So please use the flag "--threads " and rerun the "benchmark". Maybe edit the description.
The first time I tried a tape drive with Linux was a 8mm exabyte drive and it failed. Probably too old of hardware. Currently I have a 6 tape library. Though I don't think Used it with Linux yet. I also have a older DLT drive that I have used with Linux.
1) How have you never done Linux md raid before? 2) ZFS on Linux is fine. I'd trust it just as much as FreeBSD at this point. 3) ZFS is no harder to set up than md RAID if you have a little experience with it. I would stripe two mirror vdevs together with the SSDs, basically a RAID 10. You can grow it by replacing the disks in a mirror one at a time with larger disks and re-silvering. Do not add vdevs, you can't remove them once you add them, just replace them.
Stopped using md raid myself a while back cause I heard pretty bad things about it's raid1 where if a disk has a problem it doesn't know which disk to believe so there's a 50/50 chance of data loss. Moved to ZFSoL because of that anyway, not sure if that's just negative propaganda but I'm fairly happy with my raidz1 and the nice statistics that I can get out of ZFS. Only problems I've had with ZFS were my own fault adding a single disk to an existing raidz1 vdev nuking it's redundancy and having to rebuild the pool, but that's what I get for working on my server while tired and superuser.
Here's something you can do with the server PCs lying around. Have them all, via the Internet, render your clips at the exact same time (all of them helping render the same clip at the same time would certainly speed things up even more). 18fps for rendering ProRes clips to x265 would certainly be a godsend in @AkBKukU's case
ZFS on Linux (from OpenZFS) is actually very very good, and on some levels better than BSD. Also, instead of ZFS RAIDZ1 you could make two mirrors and stick them in a pool. No calculations and therefore faster! Can't lose two drives from the same mirror tho, so that is a tradeoff.
Did you make more videos of this type? Could you give me the links so I watch them first? Since this is the final part, I would like to see the first parts of this content. Thanks for help O/
I updated the description with links to all the parts, but I can put them here as well: Part 1: ruclips.net/video/V67YPVKQsSQ/видео.html Part 2: ruclips.net/video/pyhEtor-d8A/видео.html Part 3: ruclips.net/video/8cfW5WRO6HY/видео.html
Did you do a ubuntu-server-cloud install :S? I thought that was the only one that came with 'plymoth' ? Besides that, it's ported - be happy in terms of powershell ;). Gawhd! Please , I'll even donate money for a new PSU, you'll be overworking that poor bastard loaded with disks soon enough..But welcome to linux software raid ;). Kudos however getting to see the re-encoding! And finally, you mention the screws :p. And cat6 can do 10gig as well ;).
Well, two problems. I need to update the pinned post because I mistyped my copy command before recording apparently and used an 8GB file for the encoding (which makes a lot more sense now that it reduced to ~200MB.) But I don't know where I could host a file that large for people to download themselves without having to worry about getting locked down by the provider. Maybe in a server follow up video I'll record a shorter clip that is a better test with a still segment and some movement that will give the encoding more of a workout.
hi i using the same a video about tape drive;s is a good plan and all the cable for mats would be good if there any thing bad with your mother board the tape drive will not work as my lto backs up ok but not take it from the tape i tested my drive on a 100% new mother board and it worked ok getting used gear is not good news i have the same xeon lay out hell YOU WILL NEED TO HAVE GOLD BARS TO PAY THE RUNNING COST i got a watt meter on the 240v coming in it will use a lot
you might be able to just relubricate the 10GbE fans. And.... PLEASE remove the tape metal cover. It triggers me :D. Without it the server would look super sleek. And it would be very interesting to see the rack. I don't care if the video has bad quality ;). Just out of curiosity.
"And 100% chance of burning my house down." 😆
I'll mention my Powershell remark here to clarify it a bit. For Windows, Powershell is a massive improvement and has made some great changes. Linux/UNIX/POSIX was already there though. There's no reason to switch when what you have is already very good. It's not a "grass is greener on the other side" situation. Both fields have green grass, so why climb the fence?
Also, it turns out the file I converted with ffmpeg was originally 8GB, not ~600MB. That seems much more like the encoding differences I've seen in the past.
Modern powershell does have some deep functionality that I don't see from POSIX. Powershell takes the "everything is a file" philosophy to a "everything is an object". A lot of unixy shell operations that necessitate grep,awk, or find are much simplified by this, since rather than commands passing in and out raw text information (e.g. tab or space separated fields, grouped by newlines), they output real objects with named fields. So rather than awking the 4th tabbed element of every line, you can say $output.Filename or similar.
Not necessarily grass is greener, but there may be more at play than many linux centric admins realize. (I'm certainly not knocking linux/unix, I prefer it myself for most things, but I am occasionally forced to use Windows for work and am surprised by how right they get certain things)
Powershell is there for the same reason .NET Core is on Linux.
But just we need to Windows Server 2019 or 2016
Well if Powershell is an option, it obviously means someone wanted a powershell option enough to have one. So there's at least one person in the world that prefers managing Linux using powershell rather than some linux shell interface. Maybe they were taught using powershell, or maybe they have used powershell for a longtime, and it's what they enjoy. Or maybe Powershell has some feature that isn't present in linux shells and they consider it essential. In any case: user preference. (edit: corrected typos)
gigaherz I don’t know if it’s more because for the user experience but it’s useful to have the same build script or something for both developing on Windows and deploying on a Linux server.
But it’s funny that PS has both ls and dir aliases to the same command.
First time I've seen tar used with an actual tape drive :D
please please please clean the dust !!!
I did go back and clean it up a bit: i.imgur.com/u53QEO6.jpg
I just didn't want to focus on that too much in this video since it was already so long.
Now I can sleep better at night, thanks for the reply.
How about the fingernails? 🤣
Hey AkBKukU, I just want to say, thank you for doing these videos! Watching this video inspired me to ditch FreeNAS, grab a more powerful motherboard and CPU, and use my "server" as a real server using Ubuntu. Now I'm on my way to compressing a bunch of absurdly encoded files with FFMPEG at super speeds! :D
I have serious server envy. Also wow, you almost have 1.9 million views on your brand new 98 build vid?! Well done!
It's hard to think about numbers like that. Nearly 2 million people have watched one of my videos? That's just crazy. As of right now, 353,792 of those views are from the US. So out of around every 1000 people I walk past, 1 of them has watched that video.
It's also crazy that 82% of the views are international! That is the part I was least expecting but it's awesome! I love that the internet lets you instantly share stuff like this around the globe!
@@TechTangents Oh wow, that one in 1,000 stat is amazing to think of. It was a great video and you certainly earned those views!
Hi from Australia by the way :P I've been meaning to send you something since before the first mail time but I need to figure out some logistics and setup stuff first. Still the same address as the one you DM'd on Twitter in July? Or should I DM again for a new one?
That's no problem! Take all the time you need. It's actually a bit relieving to hear you hadn't sent anything yet. I've got other people's mail in my box a few times and I was concerned that the letter you wanted to send may have been mixed up and lost.
It is the same address, today is actually the day I need to renew my PO box as well, I should go do that right now...
That 98 video was the first one i have watched and now i am a subscriber and love the content. Greetings from Brazil!
Bacula is your friend. Seriously it's a life changer.
Most of the time I don't understand what you're talking about, but I like it very much :D
I know Linux/Unix guys like to hate on Powershell. But it is pretty decent. It can be a bit verbose but there are default sensible aliases and you can make your own. However I come from a Java / C# / Python programming background and had to write some powershell. So I think it is pretty decent.
Spending to much on SSDs, you are really evolving to Druaga1 :p
You're already 5 videos ahead of Druaga1 this year lol.
It's pretty awesome that you're going to LTX and doing some stuff with Linus. Can't wait to see what you bring. I've been watching you and druaga for a couple years now and didn't see this coming lol
I know it’s been over 8months since this video came out. I also guess not a lot of people ask about LTO tape drives as it’s old tech, but I have a big interest in it and would love to see an in-depth look at LTO tape drives. Like setting them up, installing them in OS and in general the commanding.
I have a LTO-2 drive and a LTO-5 drive just waitIng for some life, I don’t know if you’ve looked at all at LTFS but perhaps a future video into that field would be greatly appreciated!
Keep up the fantastic work 👍🏻
I've been using software raid 1 on a Debian home web server/file server for quite a while without any issues. I did have to replace one of the drives a while back due to failure which was pretty straight forward. Personally I don't think software raid deserves the bad reputation some seem to give it. I get that a proper raid card will offer battery powered (or flash) backup, cache etc... but out of the cheap options I'd pick software raid over fake raid any day.
I do have servers with battery backed raid cards but opted to use an old workstation for the home server as it's cheap enough to leave running 24/7 without any surprise electric bills.
Me about to sleep... (set the bell notif on)
OH NEW AKBKUKU VIDEO!
Yay new server video
I don't think you needed a partition table on /dev/md0. If you just have a single partition you could have created ext4 fs on /dev/md0 itself.
Fedora is also a great option too if you want inbetween semi-latest packages of ubuntu and the stability of centos. Also it comes with Cockpit out of the box.
The Tape reader, the caddy you can take the metal bracket off thats blocking the front of your tape reader, I've had 3 of these cases I got from work, I used 1 of them for a while, parted them out and sold them.
Have you seen the SwissMicros clones of classic HP calculators?
Also just a guess and probably already been solved but the caddy that holds the tape drive it looked like the metal part thats in the way had screws on its side to remove it then turn the caddy around to make the the drive sit flush with the front.
I have seen those, I would love one, but they're pretty much just as expensive as tracking down an original one.
The screws are only there to hold the metal in place, it's all one stamped piece. I could cut it, but really it's not worth the effort unless later on the tape door clearance becomes an issue. I see a lot of drives with the door removed on ebay. I wonder if this is why.
SandyStarchild, who is that character on your avatar? o3o
Is it maybe a defective piece? I can imagine that that lip should be bent down flush with the bottom of the drive as a support piece. It could easily be remedied with two pieces of flat steel, a vice, and a hammer.
You are awesome thanks to Linus WAN show i found your channel and now i will have so much great content to watch.
Does this board support PCI passthrough? If you are going to install Windows you might be able to run the Linux part headless and have Windows use the GPU directly. You could also virtualize FreeNAS for your storage but you will need to use the passthrough in your controller card so it has direct access. BTW, I prefer software raid because it is easier to recover from a failed controller card and because I don't trust raid controllers to tell the truth to the OS about flushing buffers.
That SCSI cable, what were they thinking?
Before you throw money on a consumer grade 1000W PSU look for a server-dedicated used one made by Delta Electronics (they're the most reliable). It's not as easy to find, but you can get one for 100$ or less because it's a niche product with very limited market and companies usually prefer to buy new parts, not used. Providing you dust it off every now and then it will last for a lifetime, I've never seen one failing except for catastrophic events like a huge power surge and even then the server itself will survive.
Regarding splitters: why don't you make one that fits your needs? It's just a 4 wire connector, you can easily build one with as many output connectors you want using parts from other splitters or even from a dead PSU.
Totally agree on the Delta PSUs, they're built like tanks, but yeah finding 'em can be a pain but as goes the saying, patience is the key.
You can probably find used OEM workstation/server PSUs cheaper, and they are very cheap, sometimes less then 50$, especially if someone offloads them together with an old case.
They are very reliable as well
@@TheRailroad99 OEM parts are fine providing they're fully compatible with other platforms, which not all of them are. Generally speaking Dell, Compaq and Fujitsu servers tend to have custom connectors and dedicated PSUs that you can't easily swap on other systems. IBM and Intel servers usually come with the best quality and universally compatible OEM power supplies (often manufactured by Delta as well). You can also find decent PSUs inside NEC and Telekom workstations.
Remember kids. Molex to SATA loose all your data!
@VideoCommenter Nah its also bad because if divides power too
@@eduardoavila646 Dividing power isn't the problem
@@griffin8062 For ssds not that much, but for hdds possibly. They draw more power. If the divider has a too flimsy and thin cable it may limit the current, and maybe make some setups not work propperly.
@VideoCommenter With ssds it probably isnt the issue. The biggest one wich i didnt think of initially is the bad connection, that with a vibration of airflow, could lead up to a failure in the connection for a brief moment and maybe cause data corruption. This happened to me, well i had the cable basicallt dangling down of a opened case, but you get it.
Except that it fucking doesn't if you buy quality cables.
Make that "...through *its* paces..." -- no apostrophe!
Heh. I'm really enjoying this video series. I would have taken a nibbler to that flap on the 5 1/4 bay ages ago. Can it be unscrewed? There do appear to be screws around it.
Just found you through LTT and so glad I did
Does ffmpeg have GPU acceleration? If you need a GPU in there anyway, might as well get a 1060 to encode with.
Thanks for sharing that build. I'm, starting with the tapes myself and really enjoy it. It's a shame You lost ipmi, but with all the convenience, it's only a nice bonus.
The lip on the 5 1/4 bay is for security so you need access to the server to eject.
Are you going to "vlog" LTX?
I don't know how it's going to play out. I'm going to be in my booth answering questions all day. So I don't know if I'll even get to walk around and see stuff let alone have time to set up a camera and film. But I will be bringing it just in case I do. I would love to get some footage while I'm there.
Will you go along with druaga?
LTO3 tape in an LTO4 drive, hiws that working? as in does it see it as an LTO4 capacity or still as an LTO3?
Usually, LTO tape drives are able to read/write to the last generation and read the generation before that. So my drive can read/write LTO4 and LTO3 as well as being able to just read LTO2.
Came from LinusTechTips cause you got the server stuff going on
Yay! more server content!
try a bit of isopropyl alcohol on the fans bearings first to see if they loosen up. Good short term fix.
Ah, a tape drive. Isn't that gloriously old-fashioned?
Random boring kinda related anecdote.
The boot drive for my old server was a hard drive hot glued to the top of the remote management card. It's much better now though, I've modified the bracket for the PCIe riser on my new server so I can mount a hard drive to it. I don't need any expansion cards in the server so it doesn't matter that it's in the way of the slots.
I apologise for the incredibly boring nature of this anecdote.
Hey AkBKukU, what do you plan to use the tape drive for?
Great content. If you wanted to do some video shorts, you could cover some of the linux commands, utilities you use. Watching this series, I stopped and checked out several of the utilities you used/scripted. Or maybe I'm just a noob.
LTT SQUAD here!
Isnt that weir bracket interfiering with the tape drive's cover as well?? Like the top of it is blocking it or it's the case? I just want to see that bracket burn tbh
Do you have any tips for getting an LTO5 or newer drive for a decent price?..
I'd like to have long term storage of infrequently accessed data, and LTO seems like the best bet. But the initial cost kind of sucks...
Not sure if this will help, but the 1100w PSU in my T7500 is actually ATX. Your cable requirements may still require some soldering, but at least you’ll know it has the grunt to back it up.
And I’m sure you can find (probably the whole machine) dirt cheap.
So, something to know about ZFS is there are recommended limitations for vdevs. Multiple of 9. Though most people recommend avoiding RAIDZ and using mirrors if you want speed. I'd do a bit of research before moving fully over. I setup 12 8TB drives, though I used RAIDz2 as its archive only. 6 per vdev.
ZFS on Linux is actually not too bad alot of my colleagues for a data backup company I work for uses ZFS and we use it in thousands of devices.
15:57 why not Debian?
Pop the sata connectors off the other splitter and put them on the other molex to sata splitter. They just crimp on.
if i had remembered this sooner i would have mentioned it sooner, but you can dremel out the back of one of the pcie 8x slots for a video card if you wanted to. most (if not all) video cards will not be bottlenecked by an 8x connection.
putting the video card right up against the side of the case will choke the card :(
I don't see a need for the emergency Raspberry Pi as the board seems to have Lights-out Management built in ? (not positive on that though)
you could just mod a power supply and repin the main connectors.
How come your using LTO-3 Tapes where LTO-4 Tapes have twice the storage and a much faster transfer speed for archiving footage? For almost the same price.
Only curious...I got a LTO-5 Drive recently and looking forward to archiving everything I have.
I have some LTO3 tapes I use for testing so I don't wear out my LTO4 tapes that will be used for real backup.
@@TechTangents Any chance of that tutorial on setting up the LTO Tape Drive?
It would be so interesting to see how this is done. I have a LTO 2 and 5 drive but just finding it complicating to even set one up.
Just the basics of the software configuration and then the installation of the drive would be fantastic.
Keep up the good work!
You can pick up eps 12v splitters to give you the extra power connections using a standard atx psu. I had to do that with my x99 board
Just a little question : why not using ESX, Hyper-V, Xen or whatever as an OS? I think it's a little weird to use that type of server as a standalone, it's usually used as a virtualization server to have as many VM as you want, it's a little limiting to install Ubuntu Server and only that. Ubuntu Server, Windows Server or whatever are usually in the realm of VM or cheap 1U server with 1 CPU, at least in more "professional" context, not beasty 4U server with dual-CPU, a shitload of RAM and that many SAS ports.
(Yeah, ok, I guess if you use it as a rendering server, a VM won't have the same performance, but the difference is now almost non-existent, especially with GPU rendering since you can assign GPU to a VM and it can use it directly).
ZFS is going off the Linux kernel ... So yeah... Don't know how to build it etc. - Maybe ButterFS or something else?
Just cut the metal peace in front of the tape drive.
I love Samsung SSDs. They come in a metal case instead of plastic like most other manufacturers ones. Temperatures always seem to be lower due to that.
Whats the difference between the grey and black sata ports?
Plymouth is the boot splash for Linux, not an installer.
How about using raid 1 with two of your evo drives if you have three working.
You actually can use the text installer for a desktop install. It’s the netboot/mini iso. Slightly obscure, but it exists and IMO it’s the only iso you should ever use to install Ubuntu because it downloads the latest of the packages you want to install rather than including outdated versions in the initial download that you then need to upgrade after you install. Plus you can pick other packages to install while you’re at it so you can walk away and come back with everything you need installed.
help.ubuntu.com/community/Installation/MinimalCD
Just make a two mirrored pool, raid5 is expensive in *everything* except space efficiency and also unusable in production class boots for systems, I have never had a problem with a good raid10 like "MBOD" or mirrored bunch of disks via zfs. If this thing has even halfway viable efi then you can put grub inside the efi part and boot right off of a near enough raid10.
Just prep the pool;
sgdisk -n:0:+512M -t1:EF00 -n2:0:0 (-n2:BF00 optional imo) /dev/sda,b,c,d
zpool create -o ashift=12(explicit is always good with this) -O mountpoint=none (for inheritance reasons as mount points don't play nice under linux as with solaris) -O compression=on (its free real estate) goodname mirror /dev/disk/by-partuuid/sda,b mirror /dev/disk/by-partuuid/sdc,d
There is a lot of problems with races and zfs and systemd, there are a many complex solutions that don't light my fire so I just set the rootfs as legacy mount and fstab is fine.
I also have so many efi parts of course to have redundant backups of both grub and the efi loaders to boot my pool even if it's TWO disk degraded and I'm lucky enough to have it be the two disks that still enable operation.
Have you considered Fedora Server? Switched from Ubuntu and no regrets.
Camera SSD? When did that happen, did you get a black magic?
Yep! It happen with the iMac video. With this server being done I'm getting close to ready to do a video on my setup. It's taken me a couple months to catch up all my computer hardware with the camera because it is crazy when it comes to the bitrates.
@@TechTangents why not just shoot 2k raw? I mean 4k is kinda overrated and I still watch videos between 480p (on my phone) and 1080p on my desktop. It's even worse when it's running at 60fps for no real reason, my computers are powerful enough to process 60fps but RUclips constantly freezes anyway. It still makes sense to have that hardware even if you shoot 2k but you could save some time and money on backing up if you just shoot 2k/2.5k since your camera if I remember can still do that.
@@coolduder1001 I was pretty sure but I double checked, the camera can only shoot 1920x1080, 3840x2160, and 4096x2160. So no 2k. But I want to shoot at 4k. I agree 4k is overkill. But I see that as a good thing. This is it, I will never want a higher resolution camera and I'll never wish my prior footage was in higher resolution. There is something to shooting in a higher res but delivering in a lower one. But I'm happy with this setup. I don't even have a 4k display for this.
With the re-encoding the storage requirements aren't that bad. So I'm fine with that part. And I have all the hardware to work with footage of this quality(well aside from a monitor) so I'm ready to produce 4k content. I might as well do it.
@@TechTangents: I will never want a higher resolution camera --> No one will ever want more than 640K RAM... :)
@@retroretiree2086 This is different. RAM is a resource. Resolution is an interface. You don't need a keyboard with 1000 keys. Sure, you could have all the macros you ever want, but there is a point where more keys no longer help.
Well, there is a point where the resolution of a display is "sufficient" because it has to be used by an imperfect human. I see 4k as unnecessary, in a lot of cases it isn't going to be significantly different than 1080p. But 8k is dumb. At that point you are wasting resources on benefits you cannot appreciate. Sure, 8k > 4k, but that doesn't mean you can use it. So I see 4k being the last real resolution. It is too much in some cases, so it's going to be good enough to cover just about every possible scenario.
As a camera operator, you can treat resolution as a resource. So there are instances where it could make sense. Blackmagic has a 4.6k camera and that exists for a reason. It can allow you to reframe an image after shooting, apply digital image stabilization, or do mild digital zooms while potentially maintaining a 4k base resolution. An 8k camera could offer even more flexibility. But for home sized screens, the drawbacks to 8k delivery vastly out weigh any possibly benefit.
I would replace the fans with noctua ones, or more silent ones. It probably will be fine on thermals but be alot quieter
So it works out of the case, but mounted in the case, IPMI and onboard vga doesn't work....
Looks like something in the case shorting something maybe ?
Congratz on hooking up at LTX. I won't be able to attend but it sounds like it'll be awesome! Are you going to have a video about it?
at 7:22 that is one of the safe sata molex splitters as apposed to to the ones that catch fire
at 8:23 that female sata plug looks like the fire starter kind
I'd be interested to see what kind of dual/hotswap power supply configurations are available on this case, it looks like the ATX PSU mounting bracket is removable. Depending on the case/mounting style, old server PSUs can be pretty cheap on eBay (not that you're itching to spend more money on this ;))
Wow am early for an upload for once XD
Could you set up a straight connection from your camera to the file server? Just record straight to disk
Something to watch out for: apparently some Norco cases have a hardware problem that can fry hard drives, but there's a workaround: wsyntax.com/cs/killer-norco-case/
That's very good to know. I'll double check which back planes I have to see what they can handle and look them over.
What camera are you using to record?
It's a Blackmagic Pocket Cnema Camera 4k
you may have done this already bur if not try a bios update on the main board to see if it fixes the remote management also see if their is a way to default the settings on it.
Instead of Ubuntu Server, how come you didn't do something like ESXi or unraid and just virtualize whatever you need?
Your "benchmark" with ffmpeg is flawed, if you didn't want to know the singlecore performane. You aren't using all threads. So please use the flag "--threads " and rerun the "benchmark". Maybe edit the description.
For H265 encoding it defaults to all threads. I have verified this with htop.
@@TechTangents Oh ok. I didn't know this, because I only encode in h264 for compatibility's sake.
Pretty sure the tray was designed to hold an optical drive like that with the other faceplate over it.
why you didn't clean before installing new drives!! :(
Servers looking good. Will there be a part 4?
The first time I tried a tape drive with Linux was a 8mm exabyte drive and it failed. Probably too old of hardware. Currently I have a 6 tape library. Though I don't think Used it with Linux yet. I also have a older DLT drive that I have used with Linux.
yay for zfs < 3 you won't be disappointed.. with the fs at least, i don't know how stable it is on linux. but why are you using mdadm then?
ahh so zfs is for the NAS. got it.
Maybe, to solve the Tape Drive issue, you can 3D Print a new bracket to hold it "better" in place.
1) How have you never done Linux md raid before?
2) ZFS on Linux is fine. I'd trust it just as much as FreeBSD at this point.
3) ZFS is no harder to set up than md RAID if you have a little experience with it. I would stripe two mirror vdevs together with the SSDs, basically a RAID 10. You can grow it by replacing the disks in a mirror one at a time with larger disks and re-silvering. Do not add vdevs, you can't remove them once you add them, just replace them.
Stopped using md raid myself a while back cause I heard pretty bad things about it's raid1 where if a disk has a problem it doesn't know which disk to believe so there's a 50/50 chance of data loss. Moved to ZFSoL because of that anyway, not sure if that's just negative propaganda but I'm fairly happy with my raidz1 and the nice statistics that I can get out of ZFS. Only problems I've had with ZFS were my own fault adding a single disk to an existing raidz1 vdev nuking it's redundancy and having to rebuild the pool, but that's what I get for working on my server while tired and superuser.
Here's something you can do with the server PCs lying around. Have them all, via the Internet, render your clips at the exact same time (all of them helping render the same clip at the same time would certainly speed things up even more).
18fps for rendering ProRes clips to x265 would certainly be a godsend in @AkBKukU's case
ZFS on Linux (from OpenZFS) is actually very very good, and on some levels better than BSD. Also, instead of ZFS RAIDZ1 you could make two mirrors and stick them in a pool. No calculations and therefore faster! Can't lose two drives from the same mirror tho, so that is a tradeoff.
Oh, and DO NOT ENABLE DEDUPLICATION. Unless you have a shit ton of RAM and a lot of cache drives it will not work the way you think it works.
8:12 my god that's a fire waiting to happen O.o
Did you make more videos of this type? Could you give me the links so I watch them first? Since this is the final part, I would like to see the first parts of this content. Thanks for help O/
I updated the description with links to all the parts, but I can put them here as well:
Part 1: ruclips.net/video/V67YPVKQsSQ/видео.html
Part 2: ruclips.net/video/pyhEtor-d8A/видео.html
Part 3: ruclips.net/video/8cfW5WRO6HY/видео.html
Did you do a ubuntu-server-cloud install :S? I thought that was the only one that came with 'plymoth' ?
Besides that, it's ported - be happy in terms of powershell ;).
Gawhd! Please , I'll even donate money for a new PSU, you'll be overworking that poor bastard loaded with disks soon enough..But welcome to linux software raid ;).
Kudos however getting to see the re-encoding!
And finally, you mention the screws :p.
And cat6 can do 10gig as well ;).
You should do a network tour
How about Debian? Works great as a server-OS
I am really surprised that Samsung didn't call these SSD's - Samsung Galaxy SSD
They did a camera (well more than one model) which had the galaxy name. They even ran android
Now you can use sas drives
@AkBKukU please upload the file you tested with and the ffmpeg settings i would love to compare my servers with yours.
Well, two problems. I need to update the pinned post because I mistyped my copy command before recording apparently and used an 8GB file for the encoding (which makes a lot more sense now that it reduced to ~200MB.) But I don't know where I could host a file that large for people to download themselves without having to worry about getting locked down by the provider. Maybe in a server follow up video I'll record a shorter clip that is a better test with a still segment and some movement that will give the encoding more of a workout.
@@TechTangents Could always make it a torrent, once you've got a full copy up just stop seeding ;)
@@TechTangents Maybe put it on Google Drive?
Hey! No shaming PowerShell! It's acutally pretty cool!
hi i using the same a video about tape drive;s is a good plan and all the cable for mats would be good if there any thing bad with your mother board the tape drive will not
work as my lto backs up ok but not take it from the tape i tested my drive on a 100% new mother board and it worked ok getting used gear is not good news
i have the same xeon lay out hell YOU WILL NEED TO HAVE GOLD BARS TO PAY THE RUNNING COST i got a watt meter on the 240v coming in it will use a lot
you might be able to just relubricate the 10GbE fans.
And.... PLEASE remove the tape metal cover. It triggers me :D. Without it the server would look super sleek.
And it would be very interesting to see the rack. I don't care if the video has bad quality ;). Just out of curiosity.
I use 24/7 an 3 way RAID 0 with 750GB WD Blue HDDs, on the Intel Controller too. Rock solid since 2014
What the hell kind of tape drive is that!?
aww.. no btrfs...?
I need help on my PC
Remember: Molex to SATA, lose all your data.
They have a 6 2.5 inch drive to 1 5.25 bay things you can put in that 5.25 bay.