What is SSD Overprovisioning?
HTML-код
- Опубликовано: 20 авг 2024
- Have you ever noticed how SSDs are often listed as having different capacities than traditional hard drives? There's actually a very good reason for this...
Visit www.tunnelbear... and start your 7-day free trial today!
Techquickie Merch Store: www.designbyhu...
Techquickie Movie Poster: shop.crowdmade...
Follow: / linustech
Leave a reply with your requests for future episodes, or tweet them here: / jmart604
License for image used: creativecommon...
Title music: Showdown by F.O.O.L from Monstercat - Best of 2016
Video Link: www.youtube.co....
iTunes Download Link: itunes.apple.c....
Listen on Spotify: open.spotify.c....
Now this is a real Techquickie!!!
PS thanks for the upload
The Master Agreed!
The rest are all a cringy mess
thumbnail looks from the 80's, haven't watched the vid but suck my grapes. Edit: wait......... add a solid state driver?........????????????????????
The Master i know! but they still didnt get rid of the cringy intro
1:15 Linus predicted the overprovisionning of toilet paper :)
Lots of empty unpartitioned space at supermarkets and convenience stores -- exactly as intended and designed, nice.
Now THIS is an episode that is actually USEFUL!!! I have noticed the weird storage capacities of SSD storage before I saw this video, but I had never heard that term "Overprovisioning" before.
Keep making videos like this that are truly useful for educational purposes and your subscriber count will explode!
2017 to 2020, Linus aged 10 years, though his voice stayed the same.
When my wife starts to sing I always go out and do some garden work so our neighbors can see there's no domestic violence going on.
Brutal
Huh?
Just some auditory violence, nothing to see here!
*When you haven't watched techquickie yet*
"Thanks for watching techquickie"
WAT
Rattacko full verse please ?
He said , during the previous month , we recommended sdd in your pc . We thanks you for watching techquicki .
Rattacko Don't watch news too much often . Because they only shows part of it .
I'm talking about the intro
It was just so quick that you missed it
Linus I wish you went more into Gigabytes vs Gibibytes, since it has a lot more impact on advertised storage vs actual storage than you talked about.
My SSD has an advertised capacity of 480GB. According to Windows 10 however, it has a capacity of 446GB. Now it's time to take the advertised storage to the GB to GiB converter. 480GB is equal to 447GiB.
I'll do this on another drive as well. My 3TB HDD, according to Windows 10, has a capacity of 2.72TB. Again, throw it into the converter. And the result is that 3TB is equal to 2.72TiB.
Just a note I thought I should add, since Linus never went into detail about this in the video.
Edit: I did round off my results.
Its also worth pointing out that, most (or all) computer storage manufacturers uses a base 10 system (1 GB = 1,000,000,000 bytes), but computers always uses base 2 system, so 1 GB (Or the Linux users might see the OS mentioned it as GiB: Gi"Bi"Bytes) is actually 1,073,741,824 Bytes.
So, for every 1 GB the hard drive advertised, you'll lose around 73 megabytes when the computer addresses it (without addition in formatting overhead, file systems and such)
Not all OSes show gibibytes. So, to be sure, you can just check the byte count, then divide that by 10⁹ to get size in gigabytes (10¹² for terabytes, 10¹⁵ for petabytes, etc).
fun story: my office computer was running out of space with only 100GBs available on it's HDD. I was going to upgrade it a bigger SSD, so I looked into drive management work out some partitions in preparation to the new drive, it had 900 GIGABYTES OF UNALLOCATED SPACE! that computer from 15 years ago had a 1 TERABYTE HARD DRIVE IN IT WITH MOST OF IT JUST NOT ALLOCATED!
It wasn't a fun story.
Wtf
damn, so it is possible to overclock an ssd huh
technology has come too far
It was also possible to overclock HDDs back in the day, but it was kinda hardcore.
I miss the defrag coloured blocks that used to display the amount of defragmentation being corrected. I used to watch them till the early hours of the morning.
Anyone else feel my pain over GB vs. GiB (or MB vs. MiB, etc). When I learned all this 30 years ago, there was no KiB, it was just KB, and 1 kilobyte = 1024 bytes because 1 byte = 8 bits. Damn Apple.
I'd like to see a video from you explaining the difference between Garbage Collection and TRIM, and how important each is.
TechQuickie's intro poisoned our water supply, burned our crops and delivered a plague upon unto our houses.
4K PS2 Games PCSX2 and other emu's IT DID???
This should have more likes for originality
Haven't played dink for AGES
It did?
Sigma Waffle no, but are we gonna wait around till he does?!
"Some"
*Almost 1TB*
this linus-looking-guy
predicted the future
we are OVERPROVISION toilet paperd
😂
"And speaking of extra space..."
Me: "okay, here comes the square space B-roll... What?"
I was agonizing over this when I got reminded of it months after I bought my ssd and is now almost full. Fortunately it was in one of those odd sizes, 240 GB so it turns out I don't need to do manual overprovisioning at all.
The real question is why were SSDs designed like this in the first place? Is there no better way to have solid state storage?
Thanks Linus. That was really informative. I knew that there was a reason for the weird partitioning numbers, but now I know why. Love the format. You guys should have Jon do more Tech Quickies: maybe one a week? Loved the Dyson Sphere, cause it was on my favorite topics; science, technology, and fiction!
Teacher: ok class can anyone tell us what 1,073,741,824 mega bytes translates too?
Kid 1: thats a gigabyte!!
Random kid in the corner that never talks: unh uh that theres a darn G I B I B Y T E
I love how you look to the right of the screen when you say something confusing
0:46 partially right, but you have to realise that Windows uses the 1024 byte system, and the manufacturers state the unformatted capacity of their drives, because it isn't known what the OS the SSD is going to be used on
Another reason why the SSD is best used as your OS drive since you won't be overwriting, or moving your OS (generally). You can use one for more volatile storage, but you won't get as much longevity.
Thank you for an informative video that takes the viewers seriously.
The first SSD I got was an 80 gb intel ssd for 200 dollars 10 years ago. It had a read speed of 250 mb/s and a write speed of 95 mb/s (sequential), but far higher random read/writes than hard drives. I just got a 1000 gb ssd for 145 bucks which has a read speed of 560 mb/s and a write speed of 525 mb/s. That's a decrease in cost per gb by a factor of around 17. Incredible stuff. My build lasted 10 years before I replaced the motherboard and CPU, and it still ran fine. This is why I suggest building your own so you can replace parts as needed.
For 1, why there're unconventional capacities - this is likely down to the individual chips making up the SSD. Say they're manufacturered in 60GB chips. Take two, that's 120gb, take four and you have your 480gb. Eight, there's your 960gb. (Though looking into it, they probably are just nipping away at 64/128GB chips)
And for point 2, showing up in lower capacities when reported by your OS, this is mostly Windows now, and it's due to the difference in definitions of GB. Windows still uses the 1024 bytes to the kb, whereas manufacturers and other operating systems use 1000.
If you do a quick conversion - (1000/1024)³ x 512(GB) = 476.8(GB).
I know that Seagate specifically add this extra 7.37% difference for the provision such that it really is a 512GB drive, but really any amount can be added by the manufacturer that's invisible on the OS-level for the sake of ssd shuffling as it were.
So for these, I find the images and topics on this Techquickie a little misleading. (Especially since #2 will also be evident in conventional mechanical hard-drives, which don't use overprovisioning)
I'm just checking how many people's head are exploding over a 7 seconds intro
Maybe that's because the intro treats people like idiots who apparently don't know the concept of "Hey I like this guy's videos, I'll subscribe to him for" and needs to constantly beg people on every video
me too LOL especially after he streamed last night talking about it. I don't mind it.
Neitsuke not everything is about you. The intro isn't for you then. They aren't treating people like idiots.
Now if only some automated text would pop up below that comment right now for me, telling me to "Please like this comment if you like it, and don't forget to subscribe" I'd be dead on the floor.
If people are too dumb to realize that they have the power to like whatever they want and subscribe to RUclipsrs they want to see more content from, then yeah, maybe, just maybe people are not idiots, maybe I just happen to have more common sense than the average guy, let it be at that
The thing is, RUclips is mostly used by "idiots" who don't know what subscribing does or how it helps creators. It's why most of the popular RUclipsrs go "LIKE COMMMENT AND SUBSCRIBE IT REALLY HELPS ME OUT" every five seconds, it's proven that doing that yields more subscriptions and interaction on your videos.
Seems like an interesting feature ... There's quite some guides on SSD performance, and few mention this function.
Great video, I cannot believe that You guys were able to squeeze in so much information into just 4:53 (including advert).
The intro really needs some getting used to. Great video though
Does this apply to eMMC and UFS ?
Do I need to keep 6 GB of my 64 GB phone empty to keep it good ?
Or can I have 99% filled and no worries ?
I have got mine to 300 megabytes free of 16 gigabytes (6.04 used by android nougat 7.0.0) and it's fine but i would NOT recommend it because updates for apps will not download from the Google play store (butihavetheazpenstore)
When I head The intro I went to hit skip ad and realized it wasn’t an ad :(
So, what happens if you later on decide to add a partition to the unused space?
This explains why my 1050 (1tb) gb m.2 drive only has 990 of usable space.
It's also true for USB data sticks. There are factory utilities that can modify the provisioning and you can increase the life and decrease the usable size or vice versa.
> "... advertized to hold the more typical amount of data like 512 GB, why does your computer tell you the actual capasity is far lower?"
> Proceeds to then show a hard drive with 512 GB of capasity, identified by the operating system as having 512 GB of capasity.
The real question should have been "why does Windows tell 512,108,785,664 bytes = 476 GB?". It's due to Windows using a stupid convention where 1024 bytes = 1 kB, 1024 kB = 1 MB, 1024 MB = 1 GB and so on, which only makes sense for ram these days. It has absolutely nothing to do with overprovisoning in SSD's and it's really confusing since you can't differentiatie these power of 1024 based prefixes from the proper power of 1000 based SI prefixes.
i have a new intel ssd that i got for christmas last year and im loving it
That's an awesome feature!! Found out now in magician sw for my samsung evo ssd. SSDs should do that automatically!
SSD's write things into what are called pages, which are then organized into blocks, which are then integrated into larger cubes, which of course are part of the larger "binder" organization structure, which are then super imposed over the matrix stack.
Thank you for asking a question i didn't even know i had!! Great work :) at 2:49
i don't think the first issue is formatting overhead. it's the manufacturers scamming that 10^9 Bytes = 1 GB, instead of the proper 2^30 Bytes = 1 GB. you can easily check it yourself
Do a video about the The Life Reckoning Checksum Error
So if you're a frequent Techquickie viewer, you've probably noticed by now that we added a intro to our videos as a simple upgrade that will usually make your viewers get annoyed and more, but we keep it in for whatever reason.
I mean, you could just very easily press the right arrow button, which skips most of the intro. But like most people are annoyed, because they dont want to sit through 7 seconds of blah blah blah reminding them of something they already did.
The only argument that there is is the fact that there might be more people being aware of the buttons existance. Now, I dont have the data Linus and his staff members have. Maybe this intro does something after all, who knows.
marco_rennmaus he did a livestream about it. And they actually do have some very good reasons for it. I think the video is still up from last night
marco_rennmaus Maybe the intro should get changed to "If you're new to Techquickie, click the subscribe button..." and continue on with the rest of the intro.
Newport31311 Sadly, it's not...
marco_rennmausb Linus did a livestream on this yesterday he explained that about 60~70% of viewers on techquickie are not subscribed. This compared to 30~40% for the other channels
which is better for long term storage and archiving? SSD or HDD? if you write files into SSD once will it last for ever?
Seeing how almost all NES cartridges still works fine. I would go for a SSD.
that was I was thinking
What if my SSD isn't even half full? Should I still use Overprovisioning?
I care about my personal space. Let's step up here, and everybody get stepped up, and let's get some stepped up PERSONAL SPACE UP IN THIS PLACE! Here we go. We get a 1) personal space. 2) personal space. 3) stay out of my personal space 4) keep away from my personal space 5) get out of that personal space 6) stay away from my personal space 7) keep away from that personal space 8) personal space 9) personal space. You know, I take personal space pretty seriously.
This message brought to you by Tunnel Bear. They care about personal space.
The ad goes by quickly so it's not bad, second of all it's like less than 5 seconds so chill xD
wheres the CC?
The Crucial MX500 series of ssds appears to have a firmware bug that causes them to waste most of the finite lifetime writes per NAND block, which will cause MX500s to die prematurely. My guess is that the ssd firmware's Static Wear Leveling algorithm is too aggressive about trying to maintain perfect equality of write count per block, which is foolish unless Crucial wants their ssds to die soon after the warranty expires. The bug correlates perfectly with another well-known bug of the MX500 series: the S.M.A.R.T. attribute "Current Pending Sectors" frequently changes briefly to 1. You can see the perfect correlation by logging two S.M.A.R.T. attributes every couple of seconds for several hours: "Current Pending Sectors" and "FTL Background Page Writes." The log shows the brief changes of Current Pending Sectors to 1 occur during huge increases of FTL Background Page Writes: it changes to 1 at the beginning of the FTL surge, and changes back to 0 at the end of the surge. Unclear is the cause and effect: is the change to 1 a weird side effect of the surge, or does the change to 1 trigger the surge? Each surge lasts at least 5 seconds so logging every 2 seconds will reveal the correlation. Each surge writes a multiple of approximately 37,000 NAND pages, which is approximately 1 GByte: usually 37,000-ish pages, sometimes 74,000-ish pages, occasionally as much as 5 x 37,000. I'm writing this hoping that LTT will reproduce my result and publicize the bugs in order to exert pressure on Crucial to fix the bugs.
It could be nice if you explained the difference between Gigabyte and Gibibyte. When the industry tried to enter the International System of Units (they finally did it in 1996 or maybe 1999) they found the problem that to keep consistence with units and measures the prefixes "kilo", "mega", "giga", etc. are decimal based units meaning exactly 1000, 1.000.000, 1000.000.000, etc. respectively. Keeping their binary values of 1024, 1.048.576 etc. meaned those prefixes had different values thus would become non standard (which goes against the idea of standarization) so they decided to create new acronyms like "KiB", "MiB" etc. meaning (K)ilo B(i)nary (B)yte, (M)ega B(i)nary (B)yte...And it's the reason when you buy a 500 GB (Gigabytes) Windows says you have just 465 Gigabytes total space. Because Microsoft are a bunch of idiots and refuse to accept standards. The right form Windows should explain it is "465 GiB (Gibybytes or giga binary bytes) total space"
So when you buy a 500GB disk it means it has 465 GiB. In HDD and SSD in my own experience they always keep the decimal (Gigabyte) but when you buy RAM most of the times they use the GB acronym when they should use the GiB one (because it really has the announced GibiBytes). Some brands of discs (CD,DVD,Bluray...) use one or the other acronym and in my experience they use it well (for example 4.7 GB DVD equals 4.5GiB, TDK normally uses the GiB form).
I don't think that leaving an unallocated partition will make SSDs see it as an over provisioning space. Where is the source of that info?
If over provisioning is a thing why not put more nand chips on the SSD to account for the lost space?
3:57 fin.
Is everyone seriously disliking? Is it just because of the intro?
This video is seriously an informative video. Even though I already know about it this is definitely a good video.
That bunker joke is now reality rip
Ikr
You also loose space when they use chunks of say triple layer flash as if it were double or single layer flash as a write buffer cause its much faster for writes.
Samsung removed overprovisioning in Samsung Magician 5.0 indicating, that they no longer deem it to be necessary.
This is the techquickie we all know and love
tfw the Techquickie channel has far better content than the actual LinusTechTips channel
Best transition in awhile.
Linus is this also true for M.2 SSDS as well? Or just normal SSD l size and SATA format?
I got a question... if I run 2 operating systems from one ssd does that reduce the lifespam of the drive ? if there's always one partition of data not being used at the back end of the drive with files not seeing use? does the controller treat it differently ?
I think now it would be a good time to make a video talking about why a 1TB HDD is shown as 931GB in Windows and if that means we are being cheated by manufacturers. I know the answer to this already, because of a video GamersNexus uploaded a while ago, but I think that the answer can be made shorter and still understandable like these TQ videos.
For those who wanna see the video - ruclips.net/video/B7tps8364ag/видео.html
While looking for the GN video, I also found a shorter video explaining the same thing (by ThioJoeTech) - ruclips.net/video/DufUYmtVYYU/видео.html
Linus - SSDs dont have a large life span ........
Me- I think i will stick with my HDD
then you're dumb.
i had an hdd and it took so long to do searches and starting up my pc took nearly a minute! now with my ssd i can start my pc in 13 seconds or less and search almost instantly.
Harddrive manufactures report the capacity is GB (Giga bytes), which is 1.000.000.000 bytes. While the operating system reports the capacity in GiB, gibibytes, which are 1.073.741.824 bytes.
I learned something today, yay! :)
After watching this video. I have started loving my old Hdd
Love these vids! Never knew!
Great Techquickie. I'd like an episode in the future on how you can turn off the part of the video that asks you to sub if you already subbed. I'm kinda shocked RUclips hasn't provided a solution for that already. Like when you go to a channel you're not subbed to, the channel can play you a welcome video but once you are subbed, that welcome video doesn't play. Why can't we have that same idea applied to every video. Where you have a subscribe/press the bell clip that gets attached or prefixed to any video where you haven't indeed subscribed/belled but that clip goes away once you are. Another step for RUclipsrs but one that I think the audience as a whole would really appreciate.
Always wondered what this options was in Samsung Magician.
For some reason the SSD in my computer actually did the opposite of overprovisioning by adding .11 GB of space. My SSD was advertised to be 512 GB, but it is actually 512.11 GB.
You must have won the nand flash lottery
@@drabberfrog yep I must have
I looked the MAC Book Air which has an SSD. Are you saying that at some point in time the SSD will no longer have space to write/save data?
Hi Linus - great video, but I feel a primary point was missed as far as drive size is concerned. It can be confusing so here goes - all drives actually have sizes allocated by powers of "1000" megabytes - so when the drive lists itself at 5 Gigs - it's actually referring to a total space of 5000 megabytes. But WINDOWS reads the drive at 1024 megabytes per (Gibibyte), not 1000 - so inherently, all drives will automatically read as a 2.4% smaller size - simply due to the way Windows does the mathematics specifically. So there are the things you did mention in the video, but don't forget the math - that's important too.
Good video. This was some valuable information and I was wondering what was going on.
99.9% Of comments are people complaining about the people bitching about the intro
.1% are actual complaints about the intro
Well what if you just keep some space open? Same thing right?
> starts vid
> immediately press 1 to skip the intro
ALWAYS EXPLAINING THESE TOPICS SO CLEARLY!!!!!!!!!! THANK YOU!!!!!!!!!!
"Older style mechanical hard-drives" - They aren't quite old enough yet to deserve that title..
We need new ways of data storage
The fact that ssd drives have a limited lifespan puts me off ever buying one
Finite read-write cycles is the reason I want to stick with magnetic hard drives at least for OS storage as long as Western Digital and/or Seagate will make them.
@2randomcrap3:
The crappy part is that they (ie. hard-drive manufacturers) are intentionally making them crappier (secretly changing ALL-of-them to Shingled-Magnetic-Recording method, for example) to move-over everyone (by force) to SSDs :-(
I LIKE THE INTRO, IT GIVES A PROFESSIONAL VIBE or something like that.
Great video
To send or not to send an error report?
It's an easy to google but a Techquickie of it would be cool
Intro's still better than an Ad.
Change the intro put it at the end
Pervaiz he said he wont put it at the end since over half of the viewers are non subbers, and he doesn't want people to click off before having been given a nudge to engage with the vid... it apparently has been working so far.
What I don't get is that it seems like the intended audience are people who search a topic and find the video for an explanation. What does some person who comes across the topic and search for an answer want to do subscribed to this channel? it just doesn't make sense...
yeah "Im going sub to this channel before watching the video xD"
WHO DOES THAT LMAO
I don't think it doesn't work... I just think it's annoying...
And you're telling me the people who need to be told to subscribe to a channel, will think to subscribe after watching a 4 minute video? buuulllshite. People click to subscribe because it's the third video they're watching and they go, "yeah I guess I watch enough of these" but then they subscribe and may not watch anymore videos because none interest them. I'm sure they're getting more subs, but they're not going to be consistent watchers.
And it's 7 seconds times however many videos I watch... and you can't deny it's annoying... It is starting the video off on a negative foot. It's just not very professional imo.. It's like novice youtubers who say "Sorry I haven't posted a video in a while, I've been busy". that annoys me too, shut up and get to the content which I subscribed for... (And as a youtube red subscriber, therefor support with my money, no matter how small a fraction gets to them)
Minor grievances, but still valid I'd say. I don't really care if they stay or go I'll probably keep watching but don't blow my claims out of proportion. I'm not saying "I'M GOING TO DIE BECAUSE IT'S THERE" I'm saying it's annoying and probably not worth it given how much it's annoying consistent watchers...
so... should i stop leaving 20-15-10% of my SSD free since it already has it reserved?
Ok, I saw the stream about the intro and with that in mind I would suggest shortening the subscribe bit, I find the enable notifications bit drags the intro out and is a bit clunky. Maybe just "If you like this please subscribe" and just visually suggest the use of the bell icon.
Do an As Fast As Possible when the comments die down and address how much the intro actually affected viewer engagement.
I was advised to get a laptop with an SSD, and I did. Big mistake. Windows itself takes up at least 1/6th of my 128GB SSD, and my programs take up almost all the rest. BUY A HARD DRIVE. The lower price and higher storage space really helps. Unless you use a REAL operating system (read: Linux). Then you can get away with 20GB pretty easily.
It makes me laugh that most of these people are probably in the middle of taking a shit yet they are complaining that the seven seconds of the intro completely ruins their day but they will comment on it over and over again. Just be happy that they make these awesome videos for free and enjoy them without blowing an o-ring lol
I was a bit sceptical at first, but the new Intro is growing on me.
I liked this video just for the explanation of GiB. Also as someone who works in the storage industry this video is well done.
Listen to your subs and move that intro to the end
Konrad Godel He had a livestream where he said they weren't going to get rid of it. If you can't handle a 7 second wait, that's your problem
They keep doing bullshit no one wants or doesn't care about.
Press the L key to skip it
its 7 seconds if you dont like it leave
Konrad Godel - Yes, you're right, he should listen, because 95% of his subscribers don't give a shit about a frickin'
Cool info thanks! You should do a TechQuickie episode on VPNs and how they work!
Blakehx well
ruclips.net/video/DhYeqgufYss/видео.html you are two years too late I'm afraid
Hahaha, my bad... And thanks! 😜
Ps3 and PS4 does this, my 500gb PS4 has 400gb in free space.......
But then again, I could just buy an external drive
I use a 1 GB flash drive for my saves
So this is why the N64 saves files in pages. Finally makes sense.
Not true in all cases, but here's another factor: everything being in multiples of 8, 1000mb = 1gb to the manufacturer when listing products, but your computer counts 1024mb = 1gb, so for every 500gb listed by a manufacturer that counts 1000mb as 1gb, you lose about 12gb.