It’s a shame this is no longer available. I’d love to see your review of the Muse S gen 2 to see if it is similarly or less accurate as I consider whether it is a good substitute purchase…
Rob, thank you so much for this! You are without a doubt the best sleep reviewer on RUclips. Keep up the great work. The channel will grow. You may need to get the words 'sleep' and 'review' into the channel name eg 'Sleep devices reviewed (by a sleep scientist)'
Unfortunately, this beautiful device is not available to consumers anymore. Especially the accuracy is great and the deep sleep stimulation and breath irregularities detection are pretty much unique.
A review of the MuseS, version 2, would be very helpful considering that the Dreem2 has been withdrawn from the consumer marketplace. A new player in this space is the Frenz Headband, which claims to have been validated in a recent scientific study. An INDEPENDENT scientific evaluation of this band would also be much appreciated to determine its true performance!
I've been practicing lucid dreaming for around a year now. After averaging 1 every two weeks over that period I've decided to take it more seriously. This devices ability to measure sleep stages, in conjunction with consuming (well researched and generally safe) supplements, this device can be invaluable, so thank you for the uncommonly good analysis.
Keep a dream journal first thing after waking and get in the habit of doing regular reality checks. No supplements or devices needed. That being said, from my own experience, obsessing about lucid dreaming is a waste of time. You're better off making good use of your time during the day and then letting your brain just do its thing during sleep.
Your videos are so well structured and full of real facts, that it's not logic that you don't have at least 1 million subscribers! I use a lot the Apple Watch to track my sleep and lot's of other people too, so maybe you can make an experiment based on that
I love your videos and can't believe the fact that you don't have a million subscribers. You should review sleep tracking apps such as sleep as android. I've been using it for a while with my mi band 4.
I just found your channel, I love your videos..I've been having issues with sleep lately, and what you do is very important to help people like me get back the good sleep we once had.
Hi Ayoub! Thanks so much for the compliment. Hope you are getting better sleep! Here's a link to an interview I made with a sleep scientist about getting better sleep: ruclips.net/video/MPDQ1Tt3y14/видео.html , in case you are interested. Sleep well!
CAN'T BUY ONE: They just gave a press release that said they will no longer be selling to consumers -- after lying to everyone for MONTHS and telling them they were simply "sold out". How nice.
With the Dreem 2 headband no longer available to the consumer market, have you considered doing some sleep tracking testing with the Muse S Gen 2 EEG headband? I'm curious to know how accurate it actually is and if you experience many connection issues. I have the Dreem 2 itself but I cannot wear it because it is terribly uncomfortable. I did manage to wear it in the past for 2 months but I no longer can tolerate it. The Muse S is considerably more comfortable but has the disadvantage of needing to be constantly connected to the app during the night to collect data. There is no onboard storage like the Dreem 2 has. Anyway, it would be great to hear your experience with the Muse S, particularly the Gen 2.
Love the idea of interpreting a scientific paper for us laypeople. And I think your question at the end is key: what would most people do with the data?
So far, I have been keeping a spreadsheet with some data from the oura ring. So I may compare it with my subjective scores on ''Mood'', ''Alertness'' & "Muscle Soreness''. As a layperson, I really look forward to knowing how I can improve on this.
@@jeremydudet Very cool Jeremy! Definitely keep doing that :-). I'll make a vlog soon about comparing HRV of the Oura to the subjective scores I've been keeping. Let's see if we find similar results :-) . Have you analysed the data in some way?
@@TheQuantifiedScientist That vlog topic is right up my alley! Thank you, looking forward to it! I haven't analyzed the data yet. I'll let you know once I do! I think I'll wait for a sample of 90 days. (45 so far!)
@@jeremydudet Cool! really interested to see what you find! If you want to make it more convenient to log your subjective scores, there are iPhone apps I use for tracking like rTracker and Reporter that are quite nice. However, this is just important if you want to do this for a longer time. Cheers, Rob
I'd love to have one of these - I have _strong_ symptoms of narcolepsy and I feel like this device would help at least keep a good data record for studies.
I love your content, you have an uplifting spirit and passion for science. I would love to see a video on your opinion about Ground or Earthing. There have been upcoming science towards this practice that claims it has helped people with sleep and sleep apnea. I would love to see your take on this subject. Love your work!
Hi, the confusion matrices kind of confuses me :) Since it doesn't add up to 100%. in this example, if we break down just what the Dreem recognized as "awake": * 9.73% agrees with the reference * 1.84% light in reference * 0.02% deep in ref * 0.61% deep in ref This adds up to 12.2% - what happened in the other 87.8% of cases? I know you don't use the system in your newer videos, but how should I interpret this older data?
At 1st I thought it was a typo & he meant 97.3 not 9.73 since that's the only way it would add up. After I took another look, the numbers don't need equal 100. He's just describing the accuracy of what was predicted between the two devices (professional VS Dreem).
hope you get more views, really like the videos you do! btw, would be nice if you would do a summary video of all the devices you tested whats the strength and weakness and pro and con for each of them? something like this: oura ring, small and comfy, ok reliability, price is ok, can be used for exercise(?) fitbit, comfy if youre used to wearing when sleeping, ok reliability, price is good, can be used for exercise dreem, not so comfy, good reliability, very expensive, not useful to check detailed heart stats, cant be used for exercise
Very impressive! Your channel is only one source of such kind of information. Could you test Muse S? It has affordable price, but I didn't find any real tests results
The closest match to EEG is Dreeem. The closest ,atch to Dreem is Apple Watch Ultra. Avg deep sleep of AW user is 49 minutes. Recommended deep sleep is 1.5 hour. Ergo: either the whole chain EEG-Dreem-AW is completely wrong or all Apple population is on the verge of death and nobody sleeps correclty or people need 49 minutes of deep sleep. Which one is it?
I understand Dream2 is not available to end consumers. Are there any good alternatives (not a smartwatch or a ring) for an accurate sleep headband? (tracking sleep cycles and EKG)?
Oh wow this seems like the one I would need to track well for my narcolepsy BUT would have to wear all day and night, I would definitely feel comfortable doing this 90% of the time probably🤔🤷♀️. But I'm sure going to the beach or theme parks for example would be a no for me, then I wouldn't be getting the readings needed for all the different situations.. 😕 well... Guess il go look into a different one. Thank you 😊
Good question! Given that there is already variation between scorers of the same brand, it should be equal or lower between brands I suspect. Though I am not sure if that difference will mainly be due to the software used to visualise the data instead of actually being due to the raw signal. What do you think?
Great vids. I wonder if this was a losing product for the company. Maybe the last of the most accurate and precise devices on the market available to joe public :0(
What do you think the benefit of the head band including heart rate and oxygen readings? It would be great if someone could test if you could import Withings data and Dreem 2 data and see if you could make a ML model that was even more accurate that the Dreem 2 alone? Is that something that interests you?
Hi Jason! From what I remember the Dreem 2 band can detect HR. SpO2 I do not think it can detect. However, I am unsure how much more accurate the Dreem would get with that feature. It would be cool if it could be done, but I think this is best left to the people that make the Dreem headband for the next version of their headband. The idea is super cool, but for "us" as consumers the amount of time we would have to spend collecting reference/training data, than integrating the data and building a model, and finally validating that it works better would be astronomical without a certain pay-off. So, this I am happy to leave to the people that are doing this as their actual job ;-). Thanks so much for your idea!
It seems that the was funded by the manufacturer of the headband: "Financial disclosure: This study was supported by Dreem sas. P.J.A. and M.E.B. are employees of Dreem, Inc. and V.T., A.B.H., A.G., M.H., E.D., and H.J. of Dreem sas". Also, I see that they have something different for researchers on their website for $700, so I wonder if that is different from the consumer device. And which one did they use for the study?
Hi Pedro! Did not know that Philips had one :-D. You mean this one: www.usa.philips.com/c-e/smartsleep/deep-sleep-headband , right? I will see if I can check it out! Thanks so much
The Quantified Scientist Yep! That’s the one. I’m super curious about their claims about enhancing deep sleep. You’re the only one out there able to make a scientific unbiased analysis of the thing. I would definitely buy the thing if I had a guarantee it works. Specially looking into promoting REM sleep
Great video, I would love to get this, but my budget is more appropriate for a Fitbit 3 you reviewed. I want to track my sleep stages as accurately as possible, especially the time I am awake during the night. Could I simply adjust the awake time reported by the Fitbit by 4.1% from your confusion matrix And add this time to my light sleep which your matrix shows that it underreports?
So, good question. I did not check the consistency of this misclassification of awake time over the nights yet. If it is consistent, you probably would not need to correct, since you probably just want to know if you had more or less awake time than average on a given night. So if all nights are wrong in the same way, it would not matter when comparing nights. Don't know if my answer makes sense?
The Quantified Scientist Thanks. Yes, that makes sense. Do you think a 4% over reporting on awake time is significant? Am I understanding correct that if the tracker reports for example 50 minutes of awake time then if the 4% holds correct, then you really got 48 minutes of awake time?
@@onlineservices2050 (My brain is a bit foggy after working in the night, but I'll try to be as clear as possible). So in the confusion matrix, these are percentages of your whole night of sleep. So, 4% wrong would mean 4% of your night was predicted as for instance awake by the FitBit, which should have been light sleep. So that would be a much larger percentage relative to the total amount of awake. Say for instance you spend 8% of your night awake, which is 50 minutes, and the fitbit says 12%, which is 1.5*50=75 minutes. I hope this is clear enough :-).
The Quantified Scientist thanks again this makes sense. I saw a review today of another relatively unknown sleep product - Beddr Sleep Tuner. Would love to see you review it someday. This reviewer has sleep apnea and in one of his videos compared it for accuracy against other trackers including Fitbit charge 3. Very interesting product and currently selling for $150 - ruclips.net/video/f_eaSMHBaF0/видео.html
Im looking for something like this for troubleshooting my sleep stage data, position etc to help me better understand the changes i need to make to my cpap therapy.
Very nice, ty. Will be cool if you test Withings Sleep Analyser. Its matress, so it doesn't require you to wear anything. And very interesting how is it accurate compare to PSG!
Great video. I is nice to have a scientifically validated sleep EEG headband. Unfortunately, it is not available anymore from Dreem2, or only for clinical research, and the costs for the Dreem 2 are now 1400 USD, which does not make the headband attractive even for clinical research. An alternative is the Muse S headband. Interaxon is known to have solid and popular hardware EEG devices, but their software controversial. There is the mind monitor available which offers EEG raw data. The Muse S app allows to write down the most important parameters incl. Sleep score. Since the Muse S has 4 EEG channels as the Dreem 2, we suppose that the accuracy of the Muse S is is close to the accuracy of the Dreem 2 headband. A scientific review of the Muse S against a professional EEG device would be highly desirable, to be able to use the Muse S as a Dreem 2 replacement for people which do not have a lot of money, but want a highly accurate device.
Hi Amaan, ja, gut idee. Wenn ich wieder testen machen kan in einige seit, dan soll ich die App Sleep auch probieren! ( Ich pass seit vier Monate in Wien, so mein Deutsch ist noch nicht so gut, ich hoffe dass mein Deutsch korrekt war )
Now that the Dreem 2 is no longer available for consumers which consumer EEG device will you recommend. I have been experimenting with diets, exercise, dun exposure, etc to increase my deep sleep which though improved now, after several years of insomnia and medication (benzos, etc), it's still far from consistent or optimal. So I would like an accurate (ish) sleep tracker, wearable watch types have not lived up to my expectations and seeing that the Oura ring has gone subscription-based rather than ownership (a model I loathe) I am in the market for something reliable
The Quantified Scientist i‘ve heard of sleep cycle but I‘m sceptical as how good it actually works without an apple watch for example 🤔 you too have a nice evening and greetings from Germany 🇩🇪
Also which devices would you recommend for sleep tracking? I am kinda afraid that for example an oura ring or the fitbit would interfere with my sleep because i need to wear these 🤔
@@maxfriedrich1932 I indeed think that it will likely not work very well, there is just not enough data to make a prediction. But I have to test it to make sure. ;-)
@@maxfriedrich1932 I think it will be difficult to get accurate sleep measurements without wearing anything. There is the Withings Sleep Mat, I think officially it is called the "withings sleep analyzer". I used the generation before this, and in my opinion it did quite bad. Especially if you have a partner in the same bed. Maybe I'll get to test it at some point. If you want reliable sleep prediction I think in the near future you will still need an EEG device like the Dreem 2 Headband, but this could be uncomfortable for some people. Hope this helps!
Hi n v. I mention this in the long version of this video (ruclips.net/video/OIokaYy5dXk/видео.html): more than half of the researchers are part of the "Dreem Team". So there might be some bias there. On the other hand, it would probably be difficult for them to find a completely independent party to do this research. And, some of the researchers were not from the Dreem company. Also, they contacted me, and said they were willing to send me a Dreem device if I ever wanted to test it against a professional EEG myself, which they would be unlikely to do if they did not trust the results. Have a great day!
Good question, I tested some FitBit models : ruclips.net/video/NYRq4ahPJ2c/видео.html and ruclips.net/video/UAcasFNzUl8/видео.html . And I have also tested the FitBit Ionic. All seem to perform roughly the same, and reasonably well with an accuracy ~70% . Hope this helps!
The dreem 2 is the BEST CONSUMER Sleep tracker ,better than any sleep watch and the new muse s gen 2 (2021)and the ouraring 3 (2021) and all fitbits sleep tracker watches.
@@scottk1525 No, I got your point. You're ignoring a study result based on who paid for it. Did it ever dawn on you that if the study didn't work out to their favor, they just wouldn't publish it? It's just a dumb take.
@@12centuries40 " *No, I got your point.* " Clearly you did not. " *Did it ever dawn on you that if the study didn't work out to their favor, they just wouldn't publish it?* " Did it ever occur to you that there probably are such unpublished studies? Did it also occur to you that researchers have strong incentive to interpret results in favor of their benefactors? That's the point, idiot.
A review of the Muse S as an alternative to the dreem 2 would be great! :)
It’s a shame this is no longer available. I’d love to see your review of the Muse S gen 2 to see if it is similarly or less accurate as I consider whether it is a good substitute purchase…
I would also be very interested.
Me too
Me 4
Me too
Me too!
I hope they make this product available again soon. Would love to use it to check the effectiveness of my PAP therapy.
Rob, thank you so much for this! You are without a doubt the best sleep reviewer on RUclips. Keep up the great work. The channel will grow. You may need to get the words 'sleep' and 'review' into the channel name eg 'Sleep devices reviewed (by a sleep scientist)'
Thanks for the suggestion and thanks so much for the compliment! Have a great day!
great seo tip, agreed - i do marketing for my day job
Please consider testing/reviewing the muse S head which also has sleep tracking capability! Thank you!
Unfortunately, this beautiful device is not available to consumers anymore. Especially the accuracy is great and the deep sleep stimulation and breath irregularities detection are pretty much unique.
I'd love to know why it isn't. It's such a great device
A review of the MuseS, version 2, would be very helpful considering that the Dreem2 has been withdrawn from the consumer marketplace. A new player in this space is the Frenz Headband, which claims to have been validated in a recent scientific study. An INDEPENDENT scientific evaluation of this band would also be much appreciated to determine its true performance!
I've been practicing lucid dreaming for around a year now. After averaging 1 every two weeks over that period I've decided to take it more seriously. This devices ability to measure sleep stages, in conjunction with consuming (well researched and generally safe) supplements, this device can be invaluable, so thank you for the uncommonly good analysis.
how about when you feel the vibrations on your body ?
Keep a dream journal first thing after waking and get in the habit of doing regular reality checks. No supplements or devices needed. That being said, from my own experience, obsessing about lucid dreaming is a waste of time. You're better off making good use of your time during the day and then letting your brain just do its thing during sleep.
Your videos are so well structured and full of real facts, that it's not logic that you don't have at least 1 million subscribers! I use a lot the Apple Watch to track my sleep and lot's of other people too, so maybe you can make an experiment based on that
Hi Daniel! Yes, I hope to be able to test the Apple watch sometime in the next few months :-D. Stay tuned!
I love your videos and can't believe the fact that you don't have a million subscribers. You should review sleep tracking apps such as sleep as android. I've been using it for a while with my mi band 4.
Thanks for the suggestion Iván! And thanks for the compliment! I will do my best :-) Have a great day!
I just found your channel, I love your videos..I've been having issues with sleep lately, and what you do is very important to help people like me get back the good sleep we once had.
Hi Ayoub! Thanks so much for the compliment. Hope you are getting better sleep! Here's a link to an interview I made with a sleep scientist about getting better sleep: ruclips.net/video/MPDQ1Tt3y14/видео.html , in case you are interested. Sleep well!
CAN'T BUY ONE: They just gave a press release that said they will no longer be selling to consumers -- after lying to everyone for MONTHS and telling them they were simply "sold out". How nice.
@@robinz222 -- I don't know of anything nearly as good. To say I'm disappointed would be an understatement.
@@robinz222 Thanks man -- will look into that!
Its available in India, New Zealand and Australia
I own but I can’t use it anymore. The app doesn’t phone home anymore.
It is a shame what this company did to their ordinary clients! It must come back to general market
Great stuff! This is what a review should be like, or at least what I want them to be like. Keep up the great work :)
With the Dreem 2 headband no longer available to the consumer market, have you considered doing some sleep tracking testing with the Muse S Gen 2 EEG headband? I'm curious to know how accurate it actually is and if you experience many connection issues. I have the Dreem 2 itself but I cannot wear it because it is terribly uncomfortable. I did manage to wear it in the past for 2 months but I no longer can tolerate it. The Muse S is considerably more comfortable but has the disadvantage of needing to be constantly connected to the app during the night to collect data. There is no onboard storage like the Dreem 2 has.
Anyway, it would be great to hear your experience with the Muse S, particularly the Gen 2.
Love the idea of interpreting a scientific paper for us laypeople. And I think your question at the end is key: what would most people do with the data?
Thanks Jed! Indeed, besides being "cool to know", using this type of data to improve your sleep is not trivial. Thanks for the comment!
So far, I have been keeping a spreadsheet with some data from the oura ring. So I may compare it with my subjective scores on ''Mood'', ''Alertness'' & "Muscle Soreness''. As a layperson, I really look forward to knowing how I can improve on this.
@@jeremydudet Very cool Jeremy! Definitely keep doing that :-). I'll make a vlog soon about comparing HRV of the Oura to the subjective scores I've been keeping. Let's see if we find similar results :-) . Have you analysed the data in some way?
@@TheQuantifiedScientist That vlog topic is right up my alley! Thank you, looking forward to it! I haven't analyzed the data yet. I'll let you know once I do! I think I'll wait for a sample of 90 days. (45 so far!)
@@jeremydudet Cool! really interested to see what you find! If you want to make it more convenient to log your subjective scores, there are iPhone apps I use for tracking like rTracker and Reporter that are quite nice. However, this is just important if you want to do this for a longer time. Cheers, Rob
I'd love to have one of these - I have _strong_ symptoms of narcolepsy and I feel like this device would help at least keep a good data record for studies.
I love your content, you have an uplifting spirit and passion for science. I would love to see a video on your opinion about Ground or Earthing. There have been upcoming science towards this practice that claims it has helped people with sleep and sleep apnea. I would love to see your take on this subject. Love your work!
Hi Seku! Thanks for the very nice compliments! I hope you will continue to enjoy my videos. Thanks for your suggestions and have a great day!
Hi, the confusion matrices kind of confuses me :)
Since it doesn't add up to 100%.
in this example, if we break down just what the Dreem recognized as "awake":
* 9.73% agrees with the reference
* 1.84% light in reference
* 0.02% deep in ref
* 0.61% deep in ref
This adds up to 12.2% - what happened in the other 87.8% of cases?
I know you don't use the system in your newer videos, but how should I interpret this older data?
At 1st I thought it was a typo & he meant 97.3 not 9.73 since that's the only way it would add up. After I took another look, the numbers don't need equal 100. He's just describing the accuracy of what was predicted between the two devices (professional VS Dreem).
hope you get more views, really like the videos you do!
btw, would be nice if you would do a summary video of all the devices you tested
whats the strength and weakness and pro and con for each of them?
something like this:
oura ring, small and comfy, ok reliability, price is ok, can be used for exercise(?)
fitbit, comfy if youre used to wearing when sleeping, ok reliability, price is good, can be used for exercise
dreem, not so comfy, good reliability, very expensive, not useful to check detailed heart stats, cant be used for exercise
Hi Stan! Yes, this is in the works (but in the early stages still) 😊
Giving you a like and subscribe from California. Thank you for your videos, Rob!
Thanks Jeremy, this is very much appreciated! Have a great day! Hopefully I can provide you with more informative and fun content over time :-D
Very impressive! Your channel is only one source of such kind of information. Could you test Muse S? It has affordable price, but I didn't find any real tests results
The closest match to EEG is Dreeem. The closest ,atch to Dreem is Apple Watch Ultra. Avg deep sleep of AW user is 49 minutes. Recommended deep sleep is 1.5 hour.
Ergo: either the whole chain EEG-Dreem-AW is completely wrong or all Apple population is on the verge of death and nobody sleeps correclty or people need 49 minutes of deep sleep.
Which one is it?
Another great video. Thank you.
Thanks for the compliment, it is really appreciated!
I understand Dream2 is not available to end consumers. Are there any good alternatives (not a smartwatch or a ring) for an accurate sleep headband? (tracking sleep cycles and EKG)?
In the U.S. the PLL deep sleep enhancement is deactivated thanks to the FCC. Paying $500 for just a sleep monitor is ridiculous.
Can be hacked to bring the full deep sleep stimulation. At the moment it's 10%
I hope that I can buy the dreem 3 soon in the Netherlands
Hello, thank you for the video. What would you say is the most accurate sleep tracker you have tested as of now?
It's the dreem 2
Oh wow this seems like the one I would need to track well for my narcolepsy BUT would have to wear all day and night, I would definitely feel comfortable doing this 90% of the time probably🤔🤷♀️. But I'm sure going to the beach or theme parks for example would be a no for me, then I wouldn't be getting the readings needed for all the different situations.. 😕 well... Guess il go look into a different one. Thank you 😊
Great video, thanks! I was wondering how the professional device would performs in comparison with other professional device from a different brand. 😉
Good question! Given that there is already variation between scorers of the same brand, it should be equal or lower between brands I suspect. Though I am not sure if that difference will mainly be due to the software used to visualise the data instead of actually being due to the raw signal. What do you think?
@@TheQuantifiedScientist I agree. Too many variables to control ;)
Thanks!
Hi Rob. Looking at the dream 2 headband. It looks like you could wear the Muse s and the dream 2 at the same time.
Great vids. I wonder if this was a losing product for the company. Maybe the last of the most accurate and precise devices on the market available to joe public :0(
Awesome stuff
Thanks so much Krzysiek!
But that diagonal stats were better in watches only....
Test the apple watch sleep tracking please
Once the new apple watch releases I will! Thanks for the suggestion, and have a great day!
What do you think the benefit of the head band including heart rate and oxygen readings? It would be great if someone could test if you could import Withings data and Dreem 2 data and see if you could make a ML model that was even more accurate that the Dreem 2 alone? Is that something that interests you?
Hi Jason! From what I remember the Dreem 2 band can detect HR. SpO2 I do not think it can detect. However, I am unsure how much more accurate the Dreem would get with that feature. It would be cool if it could be done, but I think this is best left to the people that make the Dreem headband for the next version of their headband. The idea is super cool, but for "us" as consumers the amount of time we would have to spend collecting reference/training data, than integrating the data and building a model, and finally validating that it works better would be astronomical without a certain pay-off. So, this I am happy to leave to the people that are doing this as their actual job ;-). Thanks so much for your idea!
It seems that the was funded by the manufacturer of the headband: "Financial disclosure: This study was supported by Dreem sas. P.J.A. and M.E.B. are employees of Dreem, Inc. and V.T., A.B.H., A.G., M.H., E.D., and H.J. of Dreem sas". Also, I see that they have something different for researchers on their website for $700, so I wonder if that is different from the consumer device. And which one did they use for the study?
Hi thank you for your great work , what device do you recommend for sleep tracking son nice dreem 2 is no longer available ?
If you need someone to pay for the device for your tests please contact me.
You have to try the Phillips one!
Hi Pedro! Did not know that Philips had one :-D. You mean this one: www.usa.philips.com/c-e/smartsleep/deep-sleep-headband , right? I will see if I can check it out! Thanks so much
The Quantified Scientist Yep! That’s the one. I’m super curious about their claims about enhancing deep sleep. You’re the only one out there able to make a scientific unbiased analysis of the thing. I would definitely buy the thing if I had a guarantee it works. Specially looking into promoting REM sleep
Any progress on testing the Phillips device?
Great video, I would love to get this, but my budget is more appropriate for a Fitbit 3 you reviewed. I want to track my sleep stages as accurately as possible, especially the time I am awake during the night. Could I simply adjust the awake time reported by the Fitbit by 4.1% from your confusion matrix And add this time to my light sleep which your matrix shows that it underreports?
So, good question. I did not check the consistency of this misclassification of awake time over the nights yet.
If it is consistent, you probably would not need to correct, since you probably just want to know if you had more or less awake time than average on a given night. So if all nights are wrong in the same way, it would not matter when comparing nights. Don't know if my answer makes sense?
The Quantified Scientist Thanks. Yes, that makes sense. Do you think a 4% over reporting on awake time is significant? Am I understanding correct that if the tracker reports for example 50 minutes of awake time then if the 4% holds correct, then you really got 48 minutes of awake time?
@@onlineservices2050 (My brain is a bit foggy after working in the night, but I'll try to be as clear as possible). So in the confusion matrix, these are percentages of your whole night of sleep. So, 4% wrong would mean 4% of your night was predicted as for instance awake by the FitBit, which should have been light sleep. So that would be a much larger percentage relative to the total amount of awake. Say for instance you spend 8% of your night awake, which is 50 minutes, and the fitbit says 12%, which is 1.5*50=75 minutes. I hope this is clear enough :-).
The Quantified Scientist thanks again this makes sense. I saw a review today of another relatively unknown sleep product - Beddr Sleep Tuner. Would love to see you review it someday. This reviewer has sleep apnea and in one of his videos compared it for accuracy against other trackers including Fitbit charge 3. Very interesting product and currently selling for $150 - ruclips.net/video/f_eaSMHBaF0/видео.html
@@onlineservices2050 Thanks for the suggestion. For sure, if possible I will include it in the next round of testing!
Excellent, thank you
Glad you enjoyed it August!
This confusion matrix has left me confused. Shouldn't the columns add up to 100? I think they're typos?
Im looking for something like this for troubleshooting my sleep stage data, position etc to help me better understand the changes i need to make to my cpap therapy.
Have you compared the muse s with the dream 2
Very nice, ty. Will be cool if you test Withings Sleep Analyser. Its matress, so it doesn't require you to wear anything. And very interesting how is it accurate compare to PSG!
Thanks for the idea! I did test the Withings Aura, so the generation before, hopefully I can also test the sleep analyzer :-)
@@TheQuantifiedScientist can tell me your results for aura? i have aura, and thinking about upgrade
@@quantifiedmax I still have to do the formal analysis, so take it with a grain of salt, but from what I remember, it was not that good
@@TheQuantifiedScientist ok, ty for info :) will wait when you can test newest one, they say its medical grade now)))
@@quantifiedmax Cool, the review of the old one will probably come first :-) . Hopefully I can convince Withings to send me a test unit
Great video. I is nice to have a scientifically validated sleep EEG headband. Unfortunately, it is not available anymore from Dreem2, or only for clinical research, and the costs for the Dreem 2 are now 1400 USD, which does not make the headband attractive even for clinical research.
An alternative is the Muse S headband. Interaxon is known to have solid and popular hardware EEG devices, but their software controversial. There is the mind monitor available which offers EEG raw data. The Muse S app allows to write down the most important parameters incl. Sleep score.
Since the Muse S has 4 EEG channels as the Dreem 2, we suppose that the accuracy of the Muse S is is close to the accuracy of the Dreem 2 headband. A scientific review of the Muse S against a professional EEG device would be highly desirable, to be able to use the Muse S as a Dreem 2 replacement for people which do not have a lot of money, but want a highly accurate device.
NO ITS NOT! How do u EVEN put that garbage Muse in the SANE sentence as Dreem?
Not sure I understand the confusion matrix fully. Shouldn't each column/row add up to 100%?
It should be sell for general public!!!
Hey kannst du mal nen Video über die App Sleep as Android zu machen
Hi Amaan, ja, gut idee. Wenn ich wieder testen machen kan in einige seit, dan soll ich die App Sleep auch probieren! ( Ich pass seit vier Monate in Wien, so mein Deutsch ist noch nicht so gut, ich hoffe dass mein Deutsch korrekt war )
Now that the Dreem 2 is no longer available for consumers which consumer EEG device will you recommend. I have been experimenting with diets, exercise, dun exposure, etc to increase my deep sleep which though improved now, after several years of insomnia and medication (benzos, etc), it's still far from consistent or optimal. So I would like an accurate (ish) sleep tracker, wearable watch types have not lived up to my expectations and seeing that the Oura ring has gone subscription-based rather than ownership (a model I loathe) I am in the market for something reliable
The problem with Dreem 2 is that it leaves an indentation on both sides of my head and feels heavy.
If you have to recommend a EEG monitoring device, which one would you recommend?
Brain bit
Please do some reviews on sleep tracking apps for the iphone 🙏🏻 ps great informative videos 👍🏻
Thanks for the compliment Max, and thanks for commenting! Which tracking apps would you like to know about? Have a great evening!
The Quantified Scientist i‘ve heard of sleep cycle but I‘m sceptical as how good it actually works without an apple watch for example 🤔 you too have a nice evening and greetings from Germany 🇩🇪
Also which devices would you recommend for sleep tracking? I am kinda afraid that for example an oura ring or the fitbit would interfere with my sleep because i need to wear these 🤔
@@maxfriedrich1932 I indeed think that it will likely not work very well, there is just not enough data to make a prediction. But I have to test it to make sure. ;-)
@@maxfriedrich1932 I think it will be difficult to get accurate sleep measurements without wearing anything. There is the Withings Sleep Mat, I think officially it is called the "withings sleep analyzer". I used the generation before this, and in my opinion it did quite bad. Especially if you have a partner in the same bed. Maybe I'll get to test it at some point. If you want reliable sleep prediction I think in the near future you will still need an EEG device like the Dreem 2 Headband, but this could be uncomfortable for some people. Hope this helps!
Please review rhe Muse S Gen 2!
The first author of study is a vp at dreem. Not what I would call an independent study…
did dreem pay for the scientific study?
Hi n v. I mention this in the long version of this video (ruclips.net/video/OIokaYy5dXk/видео.html): more than half of the researchers are part of the "Dreem Team". So there might be some bias there. On the other hand, it would probably be difficult for them to find a completely independent party to do this research. And, some of the researchers were not from the Dreem company. Also, they contacted me, and said they were willing to send me a Dreem device if I ever wanted to test it against a professional EEG myself, which they would be unlikely to do if they did not trust the results. Have a great day!
whats the point of knowing sleep stages tho?
Coulg you say a word about what to do with the data?
Hi, I have the opportunity to buy a used dreem 2 headband. I know we can't purchase the dreem 3. Is the dreem 2 usable?
Your hair is incredible
Is professional EEG device 100% occurate?
good point! I didnt thought in that ...
pleaase use a different graph
No buy button on the website. Bunch of amateurs.
If I have the dreem 1 is there an app I can use it with ? Or they're out ? thanks
Lol it's funny how the stock coding vid is some node server and has nothing to do with machine learning like he was talking about 🤣🤣
Hoi Rob, kan ik die Dreem overnemen van je?
How does it compare to fitbit versa?
Good question, I tested some FitBit models : ruclips.net/video/NYRq4ahPJ2c/видео.html and ruclips.net/video/UAcasFNzUl8/видео.html . And I have also tested the FitBit Ionic. All seem to perform roughly the same, and reasonably well with an accuracy ~70% . Hope this helps!
The dreem 2 is the BEST CONSUMER Sleep tracker ,better than any sleep watch and the new muse s gen 2 (2021)and the ouraring 3 (2021) and all fitbits sleep tracker watches.
Have you evaluated Muse S?
Dreem 2 is not available to the public anymore. Only available for research and academics.
They stopped making these
They will be back in 2023
They released dreem 3 for $1500 only to clinics , but it's same hardware as dreem 2 only rebranding to clinics and higher prices !
Try drugs and then use these machine
Shocker: the study was funded by Dreem.
Do you think their competitors would fund it? It's a massively niche product. Nobody else would spend the time to do a study on something like this.
@@12centuries40 Way to miss the point.
@@scottk1525 No, I got your point. You're ignoring a study result based on who paid for it. Did it ever dawn on you that if the study didn't work out to their favor, they just wouldn't publish it? It's just a dumb take.
@@12centuries40 " *No, I got your point.* "
Clearly you did not.
" *Did it ever dawn on you that if the study didn't work out to their favor, they just wouldn't publish it?* "
Did it ever occur to you that there probably are such unpublished studies? Did it also occur to you that researchers have strong incentive to interpret results in favor of their benefactors? That's the point, idiot.
Why does one need to basically grade how well they sleep ??? Shouldn't they just focus a methods that help people go to sleep