I would think the recent WatchOS 9.x changes profoundly improve the way autosleep works with regard to tracking stages - as they claim to use the values provided from Apple Watch. Would love an update ☺
@@smolcomputeI am not the app's creator. The autosleep algorithm unclear to me aswell, and there are even some inconsistencies/bugs that I have reported with no success. What I observed is that if you activate sleep stages inside Autosleep, then the sleep score relies heavily on the apple watch biometrics data ("sleep" data inside "health" app). It adds some extra computation but I don't think it tries to improve upon the 'raw' sleep data coming from the watch, more like what you said, a 'repackaging'
Thank you so much Rob, excellent as always!! I was wondering if maybe you could keep a rank of the top sleep trackers in your opinion, that would be just incredible, I would love that and I'm sure a lot of people too. Thanks again Rob, take care
@@TheQuantifiedScientist looking forward to that Rob. One other sleep tracker that would be also interesting to compare is the sleeptracker (by fullpower tech). It was designed by the inventor of the first camera phone and a ledge in Silicon Valley- Phillippe Kahn. I’ve found it more accurate than the Nokia sleep. It uses more big data and AI and claims much higher accuracy
thanks Rob, that's very interesting. I've tested all these apps and AutoSleep was the one who fitted my sleep better. Using it for an extended period of time I've really noticed quite some accuracy on what AutoSleep reports and how I feel. Something you did not mention was the fact that AutoSleep lets you calibrate how sensitive it should be to your movements etc. I wonder if that might've affected your results? That being said I'm staying tuned for the other videos. at the end, whichever app is better, I'll give it another extended try. For now I'll keep with AutoSleep 👍
The same question came to my mind. How accurate would AutoSleep be once you calibrated it after, let's say, three nights? It would be interesting if you would test that, Rob.
Hey! I just downloaded the app and was wondering how or where in the app do you do the sensitivity calibration? can't find that info anywhere.. thanks!
Hi Mr. Lopes, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
I agree. I checked the clock several times this night. After a bit of calibration/sensitivity changing, those wakeups have properly been reflected on the graph. For me, AutoSleep is the most accurate among the various sleep tracking apps for Apple Watch.
I’m glad I came across your videos analyzing sleep, the devices, and the apps. I appreciate your scientific data driven approach explained in an understandable relative way. Keep it up.
Thanks, i find the autosleep app detects sleep when i am awake. Please re analyze after using the calibration feature to “adjust” what you believe actually occurred to see if the correlation is much improved.
I use this app for about 5 years. I can export you the data via Advanced date range csv exports if you want. Did you do the calibrations the app provides? They are have huge impact on how the data is interpreted. Early false sleep tracking is one of them. You can also link the app to apple home, so it knows when you turned of the lights for sleep, and the watch app can be used to manually start sleep tracking when you are about to sleep
This is the first Fitbit I have used. It has some new features ruclips.net/user/postUgkxbkrje8Y7BaqRkAjimw-55ajvVo7RbcIp and I like the information that it gives me.I think the phone app could be designed to be a bit more accommodating, as it can be confusing to use. The rubber band is comfortable, and normally I do not like rubber bands for my watches, but this is comfortable.I am looking forward to seeing if this helps me stay accountable in my fitness endeavors!My only gripe is the box was very damaged when it arrived, however, the tracker is performing perfectly!
I just got 99-100% in all ratings in Autosleep. My blood pressure was better than usual, I feel that it was one of the best night sleeps I measured, so I think that Autosleep is very accurate. I had few nights ago the 3 hours of awake time while trying to sleep, so the app could be fooled by my hand in one position etc. but it wasnt, it shows 3 hours in a row of awake. For me, works great.
I use auto sleep for around two years , I love the app , maybe it’s incorrect I never had a way to test it .but I love that it shows heart rate and sound during the night .
The one million dollars question: are the results affected by the sensors of iwatch? Or the (in)accuracy is only due to app’s algorithm misspecifications??
Hey Rob, thanks for your video! I like the Autosleep App quite a lot, though you have to calibrate the sensitivity of the sensors, otherwise it shows the effects found in your test (too much deep sleep detected, wake states not properly detected etc.). It took me quite a while to figure out the best setting, but now it works quite realistically (not scientifically proven!). Did you try to calibrate the sensor sensitivity, before you started your test? Greetings from Germany!
Hi Rudolf! Good point! No, I just went with the "out of the box" settings, since I wanted to use it as most people would experience it. That being said, I also did not expect for the setting to have such a major influence, so it is very valuable to get comments like this! I might look into it at some point in more detail :-D . Have a great day!
your right, but sleep cycle has no need to calibrate and show decent results, autosleep developer should see this video as a feedback. i have both apps, and was thinking autosleep was always "right", now i have a different perspective
Hi Rodolf, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
Would you be willing to do another review of the app with the calibration? As you’ve seen in other comments, the app is very sensitive to the calibration settings and I think the results might vastly differ depending on the settings. I’m curious to see how it holds up compared to the other apps when calibrated properly.
The AutoSleep (AS) app has a "lights out function" to decrease awake vs asleep errors. Like watching this video before going to sleep😅. The problem with AS was more of a negative psychological impact. If I felt like I slept great-like the old "bright eyed" etc., but AutoSleep app says my readiness score is terrible-it has a negative impact on me. Also, AS doesn't understand that people naturally will change position while sleeping. AS marks ANY movement as restless. (We won't even discuss how AS treats you when you ask or question a result.)
Autosleep has worked very well for me, I have fine tuned my sleep to get about 50% deep sleep. One time I had 5 hours out of 7 1/2. Seems pretty accurate too.
@@Alan-lo1qc Supplements and environmental controls. Earplugs and Magnesium L-Threonate were probably the best, along with blackout curtains and L-Theanine.
Thanks for the video/test/comparison - but I don't think a test of AutoSleep without personal calibration, is particularly meaningful or comparable. If you want to seriously test/compare it, you should adapt it to your settings as the instruction manual describes. It works at least for me quite well.
Great point! This is why it is so valuable for me to get feedback 😊. I'm just here by myself testing these apps, some of them I haven't used before. I did see some options, but wanted to test the "out of the box" model, since I figured most people would not adapt the baseline model. Did not expect it might make such a big influence. I might check it again after calibrating! Have a great day!
@@TheQuantifiedScientist Yes, please do. I think many people (incl me, of course 😊) would be very interested in the a video about how to calibrate the app and how the calibration affects the app accuracy.
@@TheQuantifiedScientist It's one of the points that IMHO makes AutoSleep better than the other apps / trackers. That you can adjust it to your movements and therefore register more or less sleep... I think it will address your issues. The whole measurement is detecting too deep sleep for you. Sleep at the times you are awake, wake moments that are light sleep and too much deep sleep in general...
I know it’s relatively simplistic, but will you be able to talk about Apple’s sleep tracking that is built in? I’m curious if I should delete AutoSleep and just use Apple’s.
Ive been using Apples Sleep tracker, and today even though I woke up around 9am. The apple sleep tracker showed me that I woke up at 6:45(time my alarm was set) and stopped recording after that. It also doesn’t track my naps and all the info you get is how many hours asleep (keep in mind it doesnt calculate any time you spent being awake in the night) so it is very very basic :(
@@zahinozlan7720 oh no kidding. Almost seems like how AutoSleep works when you don’t wear the watch to bed. Just tracks when your phone is on the charger. Too bad.
@@jakekayden4061 heyy bud, Idk since I stopped using it. But let me tell you this, the watches most accurate measurement is most probably your sleep time. if other metrics are important to you, you should invest in a proper sleep tracking devicee, use the watch to track ur sleep for funsies
Great video! I personally use Pillow app which also uses the apple watch. I would love you to test this app! Keep doing these videos, I love them! Edit: I just saw on your sleep cycle video you are testing other apps, including pillow. I can't wait.
Thanks for an intriguing overview Rob. I have just switched from a Fitbit Blaze to Apple Watch 6& I’m already missing the sleep tracking. I have been trialling the AutoSleep app but remain very unimpressed. It recently scored me the best sleep ever for a night that, at best, I dozed for an hour. I also find the charts confusing & hard to get any meaningful data from.
Hi Rob- Thank you for this video. I have been using the auto sleep app for over a year now, and have been pretty happy with it, although I do think that it's somewhat complicated to read and understand. My husband has been having sleep issues so we bought him an Apple watch and he started using the Auto Sleep app. His results have been horrible! Last night, for example we both went to bed at the exact same time. In the morning, his results showed his sleep beginning 3-1/2 hours AFTER we both went to sleep. It didn't show AWAKE, it just started measuring his sleep cycle 3-1/2 hours after he was actually sleeping. We emailed the app developers and hope to hear from them. I think based on your review, we will also try out the Sleep Cycle app. Hopefully it will be easier to use and understand. Thanks!
Hi Rob, I am using Auto Sleep for several months now and I realized, that it adjusts to my sleeping/ awake patterns after a while, esp. after letting it know, that it detected something (eg a sleep period) wrongly. And it definitely detects waking stages, in which I realize myself, that I am awake. Maybe the other ones, where I get into sleep immediately again, are detected as light sleep? Over all it’s a good App for me. The only thing that’s of no help for me at all and oftenly seemes to be wrong is the detection of my „Heutiges Befinden“ (how I feel today after waking up). There seemes to be no correlation to my real feeling.
I see that a bit about readiness scores. I downloaded a few apps to check it out myself and see if there is correlation for me. Unfortunately autosleep wants to auto detect sleep, I’m afraid it will interfere with Apple’s, so I can’t try it.
Thanks a lot for this video! I would like to know which kind of settings you used for the app since in autosleep it is possible to change different sleep “sensitivity”, now sure how to define it.
Yeah, you are able to calibrate the detection so it reflects what is more accurate. I on the rare occasion do use the edit function when it misses obvious amounts of sleep.
its been 2 years since you did the app review... could you do a new review based on the latest version and technology from apple watch 9 series and iphone 15 to see how this app preform today ?
What is the best sleep tracking app for the Apple Watch Series 7? I have serious sleep issues and I am looking for something that would help me get it under control. Thanks for the awesome video! I purchased this app earlier today and I am going to try and get a refund.
Thanks for sharing, really awesome and in-depth review! Question: for sleep & fitness coaching - which I currently use the Whoop 4.0 for, would you recommend switching to Apple Watch? if so what apps would you recommend for this? Thanks!!
I have used it for a while. What I find useful is the histogram over how much sleep i got, when I got to bed, and average HR during sleep. I also tried the smart alarm, but found it consistently disturbed me during REM sleep, so I have stopped using that function.
Excellent analysis, before watching your videos, my thoughts were that the app was too generous with deep sleep and no so good when detecting awake stages. In general, i think mi band 5 is better for tracking sleep than this app. I’ll try sleepcycle. Thanks a lot for this kind of videos.
Thanx, I use the AutoSleep and use the sleep button for when I really want to go to sleep. Anyways I think I will be waiting for your final tests to buy a new app as this one is clearly not good. Thank you for your work!
This is a very good video with a lot of information, maybe too much. I am a 65 year old male and although I have a good understanding on modern electronic devices I find it difficult to understand and decide on which is a good sleep app. I want to track my sleep and try to make changes in my life to improve my sleep. Not sure I need the amount of information being provided in the Auto Sleep app. Help Please
In iOS 16 and Watch OS 9, Apple has released additional sleep stage metrics. The good news is that you have the choice to elect which sleep data you wish to use in AutoSleep
From Tunisia north africa thank you a lot we appreciate your effort , your are really helping peoples around the worlds may god bless you or nature or whatever energy contrôle this words Respect and encouragement
This was an interesting video. Thanks for the data driven analysis. It would be interesting to see if AutoSleep's performance has improved since this review with software and hardware updates. BTW, I never use the Auto sleep detection feature of AutoSleep. I find it very easy to just tap the "Lights Off" start sleep button. And that removes all the issues associated with the feature. And yes, I understand it sounds crazy to not use the Auto sleep detection feature for an app called AutoSleep. 🤣🤣🤣
Hey Rob, One view and I am now your biggest fan. Deep sleep is so important in maintaining BDNF and HGH in the aging population. The nightly feedback and tweaking variations in the daily feeding-drinking metrics (with AutoSleep deep sleep metrics) gives this 71 year old geezer the ability to successfully incorporate lifestyle changes to routinize average deep sleep outcomes greater than 3 hours.
I once had a an afternoon caffeine overdosing accident. That night I experienced an AutoSleep verified tortuous night in bed with no sleep recorded. LOL
I’ve been using Autosleep for about 2 years now. I originally tried Sleep Cycle, but wanted something that detects sleep automatically, since I often fall asleep on the couch and wake up to move to the bed after 1 or 2 sleep cucles, so I don’t get to manually mark going to bed. While I never imagined it would be scientifically accurate, I find the more deep sleep it reports, the better I actually slept. Also the readiness score has been pretty accurate for me. I also had the problem with it reporting light sleep where I was still awake, but a tweak to its sensitivity fixed that. For the results you got, I would imagine setting it a step or 2 towards less sensitive, would have eliminated the false positives at the beginning and also more accurately reported your awake periods.
Hi, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
I wonder if this has got any better with series 7 or 8. I know apple did a lot of work on their sleeping app. Is autosleep worth the money over the default app now?
Hi Rob, Yet another great video, thanks a lot. Your scientific approach is quite appreciated. I use AutoSleep for several month and as people say here, calibration is quite an issue. In the beginning the app was not accruate at all, but after some short period and calibration exercices it detects correctly the time I fall asleep and morning waking up time. Awake peaks are properly detected only if there is a lot of movments or walking. Indeed, sometimes it detects sleep when I just stay in the sofa, ~30% of those cases are true naps. Waiting for your next videos on other apps. Maybe it will make me change ? Thanks again for your great videos!
Dear Rob, I value your data and opinion and follow your channel so thank you. I am wondering what's your opinion about the cheaper solutions like xiaomi or honor or some other cheap solutions specifically for sleep tracking (IMHO the Honor Band 6 is currently the #1 choice). Also the Honor Watch ES or equivalent for a more accurate next step sleep tracking over the cheaper solutions. Again thank you for the videos.
Very good presentation .. thank you. I have autosleep but have given up tracking sleep .. it seems pointless. I go to bed at 10, take a trazodone, am sleep in minutes, sleep to 5. Was getting pissed off with the sleep stages, and especially the HRV. there is nothing else to optimize wrt my sleep habits so what’s point of stressing about things I commit change. Does my readiness or HRV mean I won’t run 4mi with the dog at 7am … no .. will I still max out at CrossFit - yes - so .. why bother. Did t AA co-opt a prayer from the 40’ “give us the serenity to accept what cannot be changed, the courage to change what can be changed, and the wisdom to know the one from the other.” .. could have been written about sleep apps.
Hello! Very informative video! I was wondering if this app can record naps during the day. I'm currently using the default Apple Watch sleep app however this doesnt register naps during the day. I want an app that can record naps.
Hey I love your videos and think they're the best out there to actually check on devices, apps and so on and see how good they actually are! Would you also like to do a video about the rise sleep app? Best from Tübingen!
Apple are putting a similar app directly on the watch in the new update. 👍🏻 I like AutoSleep but it took a while to customise so it gave me a truer reading.
I’ve been using the app for years now. And I always was worried that it is not showing enough deep sleep. After watching your video I am worried now that my deep sleep situation is even worse due to your observation that it is showing too much deep sleep as whereas I am getting not enough according to this app.
Hi Christoph, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
I've been using Auto Sleep tracker for just a week. I find it captures the times I wake up during the night well - but that may be because I'm also getting out of bed to head to the bathroom. I do find that it gives me credit for light sleep when I know I'm awake but resting in a still state (when I'm first in bed). I think DEEP SLEEP tracking is over-rated. I don't understand the "Readiness" dial which is almost always low even when I've had a great night's sleep. Can you explain that? My heart rate averages around 56 bpm which is about right. Last night it said my HRV was 9 below baseline at 23 ms (??) while my Waking was 2 below baseline at 51 bpm. I have no clue what this means or what to do to improve this. Any thoughts there?
Hi Adam! Interesting indeed. I looked at it, but I was less interested in the raw actigraphy data for this video. I would have to process these myself somehow, but it could be interesting 😀😀
Very interesting comparison. I experienced the same without going this deep into the apps. In my opinion SleepCycle is more accurate. It shows what i feel in the morning. Thanks for the Video.
Man I’m struggling to find a solution, I don’t wear my Apple Watch to bed every night so I use sleepCycle on those nights.. but it would be nice to add the data from sleepCycle into AutoSleep
Hi Rob. Richtig gutes Video. Könntest du mir bitte sagen welche Maske du zum schlafen benutz und ist es überhaupt sinnvoll wenn man ca um 22 Uhr schlafen Geht und um 6 Uhr aufsteht. Danke schonmal :)
Asking ourselves why people are using these apps might help to provide better analysis. Is it to feel well when we wake up, to know when we should go to bed to have enough cycles or other. Smart alarms need a reliability on light sleep ; cycle detection need to be accurate. I don’t see any reasons why we would want these apps if they are that unreliable. Great review, keep to progress 😉
Hi Jenny, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
Hi Rob, I just stumbled on your channel and had to subscribe. I love your videos, but so far from all of them, it seems like the Fitbit Charge 4 is the best in terms of having a well-rounded profile for predicting sleep patterns accurately? Am I wrong? Is there any other product that you think is better for sleep tracking accuracy overall? Thank you so much!
0:46 Hey Rob, is there a summary video of all the sleep apps tested and compared with the best app identified? I use auto sleep, but not happy with it and want to know if there is something better to compare it too.
Interesting. Thanks. I found auto sleep to be very inaccurate for me. I came over from Fitbit to Apple Watch and the one thing I missed was the sleep tracking which I thought was quite good on Fitbit. I ran Fitbit (versa 2) auto sleep and pillow together for 3 nights (then was fed up with wearing 2 devices - so this is just based on that) and found pillow and Fitbit matched quite closely and they both “seemed” reasonably accurate eg matched memories of waking, matched time to go sleep quite well (I know roughly how long I was reading before sleep). So I settled on pillow. I still don’t like it as much as Fitbit but It seems reasonably accurate to me. Looking forward to your assessment.
Can we revisit this app after the recent release of the series 8?
I would think the recent WatchOS 9.x changes profoundly improve the way autosleep works with regard to tracking stages - as they claim to use the values provided from Apple Watch. Would love an update ☺
@@smolcomputeI am not the app's creator. The autosleep algorithm unclear to me aswell, and there are even some inconsistencies/bugs that I have reported with no success. What I observed is that if you activate sleep stages inside Autosleep, then the sleep score relies heavily on the apple watch biometrics data ("sleep" data inside "health" app). It adds some extra computation but I don't think it tries to improve upon the 'raw' sleep data coming from the watch, more like what you said, a 'repackaging'
Thanks, Rob! Very useful. The media is clearly missing this type of comparison.
Thanks for the compliment Dmitry!
Thank you so much Rob, excellent as always!! I was wondering if maybe you could keep a rank of the top sleep trackers in your opinion, that would be just incredible, I would love that and I'm sure a lot of people too. Thanks again Rob, take care
Thanks Garluis! I was planning on making such a video once I've tested a few more trackers :-D . Cheers!
@@TheQuantifiedScientist looking forward to that Rob. One other sleep tracker that would be also interesting to compare is the sleeptracker (by fullpower tech). It was designed by the inventor of the first camera phone and a ledge in Silicon Valley- Phillippe Kahn. I’ve found it more accurate than the Nokia sleep. It uses more big data and AI and claims much higher accuracy
@@TheQuantifiedScientist Any update yet?
@@TheQuantifiedScientist update ?
@@TheQuantifiedScientist update?
thanks Rob, that's very interesting. I've tested all these apps and AutoSleep was the one who fitted my sleep better. Using it for an extended period of time I've really noticed quite some accuracy on what AutoSleep reports and how I feel. Something you did not mention was the fact that AutoSleep lets you calibrate how sensitive it should be to your movements etc. I wonder if that might've affected your results?
That being said I'm staying tuned for the other videos. at the end, whichever app is better, I'll give it another extended try. For now I'll keep with AutoSleep 👍
I was wondering the same thing -- I find calibration can do a big difference and now it's pretty accurate to how I feel i slept.
The same question came to my mind. How accurate would AutoSleep be once you calibrated it after, let's say, three nights? It would be interesting if you would test that, Rob.
Hey! I just downloaded the app and was wondering how or where in the app do you do the sensitivity calibration? can't find that info anywhere.. thanks!
Hi Mr. Lopes, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
I agree. I checked the clock several times this night. After a bit of calibration/sensitivity changing, those wakeups have properly been reflected on the graph. For me, AutoSleep is the most accurate among the various sleep tracking apps for Apple Watch.
I’m glad I came across your videos analyzing sleep, the devices, and the apps. I appreciate your scientific data driven approach explained in an understandable relative way. Keep it up.
Thanks, i find the autosleep app detects sleep when i am awake. Please re analyze after using the calibration feature to “adjust” what you believe actually occurred to see if the correlation is much improved.
EXCELLENT video! Thanks so much for all the hard work that went into gathering, compiling and presenting this data!
Would love to see a comparison of sleep and HRV tracking of data from Apple Watch vs Whoop vs Oura. Thanks
Thanks for the suggestion Ted!
I use this app for about 5 years. I can export you the data via Advanced date range csv exports if you want.
Did you do the calibrations the app provides? They are have huge impact on how the data is interpreted.
Early false sleep tracking is one of them.
You can also link the app to apple home, so it knows when you turned of the lights for sleep, and the watch app can be used to manually start sleep tracking when you are about to sleep
Thanks for the video. May I ask you what calibration settings you have used?
This is the first Fitbit I have used. It has some new features ruclips.net/user/postUgkxbkrje8Y7BaqRkAjimw-55ajvVo7RbcIp and I like the information that it gives me.I think the phone app could be designed to be a bit more accommodating, as it can be confusing to use. The rubber band is comfortable, and normally I do not like rubber bands for my watches, but this is comfortable.I am looking forward to seeing if this helps me stay accountable in my fitness endeavors!My only gripe is the box was very damaged when it arrived, however, the tracker is performing perfectly!
I just got 99-100% in all ratings in Autosleep. My blood pressure was better than usual, I feel that it was one of the best night sleeps I measured, so I think that Autosleep is very accurate. I had few nights ago the 3 hours of awake time while trying to sleep, so the app could be fooled by my hand in one position etc. but it wasnt, it shows 3 hours in a row of awake. For me, works great.
once again, super excited for the final results of all 4 apps
I use auto sleep for around two years , I love the app , maybe it’s incorrect I never had a way to test it .but I love that it shows heart rate and sound during the night .
The one million dollars question: are the results affected by the sensors of iwatch? Or the (in)accuracy is only due to app’s algorithm misspecifications??
Excellent point
Hey Rob, thanks for your video! I like the Autosleep App quite a lot, though you have to calibrate the sensitivity of the sensors, otherwise it shows the effects found in your test (too much deep sleep detected, wake states not properly detected etc.). It took me quite a while to figure out the best setting, but now it works quite realistically (not scientifically proven!). Did you try to calibrate the sensor sensitivity, before you started your test? Greetings from Germany!
Hi Rudolf! Good point! No, I just went with the "out of the box" settings, since I wanted to use it as most people would experience it. That being said, I also did not expect for the setting to have such a major influence, so it is very valuable to get comments like this! I might look into it at some point in more detail :-D . Have a great day!
your right, but sleep cycle has no need to calibrate and show decent results, autosleep developer should see this video as a feedback.
i have both apps, and was thinking autosleep was always "right", now i have a different perspective
This. I have been using the app for some time and find it very good once the sensitivity is calibrated.
Hi Rodolf, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
@@VictorCXSdotcom how do you calibrate the AutoSleep app?
I have the same experience as you. Most annoying is that Autosleep is bad at detecting when I am awake during night. I do not use Autosleep any more.
Very nice review. I’m about to get the Apple Watch and am interested in seeing which app you like best!
Would you be willing to do another review of the app with the calibration? As you’ve seen in other comments, the app is very sensitive to the calibration settings and I think the results might vastly differ depending on the settings. I’m curious to see how it holds up compared to the other apps when calibrated properly.
Hi! I might do that indeed (if time allows ;-) ). Have a great day!
The AutoSleep (AS) app has a "lights out function" to decrease awake vs asleep errors. Like watching this video before going to sleep😅. The problem with AS was more of a negative psychological impact. If I felt like I slept great-like the old "bright eyed" etc., but AutoSleep app says my readiness score is terrible-it has a negative impact on me. Also, AS doesn't understand that people naturally will change position while sleeping. AS marks ANY movement as restless. (We won't even discuss how AS treats you when you ask or question a result.)
Autosleep has worked very well for me, I have fine tuned my sleep to get about 50% deep sleep. One time I had 5 hours out of 7 1/2. Seems pretty accurate too.
Fine tuned how?
@@Alan-lo1qc Supplements and environmental controls. Earplugs and Magnesium L-Threonate were probably the best, along with blackout curtains and L-Theanine.
Thanks for the video/test/comparison - but I don't think a test of AutoSleep without personal calibration, is particularly meaningful or comparable. If you want to seriously test/compare it, you should adapt it to your settings as the instruction manual describes. It works at least for me quite well.
Great point! This is why it is so valuable for me to get feedback 😊. I'm just here by myself testing these apps, some of them I haven't used before. I did see some options, but wanted to test the "out of the box" model, since I figured most people would not adapt the baseline model. Did not expect it might make such a big influence. I might check it again after calibrating! Have a great day!
@@TheQuantifiedScientist Yes, please do. I think many people (incl me, of course 😊) would be very interested in the a video about how to calibrate the app and how the calibration affects the app accuracy.
@@TheQuantifiedScientist It's one of the points that IMHO makes AutoSleep better than the other apps / trackers. That you can adjust it to your movements and therefore register more or less sleep...
I think it will address your issues. The whole measurement is detecting too deep sleep for you. Sleep at the times you are awake, wake moments that are light sleep and too much deep sleep in general...
I know it’s relatively simplistic, but will you be able to talk about Apple’s sleep tracking that is built in?
I’m curious if I should delete AutoSleep and just use Apple’s.
Ive been using Apples Sleep tracker, and today even though I woke up around 9am. The apple sleep tracker showed me that I woke up at 6:45(time my alarm was set) and stopped recording after that. It also doesn’t track my naps and all the info you get is how many hours asleep (keep in mind it doesnt calculate any time you spent being awake in the night) so it is very very basic :(
@@zahinozlan7720 oh no kidding. Almost seems like how AutoSleep works when you don’t wear the watch to bed. Just tracks when your phone is on the charger. Too bad.
@@zahinozlan7720 has it gotten better? I hear it can take some time to calibrate to your sleep style
@@jakekayden4061 heyy bud, Idk since I stopped using it. But let me tell you this, the watches most accurate measurement is most probably your sleep time. if other metrics are important to you, you should invest in a proper sleep tracking devicee, use the watch to track ur sleep for funsies
The confusion matrix around 9:00 I think was one of the best visual tools for understanding the results. Thanks for doing this.
Thank you so much!
Waiting for Huauei Watch fit sleep tracking review
Coming soon Abdullah!
@@TheQuantifiedScientist Many many thanks dear!
Great video! I personally use Pillow app which also uses the apple watch. I would love you to test this app! Keep doing these videos, I love them!
Edit: I just saw on your sleep cycle video you are testing other apps, including pillow. I can't wait.
Thanks for an intriguing overview Rob. I have just switched from a Fitbit Blaze to Apple Watch 6& I’m already missing the sleep tracking. I have been trialling the AutoSleep app but remain very unimpressed. It recently scored me the best sleep ever for a night that, at best, I dozed for an hour. I also find the charts confusing & hard to get any meaningful data from.
It’s really confusing. I don’t think it’s a good app. Just too many settings and the calibration adjustments etc changes everything.
Hi Rob- Thank you for this video. I have been using the auto sleep app for over a year now, and have been pretty happy with it, although I do think that it's somewhat complicated to read and understand. My husband has been having sleep issues so we bought him an Apple watch and he started using the Auto Sleep app. His results have been horrible! Last night, for example we both went to bed at the exact same time. In the morning, his results showed his sleep beginning 3-1/2 hours AFTER we both went to sleep. It didn't show AWAKE, it just started measuring his sleep cycle 3-1/2 hours after he was actually sleeping. We emailed the app developers and hope to hear from them. I think based on your review, we will also try out the Sleep Cycle app. Hopefully it will be easier to use and understand. Thanks!
Hi Rob, I am using Auto Sleep for several months now and I realized, that it adjusts to my sleeping/ awake patterns after a while, esp. after letting it know, that it detected something (eg a sleep period) wrongly.
And it definitely detects waking stages, in which I realize myself, that I am awake. Maybe the other ones, where I get into sleep immediately again, are detected as light sleep?
Over all it’s a good App for me. The only thing that’s of no help for me at all and oftenly seemes to be wrong is the detection of my „Heutiges Befinden“ (how I feel today after waking up). There seemes to be no correlation to my real feeling.
I see that a bit about readiness scores. I downloaded a few apps to check it out myself and see if there is correlation for me.
Unfortunately autosleep wants to auto detect sleep, I’m afraid it will interfere with Apple’s, so I can’t try it.
Thanks a lot for this video! I would like to know which kind of settings you used for the app since in autosleep it is possible to change different sleep “sensitivity”, now sure how to define it.
Yeah, you are able to calibrate the detection so it reflects what is more accurate. I on the rare occasion do use the edit function when it misses obvious amounts of sleep.
@@ryanrealo3552 how can we find the right settings for this app
its been 2 years since you did the app review...
could you do a new review based on the latest version and technology from apple watch 9 series and iphone 15 to see how this app preform today ?
will you do another review of this?
What is the best sleep tracking app for the Apple Watch Series 7? I have serious sleep issues and I am looking for something that would help me get it under control. Thanks for the awesome video! I purchased this app earlier today and I am going to try and get a refund.
Thanks for sharing, really awesome and in-depth review! Question: for sleep & fitness coaching - which I currently use the Whoop 4.0 for, would you recommend switching to Apple Watch? if so what apps would you recommend for this? Thanks!!
I have used it for a while. What I find useful is the histogram over how much sleep i got, when I got to bed, and average HR during sleep.
I also tried the smart alarm, but found it consistently disturbed me during REM sleep, so I have stopped using that function.
Thanks for sharing Kai! Seems to match my findings
Really interesting video! Thank you for sharing the results. I'm curious how you calibrated the app?
Excellent analysis, before watching your videos, my thoughts were that the app was too generous with deep sleep and no so good when detecting awake stages. In general, i think mi band 5 is better for tracking sleep than this app. I’ll try sleepcycle. Thanks a lot for this kind of videos.
Thank you Rob. I have big data for you to analyze if you want because I had used this application for more than 1 years 😊
Thank you for making these videos, such a informative channel!! Was trying to find an accurate app for sleep tracking on apple watch.
Thanx, I use the AutoSleep and use the sleep button for when I really want to go to sleep. Anyways I think I will be waiting for your final tests to buy a new app as this one is clearly not good. Thank you for your work!
This is a very good video with a lot of information, maybe too much. I am a 65 year old male and although I have a good understanding on modern electronic devices I find it difficult to understand and decide on which is a good sleep app. I want to track my sleep and try to make changes in my life to improve my sleep. Not sure I need the amount of information being provided in the Auto Sleep app. Help Please
Thanks again Rob, very insightful !!
Thanks Tommie!
Interesting analysis, appreciate your work!
The part that is missing, is the version of the app. Can you add this next time, for future comparisons (updates). Thanks in advance.
In iOS 16 and Watch OS 9, Apple has released additional sleep stage metrics. The good news is that you have the choice to elect which sleep data you wish to use in AutoSleep
Such an underrated channel, what an analysis!....cant wait for the samsung galaxy watch 3 or active 2.
Subscribed to wait for the update on the app with the Ultra 2.
Great vid, especially the comparison to Sleep Cycle!
Thank you for the great work. Really interesting as a regular AutoSleep user. I would love to see a similar analysis of the whoop band.
Thanks! There is already a first look at Whoop if you are interested: ruclips.net/video/M7P1kv3ewDA/видео.html
@@TheQuantifiedScientist I will definitely check it out! Thank you.
Great video!!! Thanks for the work you put
I love your videos! hope you can do a video on post-calibration of auto sleep and compare it again to the EEG.
Thank you very much for your effort to produce such a highly interesting video!
Great video as usual Rob! Testing out the Whoop band at the moment, I saw earlier you also got yourself one. How do you like it so far?
From Tunisia north africa thank you a lot we appreciate your effort , your are really helping peoples around the worlds may god bless you or nature or whatever energy contrôle this words Respect and encouragement
Thanks for this great insight into this app
Looking forward to seeing the next sleep app video
Thank Rob for your excellent testing, through the prism of science. I look forward to the test on the PILLOW app. Thanks to you.
This was an interesting video. Thanks for the data driven analysis. It would be interesting to see if AutoSleep's performance has improved since this review with software and hardware updates. BTW, I never use the Auto sleep detection feature of AutoSleep. I find it very easy to just tap the "Lights Off" start sleep button. And that removes all the issues associated with the feature. And yes, I understand it sounds crazy to not use the Auto sleep detection feature for an app called AutoSleep. 🤣🤣🤣
Hey Rob, One view and I am now your biggest fan. Deep sleep is so important in maintaining BDNF and HGH in the aging population. The nightly feedback and tweaking variations in the daily feeding-drinking metrics (with AutoSleep deep sleep metrics) gives this 71 year old geezer the ability to successfully incorporate lifestyle changes to routinize average deep sleep outcomes greater than 3 hours.
I once had a an afternoon caffeine overdosing accident. That night I experienced an AutoSleep verified tortuous night in bed with no sleep recorded. LOL
I’ve been using Autosleep for about 2 years now. I originally tried Sleep Cycle, but wanted something that detects sleep automatically, since I often fall asleep on the couch and wake up to move to the bed after 1 or 2 sleep cucles, so I don’t get to manually mark going to bed.
While I never imagined it would be scientifically accurate, I find the more deep sleep it reports, the better I actually slept. Also the readiness score has been pretty accurate for me.
I also had the problem with it reporting light sleep where I was still awake, but a tweak to its sensitivity fixed that. For the results you got, I would imagine setting it a step or 2 towards less sensitive, would have eliminated the false positives at the beginning and also more accurately reported your awake periods.
Hi, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
Losing sleep while waiting for your excellent review of the Pillow app. Is it forthcoming?
Hi! Yes, a first video on the Pillow App for iPhone should be there in the next 3 weeks 😄
Fantastic job. Thanks and congrats!
Your work is just amazing!!
Hey - thank you so much for the in-depth information - when will the video with the fourth app come?
yea :( it almost never wakes me up during actual light sleep which is a bummer because this is why I bought my apple watch :(
Thank you! Very helpful!
I wonder if this has got any better with series 7 or 8. I know apple did a lot of work on their sleeping app. Is autosleep worth the money over the default app now?
Thanks Rob! awesome content
Hi Rob,
Yet another great video, thanks a lot. Your scientific approach is quite appreciated.
I use AutoSleep for several month and as people say here, calibration is quite an issue. In the beginning the app was not accruate at all, but after some short period and calibration exercices it detects correctly the time I fall asleep and morning waking up time. Awake peaks are properly detected only if there is a lot of movments or walking.
Indeed, sometimes it detects sleep when I just stay in the sofa, ~30% of those cases are true naps.
Waiting for your next videos on other apps. Maybe it will make me change ?
Thanks again for your great videos!
Hi mate how can I calibrate mine app because is count less sleep or too much awake.
Dear Rob,
I value your data and opinion and follow your channel so thank you.
I am wondering what's your opinion about the cheaper solutions like xiaomi or honor or some other cheap solutions specifically for sleep tracking (IMHO the Honor Band 6 is currently the #1 choice).
Also the Honor Watch ES or equivalent for a more accurate next step sleep tracking over the cheaper solutions.
Again thank you for the videos.
Very good presentation .. thank you. I have autosleep but have given up tracking sleep .. it seems pointless. I go to bed at 10, take a trazodone, am sleep in minutes, sleep to 5. Was getting pissed off with the sleep stages, and especially the HRV. there is nothing else to optimize wrt my sleep habits so what’s point of stressing about things I commit change. Does my readiness or HRV mean I won’t run 4mi with the dog at 7am … no .. will I still max out at CrossFit - yes - so .. why bother. Did t AA co-opt a prayer from the 40’ “give us the serenity to accept what cannot be changed, the courage to change what can be changed, and the wisdom to know the one from the other.” .. could have been written about sleep apps.
Do you think the accuracy would have changed with the watch OS 9 including more data?
Can you review and test honor band 6 please?
Hello! Very informative video! I was wondering if this app can record naps during the day. I'm currently using the default Apple Watch sleep app however this doesnt register naps during the day. I want an app that can record naps.
Hey I love your videos and think they're the best out there to actually check on devices, apps and so on and see how good they actually are! Would you also like to do a video about the rise sleep app? Best from Tübingen!
Apple are putting a similar app directly on the watch in the new update. 👍🏻
I like AutoSleep but it took a while to customise so it gave me a truer reading.
I use AutoSleep to see How long I sleep for and how my heartrate is. This video is over a year old, but for me now I think the app is really accurate.
Amazing as always!
Thanks
I’ve been using the app for years now. And I always was worried that it is not showing enough deep sleep. After watching your video I am worried now that my deep sleep situation is even worse due to your observation that it is showing too much deep sleep as whereas I am getting not enough according to this app.
Hi Christoph, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
I've been using Auto Sleep tracker for just a week. I find it captures the times I wake up during the night well - but that may be because I'm also getting out of bed to head to the bathroom. I do find that it gives me credit for light sleep when I know I'm awake but resting in a still state (when I'm first in bed). I think DEEP SLEEP tracking is over-rated. I don't understand the "Readiness" dial which is almost always low even when I've had a great night's sleep. Can you explain that? My heart rate averages around 56 bpm which is about right. Last night it said my HRV was 9 below baseline at 23 ms (??) while my Waking was 2 below baseline at 51 bpm. I have no clue what this means or what to do to improve this. Any thoughts there?
Have you tried asking the developer for actigraphy data?
Hi Adam! Interesting indeed. I looked at it, but I was less interested in the raw actigraphy data for this video. I would have to process these myself somehow, but it could be interesting 😀😀
I use sleep watch. Please review it!
Thank you!
Welcome!
Very interesting comparison. I experienced the same without going this deep into the apps. In my opinion SleepCycle is more accurate. It shows what i feel in the morning. Thanks for the Video.
Man I’m struggling to find a solution, I don’t wear my Apple Watch to bed every night so I use sleepCycle on those nights.. but it would be nice to add the data from sleepCycle into AutoSleep
Excellent review, appreciate your experiments :)
Really appreciate your videos! Can you compare the tracking accuracy between AutoSleep and the watchOS 9 built in Sleep app?
Great review. Would love to see your analysis of Sleep++ app as well.
Hi, can you please make a review of the SleepWatch app?
Hi Rob. Richtig gutes Video. Könntest du mir bitte sagen welche Maske du zum schlafen benutz und ist es überhaupt sinnvoll wenn man ca um 22 Uhr schlafen Geht und um 6 Uhr aufsteht. Danke schonmal :)
Asking ourselves why people are using these apps might help to provide better analysis. Is it to feel well when we wake up, to know when we should go to bed to have enough cycles or other. Smart alarms need a reliability on light sleep ; cycle detection need to be accurate. I don’t see any reasons why we would want these apps if they are that unreliable. Great review, keep to progress 😉
Hi. Great Video, Do you have now the review of Pilow App?
Hello rob , I found out you can put the auto sleep setting to athlete .than I notice the deep sleep is less and more accurate . If you workout a lot .
Hi Jenny, thank you for liking Autosleep! This is Rebecca, and I work with the AutoSleep team. We are conducting a new round of user interviews, and I would like to invite you to the user interview to know more about what you like and dislike about AutoSleep so that we can improve the product. We'll give you a $50 Amazon gift card to thank you. Let me know if you are interested:)
It will be interesting to see a test about Sleep as Android. Developers are near you as I understand right
Hi Rob,
I just stumbled on your channel and had to subscribe. I love your videos, but so far from all of them, it seems like the Fitbit Charge 4 is the best in terms of having a well-rounded profile for predicting sleep patterns accurately?
Am I wrong? Is there any other product that you think is better for sleep tracking accuracy overall?
Thank you so much!
All fitbits are very solid sleep trackers. I have a 2013 Fitbit flex that's outperforming Mi Band 6 and Wyze Band.
Great job! Adding a request Garmin. Tons of us that do sports or fitness rely on our Garmin and it’s body battery.
0:46 Hey Rob, is there a summary video of all the sleep apps tested and compared with the best app identified? I use auto sleep, but not happy with it and want to know if there is something better to compare it too.
Interesting. Thanks. I found auto sleep to be very inaccurate for me. I came over from Fitbit to Apple Watch and the one thing I missed was the sleep tracking which I thought was quite good on Fitbit. I ran Fitbit (versa 2) auto sleep and pillow together for 3 nights (then was fed up with wearing 2 devices - so this is just based on that) and found pillow and Fitbit matched quite closely and they both “seemed” reasonably accurate eg matched memories of waking, matched time to go sleep quite well (I know roughly how long I was reading before sleep). So I settled on pillow. I still don’t like it as much as Fitbit but It seems reasonably accurate to me. Looking forward to your assessment.