ENGINEERING DEEP DIVE: NEW Framework Laptop Webcam Module (2024)
HTML-код
- Опубликовано: 21 июл 2024
- Hyelim and Nirav sit down to talk about the new Framework Laptop webcam module.
The new webcam module: frame.work/products/webcam-mo...
---
About Framework
We know consumer electronics can be better for you and for the environment. Unlike most products, ours are open for you to repair and upgrade.
frame.work
Follow Us
Instagram: / frameworkcomputer
Facebook: / frameworkcomputer
Twitter: / frameworkputer
TikTok: / frameworkpc
Mastodon: fosstodon.org/@frameworkcomputer
Forum: community.frame.work
LinkedIn: / frameworkcomputer 
Наука
![Jelly Roll - Dead End Road (From Twisters: The Album) [Official Music Video]](http://i.ytimg.com/vi/_Mb8CqKW4R8/mqdefault.jpg)
We really got a transparent and honest CEO before GTA6
We will get second coming of Jesus (end of world) before GTA6
Hey at least we will get gta 6 before silksong
Meanwhile, Carl Pei:😠
Hahahaha what a funny and original joke! You're a genius!
What's most impressing about this video is not that the CEO is so well versed into everything that goes into the laptop (which is how all CEO's should be), but even the marketing content creator also understands that stuff and asks good questions! 🤯
Well he was a engineer in meta quests founding team, so that helps
Bro if marketing isn't braindead you know the company is cooking
I don’t even need a laptop and I’m prob going to buy one.
@@zt9233Send me one man, they're not available in my country.
Asking "good questions" is important :)
These framework youtube videos are the living proof you don't need high production when you're delivering high value.
The technical breakdown using a white board is most appreciated. Great job team.
Agree, awesome and proud to be one of their customers
Enjoying long-form information dense videos you're doing!
Gotta love Nirav for educating us instead of spreading marketing nonsense! Would really love to support your company through recommending your products but you dont ship to both my home countries despite only being a few hundred kilometers both northeast and south of taiwan :(
The transparency is so refreshing, thanks to those working at Framework for leading the way in making devices that are actually meant to be tinkered with!
I'm really excited for this module because although I don't have a framework, I think (maybe??) I can mod it into my old thinkpad and extend its life.
I'll definitely be looking for a framework when I'm shopping for a new laptop though
Uhmm.... So I think the first obstacle you'll encounter is that fancy cameras like OmniVision require a firmware to be loaded during each boot, which can be a pain if not public.
@@cmorche I'd think the firmware is just loaded by the camera controller on the board? The connector for the old webcam module seems to just be USB so I was thinking I could just replace my laptop's current module with it with a simple converter cable.
I know this probably isn't a priority for Framework right now, but will we see an option to disable the binning and get the full 9.2MP video feed, maybe with an ectool flag or similar? Obviously it's not very useful for video conferencing, but for machine learning applications or similar, it might be more beneficial to have all the raw pixel data accessible to software. I do love seeing the progress being made here and am especially glad this area is being tackled by Framework, as it's clearly been neglected for quite a while.
The audio clipping throughout is a bit unfortunate but not too distracting.
This level of transparency is incredible to see and a large part of why Framework is on top of my considerations for my next problem.
Only, I am still satisfied with the ThinkPad e585 I am watching this on, despite it's worn down state and slower 2500U APU.
Once I do hit a wall with this machine's capabilities, like I did with my previous phone, I will probably order a Framework with the money I saved up in the meantime without much further consideration.
Or I will pick up another ThinkPad, if a modular enough model is available for a significantly better price.
The Framework is comparatively expensive after all, though I also plan to replace my desktop with a Framework 16 based computer, if this becomes viable.
Or I will build something myself, perhaps with an Intel GPU as I am curious to those and still well served by a power-limited Vega 64.
Unfortunately the other options probably are more cost effective and perhaps better, but that does not mitigate the goodwill and status Framework deservedly has.
And finally seeing some better camera technology trickle down from smartphones to webcams is cool to see, I do not care for thin bezels at all but definitely appreciate this.
Definitely agreed on the audio quality. We've missed on this on the last couple of videos. We had lav mics on the way, but didn't get them in time for this video. For the next video, we'll have a better setup.
@@FrameworkComputer This right here is why Framework is my favourite company. Consistently looking for feedback and learning from criticism and msitakes, combined with clear and open communication.
Absolutely love deepdives into the tech and decisions behind it. Keep it up!
@@FrameworkComputer just ask Linus team record you.
I love that they didn't just talk about the technical improvements, they also gave a old/new sample so people can decide if the upgrade is worth it for them. It would be nice to see an example of the old webcam under normal lighting conditions as well.
This is a company I am happy to support.
and nothing phone
11:18
Fun fact: this seemingly strange setup is how the photoreceptors in your eye work- the light passes through your eyes lens, the optical neurons and THEN hits the cells which detect the light
That's the eyes of vertibrates, which includes us, sure. But the eyes of cephalopods, octopuses and squids, are actually "the right way around", like the backlit design.
It would be good to have an external housing with USB to allow replaced modules to still be used
It's got open CAD drawings, so anyone can try! All you need is break out the pins
That would be a pretty cool feature, but I have to imagine that the standard camera controller doesn't implement USB standards, and framework isn't large enough in the industry to justify the suppliers making a brand new and more complex design for such a niche.
@@sheeplord4976it is just a USB camera , it does not use DSI bus so you just need a usb cable
@@sheeplord4976 most camera modules are USB. They said it in the video that they're staying at 2.0
Love to see some technical/product design transparency on these products. I would suggest mastering your audio in mono if you aren't going to do any more in depth post-production though - it's very uncomfortable to listen in headphones when parts of the audio are panned so far to the left :(
Finally looks like a camera that wasn't from 2010! Good work Framework!
It looks like it's unscripted - in a good way. I love it, so refreshing! And the lady sounds genuinely interested, not trying to fill marketing checkboxes!
Please do more videos like these. Hope framework keeps growing
man, my friend ordered a Framework laptop for me while I'm traveling. By the time I get to see it, we'll have to order a new set of components for a "zero-day upgrade", it seems!
The older webcam module doesn't look that much worse, it may not be worth to upgrade.
very cool deep dive video!! You done already very good deep dives on the blog! but something like this is also very nice and a good extension of a written article!
I'm a few months away yet, but i cant wait until i've saved enough to get a Framework!!!
yeah the almost €2000 markup is quite steep for the AMD DIY with the new screen + webcam, I was doubting whether to instantly go for the full version of what I want(bring own OS + own SSD) or get the most basic AMD DIY one and upgrade a tiny bit later but that would already leave me with the entry Ryzen board, the old screen and the old webcam that I'm not going to use anymore just about a year after I bought it.
So guess I'll wait a bit more, maybe prices will drop some more in the coming months. I do think the ethernet port is still stupidly expensive though.
This is pretty fantastic. Thanks for all your hard work!
Love the video but I agree with other comments that the audio wasn't quite a good as usual on this video. I really appreciate the content, but perhaps wearing lavalier mics would help keep the audio levels consistent rather than passing that awkward mic back and forth?
Yea but. It’s part of the charm. They’re talking shop. They’re not putting together a fake marketing video that costs a tens of thousands to make
Lab microphones don’t mean phony content. I’d love for better audio - if a video has poor audio I usually don’t listen (this video is an exception because of its fantastic content, and I’m interested in the subject matter.)
Absolutely loving the deep dives and Nirav explaining the technical details!!
Keep it up!! I've already joined the waitlist!!
Great news! Time to upgrade and make sure my new order has this camera too. Thanks for the insight into the details!
Nice. Thank you!
Very happy to see this level of transparency as well as simple production style. Quite refreshing from those highly edited product presentation videos you see from all the other big companies these days.
Would have been really interesting if it was possible to set your own camera off symbol
You guys are awesome innit!
Love the video and the love for the craft of such an amazing product!
Great to see that the laptop I bought is alive and evolving. I was lowkey expecting this video to be made with the webcam but the preview at the end was also enough :)
love the Read-Only Memory books in the back
I really do wish Framework every success, I think it's amazing what you guys are doing!
Can't wait to put my hand on the RISC-V motherboard!
Even though it's far behind my Mac's Intel CPU performance and miles away from Apple M# CPUs.
Yet, I'm preparing to switch from Mac back to Linux on a Framework laptop, by learning NixOS and adopting more Linux-compatible tools 🤘
Exciting! 👍
If you can replace the touchpad with a Sensel haptic touchpad, that would be wonderful.
Very interesting - Frramework rocks !!!!
More of this sort of thing please. Very pleased with my framework 13 but looking forward to continuous improvements
Great info. Though you should have shot the whole video on the new webcam!
All of these were great questions! Every time I found myself getting slightly lost in the jargon, a question would answer my thoughts.
Great talk, but please get lav mics and turn down the gain/turn on a compressor.
I only just noticed the f in the logo has that flattened top bit. Totally can’t unsee.
Well explained thank you for the information about your product 👍👍👍
Pretty indepth for a webcam!
I love this!!!!! Thanks for these discussions!!
And just $40 for such a nice upgrade! Actually, I don't care enough about my webcam to upgrade, but that's what's great about Framework: I get to choose!
They got me a macbook pro m1 at my job as a work laptop, and now the 16GB are not enough anymore, and it's impossible to upgrade. Next time I'll ask for a Framework laptop and just upgrade the memory if needed.
Outstanding job, can't wait to get my hands on one! Also it's baffling that $3000 laptops from giant companies still use terrible cameras
Love what y'all are doing with these laptops. It's still out of my price range at the moment, but I promise you, I'm putting the money together and I will 100% get one at some point.
Oh I loved her question at 9:58, was just wondering about the same
I might upgrade just to get rid of that red tint. It was definitely visible in the last comparison
Very interesting.
It would be great if you could fix the audio so that the left is on the left and the right is on the right. I think because the audio recorder was held "backward" (at least from the perspective of the camera) and audio channels are swapped from the visuals
Would be nice to hear from other engineers at Framework too!
"Lux" is mistranscribed as "Luts" at 19:37 (and again at 19:51).
Can you make another one diving into the display upgrade?
Very nice.
Is there any chance of a Framework motherboard getting a socket running low powered AMD "GE" or Intel "T" processors at some point? like some NUCs?
The new Qualcomm Snapdragon X chips have the image signal processing module integrated into the SoC and connect to the camera over a more capable interface than USB 2.
How would camera module compatibility be handled in the event of a hypothetical ARM Framework Mainboard?
Hey Nirav...! When r u guys coming to India ? I swear that the Frameworks Laptops will be worshipped like anything....!! 🙌🔥
Is the module the same for the 13 and 16? Or is this module just for the 13?
Same
Will it be possible to configure or reflash the firmware? Generally speaking it would be fun to tinker with.
I could also see this ability being useful for hobbyists experimenting with machine vision as modifying the binning parameters to suit the application is something we would do when I worked in that field.
Will these support Windows Hello? I didn't really see anything about an IR sensor being mentioned and I think that's usually an integral part of supporting it.
Amazing! Any possibility to use a USB 3.0 connection in the future for 4K webcams?
Is there a limit on how much this platform „case“ can be improved? So are there any plans to make a complete redesign of everything and learn from past mistakes and implement even more future proof concepts?
perhaps at some point they'll just release "case gen.2" that still fits all the other parts perfectly but has been redesigned for more future proofing/perfection.
@@frankhuurman3955
By that point, we might see a sort of a standard pop up just like ITX
can you turn of the pixel binning if you want higher resolution?
I doubt that, since it's probably baked in the driver
Is the Bayer pattern actually in blocks of 4 like he drew? Or does each binned pixel have its own RGB sub-pixels? That would surely make much more sense.
What module did you use for the FW16?
I was waiting for the line to say, 'This entire video you have been watching was shot on this laptop's webcam.'
Wait, the Bayer pattern is at the lower resolution? I guess that might make sense with lower chroma frequency? And I guess you can't really average pixels if there's only one subpixel of that color in the superpixel area. Or did that accidentally get flubbed? You'd think pulling a Sigma and getting color information in every pixel before demosaicing would improve quality.
I do wish it was USB 3 though. MS killing on-controller webcam compression just annihilated the 4k webcam space.
Not the best thing to hold a Zoom H4n this way and move it about... Especially with the directional mics. E.g. here the right channel on Nirav's audio is clipping because one of the mics is pointed directly at him, so even with the deadcat the levels are too hot. Maybe a couple of cheap lavs fixed up to the H4n would give better audio consistency. Something like the Hollyland Lark M1 or the more expensive Rode Wireless Go 2. Just a thought.
About the binning: why wouldn't one pixel with the same area of four smaller pixels have the same sensitivity? I would think if the area is the same, the same number of photons will hit. Why should it help to subdivide the area and then add up the numbers?
How did you manage to make the interview mic sound worse than the webcam mic?
wish i can learn more hardware stuff from Nirav
According to an LTT video i watched, the real bottleneck is the connection to the CPU. Did i understand that correctly?
Not exactly. It is that snapdragon has proprietary image sensing tech on their CPUs that make cameras look better. If framework wanted to do the same, they would need to make an extremely expensive custom chip/software that wouldn't really be worth it.
No, watch the vid.
@@Tobias-fl3nb yeah, i didn’t mean that that’s where the improvement comes from for this camera module, i was just wondering if future mainboards might open them up to even better modules. I figure its not out of the question but probably not something they could influence one way or another. That’s a problem for intel and AMD to fix, right?
From what I reckon, laptop cameras have two issues : size (with the bezel shrinking tendencies), which impacts how much light the sensor can get and thus, the quality of the image (as more light means more details), while the second issue would be the lack of a good post processing unit for the webcam, which phones indeed integrate into their multi purpose chip. On laptops and desktops, it would either need to be integrated in/with the camera, or find a way to be added to the motherboard or the cpu. Though I guess a good software base method could at least partially help too.
We didn't dig into this in this video, but one major constraint on laptop camera quality is that it's extremely complex and expensive to use anything but USB 2.0 for the connection between the camera and the mainboard. That means that the 1080p stream has to be compressed down to fit in USB 2.0 Isochronous mode, and compressed using a low latency video codec, typically MJPEG. There are alternatives like using MIPI and leveraging the ISP in the processor, but beyond the cost challenge, this has historically had really poor support in Linux.
Please add timestamps to the videos. Helps a lot.
I would argue that only since covid people started caring, I thought the general attitude was its easier to buy one if you want one. as most people don't use tablets or laptop cameras, especially on desktops.
How beautiful it would be if company starts selling smart-watch with test-pad exposed at back-side and with dev-kits to flash / re-program them.
I think there is huge pool of user who likes to tinker with hardware/software.
What do you think?
Thought they were going to say that the interview was done with the new camera. Sadly no. Still looks good though.
Great laptop! Why no open source firmware (Coreboot)?
I'm 5 minutes in. There's no chance that microphone is being used for audio. Right?
Framework for president!
Still has a center-to-edge color shift... Red at the center and green at the edge.
Great work all! I sure hope the Chromebook Framework will get a finger-print sensor option or Windows Hello or biometrics options. And here is also hoping for Windows Hello IR Camera for Windows laptops.
Would love to see a RISC-V laptop!!!
They already make one
Or at least they announced it.
Will we be going to get coreboot ???
I was kinda waiting for a plot twist that this whole video was shot on the new webcam but it never came :S
Maybe next time :D
Technical marketing is the right way to go. An army of invested nerds is your best marketing.
He can definitely win a staring contest
Will this webcam come baked in to the new displays?
Please bring framework to India with genuine prices
When are we going get those laptops in india
Any news on 2 in 1? Thanks.
Don't think they even intend to make one anytime soon
She is THE content creator at Framework. All jokes aside, great to see the CEO not be some figure that sits atop and instead be actually involved in the company this much.
Ship to India pls
does it work with Windows Hello?
Can you please make a tablet and/or touch screen laptop? I need something for drawing. 🥰
I don't think CEOs of other laptop companies can explain how webcams work
You need a "highlights" version that is MUCH shorter.
It would be nice to have the camera connect over a higher speed connection than USB 2.0 in the next version. That's one of the selling points of the new Snapdragon X Elite laptops, they use better cameras and a higher speed connection between the camera module and the motherboard. I think the new Framework camera still looks worse than smartphone cameras. It's enough, but not outstanding.
…and when I replace my camera module, can We Return the 1.0 camera to you so it can be recycled or reused? Rethink, Refuse, Reduce, Reuse, Recycle, Return!
Hey Im sold. Now can one please tell me how to hook the old module to my raspberry pi please 🥺?
Nirav looks like he waited all this time to show off his shiny new gadgets😂