I would really love to see a series of the guys, each explaining their super niche profession with a whiteboard and all the time and detail they like. I do also appreciate Eben trying to get the guys to stay on a hobbyist level and - after failing - explaining the stuff he wanted the interviewee to say. All the videos are phenomenal. It's so great to peek behind this curtain of complexity.
I agree. While I'm a tech enthusiast and I can follow what they are saying, I can't help but think that having them draw diagrams or having on-screen visuals would make these videos much more informative to the less technical viewer. Just Ebon trying to explain the pipeline was complicated but if he could have drawn it out as each part was explained then I think that would have been an excellent addition. Although, on the flip side, I would rather these guys spend as much time as possible doing their thing rather than spending time doing extensive videos because thats how we end up with these amazing products.
This takes me back 30 odd years to when I worked in broadcast TV engineering. Essentially analog TV cameras worked in the same way - gain, noise, shading etc. Of course we were dealing with big voltages too :)
And I imagine large racks of electronics to accomplish it too. Now its all done automagically on a teeny tiny chip. Ironically, its the knowledge you had back then that still drives the algorithms that these chips have to run. Its all progress upon progress. If only all technology has had such clear benefits for mankind.
Maybe there is something wrong with me.... I could have listened to this talk for several more hours. I am pretty sure that I am going to spend much of my weekend learning about image procssing which I have allways taken for granted.
It’s hard to overstate how significant it is that the Raspberry Pi is a huge commercial success through _just_ doing the right thing. Just the right engineering thing regardless of the imperative to maximize profit. #engineersFTW
He is clearly the kind of leader that doesn't sit in the office all day. I bet he's down on the shop floor at every opportunity trying to help out, understand the inner workings, solve problems.
This video amazed me. This is one of the best CEOs of the world. Beside of being an employer he's able to understand the technique behind the pi's and able to talk with his stakeholders to find current flaws in different aspects of implementing the pi in future projects. I truly hope a new pi will come out for image processing purposes, so other pi's can be used for other projects. His communication skills are of the charts when you compare that to the average communication skills of the average technicians.
Just bought a pi 5 and I love it! I use it for retro gaming and I’m going to play some games with my friends. I had minimal issues with hardware and could not be happier with my purchase! Thanks, raspberry pi! ❤
It's great to know that now that as an official board has 2x4 lanes of MIPI CSI-2, the "door is open" (18:30) for the capable camera modules (IMX477 & IMX708) to have their wings fully spread. Would love to see first party camera module carrier boards where I can put on the sensors modules from existing 2 lane camera modules to expose higher (e.g. 4K@60) bandwidth. I'm specifically mentioning this retroactive upgrades, cause that reduces waste, and reuses what's already available - I'm not against having full modules (with sensors included) also as an option though - in fact I prefer having both the choices. Also, it'd be great to have some first party UVC bridge modules. Building one's own 4K cinematic/streaming webcam can be a gateway drug for future makers. Working with or reverse engineering the existing ones (with lacklustre documentations), or building a bespoke solution with CX3, CrossLinkNX or just FPGA etc. as a small maker has too many limitations & roadblocks, to make the effort viable (or even feasible). The ability, intent & opportunity are all there for Raspberry Pi to make it a first party solution - even working with/on custom bridge ICs no longer seem like a far shot.
The mix of observable processing (stuff you've seen on previous cameras) and plain ole ISP magic 🪄 🧙♂️ exposed by this discussion is simply delightful! Seeing an iPhone and Google 'style' of image makes more sense in the context of selecting parameters for so many stages of processing. Thanks for your expertise, insight, and (at least partial) explanation!
Woohoo my exact question was how has the Pi5 Camera changed and this discusses that, currently have it playing hope to learn a lot. My question about the video is, who is in it? I have seen Eben Upton many times so I know him. Hello Mr Upton nice to see you again and Thanks Again for the Pi. Who are the other gentlemen? And are any of them 6by9 as I wanted to thank him for all the help over the years.
Aggghhhh we forgot the name plates for this one! So much video content but we only dropped one tiny ball. I've added their names to the video description and here they are for you: Nick Hollinghurst Naush Patuck David Plowman J̶a̶s̶o̶n̶ ̶S̶t̶a̶t̶h̶a̶m̶ Eben Upton
Err... You don't get funny colour on stripy shirts because of YUV/YCbCr subsampling - you get it because of PAL or NTSC composite encoding (which is a different kettle of fish). If you use 4:2:2 or 4:2:0 subsampled YUV (or YCbCr) you don't get cross colour on stripy shirts...
You see all these fancy marketing videos from the likes of Samsung and Apple that say what their ISPs can do but they are tosh compared to this video. The detail of how its all achieved is excellent. I suppose those other firms have IP to protect while Raspberry Pi can be open about its work. We need more companies like Raspberry Pi in this world. Spread knowledge for the benefit of everyone instead of hoarding it to make money.
Was this filmed on the Raspberry Pi 5? That would have been a nice touch! Also, there is another kind of HDR that wasn't mentioned... 10-bit video, which has become super common over the last several years. It would be nice if the new Pi 5 ISP had support for capturing 10-bit video.
As you say, it wasn't mentioned so probably isn't supported. As its a new ISP then I'm not surprised it doesn't support everything out of the box. However, its their ISP and I quote: "...the most exciting thing is that it’s our platform, and we get to develop it going forwards." Previously they had to rely on others to develop any new capabilities which weren't forthcoming. Now, if they wish to implement 10-bit video, they can. Maybe they should start a portal for ideas akin to Mozilla Connect.
The Pi 4 was pretty capable for image analysis - I built an interesting AR system that led to a patent application, using 'off the shelf' hardware, thanks to Raspberry Pi. So seeing what a huge step forward the Pi 5 brings to this area is great, and leaves me wondering what might be possible next..
Can I replace the code in the ISP? I want to do perform specialized calculations on the data as it streams in from the sensor. Also, I'd like to do my own image stacking (astronomy / telescope) - perhaps I can do that in the ISP/2040 as well?
I have a dso with a frequency of 100 MHz, and I use Thonny IDE and Micro Python with a Rp2040 system clock of 125 MHz. I also know the pwm frequency, which is 62.5 MHz. I have to make a pwm in an RP2040 at 50 MHz, thus here's my code: from machine import Pin, PWM import time pwm_pin = 0 pwm = PWM(pwm_pin) pwm.freq(1000000) # Set PWM frequency in Hz # Set fixed duty cycle pwm.duty_u16(32768) # 50% duty cycle (32768 out of 65535) I want a square wave, however the PWM produced noises and ripples with this code. Thus, how can I lessen the noise and ripples? Help me please
I wonder, and it’s just a feeling, an intuition, but I wonder if more RPi cameras are mounted in such a way that they never move and most of the image never moves, compared to other usages of the same or similar camera modules in other areas of application. For example, a handheld actual camera for stills or video is likely to spend most of the time seeing highly varying input, moving, shifting, sliding, wobbling, shaking, panning, everything - whereas I’d estimate that most Raspberry Pi cameras are mounted and don’t move much in actual use, if at all
Ah good this might help my dashcam and rearcam project whats the maximum bandwidth/camera quality i was looking at 2 IR 64MP cameras. Is it powerful enough for that?
I would really love to see a series of the guys, each explaining their super niche profession with a whiteboard and all the time and detail they like.
I do also appreciate Eben trying to get the guys to stay on a hobbyist level and - after failing - explaining the stuff he wanted the interviewee to say.
All the videos are phenomenal. It's so great to peek behind this curtain of complexity.
I agree. While I'm a tech enthusiast and I can follow what they are saying, I can't help but think that having them draw diagrams or having on-screen visuals would make these videos much more informative to the less technical viewer. Just Ebon trying to explain the pipeline was complicated but if he could have drawn it out as each part was explained then I think that would have been an excellent addition. Although, on the flip side, I would rather these guys spend as much time as possible doing their thing rather than spending time doing extensive videos because thats how we end up with these amazing products.
This takes me back 30 odd years to when I worked in broadcast TV engineering. Essentially analog TV cameras worked in the same way - gain, noise, shading etc. Of course we were dealing with big voltages too :)
And I imagine large racks of electronics to accomplish it too. Now its all done automagically on a teeny tiny chip.
Ironically, its the knowledge you had back then that still drives the algorithms that these chips have to run. Its all progress upon progress. If only all technology has had such clear benefits for mankind.
How'd you get Jason Statham to do this videos?
Maybe there is something wrong with me.... I could have listened to this talk for several more hours. I am pretty sure that I am going to spend much of my weekend learning about image procssing which I have allways taken for granted.
It’s hard to overstate how significant it is that the Raspberry Pi is a huge commercial success through _just_ doing the right thing.
Just the right engineering thing regardless of the imperative to maximize profit. #engineersFTW
Thanks team for another great video! I’m so impressed at how much of the details that Eben has knowledge of.
He is clearly the kind of leader that doesn't sit in the office all day. I bet he's down on the shop floor at every opportunity trying to help out, understand the inner workings, solve problems.
This video amazed me. This is one of the best CEOs of the world. Beside of being an employer he's able to understand the technique behind the pi's and able to talk with his stakeholders to find current flaws in different aspects of implementing the pi in future projects. I truly hope a new pi will come out for image processing purposes, so other pi's can be used for other projects. His communication skills are of the charts when you compare that to the average communication skills of the average technicians.
Just bought a pi 5 and I love it! I use it for retro gaming and I’m going to play some games with my friends. I had minimal issues with hardware and could not be happier with my purchase! Thanks, raspberry pi! ❤
It's great to know that now that as an official board has 2x4 lanes of MIPI CSI-2, the "door is open" (18:30) for the capable camera modules (IMX477 & IMX708) to have their wings fully spread.
Would love to see first party camera module carrier boards where I can put on the sensors modules from existing 2 lane camera modules to expose higher (e.g. 4K@60) bandwidth. I'm specifically mentioning this retroactive upgrades, cause that reduces waste, and reuses what's already available - I'm not against having full modules (with sensors included) also as an option though - in fact I prefer having both the choices.
Also, it'd be great to have some first party UVC bridge modules. Building one's own 4K cinematic/streaming webcam can be a gateway drug for future makers. Working with or reverse engineering the existing ones (with lacklustre documentations), or building a bespoke solution with CX3, CrossLinkNX or just FPGA etc. as a small maker has too many limitations & roadblocks, to make the effort viable (or even feasible). The ability, intent & opportunity are all there for Raspberry Pi to make it a first party solution - even working with/on custom bridge ICs no longer seem like a far shot.
This is like reading a documentation in video form, good information but hell without content page!
i have pre ordered the pi 5, i am excited to receive it as soon as possible !
The mix of observable processing (stuff you've seen on previous cameras) and plain ole ISP magic 🪄 🧙♂️ exposed by this discussion is simply delightful!
Seeing an iPhone and Google 'style' of image makes more sense in the context of selecting parameters for so many stages of processing.
Thanks for your expertise, insight, and (at least partial) explanation!
Hace mucho tiempo que no compro una Raspberry Pi (la última fue la versión 3) y me encantó la calidad de imagen que tenía en ese momento.
I've enjoyed this series of videos, thanks for making them.
Interesting video. Lots of information and processes that I had not been aware of.
Woohoo my exact question was how has the Pi5 Camera changed and this discusses that, currently have it playing hope to learn a lot.
My question about the video is, who is in it? I have seen Eben Upton many times so I know him. Hello Mr Upton nice to see you again and Thanks Again for the Pi.
Who are the other gentlemen? And are any of them 6by9 as I wanted to thank him for all the help over the years.
Aggghhhh we forgot the name plates for this one! So much video content but we only dropped one tiny ball. I've added their names to the video description and here they are for you:
Nick Hollinghurst
Naush Patuck
David Plowman
J̶a̶s̶o̶n̶ ̶S̶t̶a̶t̶h̶a̶m̶ Eben Upton
@@raspberrypi Are any of them 6by9? And Thanks!!!
The guy on the right in the black shirt does an impressive job of ELI5’ing for me.
This is great stuff
If nothing else, it can definitely be a neat way to visualize nuclei
Great video guys! I would love to see more in the future 😊
Delightful chaps.
Err... You don't get funny colour on stripy shirts because of YUV/YCbCr subsampling - you get it because of PAL or NTSC composite encoding (which is a different kettle of fish). If you use 4:2:2 or 4:2:0 subsampled YUV (or YCbCr) you don't get cross colour on stripy shirts...
You see all these fancy marketing videos from the likes of Samsung and Apple that say what their ISPs can do but they are tosh compared to this video. The detail of how its all achieved is excellent. I suppose those other firms have IP to protect while Raspberry Pi can be open about its work. We need more companies like Raspberry Pi in this world. Spread knowledge for the benefit of everyone instead of hoarding it to make money.
Excellent video. Really enjoyed watching this.
Was this filmed on the Raspberry Pi 5? That would have been a nice touch! Also, there is another kind of HDR that wasn't mentioned... 10-bit video, which has become super common over the last several years. It would be nice if the new Pi 5 ISP had support for capturing 10-bit video.
As you say, it wasn't mentioned so probably isn't supported. As its a new ISP then I'm not surprised it doesn't support everything out of the box. However, its their ISP and I quote:
"...the most exciting thing is that it’s our platform, and we get to develop it going forwards."
Previously they had to rely on others to develop any new capabilities which weren't forthcoming. Now, if they wish to implement 10-bit video, they can. Maybe they should start a portal for ideas akin to Mozilla Connect.
In other words, black magic and voodoo is being used to accomplish these tasks.
In other words, some really clever people are doing some really clever shit to try and replicate the quality of photographic film.
The Pi 4 was pretty capable for image analysis - I built an interesting AR system that led to a patent application, using 'off the shelf' hardware, thanks to Raspberry Pi. So seeing what a huge step forward the Pi 5 brings to this area is great, and leaves me wondering what might be possible next..
⚠️📢Question. Im using roboflow on my surface pro 9 and steam deck my model is getting 5fps with this be faster? I need at least 30fps
so can we use this chip for our own image processing? like run a convolutional filter?
Could we get a Christmas Only Unofficial Jason Statham calender for 2024 ?
Can I replace the code in the ISP? I want to do perform specialized calculations on the data as it streams in from the sensor. Also, I'd like to do my own image stacking (astronomy / telescope) - perhaps I can do that in the ISP/2040 as well?
How can i have ethernet connections only work with the raspberrypi?
I have a dso with a frequency of 100 MHz, and I use Thonny IDE and Micro Python with a Rp2040 system clock of 125 MHz. I also know the pwm frequency, which is 62.5 MHz.
I have to make a pwm in an RP2040 at 50 MHz, thus here's my code:
from machine import Pin, PWM
import time
pwm_pin = 0
pwm = PWM(pwm_pin)
pwm.freq(1000000) # Set PWM frequency in Hz
# Set fixed duty cycle
pwm.duty_u16(32768) # 50% duty cycle (32768 out of 65535)
I want a square wave, however the PWM produced noises and ripples with this code.
Thus, how can I lessen the noise and ripples? Help me please
It would have been neice to put some of the new stuff before 28min in...good information and a welcome improvement to make this tool more powerful.
Hope to see GPU support for edge AI processes
I wonder, and it’s just a feeling, an intuition, but I wonder if more RPi cameras are mounted in such a way that they never move and most of the image never moves, compared to other usages of the same or similar camera modules in other areas of application. For example, a handheld actual camera for stills or video is likely to spend most of the time seeing highly varying input, moving, shifting, sliding, wobbling, shaking, panning, everything - whereas I’d estimate that most Raspberry Pi cameras are mounted and don’t move much in actual use, if at all
We can also ask what are the future smaller versions of Raspberry Pi, such as Raspberry Pi Zero 3w, are there any plans for such projects in 2024?
Ah good this might help my dashcam and rearcam project whats the maximum bandwidth/camera quality i was looking at 2 IR 64MP cameras. Is it powerful enough for that?
"We own it". !!! RP1
Can we all agree that if anyone can bring 3D to tiny computers it’s raspberry pi ? 😅👀
😯
🔥
👍👍👍👍
Please make pi4 in A+ format 🙏
Rasberry pi 500 please