The speed of global shutter and providing dynamic range of a rolling shutter . That would seriously be a game changer .Add in the Red 3D raw colour science . 👌🏼
The RED sensors were global shutters with high dynamic range. When Nikon bought RED they acquired the technology that RED developed for video cameras. In the past that meant 4K and 8K resolution for stills. However, RED had some 12K and 16K resolution video cameras too. How RED accomplished its high dynamic range at the 8K level of video performance was not well known and was still patented proprietary technology. Maybe these Nikon patents are beginning to reveal how Nikon is applying the RED technology to their products. Maybe the global shutter can freeze the action and then use data from the rolling shutter to improve the dynamic range of the global shutter captured image. Two captured images started at the same time with one having a global shutter capture time and the other having the same exposure time but it was box car banded with better dynamic range. Maybe the two images can be combined into one image with the motion control of the lower dynamic range global shutter and the improved dynamic range of the distorted rolling shutter. Sort of an AI merge of the two images based upon there geometric differences offset by a known time constant.
@ , RED is now owned by Nikon. RED was working on higher resolution sensors and cameras but the Pandemic impacts were an economic shock that caused many to flounder financially. Nikon bought RED and has been actively working its technology into Nikon. RED instantly gave Nikon credibility in the video sector and it has access to all of the RED global sensor technology including the things that didn’t make it into cameras before they were bought out by Nikon. Global shutters are important to not only controlling motion distortion but also banding. As the image resolution scales up that is important to both stills and video. Remember video uses constant lighting and it is ripe for banding with so much supplemental lighting. RED used global shutters to avoid this problem and they were at the leading edge of pushing higher resolution and frame rates. Watch Nikon and watch what the industry is saying about RED and Nikon.
@@robertatwell7615 It’s good to know, I had no idea that they were already working on cameras and high resolution sensors now is knowing when they will be released and Nikon was smart in buying RED.
Just because the patent is there doesn’t mean it would be on cameras anytime soon or if they are even gonna be used for consumer cameras. There tons of Sony patents on curved sensors, GS medium format sensors etc
Whilst the heavy hitter RUclips stars of the camera industry go on and on about AF and how AI noise reduction should be the norm from Canon and especially Sony, Nikon are the underdogs with their Z8/9 and partially stacked Z6iii. The Glass is not just affordable but innovative.
Nikon is showing signs of being the forward thinker in the industry. Canon and Sony appear to be focusing on frames per second and AI chips. Rolling shutter distortion can ruin a great shot (and does). The ability to bring up detail from shadows can turn an okay photo into an incredible photo. But I don't want to give up one to get the other. These improvements, if they can deliver, will actually improve the finished product. I don't care which manufacturer wins. Loyalty is earned.
Nikon just seen what everyone's else is offering and showing how far they are ahead of the opposition with a Z9 replacement and with the PZ lens show up a video centric range of cameras?
Their hybrid stacked sensor isn't that great tbh. The z6III for example has lower dynamic range and worse noise due to the combo, and actually has slower readout than even the R6 II unless you shoot Jpg.
You have to understand how companies use their patent portfolio. They will apply for patents for every variation of their technology, whether or not they really have much merit. The cost of a patent is small by their standards, and getting the patent in serves as an insurance policy, in case they missed something that could have been useful. Looking at the pixel circuit at 2:46 in the video, this would seem to keep the downside of a global shutter, that is the loss in photoelectron capacity and thereby saturation exposure and DR. This loss comes from the presence of a second 'photodiode' in the pixel, here masquerading as the 'capacitor' SC, resulting in only half of the real-estate for a light gathering photodiode compared with a normal pixel. So, this pixel will allow both a global and rolling shutter, but the rolling shutter mode will keep the disadvantages of a global shutter. There is another problem, of whether Nikon still has the capacity to bring a mass-production sensor to market. They've run out of fab options. They can doubtless find low volume fabs for their scientific and industrial imaging requirements, but for their volume problems, it is doubtful - which is why they have been depending on Sony Semiconductor for all of their current product line. That could be another reason for the patenting activity - it gives them IP to bargain with.
Patients are stupid, they just harm the 2nd & 3rd discover. Sony Canon and Nikon are all working on separate things differently and they may find the same thing, but whoever wins the race to the patent office, blocks the others, ridiculous.
I had a Nikon Z9 and I sold it because I didn't like the digital look of the photos. Canon doesn't have that look. If I understood what I heard and correct me if I'm wrong. 'Nikon is making their own sensor?'
Not likely. That takes a "fab" which is a big building (or set of buildings) and associated stuff like water, electrical power, waste disposal. Sony and Canon are the biggest fabs and Sony in particular makes sensors for others under specific contracts. Sony has been making Nikon's sensors. That does not mean they'll make this one.
Cost of a sensor fab would cost more than Nikon’s entire net worth. Most here don’t get neither Red nor Nikon fab their own sensors, they subcontract it to companies like Sony, Onsemi, Canon etc
Sony only Makes them, not design them. The sensors in some of the higher end models are designed by nikon. It's like sending your photos to a printing shop. The photos are still yours and the shop don't get the rights to ownership or duplicate it. If nikon sends this new hybrid sensor design to Sony semiconductors to be manufactured, Sony still can't put it in their cameras. They also can't copy it exactly because it's patented.
If Nikon can pull this off, it will be yet another extraordinary story for the company many were predicting its demise not that long ago.
The speed of global shutter and providing dynamic range of a rolling shutter . That would seriously be a game changer .Add in the Red 3D raw colour science . 👌🏼
That's what I'm imagining. Hopefully this does come to pass.
Refreshing to see you discussing Nikon
I take your say so as credible ❤
Greetings from Johannesburg South Africa
VERY exciting news. Next year is going to be very interesting!
Next year should be what this year wasn't ;) I hope this sensor does make it to light and does deliver what the patent is indicating.
informative news thanks Simon.
The RED sensors were global shutters with high dynamic range. When Nikon bought RED they acquired the technology that RED developed for video cameras. In the past that meant 4K and 8K resolution for stills. However, RED had some 12K and 16K resolution video cameras too. How RED accomplished its high dynamic range at the 8K level of video performance was not well known and was still patented proprietary technology. Maybe these Nikon patents are beginning to reveal how Nikon is applying the RED technology to their products. Maybe the global shutter can freeze the action and then use data from the rolling shutter to improve the dynamic range of the global shutter captured image. Two captured images started at the same time with one having a global shutter capture time and the other having the same exposure time but it was box car banded with better dynamic range. Maybe the two images can be combined into one image with the motion control of the lower dynamic range global shutter and the improved dynamic range of the distorted rolling shutter. Sort of an AI merge of the two images based upon there geometric differences offset by a known time constant.
A question, does RED have cameras or will they announce cameras with 12K and 16K resolution soon?
@ ,
RED is now owned by Nikon. RED was working on higher resolution sensors and cameras but the Pandemic impacts were an economic shock that caused many to flounder financially. Nikon bought RED and has been actively working its technology into Nikon. RED instantly gave Nikon credibility in the video sector and it has access to all of the RED global sensor technology including the things that didn’t make it into cameras before they were bought out by Nikon. Global shutters are important to not only controlling motion distortion but also banding. As the image resolution scales up that is important to both stills and video. Remember video uses constant lighting and it is ripe for banding with so much supplemental lighting. RED used global shutters to avoid this problem and they were at the leading edge of pushing higher resolution and frame rates. Watch Nikon and watch what the industry is saying about RED and Nikon.
@@robertatwell7615 It’s good to know, I had no idea that they were already working on cameras and high resolution sensors now is knowing when they will be released and Nikon was smart in buying RED.
Just because the patent is there doesn’t mean it would be on cameras anytime soon or if they are even gonna be used for consumer cameras. There tons of Sony patents on curved sensors, GS medium format sensors etc
Whilst the heavy hitter RUclips stars of the camera industry go on and on about AF and how AI noise reduction should be the norm from Canon and especially Sony, Nikon are the underdogs with their Z8/9 and partially stacked Z6iii. The Glass is not just affordable but innovative.
Hey Simon, you remember that I sent you a patent of a global shutter from Nikon, I invite you to analyze it more closely.
I get excited every time I hear global shutter!
I hope this technology plays out. It's radical thinking.
Nikon is showing signs of being the forward thinker in the industry. Canon and Sony appear to be focusing on frames per second and AI chips. Rolling shutter distortion can ruin a great shot (and does). The ability to bring up detail from shadows can turn an okay photo into an incredible photo. But I don't want to give up one to get the other.
These improvements, if they can deliver, will actually improve the finished product. I don't care which manufacturer wins. Loyalty is earned.
I could see Nikon using RED sensor technology in their flagship Z9. Basically, taking the Komodo X VV sensor and adapting it.
Nikon just seen what everyone's else is offering and showing how far they are ahead of the opposition with a Z9 replacement and with the PZ lens show up a video centric range of cameras?
Their hybrid stacked sensor isn't that great tbh. The z6III for example has lower dynamic range and worse noise due to the combo, and actually has slower readout than even the R6 II unless you shoot Jpg.
You have to understand how companies use their patent portfolio. They will apply for patents for every variation of their technology, whether or not they really have much merit. The cost of a patent is small by their standards, and getting the patent in serves as an insurance policy, in case they missed something that could have been useful. Looking at the pixel circuit at 2:46 in the video, this would seem to keep the downside of a global shutter, that is the loss in photoelectron capacity and thereby saturation exposure and DR. This loss comes from the presence of a second 'photodiode' in the pixel, here masquerading as the 'capacitor' SC, resulting in only half of the real-estate for a light gathering photodiode compared with a normal pixel. So, this pixel will allow both a global and rolling shutter, but the rolling shutter mode will keep the disadvantages of a global shutter.
There is another problem, of whether Nikon still has the capacity to bring a mass-production sensor to market. They've run out of fab options. They can doubtless find low volume fabs for their scientific and industrial imaging requirements, but for their volume problems, it is doubtful - which is why they have been depending on Sony Semiconductor for all of their current product line. That could be another reason for the patenting activity - it gives them IP to bargain with.
Patients are stupid, they just harm the 2nd & 3rd discover. Sony Canon and Nikon are all working on separate things differently and they may find the same thing, but whoever wins the race to the patent office, blocks the others, ridiculous.
I had a Nikon Z9 and I sold it because I didn't like the digital look of the photos. Canon doesn't have that look. If I understood what I heard and correct me if I'm wrong. 'Nikon is making their own sensor?'
Not likely. That takes a "fab" which is a big building (or set of buildings) and associated stuff like water, electrical power, waste disposal. Sony and Canon are the biggest fabs and Sony in particular makes sensors for others under specific contracts. Sony has been making Nikon's sensors. That does not mean they'll make this one.
Explain what look you're talking about cause sounds like bs
Cost of a sensor fab would cost more than Nikon’s entire net worth. Most here don’t get neither Red nor Nikon fab their own sensors, they subcontract it to companies like Sony, Onsemi, Canon etc
i dont get it. isnt sony making nikon sensors?
Sony only Makes them, not design them. The sensors in some of the higher end models are designed by nikon.
It's like sending your photos to a printing shop. The photos are still yours and the shop don't get the rights to ownership or duplicate it.
If nikon sends this new hybrid sensor design to Sony semiconductors to be manufactured, Sony still can't put it in their cameras. They also can't copy it exactly because it's patented.