I Hacked a Mouse into a Camera!
HTML-код
- Опубликовано: 20 июн 2024
- An optical computer mouse is actually a camera! In this video I show how I modified an old optical mouse by hacking its sensor and replacing some parts. Can you recognize what it films?
Thank you to PCBWay for supplying the 3D prints: www.pcbway.com/?from=Doctor%2...
Consider supporting this channel on Patreon and get updates about ongoing projects and ad-free preview videos!
/ docvolt
Items used in this video:
Please use these links for your order to support the channel. It's the same price for you, but I'll get a small commission.
Oscilloscope: amzn.to/3tRxM2k
Desoldering station: amzn.to/3RQbmGW
ESP32 S3 Dev board: amzn.to/48JoCDW
Code on Github: github.com/michalin/mousecam
#electronic
#electronicscreators
#arduino
00:00 - Dissecting a mouse
01:03 - Examining the ADNS2610 optical mouse sensor
02:47 - Controlling the ADNS 2610
04:05 - Modding the electronics with an ESP32-S3
04:46 - Reading images from ADNS2610
06:28 - Making the camera
08:48 - Taking pictures
09:32 - Thank you 
Наука
Now take a full frame sensor and make the most powerful mouse on earth !
Not as powerful as an NYC mouse. They growl and hiss at you and they have knives, guns and gangs.
@@InsideOfMyOwnMind Lame comment
@@BurkenProductionsLame reply
@@stoobidthing lame thread
@@TheTanadur/brokethechain
would be really interesting to see what a modern high dpi mouse could do. 🤔
231 likes and no replies? Lemme fix that
It would still be better than the bank's security camera
I was actually thinking of this! I started making plans for a modern 16000DPI mouse sensor, and then connect 9 of them to create a full frame sensor
I may be wrong, but I believe this is how most UFO and hauntings videos are filmed
Cool video! This is literally the camera that they use as security cameras
lol
Security mouse
I don't blame how it was back in the day since technology would've costed a lot more. But yeah, there's no excuse for potato quality today. Heck, any ordinary people can have quality CCTV at their own home and connect to it anywhere from their phone. Places that truly need it the most shouldn't be cutting costs getting the cheap old stuff. Like police dashcam footage from decades ago was trash, but now everyone can drive around with quality cameras.
this is how UFOs are captured :D
Incredible! Now have a RGB led quick cycle some flashes to read each color channel brightness and blend the three values overlayed to get a rough color photo
Next episode: "Bad apple but it's through a mouse sensor"
touhou reference⁉
I feel like you should be able to get higher frame rate out of that sensor... I think the ESP mini board was a limiting factor there
No, the limiting factor was the sensor. Reading the images without error takes that long.
maybe with a newer gaming sensor you would be able to do that
@@cle4tle yeah aint no way a mouse is that slow, how would it manage to be precise
EDIT: I looked at the datasheet of the ADNS-2610 chip. Basically it has different registers for either X and Y movement and a pixel data one. (there's others as well)
So apparently it can compute internally the X and Y movement, as it only needs to send that, as opposed to sending the whole image, which makes sense why it's slow in this case.
@@CreepyMemes the sensor also has delta_X and delta_Y registers and does tracking internally, I assume in normal operation the raw image data isn't read through SPI
@@CreepyMemeseverything happens inside the same chip, in normal operation only the movement vectors are communicated, not the image.
7:23 Well, I did such a project back in 2005... but I used the good old DB25 (LPT) as an interface and even wrote a simple webcam driver for it... and somehow get like 12fps of a resolution 16x16pix... and it worked perfectly through my 33.6kbit/s dial-up connection =))
You still were using modem in 2005?
@@imperia777I had to cope with dial up in rural south of Milan until 2007, so it's possibile
@@fabiosemino2214my uncle had a dial up until 2009-10. He said he didn't need anything better. Atlast he did get fiber optic.
@@imperia777 Yes we used dial up to 2008.
I know people in rural Arkansas who were using dialup in 2011.
i am astonished by the fact that simple interpolations can build a fairly good video from a bunch of pixels
What an extremely underrated channel
Oh, yeah? Well, I hacked a cat into a meowcrophone!
Are u by any chance from the 1960s CIA?
I think your cat is bugged :0
meoooow
@@captainretro373rip meowcrophone, make sure to keep yours away from cars
@@dysphoricpeachcars
POV: You're a bank security camera
7:24 local man reinvents the bank security camera
I noticed "those tiny little stars" are in the EURion Constillation. A specific pattern of 5 dots that, if recognized by photocopiers, color printers, and the like, will stop printing. It's to make counterfeiting just that little bit harder.
I have to try this, update soon 😂
Thank you for the captions! What an incredible video, you are amazing! 🖤
Brilliant. This is something I have wanted to try for years, thanks for providing the details
Beat you to it by about 20 years? We've done such a camera back then, trying to make it into a slightly smarter motion sensor, with a quick response low resolution image stream. Probably because the sensor is not as good as today, we found that the sensor has a too low dynamic range and can only be used indoor and in a dim environment. Glad to know it works now!
Big thumbs Up for your hardwork and for a new invention you created.
Great Dr. volt, you're the best. Greetings from an old technician.
For those who are interested in the mouse model shown in the video. It's a Logitech M-SBF96 Optical Mouse PS/2. You can also find it with Hewlett-Packard branding, but it is essentially the same mouse.
Here are some other mouse models that might also work for this tutorial:
M-SBQ133
M-SBR-ACR2
Amasing!
It can be used to make precious end of range sensor for CNC or 3D printing
Man IDK what they injected into the algorithm over there at YT HQ but I'm getting the feshest content for a while. Another great channel to sub. Keep on with the jokes, even tho the cricket chirps was cute, I actually laughed at that silly joke so totally no need for the crickets. Keep the good content coming (and this is good content) and you will grow and succeed I'm sure of it. Also great video.
Man i was confused for a second and thought you somehow connected a camera to a real mouse's brain or something.
Thank you for your hard work making this, I have been enlightened.
Absolutely grey. I'm glad you added all these Meme sounds it makes it fun to watch.
Very cool!! You've got mad tech skills
I liked the aesthetic, looks like the first videos ever made, but even more crispy...
I came for the tech, but stayed for the dry humor! Great channel!
Amazing ! Looks like 1900 year videos😁
Unfortunately, most types of cheap mouse i saw were implemented with one chip, just chip and 3 connected buttons and wheel and sends data right to USB
Excellent work!
Sir, I think your mouse hack is really cool, I really liked it, congratulations on the work, I'm going to do something for myself too with this mouse camera, and thanks for the idea
I may have to recreate this as a game design artist. I think this would be an amazing way to natively scan in drawing with a pixelate filter over them
Amazing Work! Greetings from Argentina!
❤incredible content , it needs to be shown in electronics and programming schools . I understood a lot more than if I had read it all somewhere. Practice solves everything
I've wanted to do this ever since I saw a video explaining how "New" laser mice worked and they showed how it was tracking dust and stuff on the table and it had a view like this to show what the mouse was seeing.
Great work buddy.
我曾经也想过既然鼠标原理和相机类似，但是没有能力验证，看了作者的视频，终于了却疑虑。
感谢作者。
Cool project!
Great project!
For higher resolution I think a gaming mouse might be better as they have higher DPI .
Thanks for the great video ! Keep it up
Loved it. Turn a camera into a mouse next 😀
nice! such cheap (easy to find as recycled...) sensors could be used as image-detection for home automation presence detection: I did make some tests with USB webcam connected to a MCU and it's okay, only need a good pattern recognition layer
This is what I've been looking for for a long time, according to my mind
That is what I call, thinking out of the mouse! sorry I mean the Box!
I think your "mouse camera" is much better than many CCTV cameras these days 😂😂
Still has better vision than me without my glasses 😅
your videos are very inspirational and make me think i can rebuild an entire computer with software, because i don't feel like i get enough stability, protection and encryption (lets not talk about the performance since every electronic on this earth is now designated to go to the bin after some years) so wish me luck and hopefully i will make affordable electronics better because cheaper electronics=a better world , also i will try to make a camera sensor out of a mouse sensor but a more powerful one since it has more pins, better dpi and more even probably i will get the same result atleast i did something because i feel like it
Amazing job!
You should have scanned the bank note, by slowly going over it with the mouse, line by line, capturing the data and later stitching it together. Would have probably been a lot of work. But would have also been amazing. Missed opportunity. :D
I think John Logie Baird must have used an optical mouse for his experiments in early television, as the pictures look very similar! 🤣
Looks like your pictures come from Mars
A cat captured by a mouse... oh the irony...
This has been on my shower thoughts for a long time. Thank you...
Next one up: take a WebCam and make a super-mouse from it 😺
7:15 *POV: you’re the detective trying to solve the bank heist*
Wow! Well done! I gave you a big thumbs up.
Next week make it in colour, and I mean not by scanning the black and white sensor for fractions of microseconds (every colour has its own frequency, by turning on and off the sensor, the colour can by interpreted by the length of the phase) Although, I think you need quicker processors for that. Colour detection can be done with optical filters but that needs fine mechanics. Luckily colour can also be detected by changing the frequency of the light, add a number of different LEDs and let that light shine on the object, red light is not reflected by blue objects etc. After a rainbow of colours the real colour of the image can be calculated. Than you finally can see your cat in colour.
The cat itself is black and white, though.
That is not an accurate understanding of how visible-wavelength sensors work. Visible light image sensors of even very high end cameras are not electromagnetic devices, they are photoelectric devices, i.e. not sensitive to phase. You cannot get visible-band color information from a black and white sensor through any kind of sampling or gating scheme even if you're able to sample or gate at daylight frequencies.
@@AJMansfield1 I am sorry, you can but at this moment not a single optical sensor is fast enough to do so. Not so long ago in electronics magnificent things were done by looking at the phase, the same thing can be done with light as soon as there is some development. The fact that it is not jet possible right now does not place a barrier for thinking further then what is achieved at this moment.
@@vanhetgoor Believe me, I know exactly what you're talking about as applied to radio and microwave frequencies - quadrature sampling is a fairly ubiquitous technique used in all kinds of radio devices to extract phase information from a signal. At visible wavelengths though, the feature size you need in order to construct filter elements that are reactive to those frequencies starts to reach the point where the only construction method possible is "stacking thin films into a filter", and it's not really possible to include active elements in the effective "circuit" formed this way.
The way that ccd or cmos camera sensors operate involves an entirely different physical principle - they do not measure the electromagnetic fields directly using an antenna, but rather count the rate of discrete photon events, based on the current across a suitably-tuned semiconductor junction. It's not a matter of "good enough", it's actually a totally fundamentally different way of measuring light. And without some novel breakthrough in the design of the sensor cell, phase information will always be lost by that photon bandgap process.
6:22 - when video speaks with your inner voice (okay) 😂😂
Bro What? This is so Cool!
Best camera ever! :-D Really nice work. Bitbanging a single-wire protocol is hard, wow. I think the capture performance is limited by your bitbanging, right? Should be possible to increase the pixel speed by some factor x, 'cause otherwise it would not be able to achieve the original task of tracking that fast mouse movements. But hey, as I said: Brilliant. Awesome work!
It is so slow because it takes quite a long time to read out the images. The sensor needs at least 100 microseconds for each pixel. You also have to wait a few hundred microseconds between the read accesses to the individual pixels. So it adds up to about 1 millisecond per pixel, which at 324 pixels is about 300 ms per image. So we get about 3 images per second.
Nice video, thanks for sharing it. The one data line SPI is the I2C (it is open drain, not push-pull like SPI but it has to be). It is supported with the Wire.h library. 3 fps is pretty wierd a mouse must respond much faster.
If it is I2C then the master is probably the one determining the clock. 18x18 pixels with (guess) 8 bit resolution and wanting something like at least 60Hz refresh rate (again a very rough guess, some mice claim >1000Hz) would require around 150kbit/s. Many I2C devices can operate at 400kHz, so that should be feasible. I hence think the 3Hz will be a limitation by the implementation on the ESP32.
Sehr interessantes Video! Ich will mehr! :)
How many people thought he did brain surgery on an actual mouse to make the camera see through the mouses eyeballs? I certainly did.
I’m impressed, you earned a sub
Instant sub!
Amazing!
I wonder if a better mouse would generate a higher quality image?
Like one of those logitech G pros, razer viper whatever
Or if those have more custom parts that are harder to modify.
I'd love to see a part 2 exploring that!
Better mice don't have more pixels. They are only closer together so the resolution per inch is better. Furthermore, not all mouse sensors feature reading the raw images.
@@DoctorVolt Of course there are mice with more pixels, 3360 sensor raw image dump is 1296 pixels large, that's 36x36 pixels. Reading is quite tricky though, the sensor requires different volatile firmware uploads for each of its operating modes including test mode.
This is the type of camera sensor that pictures UFO
its been done 20 years ago, some even made a "mouse scanner" that makes an image by stiching the camera image using the mouse X-Y movement.
those had 2 separate sensors
Cool stuff 😊
How I imagine someone with severe cataracts to see.
Did a great job
Perfect camera to record UFOs
"And this thing here is a dust particle." - only way this could've been funnier would've been if he had added "for scale" to that sentence 🤣
nice lovely project! what happens if you have a high DPI sensor? is your resolution better?
Now you have the perfect camera for filming Big Foot and UFOs!
I already filmed an alien and his cat on Melmac :)
very brilliant thought concept & having correct infrastructure to realize it, what about mice who have invisible light source i tried closely to look with a digital camera couldn't see anything if it was IR would have shown white, i managed to see the dim red laser dot of a laser mouse.
Awesome! Liked and Subbed!
I thought that optical mice sensors captured images very rapidly so that they can still measure very high speeds of mouse movement. I was expecting you to be able to read at 1000s of frames per second. What would be required to make that happen? A high-fps camera would be cool even at 17x17 resolution!
It looked like an old mouse he used. Definitly no gaming mouse.
Thx for the great video Doctor 👍🏼
All is designed for slow speed. You would not expect a mouse with usb3 cable, do you? For a high speed camera, a high speed controller needs to buffer into much RAM. Nothing of it is in the cheap mouse.
@@suki4410 optical mice do not transfer the images to the host computer - all of the processing happens on the mouse controller.
Not worth the hazzle. Many new mobile phones can capture high speed movies with lower resolutions.@@AlanTwoRings
I thought so too, at least 60fps and likely higher should be possible to prevent lag. Maybe the sensor needs much more light, the illuminating led is usually quite bright and concentrated on a small area. Ambient indoor light is much much lower.
makes me think a lot of a device we use for vtubing called a 'leap motion' which is an IR sensor type of camera, mainly used for tracking hands.
This is insane! I ❤ it!!
I'm not sure if this is the most useless camera or the most useless mouse, but it looks great for taking UFO and bigfoot videos.
Better quality than most security cams
i am stunned by you, madlad.
i mean.. what in the good world?! imagine waking up some day and just going "fuck it, imma make camera from mouse"
this is insane.
instant like and repost.
Very impressive
Now it’s clear what camera was used to film the alien ships, the Yeti, and the Loch Ness monster
This mouse video quality is still better than bank security camera footage
Insane , you are genius
amazing my friend
Good job.
That's amazing!
The next project could be a microphone from a mini HDD, so you have a complete webcam😁.
i'd love to see this done with a more modern mouse, and even if the resolution isn't much higher, you can use the data from multiple captures to increase the resolution by also using the original motion tracking of the mouse to put more pixels between the ones you have
Modern mice don't have debug pins on their sensors for ouputting raw iamges. Only the old ones.
This is great!
Awesome, now lets hook this up to a live image generator and make some animations!! 🎉😊
Cool project, but there was a missed opportunity to wire up a mouse button to the microcontroller to take pictures.
Awesome channel!
That would be a funny gimmick :D but the overhead of this would be a lot. Adding an SDcard module and coding it to safe it there, while technically the "video" stream over wifi consists of 3 pictures per second.
Now take a thousand of those sensors and make a lens array to capture HD video.
I swear there was software I had in Win98 days that would let me scan with my mouse. No mods, just a particular chip in the mouse. (which I was fortunate to have) I'm pretty sure it was a PS2 mouse as I was also doing poll rate overclocking on it.
Yeah, definitely. This is old school. I first saw someone take a picture of themselves about 20 years ago.
Yooo neat, kinda like Franci Kapel's experiment!
You should look at the self-flushing toilet cameras. They have a much higher resolution.
The Waaw at 2:46 is Eddy Wally, deceased Belgian singer.
Turn a finger print scanner into a camera next
Just as a reminder, in the 2000s, there was some program around to use your optical mouse as a scanner.