Advanced Arduino Telemetry and Data Visualization
HTML-код
- Опубликовано: 20 июл 2024
- In this video I show a new version of the data logging and telemetry visualization tool that I have been developing. This tool makes it easy to visualize data received from an Arduino or any other microcontroller or FPGA.
I start with a demo showing an Arduino Uno connected to a microphone amp and microphone. The mic's waveform is digitized by the Arduino, and shown on screen in four ways: as a simple line chart, as a fourier transform (DFT), as a waveform view (basically a long exposure photo of several DFTs) and as a waterfall view.
The second demo is of an STM32-based balancing robot. I show how the new quaternion visualization works and highlight some of the other new features in this version of my TelemetryViewer tool.
Then I show how to write an Arduino sketch to send your sensor readings to the PC. We go over how to connect to the serial port, define the data structure sent to the PC, and walk through all of the possible charts that can be used to visualize the data.
Finally I walk through the Java and JOGL source code so you can see how it works and modify it to fit your needs.
Here's a changelog for v0.3:
- Added manual ranging (the y-axis) to Time Domain Charts.
- Added manual ranging (the power axis) to Frequency Domain Charts.
- Added new Waveform and Waterfall views to Frequency Domain Charts. These visualize the frequency domain's history over a period of time.
- Added manual domains (the x-axis) and autoscaled-but-fixed-center domains to Histogram Charts.
- Added manual ranging (the y-axis) to Histogram Charts.
- Added y-axis scale choices to Histogram Charts: relative frequency, frequency, or both.
- Added user-specified bin counts to Histogram Charts.
- Added manual ranging to Dial Charts.
- Added the ability to remove statistics from Dial Charts.
- New Quaternion Chart to visualize orientation (rotation in three dimensions.)
- For line charts, if you are zoomed-in enough that there are relatively few points on screen, dots are now rendered at each point.
- Automatic logging has been removed and replaced with an "Export CSV Log" button.
- Added support for high-resolution scrolling when using certain Logitech mice, such as the M705.
- Various small bug fixes. See the git commit log for more details.
The program and source code can be downloaded here:
www.farrellf.com/TelemetryViewer/
github.com/farrellf/Telemetry...
Telemetry Viewer is free and open source. If you find it useful and want to "buy me a coffee" that would be awesome: paypal.me/farrellfarahbod 
Наука
Simple but power visualisation tool!
Brilliant! Thank you!
Ooh mate, this is just fantastic, been looking someone like you 4 long time.. finally something interesting on youtube..
Amazing job man. You have no idea how many people you are saving with this. Greetings from Chile.
who care if this is long and boring this is so detailed it is just what the doctor ordered for my battery analyzer. Thanks bro keep up the good work.
Excellent, thank you for your good work
Yes! I would like to learn openGL. Was about to ask you where you learned this. I would also like to try and contribute somehow to this amazing project in my spare time to better learn java and openGL. Love your videos!
Awesome program!
What I would like to see in a new version:
- Dark Theme
- Console (sending commands to the microcontroller)
- Able to start/stop the data without disconnecting/clearing data (so you can sample for 5 seconds so files wont have 1 million rows)
- More/custom baud rates
- time/div in the corner of the x/y graph
- Exporting csv files that start with 'sep=,' so they can be opened in excel without importing them
- When you zoom in it wont change the frequency chart
You are amazing! Keep it up with the videos :)
This is an awesome piece of software - I only started to try it on my Mac, connected to an Arduino. This is much easier to use than using Processing which I did in the past. Thank you very much for the good work and for sharing. Greetings from Switzerland.
Glad you like it, thanks for the feedback.
@@upgrdman I try to use version 8 it doesnt look work for me. I use demo firmware from soft sketch upload to arduino... it doesnt show any..... pls advice
this is amazing really great. thanks alot.
Really nice!!
But please, use log scales for frequencies.
Great work
woow, That is really awesome
Thank you very much for the good work and for sharing. How can we visualize an MPU6050 Gyro sensor data? (not with Alanalog, use SCL, SDA)
Excellent tool.
Thanks
This program seems awesome, though there is one thing that i see as missing in it. Non chart info. I want to add boxes that only contain the current value and name of a certain variable in them, with the graphs being used as an auxiliary bit of information.
Thanks. I plan to add that eventually. Currently you can use a Dial Chart to get something close.
Great Work! Quick question: I am trying to use a temperature sensor and it is outputting the temp to the serial monitor in degrees Fahrenheit on Arduino Mega, however I was wondering if you could tell me how I could manipulate the LSB values on your program to actually see the y-vales corresponding with the degrees F range/scale. Thanks!
Thanks. If the Arduino is already printing out the number in F, there is no need for scaling in TelemetryViewer. Just set it to 1 LSBs = 1.
Seriously awesome project!
You have definitely rekindled my plans to build a arduino datalogger / dashboard for my racecar. I would like to use your software for data analysis later on since I haven't found any existing track analysis software that can work with .csv files, they tend to all stick to their own proprietary files. How difficult would it be to modify your code to be able to graph gauges such as engine speed or vehicle speed, and would it be possible to add track layouts and take GPS data and overlay that to show track position / time? Cheers, Alex
Thanks! Right now the software can only display live data, but replaying CSVs is planned. The "Dial Chart" is a primitive gauge. If you have experience with Java and graphics programming, you might be able to modify it to fit your needs. New charts for showing 2D and 3D positions are planned but it might be a while before I get to that.
Excellent! I have downloaded your software and planning to use it for testing my system and ironing out the bugs I had with sensors affecting each other. Will keep my eyes open for updates on this and will see about learning Java in my spare time to see if I can modify it to suit.
Thanks for sharing this project, it's very helpful!
upgrdman i have similar but very advanced software with many many functions but it reads data not from arruino. Do you want to see it? Maybe you can modify it to read from arduino.
Jesus! this is wonderful. Take my money please. :-)
Really nice work here upgrdman :) I downloaded the files, but v.03 telemetry viewer only has ´test option´available on the right corner, so it´s not possible to connect COM ports...... How can I solve it?
Fantastic work! Can I some how take the data from a UDP-connection to make it wireless?
Thanks. Currently it only supports UARTs, but I plan to add UDP and TCP support later on.
Did you do the tutorials for OpenGL? I would like to know how to move the monkey with the IMU data. I tried to follow your code but it's very complicated.
Nice work.
Oh wow. I thought for sure you are using JavaFX Charts, but this is a Swing app. Really cool man!
Thanks. In v0.1 I used the JFreeChart library, but it was painfully slow since it's CPU-only. I decided to write my own charts from scratch and render them with OpenGL. Swing is only used for the controls at the bottom of the window, and when configuring a new chart. I briefly tested the JavaFX charts but they were painfully slow when used with large datasets. I wanted things to be efficient enough to render datasets of >500k points, live, at 4k60, with just Intel integrated graphics. I'm pretty close to that goal, currently able to do 4k60 with about 400k points on a Surface Pro 4.
Cool. Thanks for the insight.
I love what you have done but I have a problem. Your original version works perfectly on my computer, but neither v0.2 or v0.3does.
In v 0.3 for example, after I enter the values in the comm area (bottom right) and hit the "connect" button, the "CVS Packet Data Structure" box opens normally, and my Arduino starts sending data. When I enter the data at the top and hit "Add," the correct info shows in the 1st line below it. When I hit "Done," the "CVS Packet Data Structure" box closes and I am back to the main grid. When I select an area on the grid for the chart, the "Add Chart" box opens. I then enter the correct info and hit "Add Chart," and the Add Chart" box closes but all I get on the grid is a dark grey area where the chart should be. Also, sometimes the program hangs and I have to force it down with the Windows Task Manager.
I had essentially the same problem with v0.2, but the first version you posted works perfectly on my computer.
Can you help?
very nicely explained video
can you please let us know the sensor with which you are generating Q0,Q1,Q2 &Q3 values
The quaternion comes from gyro and accelerometer readings run through Madgwick's filter:
ruclips.net/video/hvjNaIlHPV0/видео.html
ruclips.net/video/WqQ3HZCI3nA/видео.html
thanks for the link it's a great help
This is great work.
How can I modify to add control control buttons on the gui?
I need to do data visualization and control at same time.
I've been working on that. The next version will supporting transmitting.
@@upgrdman please i can go back to class to learn, permit me to be your student.
I just love that data visualization.
I was using Processing 3 for data plotting, now seeing your work. i am activated to continue learning Java programming again.
Awesome!!!, thanks a lot for such a great contribution, I tryed the binary version, but sometimes looses the sync, still some errors with bin?, if I use crc will help? which kind of crc, 16?
I've implemented the CRC from your code, now works fine, thanks again for this really good utility
Thanks. The binary mode is not quite done yet, and it does not currently support CRC. I'm hoping to have the binary mode in a more usable state by the next version, but that might be a couple months from now.
Then I don´t understand, because I´m using 10 floats LSB format plus CRC termination, same implementation as in BinaryPacket.java and it´s working fine, no sync errors, not like before using the CRC, anyway, thanks a lot
Excellent idea! How to display values of each graphs on separate window?numerical value ? Thanks
Thanks. The Dial Chart is the only one that will display a numerical value. Only one window is supported.
Thanks, Pls advise about dial chart numerical display on java eclipse.
On one window multiple numerical values can be displayed?
Hey Upgrdman. Is it possible to make visible the power : P =U x I P ( Power in Watt) U in Volt ( A0) I in Ampere ( A1) in a dial chart or on a other way.
You want to do math on multiple datasets? That's a good idea, but no it does not support that.
I what you have made is really a fantastic and powerful Data acquisition system. My problem is that I am not familiar at all with Java, I downloaded the .src zipped file but I am not able (my fault) to run this fantastic program. Could yo help me to have an executable program that run on Windows? I downloaded also the JRE but, again, I am not familiar with such ambient :(. Thank you in advance
Hi. thx for the awesome program. I have a question. Is this program runs only openGL ver4.5 or higher? cuz my old laptop has openGL v4.0 (3rd gen i5 cpu) and program seems automatically closes.
OpenGL 4.0 should be fine. It's probably related to OpenGL drivers. If you're using 64bit drivers, you will meed to use a 64bit JRE.
Is there anyway to increase the amount of data taken? it stops at 132298 data points.. I need 3 days worth of data.
Hie, I'm a java noob and i need to access the converted samples to use in another interface. How can i access them
how do you calculate the quaternions? I use MPU6050 and don´t use the unit DMP because is slow
I use Madgwick's Filter, which outputs a quaternion. I have a video about it, check out my older videos.
Hi, this looks like an awesome tool. I am trying to get it working on my Mac but I don't know how to get it connected to the Arduino. It doesn't show any COM ports on the Mac. The port I'm using to upload to the UNO is cu.usbmodem1411. This is listed in the dropdown in Telemetry Viewer but when I select it, it gives the error: Warning: Serial connection lost.
Any idea what I'm doing wrong?
I have not tried it on a Mac but it should work. Only one program can use the Arduino's serial port at a time. Try closing the Arduino IDE if you have it open.
Thanks upgrdman. It did work. I am using cu.usbmodem1411 when connecting via the IDE. TelemetryViewer also listed tty.usbmodem1411 and I tried it but got the same error. After shutting down everything, I tried tty.usbmodem1411 again it it worked. This is an awesome program. Thanks for sharing.
Dratt ... finally found a machine with java8 on it but the viewer can not be reduced to fit within the width of the screen (1280). How about a 'Lite' version?
Hi. I'm working on making the GUI a little more flexible, that should be part of the next version. I'll post a video when it's ready.
Hello, I have a problem on Mac. The Arduino UNO is working fine and the serial monitor window of Arduino also works fine. But I have difficulties to connect Telemetry application to Serial port. It is listing 3 cu.Bluetooth-Incoming-Port, tty.Bluetooth-Incoming-Port and Test. It is not establishing the connection to any of them. Can you please help?
Only one program can use a port at a time. Try closing the Arduino IDE or anything else using that port.
How Do i Convert the Analog readings of the MPU6050 to serial .
if some have the code to do so please do so.
@upgrdman
im using MPU605 ( connected to A4 and A5) how would i write the code for it ? all the example you showed were very useful but based on one port only and im having an issue displaying the graphs for my mpu605.. thanks :)
My earlier videos show how to send multiple values.
can you please provide me with the link of the video? im new to your channel
In my opinion, you should't limit the video name with "arduino". This work is universal on all mcu's with serial communucation.
I agree, but I try to demo most of my stuff with an Arduino since many of my viewers use them. I've used the software with an STM32F0, an LPC1768 and even a Lattice MachXO2 FPGA.
Hello. How to replace the monkey ? It seems that adding a new .stl file and modifying OpenGLQuaternionChart to get the new .stl is not enough.
Solved: Needed to mark ascii in blender when exporting. Thank you !
@@embeddedroom Can you explain me how to do it?
Can you add a timestamp in exporting option?
Yes, I plan to eventually support logging the timestamp of each sample.
How to install on Linux 18.04
The new options are very usefull. It works beautiful on my Destop . Excellent. But i have a problem with this programm on a new notebook with windows 10 : Open GL es error . Can't find the name of Intel ICD open GL driver. Doe you have a solution?
It sounds like the software can't find an OpenGL driver. Making sure Windows has all updates installed, and check Device Manager for any problems (there should be no yellow triangle warning icons, etc.)
All updates are installed from Windows 10. There are no problems in Device Manager. This is the system.Notebook.Specificaties: Medion Akoya E7424 (MD 60150)Processor: Intel Core i3-7100U
Beeldscherm: 17,3 inch, HD 1600 x 900 pixels resolutie
Grafische kaart: Geen, Intel Graphics 620 grafische chip
Werkgeheugen: 4 GB DDR3L
Opslagapparaat: 128GB SSD & 1TB Harde schijfNew 8 februari 2017Hope on a solution.
I Google'd the error message you saw, and got lots of conflicting reports. It seems like the issue might be related to the graphics driver, and some people had success by downgrading their driver. For example:
osu.ppy.sh/forum/t/519910/start=15
The only PC I have with an Intel GPU has Intel Iris Graphics 540 and everything seems to work fine on that with driver version 20.19.15.4463
It's works now good. My friend has found the problem. My notebook is new.I think normal all programms from Microsoft on this notebook 64 bits. I use Internetexplorer 11 and that was a 32 bits in Windows 10.After that have I installed Java . And Java had also installed in 32 bits .Now is Java and Internetexplorer in 64 Bit version. Now I happy. It's works good.The newest grafic driver from Intel was on Sunday installed.I have introduce this programm today on a highschool and they find this a very good programm. They are happy. Thank for your help Upgrdman and your very good work.
How can I get the executable file for Telemetry View?
There's a link in the video description.
Hey Upgrdman, awesome software here. Is there any new version out besides v0.3?
Thanks. v0.3 is the newest. I'm still working on v0.4, not sure exactly when it will be ready. Hopefully in 3 - 5 weeks.
Thank you upgrdman :) this really helps. Subscribed to your channel :D would love to see more from your channel. Is it possible to do telemetry from arduino sending data via Wifi?
I'm working on support for TCP/UDP but it might be a while.
Hi Upgdrman. Might i suggest an option, to compress the incoming data. as nearly 30 minutes of acquisition can sometimes create an excel file of nearly 180MB. also if there is a feature known as triggered recording(to record values to excel file only if the value crosses a threshold. Presumably adjusting the number of seconds to record before and after the trigger.
All ok only this
"A corrupt line was received.
A corrupt line was received.
A corrupt line was received." x infinite while running . Could be a bug in eclipse or ? Thank you !
That means your telemetry data is not formatted correctly. What does it look like when you connect to the device with a serial terminal?
-1.492384,0.802836,9.759053,0.003512,0.005534,-0.002128,98.110879
-1.493821,0.797327,9.762646,0.003725,0.005108,-0.001916,98.176490
-1.498850,0.791818,9.766239,0.003938,0.004683,-0.001703,98.252948
-1.503880,0.789902,9.760730,0.004257,0.004363,-0.001703,98.157451
-1.504120,0.788944,9.760730,0.004257,0.004257,-0.001703,98.156659
-1.504359,0.787986,9.760730,0.004257,0.004150,-0.001703,98.155869
-1.501485,0.787986,9.762407,0.003938,0.004044,-0.001490,98.179962
-1.500527,0.789663,9.754263,0.003512,0.004044,-0.001277,98.020800
-1.499569,0.791339,9.746120,0.003086,0.004044,-0.001064,97.861779
-1.498371,0.793974,9.730552,0.002873,0.004150,-0.001383,97.559150
-1.496934,0.798046,9.718576,0.002661,0.004257,-0.001703,97.328415
-1.495497,0.802117,9.717858,0.002235,0.004683,-0.002022,97.316665
-1.490707,0.806907,9.719295,0.002235,0.005002,-0.002128,97.338000
-1.485917,0.811698,9.720732,0.002235,0.005321,-0.002235,97.359431
-1.487833,0.815530,9.716660,0.002554,0.005428,-0.002341,97.292223
-1.491665,0.816248,9.717139,0.002873,0.005640,-0.002448,97.314122
-1.495497,0.816967,9.717618,0.003193,0.005853,-0.002554,97.336053
maybe it's the empty line
First problem solved. I had an extra line. Thank you .
A second problem I discovered now when trying to add new graph is this: Thank you !
java.lang.NullPointerException
at LogitechSmoothScrolling.enableSmoothScrolling(LogitechSmoothScrolling.java:101)
at Main$1.windowGainedFocus(Main.java:35)
at java.awt.Window.processWindowFocusEvent(Unknown Source)
at java.awt.Window.processEvent(Unknown Source)
at java.awt.Component.dispatchEventImpl(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Window.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.KeyboardFocusManager.redispatchEvent(Unknown Source)
at java.awt.DefaultKeyboardFocusManager.typeAheadAssertions(Unknown Source)
at java.awt.DefaultKeyboardFocusManager.dispatchEvent(Unknown Source)
at java.awt.Component.dispatchEventImpl(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Window.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.SequencedEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
it seems that can not connect to 127.0.0.1 on port 53459. Need to enter more deep into LogitechSmoothScrolling instructions...
Why I can't change to other stl file?
That's planned for a later version.
upgrdman is there anyway i can change to other stl file?
Not an expert, but have you seen the library's made available from NASA? Might check it out. Not sure if it applies. code.nasa.gov/