Get Dynamic Bitcoin Data in REAL TIME with Python - Intro to Deephaven - LINUX OS!!!
HTML-код
- Опубликовано: 2 июн 2024
- Today we will find a SIMPLE solution to one of the most complex data science problems - working with real-time dynamic live-streaming data!
We will learn how to fetch data directly from the Coinbase cryptocurrency exchange, we will then manipulate it, reconstruct it and even plot it! (YES! a graph that keeps MOVING CONSTANTLY as new data comes in and updated within microseconds! 😱😱😱)
And the best part is - no need to have any prior experience with web sockets or setting up your own server! 🤩
If you're wondering how it's even possible - allow me to introduce you to Deephaven! A very powerful open-core framework that made this entire process 100% beginner friendly!
Find out more on Github: github.com/deephaven
(Especially if you'd like to contribute to their open-source project 😉)
Or alternatively you can checkout their website for more info:
deephaven.io/
⏰ TIMESTAMPS ⏰
--------------------------------------
00:00 - intro
00:55 - install Deephaven and dependencies
04:12 - quickhook vs setting up your own websocket
04:50 - Coinbase data stream overview
05:25 - basic data manipulation (drop columns)
07:04 - split data (filter rows of interest)
08:18 - highlight large volume transactions
11:31 - plot dynamic data
15:31 - extract new data features
23:00 - next steps
24:10 - thanks for watching! :)
🎥 MORE DATA SCIENCE TUTORIALS OF MINE 🎥
---------------------------------------------------------------
⭐ Pandas Basics:
• Basic Guide to Pandas!...
⭐ Line Graph with Pandas:
• Professional Pandas Li...
⭐ Plot Graphs with Matplotlib:
• Plotting Google Trends...
🤝 Connect with me 🤝
--------------------------------------
🔗 Github:
github.com/mariyasha
🔗 Discord:
/ discord
🔗 LinkedIn:
/ mariyasha888
🔗 Twitter:
/ mariyasha888
🔗 Blog:
www.pythonsimplified.org
💳 Credits 💳
----------------------
⭐ Beautiful animated graphics by:
mixkit.co
⭐ Beautiful icons by:
flaticon.com 
Наука
Heck yeah. Now we just need coinbase to go opensource and work towards being decentralized in some manners lol
hahahaha yup! 😅 it's ironic to see how the concept of skipping authority approval on transactions (which is arguably the best part of Bitcoin) is rarely implemented. Many people (unfortunately including my spouse and I) are using middle man apps and exchanges that act as the same authority that Satoshi was aiming to dispose of 🙃
Oh well... I did get a Ledger device not too long ago! I might cover how to set it up on the channel. I find it very shameful to admit I've been using the centralized system for so long hahahaha time for a change! 😉
Hi, I'm a fan of the channel. You could continue making content for the extraction and manipulation of data, calculations of indicators such as RSI, SMA and being able to open positions, follow them, close them... Broken down by steps to continue learning Python but with a lucrative purpose... I congratulate you, you are very professional...
@@PythonSimplified lol no doubt!! I think it's a great idea to show people how to set up the ledger and other secure hardware wallets.
Personally I've decided to recieve my paychecks in Bitcoin...I can sell what I need immediately to pay monthly expenses but I'd rather have direct access to put away what little I have left for family and or emergencies into a hot or cold wallet.
World is changing and we need people like you who have influence to help folks along. Thanks for your content!! And big thanks for helping me learn python along my own journey!
I recently discovered your channel, I am doing my master's in data analytics. Your videos are addicting and easy to follow along. Thank you.
You seriously have an amazing ability to teach and explain things that us early aspiring programmers can follow along and understand and I thank you for that. Great video! 😊
Thank you so much for the incredible comment Joey!! 😀
Super happy you enjoy my tutorials!! Cheers! 🍻
Gosh, I really love the way you explain things. Very clear and engaging. Thank you so much!
Thanks for this explanation, very clear and has a nice pace. Find also your voice pleasant to listen to. Keep up the great work.
I'm a blockchain developer turning programmer. Also wanted more examples of Loops and found you. Deephaven is awesome, I can already think of plenty of uses as I chase scam transactions and price movement. Thank you for making this learning experience even better than it already was.
Very good video. Exactly what I was searching some time ago. You explain very well, keep up with the good work
Thank you so much Pedro!!! Super happy you found it helpful! 😃😃😃
Thank you so much !!! I work in Medical Research (Biostatistics and Data visualization). I use GraphPad Prism, D3.js, R, pandas and matplotlib. Now, thanks to you, I will try Deephaven ! 🤗
Great video. Deephaven looks so easy to use, I gotta check it out
Приятная и умная няша)) Спасибо за труд, вдохновляете)
Amazing tutorial and Deephaven is an amazing framework. You are very good at this. Thanks a lot!
Thank you so much for the beautiful comment, bckzilla! Super happy you liked it! 😀😀😀
I love this...Thank you Mariya
Exactly what i was looking for ty
Thank you so much for this tutorial. I'm new to python but been trading for several years. So this is particularly useful to me. You did a great job explaining it and made it sound and look so easy. Will be setting this up myself soon!
Thank you for your content! You are helping me a lot with Python! :)
Thank you so much Jarosław! Super happy to help! 😀
Great content, Mariya retains the crown 😉
thanks for the video
Greetings from Colombia
Hi, I'm a fan of the channel. You could continue making content for the extraction and manipulation of data, calculations of indicators such as RSI, SMA and being able to open positions, follow them, close them... Broken down by steps to continue learning Python but with a lucrative purpose... I congratulate you, you are very professional...
Meus parabéns!! Você ganhou mais um inscrito!!!!👏👏👏👏👏😎👍
thanks for sharing.
Sick!
🙏
Hi.
1st, thanks for your videos.
2nd, a question: I am looking videos explaining MPLStereonet for Python, and i can't find any video talking about how to manage to do graphic with it.
I am making an app for educational purpose for plotting compass data in a StereoNet.
Do you have an idea where to find videos explaining how to program this?
I have the dbase for the compass data, the UI, all works, but i cannot draw the dots in the net.
You are Amazing..
Wspaniały materiał
Dziękuję Adam! 😊😊😊
Can you make a tutorial about flet framework (replacement of flutter)?
my mind is melting with all the things I can think to use it for, stocks namely. Also, they have some great other projects on the site.....
Dear Mariya, I’m always fascinated about number of planes flying in the sky. Because I love travel a lot and about month back I saw planes travel network which is phenomenal.
Then I must recommend a video game you might enjoy! Have you ever played Microsoft's Flight Simulator?
You can actually share the skies with real planes in real time or rewind back to any day in recorded flight data history - even fetching the same temperature and lighting conditions! 😱😱😱
I've had it for a while, still don't know how to take off or land, but I'm good at not crushing during the flight itself hahahaha (probably not a baggable quality 😅) here's the evidence:
ruclips.net/user/postUgkxhrCZrpA6WXcC_YsD6QLCO1i0ciX7qWv4
Dear Mariya, I played on Facebook a game called Aviator which is fantastic. Literally you transport people and goods everywhere around the world where you need to.
Very interesting framework, thanks for presenting it. I am curious to understand how it works under the hood.
With websockets, API-calls, Kafka? I find the whole world of real-world data, push-Frameworks, ... very confusing.
It is definitely not as transparent as simple API calls or CSV downloads.
Concerning real-time data: I guess most of it is either non-public. There is a lot of financial data, and maybe something like weather stations.
It would be good to have a guide on how to identify and find high-frequency data sources.
Pleaaaaase make more data videos please!!!! and thank you
Mariya Excellent work, can i install all of this into a Centos 7 or Almalinux and show on line?
Thank you so much! 😁😁😁
I believe you can! I've only had Almalinux briefly (and I unfortunately can't get a copy of Centos 7 anymore, it was my favourite 😭😭😭).
I found a quick tutorial demonstrating how you might be able to install Java on Almalinux: linuxstans.com/how-to-install-java-almalinux/
Not sure if it's any good as I have no way of checking that hahaha... but I hope it helps!
Other than installing Java - the rest of the commands should be a perfect match to mine.
Good luck! and let me know if it worked 😀
Fantastic work
Thank you so much for everything
Can you please share your terminal settings?
מריה מדהימה , מנסה ליצור איתך קשר ברשת , תמצאי אותי !
Can you get historical data? Or just live?
that waz truly amazing!
(obviously U2, lol)
I would like to track currency'z & precious metal'z
Today people who are join with cryptocurrency science increase. good choice for this part and how is using it with lovely Python. Thank you Mariya (\/)
Thank you so much Hamoudi! 😀
great content
Thank you so much Alan!! 😀
Great tut actually, but I hated Coinbase when they suspended trading in XRP.
Thanks for the great tutorial, you are doing a wonderful job and deep heaven is a great Framework,
We need to fetch some FOREX data plzzzzzz 😄
great job! i am looking for a solution to save for example btc data of one day (0-24h). new day new table data... ;-)
22:15 My dream data source would be historical forex pair tick data including time, bid, ask, and volume for the 28 major fiat currency pairs. My dream platform for analyzing it is evolving and I am in the middle of seeing if I can get pandas and/or numpy to assist my implementation of it.
is it possible to make same work for gold price ?
How you enable live eth/btc api. Did you use async for it continuous running?
Hi Mohamed 😀
In this tutorial we're using a web socket that Deephaven has already set up for us, it's a quickhook to Coinbase cryptocurrency exchange and that's where the real-time data comes from.
You've missed the beginning of the tutorial, but checkout what I'm saying at minute 04:12 😊
Fetching your own data involves lots of work, I'm really hoping to cover it on the channel one day, for now if you have a data source you'd like to work with please let me know and I can check if Deephaven is able to create a quickhook for it 😉
Great, glad to see your teaching passion, that's trigger my thinking with different aspect of implementing concept with step be step to implement functionality, that's really good, thank you for your work, keep active us with your passion♥️♥️
i follow along this tutorial and some error show up. when starting "deephaven_example_app" my terminal show this "RuntimeError: can't find any Python shared library". i dont know whats wrong
me too, did you get the solution?
localhost:10000/ide, site can't be reached how do I fix this?
😍😍😍😍😍
Can you help us code in tradingview?
You are absolutely gorgeous. You are most welcomed in any country in the universe....Lucky Canada to have your heart bound....
Maybe you can try Arch Linux in future?
maya can you do a video for window users
Absolutely! I'm working on it 😉
It's gonna take a bit of time as I need to cover Docker first (it's the easiest way to run DeepHaven on Windows but I'm yet to make a tutorial on how to use it 🙃)
Stock availability and price of PS5's haha 😁
What makes your prompt look like that?
It's just the regular terminal you get with Kali Linux, I've enlarged the font a bit but everything else is on default setting 😊
it works on a mac surprisingly. Great video!!!
is it possible maybe one day u build bet365 clone ? that read data from another site
I want my own crypto 🙃
Just make sure you send me one DiwakarCoin when it's ready 😉
@@PythonSimplified done I will try 🙃
Que linda guerita.
You really (and/or 'still') code C++? if so, why don't you play around with it a bit? Would like to see whatcha got -- skillss)
I can't really post C++ stuff on a channel called "Python Simplified" 🙃
But you're more than welcome to check out my C++ projects on Github 😉:
github.com/MariyaSha/DJMixingStudio
А на таком широком мониторе глаза не разбегаются? :)
Неа! ты просто чувствуешь что ты командир космического корабля хахаха 😊😊😊
Sadly, it doesn't work anymore
Great tutorial Is it just a little hard to concentrate since you are so gorgeous.!
Será que dessa vez Mariya responderá o comentário?
Eu costumo fazer, Maricio 😊 Eu tento responder o máximo possível nas primeiras horas de publicação de um novo vídeo...
(I've used Google Translate for this, my apologies if it doesn't make grammatical sense hahaha)
@@PythonSimplified Desculpe, Mariya, mas você nunca me respondeu. Eu gosto muito de você e dos seus vídeos.
Okay being smart is what actually makes you soooooooo attractive, not even mentioning how beautiful you are, just be my gf already.
dont lie to us ..this is not for people with no experience :)))) ...i watching you because you cute and explaining well ,and also because i like programing ...)but i gived up on python ) started Unreal Engine :)) ...ofc nothing to do with python
Max!!! if you can figure out Unreal Engine - Python shouldn't even be a challenge for you!! 😉
I've had my share of C++ learning in university and it's a million times more complex! (that's the language you use there, right?)
With that said - if you're interested in video game development and virtual reality stuff - you're spot on the right track! 💪
Python is very versatile, but I find that it has the biggest advantage when it comes to data science and AI - but in terms of complex graphics engines we're not there yet (well... maybe future versions of Python will have a solution to this)😀
@@PythonSimplified i didnt start with C++ ...started on Unreal Engine 5 ..wich is more graphicaly visual thing ... (like you connecting some codes and you can actualy see the result on screen) C++ is more complex your right :)) that why for the moment i skipped it haha ...(working on ue5 the engine itself no need for c++ there ...but eventualy i will need c++ too i think
Help!
I got error : AttributeError: module 'deephaven.dtypes' has no attribute 'DateTime'
when I tried:
python -m deephaven_example_app
I have pyhton 3.9.13
:(
I'm having the same issue
Hi , I have many crypto bot projrcts auto trading on binance , how to contact you to share my projects with you ?
Python projects and works perfectly, I use them daily trading and happy to share with you to make tutorials on it