- Видео 198
- Просмотров 171 494
The Data Channel
Индия
Добавлен 10 сен 2021
"The Data Channel”, your go-to destination for unraveling the mysteries of the ever-expanding data universe. In an era where information reigns supreme, understanding the intricacies of data and its related technologies is not just a skill but a necessity. Whether you’re a seasoned data enthusiast, a budding analyst, or someone simply curious about the transformative power of information, this blog aims to be your compass in navigating the dynamic world of data.
Join us at “The Datapedia” as we navigate the exciting intersections of data engineering, data science, and the ever-evolving landscape of cloud platforms. From foundational knowledge to advanced techniques, our mission is to make the complexities of these technologies accessible to all. Embark on this data odyssey with us and discover the limitless possibilities within the data spectrum.
Join us at “The Datapedia” as we navigate the exciting intersections of data engineering, data science, and the ever-evolving landscape of cloud platforms. From foundational knowledge to advanced techniques, our mission is to make the complexities of these technologies accessible to all. Embark on this data odyssey with us and discover the limitless possibilities within the data spectrum.
Python Dictionary in Action - with Real time Use Cases | Topic #18
#pythontutorial #pythondictionary #pythondictionaryComprehension #thedatachannel
Python Installation: ruclips.net/video/zBgIAjzfvAo/видео.html
IDEs Installation Steps:
VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html
Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html
PyCharm Installation: ruclips.net/video/aM7T3l7O3Hk/видео.html
Spyder Installation: ruclips.net/video/tcGAyByawYs/видео.html
In this video will explain what is the need of Datatypes and which are the Datatypes in Python and how they can be used
WEBSITE: thedatapedia.com/
WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL
FOLLOW US ON:
Twitter: The_DataChannel?s=09
Facebook: Th...
Python Installation: ruclips.net/video/zBgIAjzfvAo/видео.html
IDEs Installation Steps:
VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html
Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html
PyCharm Installation: ruclips.net/video/aM7T3l7O3Hk/видео.html
Spyder Installation: ruclips.net/video/tcGAyByawYs/видео.html
In this video will explain what is the need of Datatypes and which are the Datatypes in Python and how they can be used
WEBSITE: thedatapedia.com/
WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL
FOLLOW US ON:
Twitter: The_DataChannel?s=09
Facebook: Th...
Просмотров: 16
Видео
Categorical data encoding using CHATGPT- (PART II) | Topic 5
Просмотров 20День назад
#datapreparation #chatgptcourse #categoricalEncoding #thedatachannel In this video, will understand what is categorical data encoding, how to make use of ChatGPT for exploring categorical encoding with examples WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: The_DataChannel?s=09 Facebook: The-Data-Channel-110561871369...
Python LIST in Action - with Real time Use Cases | Topic #17
Просмотров 35День назад
#pythontutorial #pythonlistomprehension #pythonlist #thedatachannel Python Installation: ruclips.net/video/zBgIAjzfvAo/видео.html IDEs Installation Steps: VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html PyCharm Installation: ruclips.net/video/aM7T3l7O3Hk/видео.html Spyder Installation: ruclips.net/video/tcGAy...
Python STRING Data Type In Details:Slicing, String methods, Formatting, Escape Characters| Topic #16
Просмотров 2014 дней назад
#pythontutorial #pythonstrings #pythonstring #thedatachannel Python Installation: ruclips.net/video/zBgIAjzfvAo/видео.html IDEs Installation Steps: VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html PyCharm Installation: ruclips.net/video/aM7T3l7O3Hk/видео.html Spyder Installation: ruclips.net/video/tcGAyByawYs/...
Categorical data encoding using CHATGPT- (PART I) | Topic 4
Просмотров 3121 день назад
#datapreparation #chatgptcourse #categoricalEncoding #thedatachannel In this video, will understand what is categorical data encoding, it`s importance and types with examples WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: The_DataChannel?s=09 Facebook: The-Data-Channel-110561871369766/ Instagram: the.data.channel @Th...
Python Data Types- Numbers, Strings, Lists, Dictionary, Tuple, Sets, Boolean | Topic #15
Просмотров 1521 день назад
#pythontutorial #pythondatatypes #thedatachannel Python Installation: ruclips.net/video/zBgIAjzfvAo/видео.html IDEs Installation Steps: VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html PyCharm Installation: ruclips.net/video/aM7T3l7O3Hk/видео.html Spyder Installation: ruclips.net/video/tcGAyByawYs/видео.html I...
Conditionals and Loops in Python and Importance of them in Data Processing and analysis | Topic #25
Просмотров 75Месяц назад
#pythonconditionals #pythonloops #pythoncode #thedatachannel Python Installation: ruclips.net/video/zBgIAjzfvAo/видео.html IDEs Installation Steps: VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html PyCharm Installation: ruclips.net/video/aM7T3l7O3Hk/видео.html Spyder Installation: ruclips.net/video/tcGAyByawYs/...
Practice Python without any Installation using Online Platforms for FREE | Topic #14
Просмотров 45Месяц назад
#replit #googlecolab #pythonanywhere #thedatachannel IDEs Installation Steps: VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html PyCharm Installation: ruclips.net/video/aM7T3l7O3Hk/видео.html Spyder Installation: ruclips.net/video/tcGAyByawYs/видео.html In this video will explain how to practice Python without h...
Install Sublime Text Editor for Python | Python for Data Professionals | Topic #13
Просмотров 36Месяц назад
#sublimetext #pythoninstallation #thedatachannel Prerequisite: Install Python ruclips.net/video/zBgIAjzfvAo/видео.html In this video will explain how to Install Sublime Text Editor and write and execute first Python Program WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: The_DataChannel?s=09 Facebook: The-Data-Channel...
Data Preparation and Cleaning using CHAT GPT | Topic 3
Просмотров 70Месяц назад
#datapreparation #chatgptcourse #promptengineering #thedatachannel In this video, will understand how we can prompt Chat GPT to automate the process of Data Preparation and Data Cleaning. WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: The_DataChannel?s=09 Facebook: The-Data-Channel-110561871369766/ Instagram: the.dat...
Which Python IDE is Best for you? VS Code vs Jupyter vs PyCharm vs Spyder | Topic #12
Просмотров 143Месяц назад
#vscode #pycharm #jupyter #spyder #thedatachannel In this video will explain understand features of IDEs(VS Code vs Jupyter vs PyCharm vs Spyder) and which helps you to choose Best one for you IDEs Installation Steps: VS Code Installation: ruclips.net/video/_FQRJifGxBQ/видео.html Jupyter Notebook Installation: ruclips.net/video/Nf-47V3LLzs/видео.html PyCharm Installation: ruclips.net/video/aM7T...
Prompt Engineering and its Key Features | Topic 2
Просмотров 50Месяц назад
#chatgpt #chatgptcourse #promptengineering #thedatachannel In this video, will understand what is prompt engineering and what the Key Features of Prompt engineering like Clarity, Structure, Context, Iterative Refinement, Constraints, Specificity, Pre-trained Knowledge and Error Handling WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: twitter....
Install VS(Visual Studio) Code for Python development | Python for Data Professional| Topic #11
Просмотров 612 месяца назад
#vscode #visualstudiocode #pythoninstallation #thedatachannel In this video will explain how to Install VS(Visual Studio) Code, Install Python Extension in VS Code and execute first Python Program in VS Code WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: The_DataChannel?s=09 Facebook: The-Data-Channel-110561871369766...
Generative AI: Key Concepts, Techniques and Applications | Topic 1
Просмотров 682 месяца назад
#chatgpt #chatgptcourse #generativeai #thedatachannel In this video, will explain about what is Generative AI and Key Concepts and Techniques of GenAI like (Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), Transformers and Diffusion Model WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: The_DataChannel?s=09 ...
Install Spyder IDE for using Anaconda and Python PIP | Python for Data Professional | Topic #10
Просмотров 482 месяца назад
#spyder #anaconda #pythoninstallation #thedatachannel In this video will explain how to Install Spyder using Anaconda and Python PIP(2 different ways) and execute first Python Program WEBSITE: thedatapedia.com/ WHATSAPP: chat.whatsapp.com/CbXLGiu2QUoI3DOgl55JSL FOLLOW US ON: Twitter: The_DataChannel?s=09 Facebook: The-Data-Channel-110561871369766/ Instagram: the.data.ch...
Install Jupyter Notebook using Anaconda and Python PIP |Python for Data Professional | Topic #9
Просмотров 692 месяца назад
Install Jupyter Notebook using Anaconda and Python PIP |Python for Data Professional | Topic #9
ChatGPT for Data Professionals Course -Introduction | Topic 0
Просмотров 1392 месяца назад
ChatGPT for Data Professionals Course -Introduction | Topic 0
Install Python and PyCharm IDE on Windows |Python for Data Professional | Topic #8
Просмотров 642 месяца назад
Install Python and PyCharm IDE on Windows |Python for Data Professional | Topic #8
Execute Python Program Using Command Line and Interactive Mode|Python for Data Professional|Topic #7
Просмотров 492 месяца назад
Execute Python Program Using Command Line and Interactive Mode|Python for Data Professional|Topic #7
Step-by-Step Guide to Install Python and create Python Virtual Environment on Windows | Topic #6
Просмотров 812 месяца назад
Step-by-Step Guide to Install Python and create Python Virtual Environment on Windows | Topic #6
Application of Python in different domains and industries | Python for Data Professionals | Topic #5
Просмотров 842 месяца назад
Application of Python in different domains and industries | Python for Data Professionals | Topic #5
Python: Is it a Compilation or Interpretation language | Python for Data Professionals | Topic #4
Просмотров 812 месяца назад
Python: Is it a Compilation or Interpretation language | Python for Data Professionals | Topic #4
Why Python for Data Processing | Python for Data Professionals | Topic #3
Просмотров 682 месяца назад
Why Python for Data Processing | Python for Data Professionals | Topic #3
How Python Stands out from JAVA,C/C++,JavaScript, SQL | Python for Data Professionals | Topic #2
Просмотров 642 месяца назад
How Python Stands out from JAVA,C/C ,JavaScript, SQL | Python for Data Professionals | Topic #2
Primary Key vs Surrogate Key | Data Modelling Master Class| Topic 13
Просмотров 993 месяца назад
Primary Key vs Surrogate Key | Data Modelling Master Class| Topic 13
Python Introduction - History and Features | Python for Data Professionals | Topic #1
Просмотров 743 месяца назад
Python Introduction - History and Features | Python for Data Professionals | Topic #1
Normalization-Normal Forms- 1NF,2NF,3NF,BCNF,4NF,5NF | Data Modelling Master Class| Topic 12
Просмотров 983 месяца назад
Normalization-Normal Forms- 1NF,2NF,3NF,BCNF,4NF,5NF | Data Modelling Master Class| Topic 12
Normalization-Purpose and consequence of not using it | Data Modelling Master Class| Topic 11
Просмотров 613 месяца назад
Normalization-Purpose and consequence of not using it | Data Modelling Master Class| Topic 11
Entity and Attributes, Relationship in Detail | Data Modelling Master Class| Topic 10
Просмотров 803 месяца назад
Entity and Attributes, Relationship in Detail | Data Modelling Master Class| Topic 10
Key Elements of Logical Data Modelling | Data Modelling Master Class| Topic 9
Просмотров 683 месяца назад
Key Elements of Logical Data Modelling | Data Modelling Master Class| Topic 9
Seems, Topic 5 is missing..
Great Job!! Sent an email for practice notes.
Sent to your mail ID Thank you
Very useful videos, Thanks for knowledge share.
Thank you for your support Happy learning 😇
hi day 2 for requesting all files related to this playlist and even i have mailed you .please help
Apologies for delay, I have shared now, please check your mail
Please send spark associate developer playlist dbf files i have send u email request still not response
You mail id?
please upload video 5
hi thanks for the course i have emailed to requesting for dbc file thanks
Sent to your mail, please check, Thank you
Sir! Where is the autoloader video. I cannot find it in this playlist! Please upload it.Thanks!🙂
Hi hope you’re doing great 👍 ! After learning basics n understanding ( types of data, 6vs of data, etl vs elt, db vs dw vs dm vs dl, full vs incremental load, fact vs dimensions, dw schemas, scd type n storage layer types, oltp vs olap) in one day , i have moved to databricks instead of data analysis as i want to become data engineer so today i have started this playlist n done with below topics ( 1- data bricks -- simple open source and single seloid teck stack ( all stack under 1 unberla ) lakehouse Data lake + dw = lakehouse (delta lake ) as delta lake is heart of lake house n lakehouse is build on top of delta lake (Topic-2 free trail - 2 ways aws n direct db website register ( need credit card 14 days trail n set termination 120 or 15 minutes as if u unchecked it will consume storage ) 1- trail version single node ( default driver node ) Multi node has worker + driver Topic-3 ( db architecture n services) ( control plane n data plane Control plane :: db cloud admin control Data plane : customer cloud ( aws azure gcp ) all exution transformation compute memory storage physically present here ) High level cluster : 1- general purpose interactive n job cluster Topic-3 db workspace Db page overview ( left side personas ( ml de n sql will b available in premium version) rest create workspace repos compute data workflow will b same in all 3 pasonas ( ds ml sql ) -- right side top ( user settings , admin consle , logout many more ) Topic -4 create n manage clusters Workspace create or compute create new ( single node -) When u click on created cluster u will have many options logs alerts metrics many more where we can mintor all Topic-5 db notebooks 1- create new notebook name n select lang u want 2- execute cell print (“hello”) 3- magic command %sql %python to change language of note book 4- md 5- %run “path” of child notebook or second notebook 6- %run “./notbookname” for exiting folder 7- dbutilies.help 8- display dbutlies.fs.help to display in tabular format Topic-6 git version n repos Create account in git hub settings developer mode acess token create copy then go to db settings add token repos n configure then create a child branch n to avoid conflict ( first always pull latest version n then push) Topic -7 taking brake may b evening i will practice Thanks 😊 once again !!
Amazed by your dedication, it is really inspiring. Thank you for your learning journey updates
Learn in one day all below topics n return what i learn thanks now starting this playlist Topic -1 Types of data 1- structured ( oltp transactional online banking booking erp ) relation between tables Eg : oracle sql server ibm db2 vertica 2-semi structured- json xml format Dw / data bricks / delta or data lake ( iot sensor data ) 3- unstructured ( images videos ) ( dw / delta lake ) N for statistics data ( Topic -2 6 vs of data 1- volume (gb tb peta bytes) 2- variety (semi structured unstructured) 3- velocity-( 4- value ( analysis dashboard) 5- veracity ( redundancy scalability) 6- variability( change in variable) Topic -3 etl vs elt Etl : extract transform load- specific use case Elt : extract load n transform- many use case Topic -4 Db - rdbms oltp ( relationship primary n foreign key) Dw - storage ( dw / db) fact n dimensional ) Dm - subset of dw for fast recent revision history Dl- large storage Topic -5 full vs incremental load Full: replace full load in target system ( useful when less volume n frequency is often Incremental load : first time full load n from next load it only takes updates or modified record( volume is high n modifications) Topic-6 fact vs dimensions Fact: Measures Transitional Dimensions: Not change statics Dim tables Topic-7 scd Scd -0 to 6(5) Scd -0 fixed dimensions Scd-1 no history Scd -2 Scd -3 Scd -4 Scd -6(5) Topic -8 dw schemas 1- star - straight forward centralised fact n many dim tables but dim tables will not have relation with other dim tables 2- snow flake - Complex query performance low One fact table have many dim tables n each dim tables have relation b/w them know as child tables 3- galaxy star schema
Appreciate your efforts on compiling all this topics. Which would eventually help many learner’s Thank you, happy Learning
@@thedatachannel878 thanks for making’s such clear content video I request you to make video on real time projects for azure data engineering with step by step notes 📝 n data sets which can easily downloaded n use for practice thanks 😊
@neuera9556 Noted Thank you for your genuine feedback
I saw thinking due to storage outage
is this sufficient to pass databricks certification and also pls share practice notebook hv shared a mail
We covered almost all the topics as part of certification. But to attend to certification exam, suggest you to please take exam dumps and understand the pattern of questions
Thanks for the tutorial ...Have mailed for the notebooks and course content. Please share.
Have shared details of practice notebooks in mail. Thank you
Thank you for making the course. Can I ask for the notebooks and data?
Hi thank you responding. Request you to please send mail request to yt.the.data.channel@gmail.com and we will send required materials for practice
Request mail for the .dbc file to practice was sent to your mail, could you please send that file for my mail. Thanks
Hi, have shared the practice notebook details to your mail id. Thank you
Hi - i wana become data engineer can u suggest ur playlist in alphabetical order
Hi i want to learn data engineering n get job as experience data engineer can you suggest playlist in alphabetical order for de and ru data engineering if yes can i know ur LinkedIn? Thanks 😊
thedatapedia.com/2024/01/04/azure-data-engineering-comprehensive-learning-guide/
Refer to this link, where there is complete curated list in order and plan to learn. Hope it helps
Content is good, but the background music is really annoying. Please don't use it in your lectures.
Thank you for you valuable feedback . We have already considered and all our latest videos are without background noise Happy learning
Hello i send you a mail for content notebook
Hi, have replied you with required practice materials Thank you
Hello, thanks for tutorial ! i send you a mail for notebook.
Hi, have shared the practice notebook details to your mail id. Thank you
Topic 5 missing
Apologies, will try to add that shortly
Is this end of the series ?
Yes this end of playlist, however if you have any suggestions for any particular topics please let us know
Good videos. Thank you. Could you pls send the data files etc.? Sent you an email earlier. Thx!
We have sent you the required dbc file for practice, please check your mail Happy Learning, Thank you
Best video to understand the concept. Thank you The Data Channel
Thank you for your appreciation. Keep supporting Happy Learning 👍
Thanks for tutorial ... I have send mail for Notebooks
Have replied to your mail with required practice notebooks, please check….
Thanks Buddy🙏🏻, Can you tell me how can i integrate github with amazon redshift for version control?
Hi Abhishek, I don’t have AWS subscription to demo right now. But this is Noted, will try to add this content in near future
The background music is disturbing
Thank you for feedback, we are already considering this and all our new video are without background music Happy Learning 👍
Nice content, looking for the material, i already have sent the email
Sent to your mail. Happy Learning. Thank you
Hi Can you please share the notebook and course details?
Please mail me to yt.the.data.channel@gmail.com will share notebooks
High clarity, good presentation. Very use full. Thank you Sir
Thank you Vasu Happy Learning 👍
Good Content! Can you please share the .dbc file for practice?
Thank you. Please send mail request to yt.the.data.channel@gmail.com
Already email your team.😊
@sumanthkumaravula7058 sent now please check
Thank you for this helpful tutorial : Good job
Thank you for supporting Happy Learning 👍
Have sent the mail for Notebook and Data Files.
Sent to your mail id. Please Subscribe and share, Happy learning
Q: Client Mode and Local mode appears to be same. Could you please share a scenario where there is a difference?
In client mode de spark session is registered into you machine so every result come back to your machine ! So il client mode if your machine fail the computing is done! For debuging is coll to see what contaning the spark session but is not necessy in oder cases ! note in cluster mode spark session is contained by driver program!
Topic -5 missing
Thank you bringing it up. Will update the content
@@thedatachannel878 thanks eagerly waiting for
Tutorial is helpful, requesting you to share the notebooks, Please share.
Can you pls drop a mail to yt.the.data.channel@gmail.com . Will share the required notebooks
if in this video if you avoid background music means that will be very help full to understand clearly
Thanks for sharing feedback, perhaps we have considered this in future video to remove background music
Really useful Python course, keep it up bro...
Thank you. Happy Learning
Thank you very nice videos sir
Thank you, happy learning
Thank you for this very useful video!
Thank you, Please Subscribe . Happy Learning 👍
greate video destroyed by pointless distracting music.
We acknowledge the issue and unfortunately there is no way to remove background noise. But we have made sure to remove noise in all our upcoming videos
Hello sir, By saying the default value of vacuum 30 days, do u mean that all the table data has only maximum 30 days life by default?
Yes that is correct
@@thedatachannel878 so in real world industry projects how is it going to work where we may need out tables for a longer time
@jenyroy8203 In real world project, if there is need of retention period more than 30 days they you can persist data in Blob storage which is cheaper solution or may be in adls etc
Pretty handy and useful
Thank you Happy Learning
Hi Data Channel, thank you for the tutorial! I'm interested in setting limits in Fabric. Can operations that exceed a cost limit be automatically shut down? For example, if a company accidentally leaves a process running over the weekend, resulting in charges of over 30,000 Euros, would implementing a kill-cost limit of, let's say, 1,000 Euros have prevented this? I'd appreciate any insights you can provide. Thank you!
Absolutely, that’s great questions. Currently I don’t see any supporting MS documentation to support setting limits. However, I am definitely sure that there will enterprise level and even subscription level limit can be set. Need to explore and if I come across supporting documentation will post it here Thank you. Happy Learning
@@thedatachannel878 Thanks for the reply. Unfortunately there is not much about this yet!
Yes, but will wait for updates to come from MS
This is master piece course and expecting really interesting topics coming out.,,,!
Thank you. Happy Learning..
Interesting and need of the hour, Kudos for you effort and knowledge
Thank you. Happy Learning..
Thank you for always brining such amazing quality content
Thank you. Happy Learning..
Much useful and excited about upcoming videos
Thank you. Happy Learning..
All your Python videos are really simple and also detailed
Thank you. Happy Learning..
Very relevant Topic, Thank you
Thank you. Happy Learning..