Want to learn more Big Data Technology courses. You can get lifetime access to our courses on the Udemy platform. Visit the below link for Discounts and Coupon Code. www.learningjournal.guru/courses/
Finally! A teacher who knows how to communicate. The pauses, cadence, and questions are very helpful and reassuring, and the explanations were thorough and clear. This was very helpful and a joy to watch. Thank you so much.
Thanks again for the tutorial. The only major issues I had were compatibility issues and an error that said that my checkpoint directory did not exist. I tried several directories, and they definitely existed! I think it was maybe a permissions problem.
thank you for explaining i was looking for a start example to get what it is but videos were like explaining to some experts well i figured out to follow your steps , after running the code and done the ncat command i m getting errors and first one is: "chk-point-dir" any help
sir, I want to know how we can apply streaming framework to a database lets say mysql, how can we read new data arrived at particular table without overlapping with new arrivals with old rows at the table
Streaming ingestion using Spark from databases such as MySQL is not possible and not recommended. Why? Because parallel streaming ingestion will not scale with MySQL and put a huge workload on the database. So we can use some ingestion tool such as ADF or fivetran etc to bring data from MySQL to directory and use Spark streaming to read from directory. It will be two step process. ADD and fivetran etc can handle CDC and ingest only new records
Sir I need the same code in this video i.e scala. Why don't you put the link for the code you use in every video? I am struggling to write code by looking at screen, Please help!
Nice tutorial but dude, it's version (ver-shun) not versun. Also, why do you keep saying good and great when you're just playing with some code? Can you also talk a bit about Coursier or Maven and which artifact repo you're pulling from?
![BLACK BAG - Official Trailer [HD] - Only in Theaters March 14](http://i.ytimg.com/vi/Du0Xp8WX_7I/mqdefault.jpg)
Want to learn more Big Data Technology courses. You can get lifetime access to our courses on the Udemy platform. Visit the below link for Discounts and Coupon Code.
www.learningjournal.guru/courses/
Finally! A teacher who knows how to communicate. The pauses, cadence, and questions are very helpful and reassuring, and the explanations were thorough and clear. This was very helpful and a joy to watch. Thank you so much.
thanks, it is great guide and simple at same time
Excellent!
Thanks again for the tutorial. The only major issues I had were compatibility issues and an error that said that my checkpoint directory did not exist. I tried several directories, and they definitely existed! I think it was maybe a permissions problem.
how did you solve it ?
This is great. Can you provide some real world examples on why would we need such solution? Thanks
kafka integration?
thank you for explaining
i was looking for a start example to get what it is but videos were like explaining to some experts
well i figured out to follow your steps , after running the code and done the ncat command i m getting errors and first one is: "chk-point-dir"
any help
thanks you are a good teacher
How to install ncat on windows. is this a new software we need to be installed 16:17 mins
It may not be required. I used it only for one example. You can just watch the example and learn. Other examples don't need it.
How we can use multithreading in streaming with executors
sir, I want to know how we can apply streaming framework to a database lets say mysql, how can we read new data arrived at particular table without overlapping with new arrivals with old rows at the table
Streaming ingestion using Spark from databases such as MySQL is not possible and not recommended.
Why?
Because parallel streaming ingestion will not scale with MySQL and put a huge workload on the database.
So we can use some ingestion tool such as ADF or fivetran etc to bring data from MySQL to directory and use Spark streaming to read from directory.
It will be two step process.
ADD and fivetran etc can handle CDC and ingest only new records
Did anyone see kafka example in this ??
thanks for this video, but I some questions have. Why you created the file log4j.properties? It is necessary?
Super
Sir I need the same code in this video i.e scala. Why don't you put the link for the code you use in every video? I am struggling to write code by looking at screen, Please help!
Sir...you should also share your codes
Which code?
You can find it on website.
www.learningjournal.guru/courses/
Nice tutorial but dude, it's version (ver-shun) not versun. Also, why do you keep saying good and great when you're just playing with some code?
Can you also talk a bit about Coursier or Maven and which artifact repo you're pulling from?