My new step-by-step program to get you your first automation customer is now live! Results guaranteed. Apply fast: skool.com/makerschool/about. Price increases every 10 members 🙏😤
OK, I'm gonna need to take a day off just catch up and study the last few videos - iterator - aggregator (again), map - plus this one. And maybe Nick, you take a week off 😛 Cheers.
Great guide, thanks Nick! 🙏 P.S. Here's the code for capturing the entire HTML of the page in your Apify scraper (47:21): const pageHtml = document.documentElement.outerHTML; Don’t forget to include pageHtml in your return object.
Who ever corrected you on Regex, I would love to know how they say Registry. I say it the same as you - coming from the UK where we speak proper English.
A great video what I would actually be interested in is how to come up with ideas yourself for automation that one can propose to clients instead of reacting to their demand.
Hey Nick, thanks for the videos. Ps. You mentioned in the video that you would upload the regex into the description but I can't seem to see it. Can you upload it please. Thanks
This was to advanced for me. I just didn't understand the concept of scraping websites like this to sell as a service or use it for my business. 🤔 Feel like a 4th grader being given a geometry problem and told to use it to build a set of stairs.😮😢😂 I just don't have the experience yet. So will focus on leveling up. Then revisit.
This is where is feel make is lacking, it doesn't have a code piece that makes it difficult for a lot things to be done properly. Unfortunately this is not as easy as pulling the html data via http. I made a solution on activepieces and I also have a solution for transcripts on Make it's just a little dependent on other tools.
Hi Nick, thanks for the video! question: I am curious if you have built something like a day and night duty planner for nurses, I tried to build it with GPT and failed XY times due to a complicated algorithm, any idea how to build such a thing?
Help? Great video. need to find a tutorial where the data of a site is only available after having logged in with several pages of search results and that one that you'd have to click "next page" to see the next set of data. Help is appreciated.
Thank you for the video nick, but i do have a question, is it possible to create http request on a web only accessible through vpn / certain ip / proxy? Is there a way to set this up?
@nicksaraev - Thank you so much for the video. But when i use your method i only get 8 outputs per run, even though the page has like over 30 freelancers. Any idea why does it limit the output to just 8 data points? Thanks in advance.
I have a question / idea. I’m beating my head against the wall. I made a knowledge based GPT and want to host it as a standalone function on a website but don’t know how. Any recommendations?
Now that upwork ended access to the rss feed, I'm wondering if we can set up an automation using their hidden api to grab new jobs and filter them.... Hmmm... Anyone have thoughts on this?
Make is very limited on what it can do. I have built similar tool more efficient tool using code integration on other platforms, also sending HTTP request would suck on websites that load dynamically, because it grabs the first "html" presented by the website. Using a code integration for example would save you cost on claude, save you cost on errors, cost on number of integrations to run and there are tons of library to integrate with to build cooler automations.
@@skylers1359 Activepieces mostly and then latenode. The issue with these other choices is that they don't have as many integrations yet. Activepieces let's you code with Typescript and latenode doesn't only allow coding but you can deploy an actual scraper that launches a headless browser directly on the platform
Hi brother Nick , i wanted to join your skool community but there is only option for annual join. But I can only afford monthly subscription. can you do anything about that please
@@nicksaraev I'm sorry brother i think that I'm signed up before reading whole email. And is there any way to join your skool community. Please give me one chance to show my hard work and i think you're best mentor for me. Thank you
Who the hell says "REGG-EX" it's definitely "REGEX" sounds like [REJ-EX] and not [REGG-EX]. Sorry for the "AckTuaLy" nerds that shat on you last video. They're wrong. It could be one of those cultural differences like in the EU they say it that way. Midwest USA it's definitely REGEX. Never ever heard it as REGG-EX.
My new step-by-step program to get you your first automation customer is now live!
Results guaranteed. Apply fast: skool.com/makerschool/about. Price increases every 10 members 🙏😤
I really appreciate that you take the time to also explain the concepts before diving into the practical details🙌
My pleasure Youri 🤝
OK, I'm gonna need to take a day off just catch up and study the last few videos - iterator - aggregator (again), map - plus this one.
And maybe Nick, you take a week off 😛
Cheers.
Great guide, thanks Nick! 🙏
P.S. Here's the code for capturing the entire HTML of the page in your Apify scraper (47:21):
const pageHtml = document.documentElement.outerHTML;
Don’t forget to include pageHtml in your return object.
Nick DELIVERING AGAIN!!!! Thank you!!
Thanks again Zach 🙏
Who ever corrected you on Regex, I would love to know how they say Registry. I say it the same as you - coming from the UK where we speak proper English.
Brilliant video. Like the HTTP and API masterclass. Power packed. Very valuable information. Thanks for sharing
This is GEM. Thank you Nick.
A great video what I would actually be interested in is how to come up with ideas yourself for automation that one can propose to clients instead of reacting to their demand.
Hey Nick, thanks for the videos. Ps. You mentioned in the video that you would upload the regex into the description but I can't seem to see it. Can you upload it please. Thanks
This was to advanced for me. I just didn't understand the concept of scraping websites like this to sell as a service or use it for my business. 🤔
Feel like a 4th grader being given a geometry problem and told to use it to build a set of stairs.😮😢😂
I just don't have the experience yet. So will focus on leveling up. Then revisit.
Interresting stuff. How do you deal with a login wall like Linkedin for instance?
Can you make a video on how to scrape RUclips to get thumbnails, author, channel name, transcripts, and video summary?
This is where is feel make is lacking, it doesn't have a code piece that makes it difficult for a lot things to be done properly. Unfortunately this is not as easy as pulling the html data via http. I made a solution on activepieces and I also have a solution for transcripts on Make it's just a little dependent on other tools.
Hi Nick, thanks for the video! question: I am curious if you have built something like a day and night duty planner for nurses, I tried to build it with GPT and failed XY times due to a complicated algorithm, any idea how to build such a thing?
I can't even make a printscreen from a lot of website! (Secured URL's) so, how you can solve this issue?
I love you 😂😂...I was really hoping for this
Help? Great video.
need to find a tutorial where the data of a site is only available after having logged in with several pages of search results and that one that you'd have to click "next page" to see the next set of data. Help is appreciated.
Just yesterday I first time saw ur video and it was the same LOL, and now this video in recommendation. We live in matrix no way
Thank you for the video nick, but i do have a question, is it possible to create http request on a web only accessible through vpn / certain ip / proxy? Is there a way to set this up?
Hello! I would like more information about using hidden API
Great work thank you.
How do you scrape multiple pages? Not just one?
Freaking amazing video. You da man. Thanks so much!!!!
@nicksaraev - Thank you so much for the video. But when i use your method i only get 8 outputs per run, even though the page has like over 30 freelancers. Any idea why does it limit the output to just 8 data points? Thanks in advance.
you're doing god's work. just saying. 😂 thanks man, that was really insightful.
Thank you nick!
Is there a way to scrape a website, that has a form with captcha? I need to scrape the response from that form
Try Apify
I have a question / idea.
I’m beating my head against the wall. I made a knowledge based GPT and want to host it as a standalone function on a website but don’t know how. Any recommendations?
Hi! You can try to do this on the Flowise platform.
nick is there a way to scrape instagram not just a profile and find multiple profiles falling in the same category
Just wondered a minute ago , strange Nick didn't uploaded a video today.. open YT .. and voala 😅😅
I scheduled this for yesterday but it was 12GB and my internet was not cooperating 😒
Now that upwork ended access to the rss feed, I'm wondering if we can set up an automation using their hidden api to grab new jobs and filter them.... Hmmm... Anyone have thoughts on this?
the thumbnail slaps
how do you make a record into a variable in a module? you wrote a split and turned it into a variable on the 38:01
What pattern for the regex if we want to get contact numbers please, emails is working well for me 🤩
Make is very limited on what it can do. I have built similar tool more efficient tool using code integration on other platforms, also sending HTTP request would suck on websites that load dynamically, because it grabs the first "html" presented by the website. Using a code integration for example would save you cost on claude, save you cost on errors, cost on number of integrations to run and there are tons of library to integrate with to build cooler automations.
What other platforms do you use with code integration
@@skylers1359 Activepieces mostly and then latenode. The issue with these other choices is that they don't have as many integrations yet. Activepieces let's you code with Typescript and latenode doesn't only allow coding but you can deploy an actual scraper that launches a headless browser directly on the platform
@@skylers1359 however there is one python integration tool on make. I just don't like it
Interested in what also you use?
What tool
Nick slow down bro, I can't keep up haha. in all seriousness though thank you for the amazing content
You should be an angel
Hi brother Nick , i wanted to join your skool community but there is only option for annual join. But I can only afford monthly subscription. can you do anything about that please
Hey man. I think you just signed up for annual and we tried processing you-could you check for an email from me? Cheers 🙏
@@nicksaraev I'm sorry brother i think that I'm signed up before reading whole email. And is there any way to join your skool community. Please give me one chance to show my hard work and i think you're best mentor for me. Thank you
any experience scraping tiktok?
Try to scrap oficial make documentation api
You mean Sir Tim Berners Lee?
Yeah him, did some internet thingy
Yes! Daddy of the Internet 👑
Who the hell says "REGG-EX" it's definitely "REGEX" sounds like [REJ-EX] and not [REGG-EX]. Sorry for the "AckTuaLy" nerds that shat on you last video. They're wrong. It could be one of those cultural differences like in the EU they say it that way. Midwest USA it's definitely REGEX. Never ever heard it as REGG-EX.
can you give regex to email
This is the Tim guy you are looking for, en.wikipedia.org/wiki/Tim_Berners-Lee
That's the one - thank you Ryan 🙏