How to build a web scraper using go and colly - golang + gocolly tutorial
HTML-код
- Опубликовано: 12 сен 2024
- This is a video tutorial for scraping websites using golang. The library I am using is this: github.com/goc...
If you enjoyed this tutorial, please give it a thumbs up and subscribe to the channel.
My github repository: github.com/tho...
Playlist:
• Advanced go tutorials
❤️ SUPPORT MY CHANNEL ❤️
--------------------------------------------------
A little support goes a long way!
Buy me a coffee: www.buymeacoff...
Become a patreon: / thomaslanghorst
📖 5 Books to skyrocket your career 📖
----------------------------------------------------
THE EXPLANATION VIDEO - • 5 MUST READ Programmin...
amzn.to/3IahMMh - Automate the boring stuff with python
amzn.to/3lI4RcM - Head First Design Patterns
amzn.to/3Ea1KjZ - Extreme Programming Explained
amzn.to/3k7xhwn - Soft Skills
amzn.to/3KdEC8n - Clean Code
🎒 THE GEAR I USE 🎒
--------------------------------------------------
💻 Technical Gear
amzn.to/3Edp4h5 - Apple MacBook Pro M1
amzn.to/3KmaWFQ - Laptop Bag
amzn.to/412MNdt - Apple Magic Keyboard
amzn.to/3jXJ2pb - Mouse (Mac Version)
amzn.to/3I3umwJ - Mouse (Windows Version)
amzn.to/3YHVCYD - Mousepad
amzn.to/3YAoAtj - SSD External Hard Drive
amzn.to/3Sdj0e7 - SSD Protection Case
amzn.to/3XDdfr9 - Headphones
amzn.to/3lJqrgN - USB Hub
amzn.to/3KamAUo - HDMI to USB
🎒 Digital Nomad Essential Gear
amzn.to/3Sdjn8v - Bag
amzn.to/40ZLyf9 - Bullet Journal
amzn.to/41130zS - Fineliner Pens
amzn.to/3YNwUps - French Press / Plunger
amzn.to/3lI44sk - Mug
📷 RUclips Gear
amzn.to/3k7bTra - Apple Iphone 13 mini (My "camera")
amzn.to/40ZbdEF - Tripod
amzn.to/3ZeMlY7 - Lightning to USB adapter for Microphones
amzn.to/3EdpSCD - Microphone
amzn.to/3Ee926A - Microphone Pop Protection
amzn.to/3S2AR7z - Selfie Ring Light
👋 SOCIAL MEDIA 👋
----------------------------------------------------
@the_langhorst - INSTAGRAM
@the_langhorst - TWITTER
@the_langhorst - TIKTOK
Music used:
"Music: Funny Quirky Comedy by Redafs.com, Licensed under Creative Commons: By Attribution 3.0 License"
• Funny Quirky Comedy (F...
Track: Vlog Chill Future Bass [Vlog Music] by MOKKA / Under Water
• (No Copyright Music) V...
Music provided by "MokkaMusic" channel and
inaudio.org
‼️ Disclaimers
The links mentioned in this description may contain affiliate links. I may receive a commission for any purchases made through these links, but there won't be any extra cost for you. I am grateful for your support, as it enables me to keep providing you with valuable content for free.
#programming #coding #golang
Hey Thomas, just wanna let you know your content and the way you have structured is really great. Appreciate the content!
Wow Nicholas...thank you so very much!!! I am super happy that you like my videos! 👍
I like this tutorial please more beginner friendly go tutorials!!
Thank you so much!!! I am very happy that you enjoyed it. And thanks for the feedback. I will make sure to provide you with more beginner friendly tutorials.
Amazing quality video with animations and great pace! Good job man
Thank you so much! I am really appreciating your comment!!!
Learning Go right now and I've watched this and your discordgo video and they are so helpful!! Please keep uploading these Go related videos
Hi Xinks. Thank you so much for your kind words. I will definitely keep uploading golang videos in the future! I hope they will meet your expectations.
Really great!!! Only one suggestion, in Go we don´t need to use `break` into switch.
Hey Alexys. Thank you so much for the advice! See, I am still constantly learning and make mistakes all the time. I love this YT community 💪
@@ThomasLanghorst I think all we are in the same page. Thanks for sharing, I'm your follower
@@Alexyslozada Thanks man. Really appreciated!
thank you for the well made tutorial!
Loved it from the hacker mode activation
This is great, can you make a surrealdb/golang tutorial? They don't have docs for the driver yet
Actually, I never heard of surrealdb. I will definitely have a look into it. But I cannot make any promises about a tutorial.
thx helped me a loooot :)
Glad to hear!
can you do an example of using it behind something that has a login or a captcha?
Thanks for the comment. You definitely made my day!
As for the login, colly provides a login example. Maybe this helps.
github.com/gocolly/colly/blob/master/_examples/login/login.go
Captchas are a whole other thing. Since colly is used for scraping static sites, I think you cannot use it for something that is protected by captchas. But I might be wrong here.
What if the web need account and password, how can i "give" the username and password to the website to extract data? Thank you!
Man i really like your content and explanations but as a newbie I feel you go too fast. I have to pause the video too often, I know it's my problem because I have no experience using goquery and I found that was holding me back to understand what was going on. It would be great to see you explaining the basics of goquery and understanding the DOM with it.
go me?
You are going a little fast ://
Thank's for the feedback. You are not the first person to mention that. Maybe I should try to slow down a bit more.