Thank you for share your data, I have a question: I have a problem with one of my websites where over 40,000 URLs are showing as 404 errors. The Crawl Stats section also indicates that there are about 40,000 404 errors, even though the URLs do not exist on the site. However, Google keeps crawling them regularly. How should I resolve this issue?
Without looking at the site, here are my thoughts on your situation: First, try to understand if there is a URL pattern causing the errors. If you can find a pattern, you could use the robots.txt disallow to block Google from crawling those unwanted pages. Another thing I would look into is finding out why Google is trying to crawl pages that don't exist. -Tiago
like seriously, am I supposed to fix these how. all I want to is run a website and write, google should be smart enough to fix problems by itself... AI, get a way, not me for God's sake. Plus these videos are totally for nerds and I don't even believe nerds get it. google, when will you evolve and be smart?
excellent content and communication - very clear thinking and explaining
Thank you for share your data, I have a question:
I have a problem with one of my websites where over 40,000 URLs are showing as 404 errors. The Crawl Stats section also indicates that there are about 40,000 404 errors, even though the URLs do not exist on the site. However, Google keeps crawling them regularly. How should I resolve this issue?
Without looking at the site, here are my thoughts on your situation:
First, try to understand if there is a URL pattern causing the errors.
If you can find a pattern, you could use the robots.txt disallow to block Google from crawling those unwanted pages.
Another thing I would look into is finding out why Google is trying to crawl pages that don't exist.
-Tiago
How can I get google to index my domain url instead of the subdomain
How to remove a carnonical tag
Submit the domain sitemap in search console.
like seriously, am I supposed to fix these how. all I want to is run a website and write, google should be smart enough to fix problems by itself... AI, get a way, not me for God's sake. Plus these videos are totally for nerds and I don't even believe nerds get it. google, when will you evolve and be smart?