Start building your own search engine RIGHT NOW!: ntck.co/linode and you get a $100 Credit good for 60 days as a new user! 🧪🧪Try it yourself!! (Links, docs, and walkthrough): ntck.co/searx 🔥🔥Join the NetworkChuck Academy!: ntck.co/NCAcademy 0:00 ⏩ Intro 1:37 ⏩ What are we doing? 2:14 ⏩ What do you need? 3:15 ⏩ What is Searx and why is it so awesome? 7:00 ⏩ Time to build our server! 9:30 ⏩ How to install Searx 12:00 ⏩ Testing our search engine! 13:24 ⏩ Tearing it all down(if you want to) 15:00 ⏩ Fixing the back button issue 15:40 ⏩ Adding in some other cool features 17:19 ⏩ Checking stats 17:30 ⏩ Outro
This was a great video Chuck Thanks! Works just as you showed us and was fun to deploy. Now that it's up, I want to replace the "SearXNG" on the front page with something more personal. Haven't been able to find it in the docs - would you have a clue?
Some little critisms for you why do you install docker on such a small vps ? are you planning to add that to you swarm if not i am not sure what your doing there do you got to much coffe? If so maybe install kvm first and run some nested hyper vision you can maybe also add some layers of binary virtualisation like some headers that shim the fs calls ?
Dear Mr Chuck, I have been an avid watcher of your videos for a number of years now but this is the first time of leaving a comment. I would like to say a massive huge thank you from the bottom of my heart because you have been instrumental in my passion for all things IT and having finally getting my foot in the door 18 months ago as an IT apprentice I am now able to play with all of these crazy and exciting topics and toys. You are an amazing teacher and are incredibly infectious and passionate about everything and so I guess I just want to say thank you dude and keep doing what you do. Kindest regards Paul
Network Chuck, as a watcher for 2 years it is the first time I have ever commented. And i would like you a deep thank you for the things you have been doing. Hats off to you!!
Thanks! Useful video and great to finally get rid of the search engines that are only out there to make a buck off your private information. Thanks again!
Projects Like this are great, you could make a whole series of self hosted services that you think that are cool to have. To enhance the series, you could show it all on a raspberry pi running docker
Whilst there is some privacy gains by doing this, you are still subject to content ranking/filtering algorithms employed by the major search engines so if you're searching for things 'they' don't like, your search results will be poor quality. One project worth exploring is building your own web crawler/indexer and then a basic web front end to facilitate the search and results.
This would probably be a pretty hard task there is a reason of why most know private search engines uses preexistant indexes (bing for DDG or google for StartPage)
It would be a cool learning project, but I don't think you could build something that is actually usable. That's no one man's project, you would probably need petabytes of storage, and a sophisticated algorithm, plus many other things, if you want decent results.
@@badrang431 Possibly, but I think it's the sophisticated algorithms that are causing a large part of the problem by over sanitising results. Building a 'raw' option can't be that hard. Basically what I'm saying is, I'm going to try haha.
@@ioneocla6577 Indeed, but the question then becomes 'would it be worth the effort?'. To build something that allows an unfiltered view of content on the internet that is not manipulated by 'big tech', for me the answer is yes.
X is Chi so SearXNG = Searching. And the reason POST is used is because GET means your data entry is in the URL field which is recorded by the browser.
I was getting the HTTP 429 error whenever I tried performing a search. Hosted on linode, DNS on cloudflare. Here was the fix: Disable proxy status (change to DNS only) on the DNS record in cloudflare for the A record pointing to your server. Works like a charm now - Thanks Chuck.
BRUH!!!! This is amazing. I have watched this video (along with many others) 10+x over and over. This is so much easier to build and the nicest database around. Thank you for this information and tutorial.
In some languages, the usage of the X in SearX makes a “ch” sound, so basically, you pronounce “SearX” as “Search”. Pretty clever. Sometimes I’ll pronounce it “Sir X” If I want to emphasize that I’m using the SearX program.
This is exactly correct. This is the same reason I argue every Christmas that Xmas is a legit alteration because its derived from the Greek letter Χ or "chi" So it should just be pronounced the same as Search. en.wikipedia.org/wiki/Chi_(letter)
Hi Chuck. Love your videos! I work in a tech related field and your videos often give me a great nudge into topics I want to learn more about. Best wishes from Germany
Lol right? Same. I just about finished build my home lab that has everything but a standalone Firewall. I just finished building a hypervisor with a Recursive DNS server, NAS, and Media server. I ran the installer for a game server last night.. should be finished, now I'm going to build a search engine probably on the same VM as my DNS server since it still has room and why bother spinning up a brand new VM
QWANT is a French search engine that tried very hard to sell itself on the basis of challenging Google and Bing on the basis of privacy and security. It's still used, but hasn't lived up to the dream so far. I understood about 5% of this video but I love it. I know you said you wouldn't explain how to set this up without Linode, but some pointers would be nice. I have never used Linux so I get real confused. Mind you, I get real confused with Windows too. That's why I watch your vids: for a nanosecond, I feel all smart and geeky.
He also has video's where he sets up a linux server (which is just a computer with Linux on it which is running somewhere in the corner of your room) or if you have a raspberry pi, you can set that up as well. He has video's about that too. However, for setting up a Linux server or raspberry Pi with Linux you can just go on RUclips and search for it. There are tons out there. I would recommend setting up a Raspberry pi because it is completely under your control, at home and it is the cheapest option. And good luck with learning Linux. Like the Nike commercial.... "Just do it". It is a wise decision to learn Linux. Linux will still be around when Microsoft and Apple are long forgotten. The future starship enterprise will run on an embedded version of Linux. 😁
This is my biggest criticism with this guy. Its not that anything he puts out is too difficult. Its that he talks too fast, brushes over everything in a very handwavy sort of way, shows off flawless runs that require no troubleshooting, expects us all to go the exact same route as he does via linode (hardly ANYONE wants to), and puts a lot of effort into hyping something up without actually saying anything useful.
@@leesweets4110 this is a valid criticism of nearly everything and everyone talking about linux. It’s been like that since it’s birth. BSD is the same. Geeks aren’t generally empathetic and can’t understand how non nerds think. These are all generalizations as I said, but I’ve found them the same over my 30 in IT. (God I got old)
I'm new here. Love this channel already. Your production value is very good, so good that it makes me want to pickup a camera and make things... (camera quality, color grading, AUDIO is huge.) Plus you have a very charismatic charm to your personality. I would also like to give props to your editor for making everything flow so well!
I think it's a pretty good idea to create my own search engine especially because I want my search engine to collect data about me, but I don't want it to be a third-party.
@@newnegusnetwork1787 1) How can a programming language be vulnerable to exploits? Unless you add vulnerabilities to your code, it isn't 2) JavaScript is not Java, but Slink already said that.
Best part of Mr Chuck is even the most complicated things makes it look very easy and with his coffee break it gets better by every minute.The audience is always on some mission.
Thanks for the video!! Had a curve ball with trying to figure out let's encrypt. Never worked with cert bot before. Took me a little bit to get things in place but worth it. AT $5 a month for linode and $10 a year for google domain, that's $70 a year for my own search page. So worth it!!!
For those who ultimately want control over your computing power, whether its your search engine or God forbid the day you upload your conscious itself to a cloud, you want to be in control of your data. This means it has to be free and open source. All that power is within your own hands. Good luck! 😁
This is interesting, though it would still have an issue, especially if you're running it from home because your IP address, geolocation of the IP (for when it shifts because likely you don't have a static ip at home) can be use to correlate search data to build a profile on you regardless of cookies or user agents etc. Though, admittedly it does make it FAR harder, and makes the data more limited at the very least. Edit: Obviously this wouldn't apply to you personally using the linode method he describes, it would be a profile on you, but harder to personally attach it to you
I know VPNs are not the end all, say all when it comes internet privacy because they aren't true privacy that they claim. But if you were running this docker container on your computer as your search engine, couldn't you use your VPN as your connection to mask your IP address?
@@schildwacht but the issue is if any legitimate criminal activity is being performed governments and such have the ability to ask for logs from the VPN provider, as most providers log activity and keep track of everything that's happening on their servers believe it or not, so you're still traceable just it's very unlikely someone will put in all that effort unless you did some REALLLYY fucked up shit
@Runner Right. You couldn't get away with nefarious shenanigans with this method 🤣 but if you were simply just wanting to search with some privacy, not a bad method!
@@schildwacht yeah that could make a difference, or at least add one step to identifying you, the search engine may not get the data to profile you, buuuttt someone still has it.. What you could do is set it up on linode or AWS or wherever with an ephemeral IP address (I know you can with AWS, not sure about linode) then use their API to periodically stop and start the instance which will likely change the IP, then use more code for API access to wherever to automatically update DNS records. Though there are places that track dns changes over time so it would just be adding another step before being able to possibly identify you. I guess moral of the story is you can't avoid online traffic being possibly identified depend on circumstances, you can just make it not worth the effort
@@scoobone run your own VPN on a VPS instance and disable all logging, and I mean all logging. Run your VPN by itself on the VPS instance and setup searx or whatever on a second VPS instance and configure DNS accordingly. If you want more privacy, from the VPN go to a Tor entry/exit node.
good idea, sometimes i want to get lost on the internet, or sometimes i need more information, but google always give the same results again again and again
I love watching your video's. Your an absolute genius and you have the gift of entertainment and presentation. I wish you nothing but success man you definitely deserve it.
Lot of comments here but I'll give this a shot. This is the first time I've run across your video. I love your subject matter and look forward to learning more. In this video you described creating your own search engine which utilizes the other search engines. One of the things that bothers me these days is the algorithms that the other search engines use. This method obviously has to utilize their algorithms because that's what's going to be returned in the search. Is there a way to build your own web crawler? I used to use an aggregator called Copernic but they've since gone out of business. Do you know of any non-algorithms search engines where you can just get pure information from the net?
Dang Chuck. You made 30+grand off this video alone not including what youtube pays you. That's impressive. I think you are my new best friend. I decided to become an affiliate instead. I think I can learn a lot from you. It will take me a few years to get that many subscribers. I just need something to pump out there.
Hey buddy, With over 20y. Of experience, I love your videos. The content is super easy to understand, but the presentation and how you deliver the information are valuable in those videos. When you build your own search engine, the next milestone is to search for "IT Viking," and I want the first match to be you.
Nice video, I spun up my own and works fine. The only thing missing was how to change it to your default search engine. I figured it out by going into options and then adding the custom search query for searxng based sites.
17:32 "If you're a home labber, or just a geek or IT or you're a person..." I'm all of the above so will be building my own in Linode tomorrow. Thanks for sharing 😁
"If the word docker scares you...", LOL, there was a time that it did. Now I have 18 containers on my home server. It's amazing. Will be adding this soon!
If you're using AWS and Ubuntu, ensure you update the firewall rules to allow the connection (or disable the firewall), otherwise you'll get a "Connection refused" message. Also AWS seemingly doesn't allow the https connection, so don't add your email for encryption. It didn't work for me with AWS, but it might work for you.
Running on an EC2 Instance with Ubuntu and the Security group allowing the connedtion in, I still get a ERR_SSL_PROTOCOL_ERROR back from the browser. There must be something in the config that needs to be adjsuted or changed. Anyone have any idea?
Two questions: 1) if you self host, doesn't that expose your IP? 2) if you buy a domain and you don't pay extra for the privacy registration, doesn't that also expose you? Even if you pay extra for the privacy domain, I am not 100% sure that's going to prevent entities from discovering your ownership of the domain name...
_they'll probably put an ad for 1 right now..._ Wow. What usually happens to me is I research it, order it, and it gets here, and then I see ads for it.
Made my own using Linode yay, but not without issues when editing the settings.yml file - actually had to test and try until I found that something in the general section was the culprit - the safe_search: 2 line, and yes I used the same Ubuntu version as you (on my 2nd try) so a bit odd - guess I will have to keep nerding a bit more into this as I do like the basic concept :) Update: and as another person described, that the X can be pronounced as CH, then it becomes very clear that searXNG can just be pronounced as 'searching' duh
Ok Chuck, I just watched this episode and decided to go for it.. Armed with a full pot of coffee I went to work on my Raspi box, blew it all up the 1st try, reinstalled the Raspi and saddled up to try again.. success! Ok.. it works on localhost.. how do I get access to it from other machines on my 192.168.2/24 net.. I've been searxing for answers, no luck yet, when I hit this server from other hosts I get the apache default page.. I'll figure it out, just thought I'd ask in the meantime..
Now if someone made an installable version of this in one package for Raspberry Pi it would go down well , Burn image to Micro card, plug that in Pi start it up, Make a few changes, like the name etc and bang its all up and running.
you could do that; install searxng and create an image. Next time you put it on a pi, you just need to update it, change some settings like name and stuff and it should be good to goTh in fact, it is doable with any software. This is how I installed an OS and set up some software on a pi because i don't have an external monitor. Did the initial stuff on qemu and created an image
(im at 5:46 of video) I trust you and your sites... but I don't trust data-breaches. From watching your videos and getting to understand you makes me feel more safe around the things you have and will be eventually be telling us.
This is awesome. Do you know a good way to customize the home screen? Would be nice to have a custom image as well as limit what config pages are accesible
I tried following your instructions, you need to slow down a bit. Among other things, you should mention that it can take a little while to start up the first time while it's creating the SSL certs Another thing, it defaults to SSL now and, I'm not sure it can do the LetsEncrypt if you on a nat'd system behind a firewall
Yeah. It didnt work as fast for me. I set it all up with a domain and everything, but its not showing up on my domain which is weird since i added to the godaddy dns record.
Excellent video. I really enjoy your videos, thank you for taking the time to make them. This is such a cool idea. I cannot wait to do this project this week. Thanks again.
Onw question that crossed my mind while watching: If you're hosting it on your box in the cloud, isn't the reverse lookup and the sub/-domains associated with all of this setup also a way for them to build up a profile? Like you're running it as a subdomain and from there you can basically backtrack all the way to this channel and/or your devices that are logged into it etc. so after a couple of randomized searches it's just like using google etc. directly? wouldn't it be better to have it on a box with no domain, no ties to anything else setup so that route won't work? yes having the container public and used by other people might fool it for a while but unless you don't have ANY similarities in your searches between what your history so far shows and what you did since running the container, it will catch up... or am I missing something here?
not exactly sure about this, but technically, they can't back-track the domain if you haven't set up a reverse domain name for the your public IP. however, while this search wrapper is spoofing you unique browser/search ID, you are still sending all the requests from the same IP, which might also be used to build a profile about you. you'd have to go additional steps to hide your IP, like VPNs, TOR or whatever else.
Fantastic. Definitely building one of these. Thank you! Two questions 1/ why use sudo for nano on the Linode device when you're root? Habit? 2/ To update the docker container, do I just bring down the docker-compose, and then bring it up again? Or do I need to pull again with git?
Doh - 13:45 - "should update the containers to the latest versions available" after using "sudo docker-compose up -d". This video, like most of your vids, is worth rewatching! ;)
If you use the latest tag in compose on the image you would have to stop the containers, delete them with docker rmi and then start the containers again. If you have a container image downloaded/cached with the tag of latest (or any other tag for that matter) docker does not go and pull it again, even if the newest version of latest in the repository is different from the version you have. This is by design. I think there is an option to have docker always pull the images before running, but it has its drawbacks.
Interesting video - I hadn't heard of SearX, and I might have to set one up in my homelab. However, quick question: is there a reason you aren't using docker compose v2? Use the docker-compose-plugin package instead of docker-compose; it's newer, has more features, and uses docker plugin integration.
Nice video! My only nitpick is the title, "build". No, you're not building your own search engine. You're installing an existing search engine and configuring it. That's a huge difference. When installing software it's usually not called building, right? Or would people say "Build your own operating system!" and then just show how to install windows and then create a user and change the wallpaper and user profile picture? 🤷♂ If the title was more about the installing and configuring part it would be pretty much perfect.
A big fan of your videos by which I have learned a lot I want to know about the firewall how does it work and how it's made... Looking forward for your video on this subject in future
Its weird, im getting at "ERR_SSL_PROTOCOL_ERROR" in the webrowser when I try to navagate to the search engine. I am using linode. I am using a subdomain with my domain. I get the same thing when using the IP of the linode server
I don't want to use my own search engine because I want my own privacy. I want to use my own search engine because I want the search legitimacy to be defined by me. I want my engine to learn from me.
Very cool video and software . I actually wanted to do exactly that someday and now I can do it very easily and free in 5 minutes using your code in Linode. Thanks..
Sort the comments of this vid by 'most recent' and check out my last post. I wrote an 'updated' step-by-step guide which addresses some of the SSL issues I also encountered from his vid.
You really contradicted yourself by preaching privacy but then recommending using GET instead of POST towards the end. Defeats the whole purpose of this tutorial. If anyone is reading this, DO NOT USE "GET".
I'm just gonna use Chuck's search engine from now on, even though DDG is still not tracking per se (read the full article on the "deal" with Microsoft). As for Chuck's search engine, none of the ad-blockers, Ghostery, NoScript, etc. that I have running found anything malicious. Awesome!
So I've recently discovered your channel, and I've been watching a bunch of your videos cause they're awesome. Anyway, I checked out your link to the search engine and Chrome is just spitting out "Error Connection Refused".
Sort the comments of this vid by 'most recent' and check out my last post. I wrote an 'updated' step-by-step guide which addresses some of the SSL issues I also encountered from his vid.
Trading crypto has been favourable😀, crypto market has brought me great success!!! Irrespective of the economic downturn I can boast of over $85,000 every month on my investment. Thank you Kimberly Jose for your focus on quality management🙌.
Just hit up 60K today thanks to her for all the knowledge and nuggets she had thrown my way over last months. Traded 5k with expert Kimberly Jose for a start
Same here, crypto market controls the huge part of my passive income flow. I put in $180k about a month ago i have gained over $500k. Mrs Kimberly is amazing
I'm glad you brought this up I've been working on this project for a while I developed my own search engine browser social media app that connects to string of block chain networks that connect to you meta mask wallet...then I can burn 🔥 the history lol
Idk but your way of speaking seems so natural its easy to follow, Saw few video's last few weeks and the clean and clear video's. Yepp you hooked me as Subscriber without even asking it and even clicked notify, Can tell you your the first to even have me do that without the standard youtuber nosense. (Makes me auto unsub even in most cases) Keep up the great work you make it seem easy as (rasberry)PI.
I’m thinking of doing this because these corporations suck at using my data. I don’t mind being profiled, but they aren’t showing me anything I’m interested in lol. They’re fired.
![I.N "HALLUCINATION" | [Stray Kids : SKZ-PLAYER]](http://i.ytimg.com/vi/n5B5q1Hwt_U/mqdefault.jpg)
Start building your own search engine RIGHT NOW!: ntck.co/linode and you get a $100 Credit good for 60 days as a new user!
🧪🧪Try it yourself!! (Links, docs, and walkthrough): ntck.co/searx
🔥🔥Join the NetworkChuck Academy!: ntck.co/NCAcademy
0:00 ⏩ Intro
1:37 ⏩ What are we doing?
2:14 ⏩ What do you need?
3:15 ⏩ What is Searx and why is it so awesome?
7:00 ⏩ Time to build our server!
9:30 ⏩ How to install Searx
12:00 ⏩ Testing our search engine!
13:24 ⏩ Tearing it all down(if you want to)
15:00 ⏩ Fixing the back button issue
15:40 ⏩ Adding in some other cool features
17:19 ⏩ Checking stats
17:30 ⏩ Outro
omg finally a great server to run my python scripts thank you very much !!!!! finally I can turn off pydroid 3 :p
@@rickysargulesh1053 lol it's not 12:40
This was a great video Chuck Thanks! Works just as you showed us and was fun to deploy.
Now that it's up, I want to replace the "SearXNG" on the front page with something more personal. Haven't been able to find it in the docs - would you have a clue?
Okay, chuck. @ 12.06 get 'this site can't provide a secure connection' ##.###.###.## sent an invalid response. ree_ssl_protocol_error
Some little critisms for you why do you install docker on such a small vps ? are you planning to add that to you swarm if not i am not sure what your doing there do you got to much coffe? If so maybe install kvm first and run some nested hyper vision you can maybe also add some layers of binary virtualisation like some headers that shim the fs calls ?
Dear Mr Chuck,
I have been an avid watcher of your videos for a number of years now but this is the first time of leaving a comment. I would like to say a massive huge thank you from the bottom of my heart because you have been instrumental in my passion for all things IT and having finally getting my foot in the door 18 months ago as an IT apprentice I am now able to play with all of these crazy and exciting topics and toys. You are an amazing teacher and are incredibly infectious and passionate about everything and so I guess I just want to say thank you dude and keep doing what you do. Kindest regards Paul
ok but,
nice
@@7w82isntReal you had me in the first half
@@ocsanik502 then we got lost
Network Chuck, as a watcher for 2 years it is the first time I have ever commented. And i would like you a deep thank you for the things you have been doing. Hats off to you!!
Yes, you can build your own search engine by integrating the search API of Google!
😂😂😂😂
Whats about Yaci? Crawl ur own index or federate it p2p
🙂🙂
Bro if your are using Google api then what is the point of building search with it, we are making it for privacy and anonymity ❤️❤️
Lol
Thanks! Useful video and great to finally get rid of the search engines that are only out there to make a buck off your private information. Thanks again!
Lol
Every time Chuck spins up a $5 VPS: "This is such a steal. So cheap!"
His monthly bill for all his VPS' combined: $320
That is scary accurate.
@@NetworkChuck Someone is getting profiled..... keep using those proxychains!
@@DaFreshbreeze ROFL!!!
If I spin up another VM the wife is going to kill me 😂 jk
@@NetworkChuck just like you :)
Projects Like this are great, you could make a whole series of self hosted services that you think that are cool to have. To enhance the series, you could show it all on a raspberry pi running docker
Whilst there is some privacy gains by doing this, you are still subject to content ranking/filtering algorithms employed by the major search engines so if you're searching for things 'they' don't like, your search results will be poor quality. One project worth exploring is building your own web crawler/indexer and then a basic web front end to facilitate the search and results.
This would probably be a pretty hard task there is a reason of why most know private search engines uses preexistant indexes (bing for DDG or google for StartPage)
It would be a cool learning project, but I don't think you could build something that is actually usable. That's no one man's project, you would probably need petabytes of storage, and a sophisticated algorithm, plus many other things, if you want decent results.
@@badrang431 Possibly, but I think it's the sophisticated algorithms that are causing a large part of the problem by over sanitising results. Building a 'raw' option can't be that hard. Basically what I'm saying is, I'm going to try haha.
@@ioneocla6577 Indeed, but the question then becomes 'would it be worth the effort?'. To build something that allows an unfiltered view of content on the internet that is not manipulated by 'big tech', for me the answer is yes.
@@dang6206 could you make a GitHub or something for this project (if you start it) plz. I’d like to see how you would do that
Thx
X is Chi so SearXNG = Searching. And the reason POST is used is because GET means your data entry is in the URL field which is recorded by the browser.
I was getting the HTTP 429 error whenever I tried performing a search.
Hosted on linode, DNS on cloudflare.
Here was the fix: Disable proxy status (change to DNS only) on the DNS record in cloudflare for the A record pointing to your server.
Works like a charm now - Thanks Chuck.
if you disable cf proxy, there is no point to use it.
@@orhancekic_ Also getting 429 error believe it some bad setting in docker-compose.yaml
What you've taught me so far...🤯🤯🤯
1 of my Best RUclips Channel subscription ever.
BRUH!!!! This is amazing. I have watched this video (along with many others) 10+x over and over. This is so much easier to build and the nicest database around. Thank you for this information and tutorial.
In some languages, the usage of the X in SearX makes a “ch” sound, so basically, you pronounce “SearX” as “Search”. Pretty clever. Sometimes I’ll pronounce it “Sir X” If I want to emphasize that I’m using the SearX program.
it's like LaTex
This is exactly correct. This is the same reason I argue every Christmas that Xmas is a legit alteration because its derived from the Greek letter Χ or "chi" So it should just be pronounced the same as Search. en.wikipedia.org/wiki/Chi_(letter)
I was coming hear to say the same
I thought of the x as a ch and add the ng and you have Searching.. lol
@@dragonsage6909 Also clever.
i just can say, don’t ever stop teaching please. 🙏🙏🙏
Hi Chuck. Love your videos! I work in a tech related field and your videos often give me a great nudge into topics I want to learn more about. Best wishes from Germany
Lol right? Same. I just about finished build my home lab that has everything but a standalone Firewall. I just finished building a hypervisor with a Recursive DNS server, NAS, and Media server. I ran the installer for a game server last night.. should be finished, now I'm going to build a search engine probably on the same VM as my DNS server since it still has room and why bother spinning up a brand new VM
QWANT is a French search engine that tried very hard to sell itself on the basis of challenging Google and Bing on the basis of privacy and security. It's still used, but hasn't lived up to the dream so far. I understood about 5% of this video but I love it. I know you said you wouldn't explain how to set this up without Linode, but some pointers would be nice. I have never used Linux so I get real confused. Mind you, I get real confused with Windows too. That's why I watch your vids: for a nanosecond, I feel all smart and geeky.
He also has video's where he sets up a linux server (which is just a computer with Linux on it which is running somewhere in the corner of your room) or if you have a raspberry pi, you can set that up as well.
He has video's about that too. However, for setting up a Linux server or raspberry Pi with Linux you can just go on RUclips and search for it. There are tons out there.
I would recommend setting up a Raspberry pi because it is completely under your control, at home and it is the cheapest option.
And good luck with learning Linux. Like the Nike commercial.... "Just do it".
It is a wise decision to learn Linux.
Linux will still be around when Microsoft and Apple are long forgotten. The future starship enterprise will run on an embedded version of Linux. 😁
@@Ctrl_Del_0 Thanks for the heads-up. Much appreciated.
Really good
This is my biggest criticism with this guy. Its not that anything he puts out is too difficult. Its that he talks too fast, brushes over everything in a very handwavy sort of way, shows off flawless runs that require no troubleshooting, expects us all to go the exact same route as he does via linode (hardly ANYONE wants to), and puts a lot of effort into hyping something up without actually saying anything useful.
@@leesweets4110 this is a valid criticism of nearly everything and everyone talking about linux. It’s been like that since it’s birth. BSD is the same. Geeks aren’t generally empathetic and can’t understand how non nerds think. These are all generalizations as I said, but I’ve found them the same over my 30 in IT. (God I got old)
I'm new here. Love this channel already.
Your production value is very good, so good that it makes me want to pickup a camera and make things... (camera quality, color grading, AUDIO is huge.) Plus you have a very charismatic charm to your personality.
I would also like to give props to your editor for making everything flow so well!
I think it's a pretty good idea to create my own search engine especially because I want my search engine to collect data about me, but I don't want it to be a third-party.
You can create a chrome addon for that.
@@remy44444 I think I'm better off creating programs using python rather than JS, just cause it's much simpler...
@@Slink1 isn't java also vulnerable to numerous exploits?
@@newnegusnetwork1787 I didn't talk about Java... I said I rather make a project like this in python over java*script*
@@newnegusnetwork1787 1) How can a programming language be vulnerable to exploits? Unless you add vulnerabilities to your code, it isn't
2) JavaScript is not Java, but Slink already said that.
Best part of Mr Chuck is even the most complicated things makes it look very easy and with his coffee break it gets better by every minute.The audience is always on some mission.
dude you've taught me so much, i appreciate all that you do. don't ever quit what you're doing, no matter the struggle or obstacles!
Seriously! Every time this guy upload a video, It is something thet is really helpful and extremely valuable.
0:33 I pulled a ultimate troll and asked Bing GPT about this, and it denied it 😂😂😂😂
Proving a point to me that I will always remember.
SearX is likely wordplay with the Greek letter chi [χ], causing SearX to simply be pronounced Search, like arXiv is pronounced Archive
I believe the the name is pronounced "Searching"
WOW
Came to the comment section to say exactly this lol. "X" can be pronounced "ch" :)
X is pronounce CS not CH in Greek.
@@AITreeBranches I literally just pulled up RUclips to find this video again, and your comment from 24 mins ago was in my unread notifications 🤯
This is my first time commenting on your videos! They are great!
You're the man! Can't wait to try this!
Thanks for the video!! Had a curve ball with trying to figure out let's encrypt. Never worked with cert bot before. Took me a little bit to get things in place but worth it. AT $5 a month for linode and $10 a year for google domain, that's $70 a year for my own search page. So worth it!!!
For those who ultimately want control over your computing power, whether its your search engine or God forbid the day you upload your conscious itself to a cloud, you want to be in control of your data. This means it has to be free and open source. All that power is within your own hands. Good luck! 😁
Most RUclips channels I watch at playback speeds of 1.5 to 2. With Network Chuck, I find it best at 0.75.
This is interesting, though it would still have an issue, especially if you're running it from home because your IP address, geolocation of the IP (for when it shifts because likely you don't have a static ip at home) can be use to correlate search data to build a profile on you regardless of cookies or user agents etc. Though, admittedly it does make it FAR harder, and makes the data more limited at the very least.
Edit: Obviously this wouldn't apply to you personally using the linode method he describes, it would be a profile on you, but harder to personally attach it to you
I know VPNs are not the end all, say all when it comes internet privacy because they aren't true privacy that they claim. But if you were running this docker container on your computer as your search engine, couldn't you use your VPN as your connection to mask your IP address?
@@schildwacht but the issue is if any legitimate criminal activity is being performed governments and such have the ability to ask for logs from the VPN provider, as most providers log activity and keep track of everything that's happening on their servers believe it or not, so you're still traceable just it's very unlikely someone will put in all that effort unless you did some REALLLYY fucked up shit
@Runner Right. You couldn't get away with nefarious shenanigans with this method 🤣 but if you were simply just wanting to search with some privacy, not a bad method!
@@schildwacht yeah that could make a difference, or at least add one step to identifying you, the search engine may not get the data to profile you, buuuttt someone still has it..
What you could do is set it up on linode or AWS or wherever with an ephemeral IP address (I know you can with AWS, not sure about linode) then use their API to periodically stop and start the instance which will likely change the IP, then use more code for API access to wherever to automatically update DNS records. Though there are places that track dns changes over time so it would just be adding another step before being able to possibly identify you.
I guess moral of the story is you can't avoid online traffic being possibly identified depend on circumstances, you can just make it not worth the effort
@@scoobone run your own VPN on a VPS instance and disable all logging, and I mean all logging. Run your VPN by itself on the VPS instance and setup searx or whatever on a second VPS instance and configure DNS accordingly. If you want more privacy, from the VPN go to a Tor entry/exit node.
good idea, sometimes i want to get lost on the internet, or sometimes i need more information, but google always give the same results again again and again
This seems great I’ll give it a shot
I love watching your video's. Your an absolute genius and you have the gift of entertainment and presentation. I wish you nothing but success man you definitely deserve it.
Lot of comments here but I'll give this a shot. This is the first time I've run across your video. I love your subject matter and look forward to learning more. In this video you described creating your own search engine which utilizes the other search engines. One of the things that bothers me these days is the algorithms that the other search engines use. This method obviously has to utilize their algorithms because that's what's going to be returned in the search. Is there a way to build your own web crawler? I used to use an aggregator called Copernic but they've since gone out of business. Do you know of any non-algorithms search engines where you can just get pure information from the net?
Searx is basically a self-hosted Copernic.
1st time I have ever seen your RUclips channel - subscribed!! it looks great - thank you for the channel.
That was such a cool tutorial Chuck! This is definitely going on my list of things to try!
You have really great delivery and flow in your videos. Keep up the good work.
Such an amazing concept
Dang Chuck. You made 30+grand off this video alone not including what youtube pays you. That's impressive. I think you are my new best friend. I decided to become an affiliate instead. I think I can learn a lot from you. It will take me a few years to get that many subscribers. I just need something to pump out there.
Hey buddy,
With over 20y. Of experience, I love your videos. The content is super easy to understand, but the presentation and how you deliver the information are valuable in those videos.
When you build your own search engine, the next milestone is to search for "IT Viking," and I want the first match to be you.
Really interesting! I've seen a few of your other vids in the past, interesting stuff as well! Keep up the good work!
next video on building our own cloud / web services
:)
Nice video, I spun up my own and works fine. The only thing missing was how to change it to your default search engine. I figured it out by going into options and then adding the custom search query for searxng based sites.
X can sometimes have a "ch" sound, so I think it's still "SEARCHING" but with Sear-xing. X instead of CH is like internet slang.
Network xuck 😁
17:32 "If you're a home labber, or just a geek or IT or you're a person..." I'm all of the above so will be building my own in Linode tomorrow. Thanks for sharing 😁
To hell with linode
That’s what Pi’s are for
"If the word docker scares you...", LOL, there was a time that it did. Now I have 18 containers on my home server. It's amazing. Will be adding this soon!
If you're using AWS and Ubuntu, ensure you update the firewall rules to allow the connection (or disable the firewall), otherwise you'll get a "Connection refused" message.
Also AWS seemingly doesn't allow the https connection, so don't add your email for encryption.
It didn't work for me with AWS, but it might work for you.
Running on an EC2 Instance with Ubuntu and the Security group allowing the connedtion in, I still get a ERR_SSL_PROTOCOL_ERROR back from the browser. There must be something in the config that needs to be adjsuted or changed. Anyone have any idea?
Imma save and watch this vid a couple of times, it's perfect for a project I want to do
Two questions: 1) if you self host, doesn't that expose your IP? 2) if you buy a domain and you don't pay extra for the privacy registration, doesn't that also expose you? Even if you pay extra for the privacy domain, I am not 100% sure that's going to prevent entities from discovering your ownership of the domain name...
It definitely won’t protect you lol
That tags a domain ownership on you. It doesn't validate the owner of the domain actually did the search in question.
@@freaksizedcock Interesting way to look at it. Thanks for answering my question.
_they'll probably put an ad for 1 right now..._
Wow. What usually happens to me is I research it, order it, and it gets here, and then I see ads for it.
Made my own using Linode yay, but not without issues when editing the settings.yml file - actually had to test and try until I found that something in the general section was the culprit - the safe_search: 2 line, and yes I used the same Ubuntu version as you (on my 2nd try) so a bit odd - guess I will have to keep nerding a bit more into this as I do like the basic concept :)
Update: and as another person described, that the X can be pronounced as CH, then it becomes very clear that searXNG can just be pronounced as 'searching' duh
Search (searX as "sear-CH") Engine (NG as "en-gee")
You are a wizard at videos my friend! Kudos!
Ok Chuck, I just watched this episode and decided to go for it..
Armed with a full pot of coffee I went to work on my Raspi box, blew it all up the 1st try, reinstalled the Raspi and saddled up to try again.. success! Ok.. it works on localhost.. how do I get access to it from other machines on my 192.168.2/24 net.. I've been searxing for answers, no luck yet, when I hit this server from other hosts I get the apache default page.. I'll figure it out, just thought I'd ask in the meantime..
I am in the same boat so if you figure this out let me know
Having this problem too...
@@hayunblogdemarcelo I'm working on it, should have a solution by tomorrow evening.. I will post s fix here.. asap
@@hayunblogdemarcelo see my latest comment.. found the solution..
Hey Chuck you are a genius. I know you are not letting Google know your info, you are giving it to Linode! 🤣🤣
Chuck is my college. I've achieved more in my professional life by watching his videos than I've achieved by completing a bachelor's degree.
This speaks for itself! I'm not 'qualified', but becoming better each day thanks to our friends here on YT!
You ain't lyin about that
Love this guy best channel on RUclips, completed yesterday great video. Many thanks
Now if someone made an installable version of this in one package for Raspberry Pi it would go down well , Burn image to Micro card, plug that in Pi start it up, Make a few changes, like the name etc and bang its all up and running.
you could do that; install searxng and create an image. Next time you put it on a pi, you just need to update it, change some settings like name and stuff and it should be good to goTh
in fact, it is doable with any software. This is how I installed an OS and set up some software on a pi because i don't have an external monitor. Did the initial stuff on qemu and created an image
Pi can run docker just fine, nothing changes. The searxng image supports ARMv7.
(im at 5:46 of video) I trust you and your sites... but I don't trust data-breaches. From watching your videos and getting to understand you makes me feel more safe around the things you have and will be eventually be telling us.
This is awesome. Do you know a good way to customize the home screen? Would be nice to have a custom image as well as limit what config pages are accesible
I tried following your instructions, you need to slow down a bit.
Among other things, you should mention that it can take a little while to start up the first time while it's creating the SSL certs
Another thing, it defaults to SSL now
and, I'm not sure it can do the LetsEncrypt if you on a nat'd system behind a firewall
Thanks. I was wondering why Chrome was saying that it couldn't establish a secure connection.
Yeah. It didnt work as fast for me. I set it all up with a domain and everything, but its not showing up on my domain which is weird since i added to the godaddy dns record.
Excellent video. I really enjoy your videos, thank you for taking the time to make them. This is such a cool idea. I cannot wait to do this project this week. Thanks again.
Onw question that crossed my mind while watching: If you're hosting it on your box in the cloud, isn't the reverse lookup and the sub/-domains associated with all of this setup also a way for them to build up a profile? Like you're running it as a subdomain and from there you can basically backtrack all the way to this channel and/or your devices that are logged into it etc. so after a couple of randomized searches it's just like using google etc. directly? wouldn't it be better to have it on a box with no domain, no ties to anything else setup so that route won't work? yes having the container public and used by other people might fool it for a while but unless you don't have ANY similarities in your searches between what your history so far shows and what you did since running the container, it will catch up... or am I missing something here?
not exactly sure about this, but technically, they can't back-track the domain if you haven't set up a reverse domain name for the your public IP.
however, while this search wrapper is spoofing you unique browser/search ID, you are still sending all the requests from the same IP, which might also be used to build a profile about you.
you'd have to go additional steps to hide your IP, like VPNs, TOR or whatever else.
can i create my own browaer and use my own search engine? bby ad blocker will be back 😂😂
Fantastic. Definitely building one of these. Thank you! Two questions
1/ why use sudo for nano on the Linode device when you're root? Habit?
2/ To update the docker container, do I just bring down the docker-compose, and then bring it up again? Or do I need to pull again with git?
Doh - 13:45 - "should update the containers to the latest versions available" after using "sudo docker-compose up -d". This video, like most of your vids, is worth rewatching! ;)
If you use the latest tag in compose on the image you would have to stop the containers, delete them with docker rmi and then start the containers again. If you have a container image downloaded/cached with the tag of latest (or any other tag for that matter) docker does not go and pull it again, even if the newest version of latest in the repository is different from the version you have. This is by design. I think there is an option to have docker always pull the images before running, but it has its drawbacks.
This tutorial is amazing and you are really good at teaching !! great job sir !
Mind blowing idea :)
Chuck. Love your videos. I'm definitely going to try this out.
Interesting video - I hadn't heard of SearX, and I might have to set one up in my homelab. However, quick question: is there a reason you aren't using docker compose v2? Use the docker-compose-plugin package instead of docker-compose; it's newer, has more features, and uses docker plugin integration.
Awww. CHUCK! Thank you man! We NEED to break free.
Hey! Nice video, quick question, why didn't you use the new "docker compose" plugin? e.g. "docker compose up -d" instead of docker-compose up -d
Thanks for this Chuck. You're the man!
Nice video! My only nitpick is the title, "build". No, you're not building your own search engine. You're installing an existing search engine and configuring it. That's a huge difference.
When installing software it's usually not called building, right? Or would people say "Build your own operating system!" and then just show how to install windows and then create a user and change the wallpaper and user profile picture? 🤷♂
If the title was more about the installing and configuring part it would be pretty much perfect.
A big fan of your videos by which I have learned a lot
I want to know about the firewall how does it work and how it's made...
Looking forward for your video on this subject in future
Its weird, im getting at "ERR_SSL_PROTOCOL_ERROR" in the webrowser when I try to navagate to the search engine. I am using linode. I am using a subdomain with my domain. I get the same thing when using the IP of the linode server
I have similar problem....
by the way, i resolve this problem ;)
@@DiabloBiker how?
@@lordofweed i yesterday replied but someone how my comment not exists anymore....
I have the same problem
This is such an incredible video brother! Could you do a more in depth tutorial for doing this and the different advanced aspects you can tweak?
I don't want to use my own search engine because I want my own privacy.
I want to use my own search engine because I want the search legitimacy to be defined by me. I want my engine to learn from me.
Cool stuff, thanks for sharing, I'm trying to de-Google myself and this is awesome
Very cool video and software . I actually wanted to do exactly that someday and now I can do it very easily and free in 5 minutes using your code in Linode. Thanks..
Thats cool! Something to add to my pi-hole. Now I need to understand this containers.
Your private search engine is not working
Sort the comments of this vid by 'most recent' and check out my last post. I wrote an 'updated' step-by-step guide which addresses some of the SSL issues I also encountered from his vid.
Okay even with an error or two I'm getting very relevant results three pages in and I'm impressed.
His website doesn't open for me
You really contradicted yourself by preaching privacy but then recommending using GET instead of POST towards the end. Defeats the whole purpose of this tutorial. If anyone is reading this, DO NOT USE "GET".
Can you please explain? Please and thank you
I'm just gonna use Chuck's search engine from now on, even though DDG is still not tracking per se (read the full article on the "deal" with Microsoft).
As for Chuck's search engine, none of the ad-blockers, Ghostery, NoScript, etc. that I have running found anything malicious. Awesome!
Error! Engines cannot retrieve results:
google ( Suspended: too many requests )
google is not happy ! lol
So I've recently discovered your channel, and I've been watching a bunch of your videos cause they're awesome. Anyway, I checked out your link to the search engine and Chrome is just spitting out "Error Connection Refused".
Sort the comments of this vid by 'most recent' and check out my last post. I wrote an 'updated' step-by-step guide which addresses some of the SSL issues I also encountered from his vid.
Trading crypto has been favourable😀, crypto market has brought me great success!!! Irrespective of the economic downturn I can boast of over $85,000 every month on my investment. Thank you Kimberly Jose for your focus on quality management🙌.
Bitcoin continues to lead the pack of cryptocurrencies in terms of market capitalization, user base, and popularity.
With expert Kimberly trading is easy, i traded my btc worth 3k with her for a start, i'm proud to say i made it
Just hit up 60K today thanks to her for all the knowledge and nuggets she had thrown my way over last months. Traded 5k with expert Kimberly Jose for a start
Same here, crypto market controls the huge part of my passive income flow. I put in $180k about a month ago i have gained over $500k. Mrs Kimberly is amazing
Congratulations!!! I'm at 10k as of today, started with 2k. I'm truly happy for you! Continue crushing it my friend
I'm glad you brought this up I've been working on this project for a while I developed my own search engine browser social media app that connects to string of block chain networks that connect to you meta mask wallet...then I can burn 🔥 the history lol
None of 2 domains is working now. Sad. I need to make my own. Thanks for this movie. I didn't knew, this is so simple to create.
I love coffee and I love the way you do IT work
Thats a real homebrew Search engine with all the awesomeness.
you should get "subscribe" printed on the bottom of your coffee cup, everytime you drink we get a subscribe reminder
Thanks a lot! That was quick and easy, and now I have my own searx instance, yay!
Köszönjük!
SearXNG is maybe a pun acronym of "Searching"?
Idk but your way of speaking seems so natural its easy to follow, Saw few video's last few weeks and the clean and clear video's.
Yepp you hooked me as Subscriber without even asking it and even clicked notify, Can tell you your the first to even have me do that without the standard youtuber nosense.
(Makes me auto unsub even in most cases)
Keep up the great work you make it seem easy as (rasberry)PI.
I’m thinking of doing this because these corporations suck at using my data. I don’t mind being profiled, but they aren’t showing me anything I’m interested in lol. They’re fired.
I love how obsessed you are with coffee ☕️
Finally a search engine with privacy that i can search for my fav brand of coffee.
i can use this next year for searching stuff in school and watching unblocked videos because my school has most youtube videos blocked
In most distros if you give yourself the docker group, you won't even need to sudo all the commands.
You lost me at "I'm building it in the cloud"
🤣