A simple paper worth a trillion dollars
HTML-код
- Опубликовано: 13 окт 2024
- The Anatomy of a Large-Scale Hypertextual
Web Search Engine (1998) infolab.stanfor...
Attention Is All You Need (2017) arxiv.org/pdf/...
Thank you to Yossi Matias, Google's head of research, for speaking with me.
Subscribe to my channel to see more videos like this: / tibees
Support me with a monthly donation on Patreon and receive a gift from me: / tibees
Buy me a coffee (one-off donation): ko-fi.com/tibees
Website: tobyhendy.com
TikTok: / tibees
Twitter: / tobyhendy
Second channel: / @tibees2
Editing by Noor Hanania
Fritz Haber's 1908 "Synthesis of ammonia from its elements" has been worth hundreds of trillions.
This is true
Was literally going to say the same thing, it's super unlikely that Larry Page and Sergey Brin would even be alive if that paper wasn't written.
Now I have to listen to "Father" again
That's the paper I expected after reading the title. But yes, it's much more than a trillion.
What gets my goat is I search RUclips for one video outside of my normal range, and the next day every fifth recommended video is related to that. There's no accounting for desire of variety. I miss the old days when the front page had recommended videos. Back when that meant something.
thanks that is a big problem nowadays, I watched "Clockwork Orange filming locations" and have been getting videos for the last week from as old as 16 years ago. I already got my fill of Clockwork Orange filming locations, I don't to watch another guy point out the same filming locations over and over again.
Artificial artificial intelligence is doing my recommendations
@@pavelow235 I didn't turn on watch history and tracking in youtube so its just a blank home screen in my case and no recommendation, I need to search what content i want to see , Sometimes i realize i don't want to watch anything so saves a lot of time, Also i deleted Facebook and Instagram, Now only use RUclips as social media platform sometimes read blogs in quora & medium that's it
"AI Search", powered by LLMs, Isn't even search; it uses a language model to respond to a prompt by generating a likely response based on the training data. The training data sets are not public, nor are the parameters given to the model generation along with the data, nor are the specific model generation algorithms, so the gaps and biases in the model can only be assessed through the responses it gives. For mimicking the general characteristics of text in the training data they're pretty good, but for factual information they're only any good at facts which are repeated consistently in the training data with a context similar to nearly every possible prompt which would be constructed as a query for that fact; for anything less common the response can only be correct by coincidence. Of course, not all "AI" is LLMs, but as far as has been made public "AI Search" is an LLM trained on the crawled pages, and is not trustworthy for generating correct answers or even factual statements
the "input the same question, get a different answer" thing would be funny if it weren't fundamentally destructive to **gestures to everything**
they predicted quite correctly how their search engine would become unusable.
Has that guy from Google recently tried to actually....use Google?
He uses Bing
This paper is predicated on a web where people are writing useful content. That stopped about 10-15 years ago, and much of the useful content that was on the web has since disappeared. I'm really kicking myself for not scraping useful websites instead of simply bookmarking them.
@@noreverse1152😆😆good one 👍🍻
@@noreverse1152 Bing's the same. I can't find a web browser that works as it ought to. All we can do is vary search terms and narrow it down that way, just like avoiding "Bill Clinton Sucks".
@rockets4kids
slashdot and icanhascheezburger are still up... if that matters to you :)
If I were you (gotta do this too) I would download wikipedia in it's entirety and get it going on an offline rack server and NAS bigger than probably anything residential in a 25 mile radius. Then rig up a seperate rack server for at home netflix legally illegally downloading digital copies of movies owned offline hard copy. in the definition you own them.
then do it with music and backdoor it so your archive backup can be listened to in different places in the house or wherever.
I still need to do that in full, but on the list of wants to do it is.
I very much like your comments about libraries. Research librarians are angels.
My Mum is one, she even worked at a university library once. Unfortunately it has become a dying trade.
Oh the irony of 'cellular phone' searched on google now returning 90% 'cellular' companies advertising their products with only one wikipedia link not being an ad. Google still works well but you've once again got to be more specific to avoid being sold something.
the irony of you saying 'google still works well'
Google today is everything this paper criticized.
Jesus loves you with all His heart ❤️
@@L17_8 No
So very true is it even considered a true search engine these days
Are you a fan of Ted Kazinsky too?
Irony is almost universal.
Always remember:
Your privacy is important to us.
Your privacy is 100% safe on our servers! We assure you can give it to us.
Your privacy, specifically and in detail, is important to us. We will store it and use it optimally.
Or don't be evil
Yes AI has been ruining out searches for some time now. We have noticed. Clearly it's been sending more advertised results than the wanted results.
We need a new paper.
Now the internet is only 200 websites and finding good information is harder than ever. 😢
"Don't be evil" Google code of conduct! (Now removed)
Unfortunately, that also includes hospitals and other organizations that value greed above all else
@@MichaelSkinner-e9jwere… you under the impression that hospitals weren’t businesses?
@@DukeEllision329 being evil is not a business model, and lying or not being transparent does not equal a good business plan.
Business does not equal evil- you make the wrong assumption.
The Wolf of Wall Street and Bernie Madoff are evil.
Done right, businesses and companies enrich the community and provide jobs/investment opportunities that people need for their livelihood. That’s not evil. That’s participating in society.
The problem I’m talking about is exploitation
"You have become the very thing you swore to destroy" - quote
Google Does Evil Now.
Remember when you could Google on Google before Google became Google and now when you Google you can barely even find what you wanted to Google?
It’s basically unusable now.
🙄
AI used in search.............. Alexa, I need emergency medical assistance. Alexa responds, I have place emergency medical assistance on your shopping list.
The last 3 minutes hits differently!
Good topic to cover. I find the best way to use search engines is to understand how to choose your search terms. You have to understand its algorithms almost more than your search terms :-) I wouldn't trust an AI as far as I could throw it; effectively zero.
No, the most important paper in terms of financial impact is Fisher Black and Myron Scholes seminal paper "The Pricing of Options and Corporate Liabilities" JPE 1973. The multi-trillion industry of derivatives started from this paper.
That paper matters to capitalist economists, but this paper matters to those searching for online-linked information. The latter group is much larger than the former.
Advertisers are paid for the attention they get, but we are rarely, if at all, rewarded for the attention we give. Are y'all paying attention?
It's all you need..
The users are "rewarded" with useful software and entertainment for "free". Is it a fair trade, don't know, most seem to be content with it.
That scrap book journal looks wonderfully maxamillist
From the title, I was sure this was going to be about the Black-Scholes model from finance
Maybe that one is about trillion dollar losses:)
When its inventors were in academia, Google was all about spreading knowledge.
Now that its inventors are in business, Google is all about making money.
In a capitalist environment you don’t have much choice. No one is going to keep on paying you to just spread knowledge
more like when google is managed by inventors vs google managed by public investors
As of 2024, I still find myself needing to go to a library to do research. There is still so much information that simply isn’t available via a Google search. For instance, old business directories. If I want to find out when an ancestor’s business was started back in the late 19th century, I need to search local business directories by year. Most businesses from that period only exist as a mention in a business directory. Those old directories, at least the ones that I need, have yet to be scanned and made available via a Google search. That’s just one example.
Yeah, but people are increasingly unaware that there is a lot of information that cannot be located on the web.
At my Uni faculty we, students, had a proverb: "The real study begins, when Google has no found results".
Video production quality has skyrocketed over the past year. Bravo, love the new style it's very immersive!
Regardless of their paper's premise, here we are.
Jesus loves you so soooo much ❤️
Truisms are true
ME: searches Google for red squirrel numbers in the UK and how fast they're declining.
Google: Here's some places where you can buy peanuts.
RUclips: Bombards me with 3x 2 minute unzippable ads before I watch a video of online stores that sell peanut butter and Nutella.
and this is where perception and the spread of misinformation come into play, because I googled exactly that and got back right at the top “There are only 140,000 red squirrels left in the UK, and more than 75% of these reside in Scotland. Their decline has been driven both by habitat loss and the introduction of the invasive non-native grey squirrel from North America”
@@farab4391🙄 It was a joke, silly.
I agree with you that AI is not necessarily a good thing and we need to be more studious in how it is deployed.
I don’t think it should be used in search in education.
In other instances, it’s too easy for it to be hacked and that data like personal information - is obviously very big and very easy for it to Biased and skewed, especially in the hands of a data hacker and cybercriminal who has intentions of their own
An idea isnt really worth anything until its built up and made.
there are thousands of amazing ideas that are practical and can change the world for the better but who has the means to do it?
Google 2003: "Don't be evil"
Google 2024: "Don't be our competition or we'll destroy you"
Toby, your style is so relaxing, that I focus on your tone over your words and am often oblivious to what is said. However, know that your content is extremely high quality--please don't change on my account.
Imagine how many other people back then had the same ideas but didn’t have the will to develop it.
Bravo again, very interesting and well-told.
Outstanding video. Accessible, informative AND interesting.Trifecta achieved!
Great insights and a reflection on research and learning for people...students, researchers, etc.
.
“The Final Theory: Rethinking Our Scientific Legacy “, Mark McCutcheon far and away the most important and interesting book/facts ever discovered/published.
The one thing I’ve learnt over the years is that a company is not successful because of the product, but because of how it conducts business. I could’ve come up with DOS and Windows, but probably never had the success of Microsoft. That’s why we have lots of very smart people, but not the equivalent number of successful companies
Wonderful video as always, Tibees! I share your curiosity about how these AI tools are going to affect the role of libraries and how humans conduct research. I slightly worry whether most humans will lose that ability to seek out the truth for themselves and blindly trust the outputs of these generative AI models.
This is a very interesting video. Thanks for sharing it with us!
Thank you for the share. Thank you, Google.
I think it is becoming increasingly important to keep Wisdom, Knowledge, Information and Data, separate in our minds.
It seems ultra high frequency can effect the mass of matter on the atomic level. I'm pretty sure it's illegal to reduce the mass of anything
The concluding statements of the video were swollen with philosophy, and I kept thinking quietly about its meaning(although in the end, I did rush to comment). I am cognizant of the idea of going to a library to conduct research, but I cannot deny how easy it is to find what we are looking for on the web. Although the need to read well preserved documents sometimes warrants a visit to a library, we can still, for the most part, get away without that effort just by looking up the internet. Also, libraries often gatekeep their materials and do not provide easy access, which is not true of the internet.
I apologize if I misunderstood your comment. If not, I had a different takeaway of the concluding statements:
At the end of the video Tibees wasn't only referring to a literal library. She was referring to the act of research-- the act of browsing through various sources to compare the validity, perspectives, and biases of those sources in order to make sense of the collection of information that you've ingested, to get a comphensive understanding of the topic you're researching.
She was referring to research that can either be done in a library with physical books OR on the web, since research in both cases involve evaluating various sources to get a comprehensive understanding of the topic being researched, whether that is through physical books or digital pages.
She brought up the concluding statements in response to Google's claim that AI makes finding information more assessible to users. She made the point that AI may deincentivize people to continue that act of research, of evaluating sources for a comprehesive understanding, since people can just type their query into an AI engine and get a response (that may be heavily biased or even false).
I was super happy to hear her include this perspective, and not just let the Google representative share those comments uncontested.
That advertising biases sentence could really use an update in desired functionality.
Yay for information science and library content management. And if smart language models get smart enough to generate value-rich synopses, non-trivial categorizations and to suggest cross-linkage at semantic rather than syntactic level - what you describe as "intentional" - then I will be very impressed and prepared to hang my hat on the AI hook. I'm faily sure that a software assistant to knowledgable kibrarians and infosci will be a far more powerful combination for far longer. Skepticism is something Ive yet to see being 3xercised by LLMs.
A good video explanation. It's good to know the conception of search engines came from academics & research. I think at that time those people assumed that this technology will not enter into mainstream commercial use. Today we see the end result of their research.
What a lovely trip down memory lane to when Google actually cared about giving useful results. The Google propagandist saying that advertising serves the user is just laughable.
Great vid - get this to the top of search.
Not if you believe in uncensored speech or honesty.
Word input "I am looking for dog"
Someone clicks link on page 4, that page now LEVELS UP!
and quickly becomes location or global oriented.
Nice!
Just an aside: What would be cool is to have you listen to Cormac McCarthy's last two books on Audible and do a review.
to be pedantic, practically all of maxwell's work on electromagnetism is worth more than all of the other papers combined in terms of its indirect impact to the global economy
"THANK YOU TIBEES"... 🙂
What about Cerf and Kahn's paper, "A Protocol for Packet Network Intercommunication"?
I could listen to Tibees for days :)
In Philippines there's Public school Mathematics teacher claimed that he solved godenbach conjecture after 2 decades of working but people making him laughingstock he write a letter to the philippines president .
Financial impact is the one true metric in our world, so yeah, this paper is indeed worth a trillion dollars. ❤
The last part of the video was super important! I believe that humans in an AI world should strive for a critical thinking mindset and think deeply about what we are looking for.
Strangest ASMR ever. Didn't understand a thing but I'm calm.
What about the paper for the Fast Fourier Transform? That must be up there in associated financial impact.
Ads are in the service of users, they say. Curious that advertisers are the ones paying. It's almost like advertisers are the ones benefiting from showing us ads. But don't you worry, ads are in the service of users.
Don’t notice the basilisk without the will to feed it.
Soon to be surpassed by Attention Is All You Need
Going from unknown to the known is the first step.
but knowledge is a double edged sword
So, we need wisdom on top of knowledge.
I wonder how much Sir Tim Berners Lee's initial idea (WWW) is worth?
That's probably hard to determine, since a lot of traffic on the Internet doesn't have anything to do with webpages. Besides, a lot of services is predominantly accessed through apps these days.
If we only count Internet as a whole, then the World Economic Forum say:
"As the global economy rapidly digitalizes, "an estimated 70% of the new value created in the economy over the next decade will be based on digitally enabled platform business models,"
I wonder how much the paper “MapReduce: Simplified Data Processing on Large Clusters” worth as well since without that Google propably would not scale their business model ..
It wasn’t all that different from gopher.
@@peterfireflylund Thank you! At least some people understand it's just a minor protocol difference and not some great invention. He is given far too much credit.
Maybe Vint + Tim ?
I missed you. So good to know you are ok.
While this paper has been very valuable, I feel like the document creating the first patent system was probably worth much more and would make a great VLOG
This really explains why Google has become so bad at finding things
I started using Google after one of my students told me about this paper, so in the first month.
Adding "AI" to Google has reduced the effectiveness. In some cases it has become impossible to find a page I have previously seen. Rarely, the page could have been removed. But so often? Give me the option of using an old search mode.
California, Seriously ❤ Toby !
A search engine should fund itself through energy production and idea sales to raise sufficient funds until the Free energy renewables are perpetual. Advertising is a temporary fix that should already be on-the way out.🤔
Toby on jet lag seems lime a completely different person
Fantastically informative video!!!!!!!! Thank you!!!!!!!
Peoples relationship to information and how to find it is an important concept. As is the development of the transformer with AI (with the aid of machine translation). The development of various links is fascinating too. There is agreement that what is learned can be handy.
With luck and more power to you.
hoping for more videos.
Thanks for the video
information in seconds at ones fingertips is as easily changed 🤔
If AI becomes better than people at specific tasks, I wonder how long it will be before people stop studying those fields in order to concentrate on things AI isn't very good at yet?
I wonder why this idea of research or search bias seems to be directed at web search and AI only? Surely, we all realize that every publication that's ever been published, whether that is a research paper, World Book Encyclopedia, or The New York Times, contains the biases of its creators. That being the case, "traditional" library research and "newfangled" web research should both be viewed with a critical eye.
I am curious what research papers have the most value to Tibees?
As a great philosopher once said, "money over everything"!
mOnEy
The Google guy speaks like a typical VP. Just corporate speak without saying anything meaningful, or straight up lying.
Yup.
This is a nice breakdown Toby, and interesting interview! Will check out both of the papers as well 👍
As for the "death of libraries", social medias already operate mostly on unsourced/non fact-checked information and the trend will probably increase regardless of traditional institutions pushing back. The more AI takes over in terms of experiments, simulations, etc. the more they'll be based on some random parameters and potentially unrelated sources, hallucinations, or other randomness that people can't even define or double-check. Not really a completely bad thing as long as the results are accurate but it's a changing landscape for sure, and it could have interesting consequences in the future for how we think of history of science, significant inventors, etc.
I googled "example of awesome people". The result was "Tibees". Good boy.
I thought you were going to be looking at Claude Shannon's Master's paper
I thought Bitcoin
Google allowed me to understand difficult things about bad people.
Foundation by Isaac Asimov Stagnation of ideas supported by sales pitches? Automatic connections and cross-references is not always a good thing for the human brain and the advancement of ideas, thought and research.
Sound is so low I can't hear you
Google is trashed. You can't get any good results anymore. I get dumber and dumber using Google. I feel like there should be a better search engine.
Diffie-Hellman key exchange is arguably as valuable.
1:46 But why did they use lipstick?
Did they mention In-Q-Tel?
AI is a quick search tool for already existing solutions etc. It can interpret human language but any imagination, like we humans have,... nope.
I am using it for code.. but one must be very critical what AI comes up with. Those without any knowledge of the technology (code or whatever) will be surprised.
I like your content
Thabks
There are certain ideas and info thsts off limits because we wouldn't be dependents anymore if we didneed then
What about the patent for the blue led? A lot of controversy about it too.
I thought this was going to be "Bitcoin: A Peer-to-Peer Electronic Cash System," since the cryptocurrency economy is worth over 2 trillion dollars today.
If you’ve been paying attention to the cybercrime that’s been ongoing, would you be willing to help the agents?
Would Google?
“You can judge a man by the books in his library.”
- Mark Skousen
What happened to do no evil?
I should start presenting my papers… idc about Nobel prizes anymore
if you sold this, you would be a trillionaire!
(for legal reasons this is a joke)
Now, in a world of "money is everything", you have to "sell something", and the best way to do it is by "advertising"...
Can you make a video about imo 2024 and maybe a way to solve the exercises