Skip to main content

Search engine vs LLM

BeginnerLesson 6 of 166 min readReviewed by Mayank Raj Parmar on

In short

A search engine finds pages that already exist and shows where they came from. An LLM writes new text from what it learned before its knowledge cutoff, and it can state false things just as confidently as true ones.

Type "Who won the IPL this year?" into Google and you get a page of links: news sites, scorecards, maybe a live update from today. Ask the same question to a chatbot with web search switched off, and you get a smooth paragraph naming a team. It might be right. It might also be last season's winner, stated just as confidently.

Both feel like asking a computer a question, but they work in completely different ways. In this lesson you'll see how a search engine finds and an LLM writes, what a "knowledge cutoff" is, why LLMs sometimes make things up, and how to decide which one to trust for what.

How a search engine answers

Google describes its search in three stages:

  1. Crawling: programs called crawlers download pages from across the web, and keep coming back for new ones.
  2. Indexing: each page is analysed and stored in the Google index, a huge database of what's on the web, a bit like the index at the back of a textbook.
  3. Serving results: when you search, it looks up your words in the index and shows the most relevant pages first.

The key thing is that a search engine finds pages that already exist and shows you where each one came from. Because it keeps crawling, it can show you something published this morning. What it doesn't do is check whether a page is true. That part is up to you.

How an LLM answers

An LLM writes an answer. As you saw in lesson 4, it predicts one token at a time, picking what's likely to come next, using patterns it learned during training. On its own it doesn't look anything up, and it doesn't keep a list of where each fact came from, so there are no links unless the app adds them.

Search engine

  1. Crawl. Programs called crawlers download pages from across the web, again and again.
  2. Index. Each page is analysed and stored in a huge database, like a book's index.
  3. Rank. Your question is matched against the index, and the best pages come first.

You get: Links to pages that already exist, including ones published today.

LLM

  1. Train. It learns patterns from a huge pile of text, up to its knowledge cutoff.
  2. Predict. It writes an answer one token at a time, picking what's likely to come next.
  3. Reply. The new text arrives in a confident, fluent voice, right or wrong.

You get: Brand-new text, with no links unless the app adds a search step.

Figure 1: a search engine finds pages that already exist; an LLM writes new text from what it learned in training.

The knowledge cutoff

An LLM's knowledge cutoff is the date its training text stops. It knows nothing about what happened after that, unless the app gives it new information, for example through web search.

Take Meta's Llama 3.1. Its model card lists a knowledge cutoff of December 2023, and it was released in July 2024. So even on launch day, it was about seven months behind the news, and the gap grows every day it's in use. Researchers have also found that a model's real cutoff can differ from the date its makers report, and can be different for different topics.

So when you ask about anything recent, such as this year's exam dates, a new phone, a cricket result or a change in a rule, an LLM without search is answering from an old memory. It may not even tell you that.

Hallucinations: when an LLM makes things up

OpenAI's researchers define hallucinations as "plausible but false statements generated by language models". They can be wrong facts, dates and numbers, quotes nobody said, or books, research papers and web links that don't exist.

Why does it happen? Remember lesson 4: an LLM writes what's likely to come next. When it doesn't really know an answer, a confident-sounding guess often looks more likely than "I don't know". OpenAI's research says that the way models are trained and tested "rewards guessing over acknowledging uncertainty".

In OpenAI's own example, a widely used chatbot was asked for the title of the PhD thesis of one of the paper's authors. It gave three different titles, all wrong. Asked for his birthday, it gave three different dates, also all wrong.

Hallucinations have real costs. In 2023, two lawyers in New York filed a court document that cited six earlier court cases. None of them existed: ChatGPT had made them up, complete with fake quotes. The judge fined the lawyers and their firm $5,000.

Why confident isn't correct

An LLM's tone is just style. It writes in the same fluent, sure-of-itself voice whether the facts are right or wrong, because it's predicting what an answer usually sounds like, not checking what's true. So a confident answer tells you nothing about whether it's correct.

Be especially careful with:

  • exact numbers, dates and prices,
  • names, quotes and who said what,
  • citations, references and links,
  • anything recent, or anything local, such as your college's fees or your city's bus timings,
  • health, legal and money questions.

Chatbots that search the web

Many chatbots can now search the web before they answer, then write a reply with links to the pages they used. ChatGPT added this in October 2024, promising "fast, timely answers with links to relevant web sources". This mixes the two approaches: the search finds fresh pages, and the LLM writes the answer from them. It's the same idea as RAG, which you'll meet in lesson 8.

It helps a lot, especially with recent events. But the model can still misread a page, mix up two sources or add a detail that isn't there, so click through to the source for anything that matters.

Which one should you use?

You want to…Better choiceWhy
Know today's news, scores, prices or timingsSearch engineIts pages are fresh, and you see the source
Check an exam date or a government ruleThe official website, through searchOnly the source itself is the final word
Understand a concept in simple wordsLLMIt explains, and explains again in another way
Draft an email, an outline or some codeLLMWriting new text is what it's built for
Find a source you can quoteSearch engineYou need the real page, not a description of it
Summarise a document you've pasted inLLMThe facts are right there in its context window

That last row matters. When you paste a document into the chat, it sits inside the model's context window (lesson 5), so the model works from the real text instead of its memory. That makes it less likely to make things up, though it's still worth checking.

Key takeaways

  • A search engine finds pages that already exist and shows where they came from. An LLM writes new text from patterns it learned in training.
  • An LLM's knowledge stops at its knowledge cutoff, unless the app adds web search.
  • Hallucinations are plausible but false statements. They happen because the model writes what's likely, and guessing has been rewarded.
  • A confident tone is not evidence: check numbers, names, quotes, citations and anything recent.
  • Use search for fresh facts and real sources, and LLMs for explaining and drafting. When a chatbot gives links, open them.

Check your understanding

Question 1 of 8
What does a search engine show you when you search?

Sources and further reading

Report an error in this lesson