🔍 The Spectrum of Search Tools

Exploring the spectrum of search tools, comparing AI-powered models like ChatGPT, Gemini with traditional Search engines like Google, and how Perplexity AI bridges the gap.

One of my favourite hobbies is trying out different AI tools on the market and determining which works best for which task.

And in today’s rapidly evolving digital landscape, the way we search for information is undergoing a radical transformation.

On one end of the spectrum, we have AI-powered tools like ChatGPT, Gemini, and Claude — these represent what we call Probabilistic Searches. On the other end, traditional search engines like Google and community-driven platforms like Reddit embody Deterministic Searches.

But what about tools that bridge the gap?

Enter Perplexity AI—a search engine that combines the best of both worlds.

So before getting into what makes Perplexity stand out, let's understand what are the extremes of this search spectrum.

👀 The Probabilistic Search

AI models such as ChatGPT, Gemini, and Claude operate on probabilistic algorithms. This means they predict likely outcomes based on vast datasets, generating creative, nuanced responses.

These LLMs are basically trained on huge amounts of data and these data include everything right from Food to Quantum Physics. For instance, ChatGPT is trained on billions of words on the internet and when generating answers for the questions that you ask, it tries to predict what the next word is and it ends up mimicking human writing.

So these LLMs are basically a next-word predictor, i.e., they use probability to predict the next word. That's why there are trust issues with these models as they can highly hallucinate.

I have written in detail about how these AI tools work here - WTF is AI

👀 The Deterministic Search

On the other end of the spectrum, deterministic models like Google, Yahoo and Reddit rely on indexing and linking existing data in a structured, predictable manner.

They provide very deterministic and relevant information but it is very cluttered.

However, despite Google’s dominance, some argue that these models are becoming obsolete. The rigid structure of deterministic searches means they may fail to provide fresh or creative perspectives.

So how do both these models differ?

↔ Perplexity AI: The Best of Both Worlds

Perplexity AI enters as a hybrid, blending the flexibility of probabilistic models with the precision of deterministic search engines. What sets Perplexity apart is its ability to curate relevant and recent information and provide well-rounded summaries of complex topics. Not only does it offer summaries, but it also provides links to the original sources, ensuring that users have access to accurate and up-to-date information, and minimizing the chances of hallucination.

This makes Perplexity an excellent tool for research-based tasks where accuracy is non-negotiable but where you also need insightful summaries of recent developments. It bridges the gap between the creativity of tools like ChatGPT and the accuracy of traditional search engines.

Diagram from a slide by Sara Platnick, Perplexity’s Communications lead

So, does that make Perplexity the 'ultimate' AI tool, blending the best of both worlds?

Well, not exactly.

If Perplexity truly was the best of both, it would likely dominate the market—but that title still belongs to OpenAI's ChatGPT.

Why?

Because most people seem to use AI tools more for creative tasks than research & following current trends.

Data from Statista. Design by author

TL;DR

• Creative tasks/New ideas and Increase productivity = LLMs like ChatGPT or Claude.

  
  

• Reliable, up-to-date quantitative data for a project/thesis = Perplexity.

  
  

• Deterministic search models like Google and Reddit = Obsolete

  Though Google’s integration of Gemini AI Overview is a promising step forward. However, we'll need to wait and see how this technology evolves and if it can hold up against the more dynamic, AI-driven future of search.