Retrieval Augmented Generation

Visakh Vijayan
5 min readSep 14, 2024

The world of tech is fascinating and every day you have the offer to witness something new. AI has been doing rounds in the market for quite some time now and it looks like every day something new comes out. While you are reading this article, OpenAI has introduced their latest model — “o1-preview” which has excellent reasoning and math skills. But more on that later.

How AI has changed they way we used to search

Why is AI so helpful?

AI has shortened the time it took to find something on the Internet. Gone are those days when we used to type something into Google and click through 100s of links till we landed on something that catered to our needs. AI can do that for you without leaving the chat GPT screen today.

So, are our problems solved?

Well. Kind of. But think of this. AI has been trained on data that the makers of the model found fit. How the models have been trained and how the dataset was made is still a mystery. There are usually knowledge gaps because of which AI has “hallucinations”. Plus the data is outdated too because it is not continuously updated in real-time. But the point is there is a vast amount of data that AI still doesn’t have with it.

Can we add our data to AI?

--

--

Visakh Vijayan

Techie from Kerala, India. Days are for coding, nights for weaving tales of tech, travel, and finance. Join me in exploring this multifaceted journey