What is an LLM?
A large language model is an AI trained on huge amounts of text so it can understand and produce language.
Think of it like...
A brilliant new hire who has read half the internet but hasn't read a single page of your company's documents.
Where it helps
Conversation, summarising, classifying, drafting, reasoning over text.
Where it goes wrong
On its own it doesn't know your internal information, and its knowledge has a cut-off date. That's why business solutions connect it to your data.
Try this
Ask a general chatbot a question about your own company policy. Notice that it can't answer properly. Then you'll see why RAG exists.
