Knowledge Graphs & LLMs: Fine-Tuning vs. Retrieval-Augmented Generation §
Highlights §
- The knowledge cutoff term indicates that LLMs are unaware of any events that happened after their training (View Highlight)
- While the knowledge cutoff date is relevant for any publicly available information, the LLM doesn’t have any knowledge about private or confidential information that might be available even before the knowledge cutoff date. (View Highlight)
- most companies have some confidential information that they don’t share publicly but might be interested in having a custom LLM that could answer those questions. On the other hand, a lot of the publicly available information that the LLM is aware of might be already outdated. (View Highlight)
- LLMs is that they are trained to produce realistic-sounding text, which might not be accurate. (View Highlight)
- Especially for missing data, it is very probable that the LLM will make up an answer that sounds convincing but is nonetheless wrong instead of admitting that it lacks the base facts in its training. (View Highlight)
- you have to be very careful not to blindly believe everything that LLMs produce. Verifying answers or producing more accurate results from LLMs is another big problem that needs to be solved. (View Highlight)
- One use case is fine-tuning a model to update and expand its internal knowledge.
In contrast, the other use case is focused on fine-tuning a model for a specific task like text summarization or translating natural language to database queries. (View Highlight)
- we will talk about the first use case, where we use fine-tuning techniques to update and expand the internal knowledge of an LLM (View Highlight)
- After you have selected the base LLM, you can start the next step of fine-tuning it. The fine-tuning step is relatively cheap regarding computation cost due to available techniques like the LoRa and QLoRA. (View Highlight)
- However, constructing a training dataset is more complex and can get expensive. If you can not afford a dedicated team of annotators, it seems that the trend is to use an LLM to construct a training dataset to fine-tune your desired LLM (this is really meta). (View Highlight)
- There is also a relatively fresh project by H2O called WizardLM, which is designed to turn documents into question-answer pairs that can be used to fine-tune an LLM. (View Highlight)
- previously NLP models were most often domain and task-specific, meaning that you would most likely need to train a custom natural language model depending on your use case and domain. However, thanks to the generalization capabilities of LLMs, a single model can be applied to solve various collections of tasks (View Highlight)
- The retrieval-augmented approach has some clear advantages over the fine-tuning approach:
• The answer can cite its sources of information, which allows you to validate the information and potentially change or update the underlying information based on requirements
• Hallucinations are more unlikely to occur as you don’t rely on the internal knowledge of an LLM to answer the question and only use information that is provided in the relevant documents
• Changing, updating, and maintaining the underlying information the LLM uses is easier as you transform the problem from LLM maintenance to a database maintenance, querying and context construction problem
• Answers can be personalized based on the user context, or their access permission (View Highlight)