- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.
- RAG where only relevant parts are included in the context.
- Use an LLM with a larger context window (like Gemini pro)
Question, how if possible could you query rows in a table?
Surely the better approach would be to have some sort of connection to table rows?
- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.
- RAG where only relevant parts are included in the context.
- Use an LLM with a larger context window (like Gemini pro)