feat: finalize context-aware prompting approach for LLM v1

[iamanishsrivastava]

Based on the experiments, finalize the context-aware prompting approach for LLM, including the choice of KNN algorithm, embedding strategy, vector storage solution, and prompt format.

• Scope:

  • Review findings from previous tasks (KNN, embedding, storage, etc.).
  • Finalize the approach for context-aware prompting.
  • Prepare an implementation plan for v1 based on the chosen method.

• Outcome:

  • Finalized context-aware prompting strategy for v1.
  • Implementation roadmap for the next phase.

[github-actions]

This GitHub issue focuses on finalizing the context-aware prompting approach for the first version (v1) of a large language model (LLM) based on prior experiments. Key tasks include reviewing findings on KNN algorithms, embedding strategies, vector storage solutions, and prompt formatting to determine the most effective approach. The issue also aims to prepare an implementation plan for v1, detailing the finalized strategy and a roadmap for the next phase of development.