Tuning plays a crucial role in the development and effectiveness of Language Models (LLMs). LLMs are pre-trained on vast amounts of text data to acquire language comprehension and generation abilities.
However, fine-tuning or tuning is necessary to adapt them to specific tasks or improve their performance. Till now, we have