Phi2 - Dialog Partner is a hugging face gradio app that answers the query you ask it. App uses qlora optimized microsoft/phi-2 model. phi-2 is a small language model with 2.7b parms. Phi-2 used here was fine-tuned on openassistant-guanaco dataset using qLORA PEFT technique in google colab T4 GPU. qLORA is a fine-tuning technique where original model's parameters are first quantized to 4-bit values & frozen. Then LORA adapters are injected into model's layers. While fine-tuning, only adapter weights that are in 32-bit precision will get updated. These adapter weights will be specialized on the fine-tuning task. Small language models combined with qLORA enables open-source developers to fine-tune the models with less computational power.