vinayak-ebook llama2 chatbot

photo-1572297982753-48c028401d18

Llama 2 is a family of generative text models that are optimized for assistant-like chat use cases or can be adapted for a variety of natural language generation tasks. Code Llama models are fine-tuned for programming tasks

IN this model we used QLoRA technique to fine-tune the model in 4-bit precision and optimize VRAM usage.

replicate will host our llama2.

Llama2-schematic-diagram JPG

As this run on free servers it will be slow to responce .. very very slow. have patience

code on github = https://github.com/coding4vinayak/Ebook-llama2-chatbot.git