My Journey into Fine-tuning Open-Source LLMs for Customer Support
التعليقات (24)
يمكنك قراءة كل التعليقات بحرية، لكن الكتابة والتفاعل يحتاجان تسجيل الدخول.
Congrats on the success! I'm curious, what kind of GPU setup did you end up using for fine-tuning the 7B model? Was it local or cloud-based?
Hey OP, for your GPU question (comment #1), I actually used an A100 80GB via a Google Cloud spot instance. It was surprisingly cost-effective if you catch them at the right time.
What about the inference costs post-fine-tuning? Are you running it on your own server or a managed service? That's where recurring costs can sneak up.
Awesome! This is exactly what many of us small businesses need to hear. How long did the whole process take you, from start to promising results?
Abdelrhman Rabea




