About the Internship
We are looking for a backend developer with hands-on experience integrating open-source LLMs (e.g., Mistral, LLaMA) and vector databases (like FAISS, Qdrant, Weaviate, Milvus) in offline or edge environments.You will help develop core APIs and infrastructure to support embedding pipelines, retrieval-augmented generation (RAG), and LLM inference on local or mobile hardware.
Selected intern's day-to-day responsibilities include:
- Design and implement backend services that interface with local LLMs and vector databases
- Develop APIs to support prompt engineering, retrieval, and inference
- Integrate embedding models (e.g., BGE, MiniLM) and manage chunking/processing pipelines
- Optimize performance for offline or constrained environments (mobile, embedded devices, etc.)
- Package and deploy models via frameworks like Ollama, llama.cpp, gguf, or on-device runtimes
- Handle local file I/O, document ingestion, metadata tagging, and indexing
- Create Agentic frameworks with multi agent deployments
Number of Openings
3 openingsPerks of this Internship
Informal dress code Certificate Recommendation letter Flexible work hours
Other Requirements
1. are available for the part time job/internship
2. have relevant skills and interests
3. can start the part time job/internship between 17th Sep'25 and 22nd Oct'25
4. are available for duration of 5 months
5. have already graduated or are currently in any year of study
Similar Internship Programs
Business Development (Sales) work from home job/internship at Kodanic
Kodanic
INR 15000 lump sum
04 November, 2025
3 months
full time
Digital Marketing work from home job/internship at Kodanic
Kodanic
INR 15000 lump sum
04 November, 2025
3 months
full time
Administration work from home job/internship at Kodanic
Kodanic
INR 15000 lump sum
04 November, 2025
3 months
full time
Social Media Designing work from home job/internship at Jarurat Care
Jarurat Care
Unpaid
04 November, 2025
2 months
Part time
