AI / ML Engineer

About the role

As an AI/ML Engineer, you will design and build AI-powered features for client products — RAG pipelines, LLM integrations, AI agents, and data processing workflows. You will work closely with backend engineers and product designers to deliver AI capabilities that work reliably in production.

What you will do

• Design and implement RAG pipelines using LangChain, LlamaIndex, and vector databases
• Integrate LLM APIs (OpenAI, Anthropic, Gemini) with robust prompt engineering
• Build LLM observability with LangSmith or Langfuse — cost, latency, and quality tracking
• Design and implement AI agents with tool use for multi-step task automation
• Evaluate model quality with representative test datasets before production deployment
• Collaborate with product team to scope AI features against real user needs

Requirements

• 2+ years of hands-on LLM/AI application development experience
• Strong Python skills with FastAPI or similar backend frameworks
• Production experience with LangChain, LlamaIndex, or similar orchestration frameworks
• Experience with vector databases (Pinecone, Weaviate, pgvector)
• Understanding of RAG architecture patterns and prompt engineering

Nice to have

• Experience with open-source LLMs (Llama 3, Mistral) via Ollama or HuggingFace
• ML model fine-tuning experience
• LLM evaluation framework experience (DeepEval, RAGAS)
• Data engineering background with dbt, Airflow, or similar