AI Engineer

About the Role We're looking for an AI Engineer to design, build, and scale the systems that power our AI-driven product. You'll work at the intersection of large language models, multi-agent systems, and production software, turning cutting-edge AI capabilities into reliable, user-facing experiences. What You'll Do - Design and implement LLM-powered pipelines, including prompt engineering, context management, and response synthesis - Build and optimize multi-agent orchestration systems where AI components interact, reason, and produce coherent outputs - Develop and maintain integrations with foundation model APIs (Anthropic, OpenAI, and others), managing latency, cost, and reliability at scale - Implement retrieval-augmented generation (RAG) and memory systems for persistent, context-aware behavior - Partner with the Evaluation/QA Engineer to build frameworks that measure output quality, coherence, and factual grounding - Collaborate with product and design to translate workflows into robust technical experiences - Ship production features across the stack, from the model layer to the application Monitor, debug, and improve system performance, token efficiency, and guardrails - 3+ years of software engineering experience, with hands-on work building LLM-powered applications - Strong proficiency in Python and/or TypeScript/JavaScript - Experience with LLM APIs, prompt engineering, and agentic frameworks (e.g., LangChain, LlamaIndex, or custom orchestration) - Familiarity with vector databases and RAG architectures (Pinecone, Weaviate, pgvector, etc.) - Understanding of multi-agent systems, tool use, and function calling - Experience designing evaluation and testing strategies for non-deterministic AI outputs - Solid grasp of API design, async processing, and scalable backend architecture - Comfort working in a fast-moving, ambiguous, early-stage environment - Experience with real-time streaming (WebSockets, SSE) for conversational interfaces - Background in fine-tuning, model distillation, or inference optimization - Familiarity with cloud infrastructure (AWS/GCP/Azure) and CI/CD - Contributions to open-source AI projects Originally posted on Himalayas