Senior Backend AI Engineer

This is a remote position. - Design and implement robust, scalable, and secure backend services for AI-powered products - Work closely with data scientists and ML engineers to integrate models into production systems - Build and optimize APIs, microservices, and data pipelines for real-time and batch processing - Ensure low-latency inference, efficient model deployment, and resource management - Maintain and improve CI/CD pipelines, containerization (Docker/Kubernetes), and cloud infrastructure - Monitor, debug, and optimize backend systems for performance, scalability, and reliability - Collaborate with cross-functional teams to define system architecture and technical standards - Stay current with AI infrastructure trends, tools, and best practices Requirements - 5+ years of backend software development experience, ideally in Python, Go, or Java - 2+ years of experience deploying and scaling machine learning models in production - Solid understanding of RESTful APIs, gRPC, message queues, and microservice architectures - Experience with ML frameworks (e.g., TensorFlow, PyTorch, ONNX) and serving tools (e.g., TorchServe, Triton, FastAPI) - Strong knowledge of Docker, Kubernetes, and cloud platforms (AWS, GCP, or Azure) - Familiarity with data pipelines, distributed systems, and model versioning (MLflow or similar) - Proficiency in SQL and NoSQL databases (e.g., PostgreSQL, Redis, MongoDB) Originally posted on Himalayas