scaleai
AI Infrastructure Engineer, Model Serving Platform
정규직(풀타임)
AI 요약
Scale AI is hiring for the position of AI Infrastructure Engineer, Model Serving Platform, located in San Francisco, CA or New York, NY. The role involves developing platforms for ML benchmarks, ensuring job performance, and improving ML workflow APIs. Candidates should have 4+ years of experience in ML platforms, with skills in Python, Docker, Kubernetes, and infrastructure as code. The position offers a salary range of $175,000 - $220,000 USD, with additional benefits including health coverage, retirement benefits, and a learning stipend. The role is full-time and not open to new graduates.
주요 업무
Develop re-usable platforms for running in-house and open-source LLM-benchmarks. Ensure correctness and performance of post-training and eval jobs on the platform. Improve APIs for managing ML workflows. Contribute to foundational infrastructure at the company for model inference and training. Participate in our team’s on call process to ensure the availability of our services. Own projects end-to-end, from requirements, scoping, design, to implementation, in a highly collaborative and cross-functional environment.
자격 요건
4+ years of experience developing ML platforms. Passion for working closely with researchers to drive business impact. Experience training and/or benchmarking LLMs. Experience with Python, Docker, Kubernetes, and Infrastructure as code (e.g. terraform).