Machine Learning Engineer

As a Machine Learning Engineer at Skyfall, you will play a crucial role in deploying and optimizing large language models (LLMs) in production environments. Your responsibilities will include deploying post-trained LLMs, optimizing inference for cost and latency, and building scalable training pipelines using cutting-edge technologies like DeepSpeed, Accelerate, and Ray. The Skyfall team, comprising of industry pioneers from Maluuba, is committed to revolutionizing the AI ecosystem by creating the first world model for the enterprise. By overcoming the limitations of existing LLMs, the Enterprise World Model aims to provide enterprises with a comprehensive understanding of the intricate relationships between data, people, and processes within organizations. You will be part of a dynamic team spread across New York, Toronto, and Bangalore, working on designing distributed training infrastructure, managing multi-cloud ML deployments, and implementing advanced model compression techniques. Additionally, you will develop internal tools to facilitate multi-GPU training and large-scale experimentation, ensuring efficient resource allocation and continuous model evaluation. To excel in this role, you should have a minimum of 3 years of experience in ML engineering, model deployment, and large-scale training. Proficiency in vector databases such as FAISS, Pinecone, and Weaviate for retrieval-augmented generation (RAG) is essential. Experience with multi-cloud ML deployment, hands-on deployment of large-scale models in production, and expertise in multi-GPU training and inference optimizations are key requirements. Your strong knowledge of ML system performance tuning, latency optimization, and cost reduction strategies will be instrumental in developing cluster management tools for external compute infrastructure and implementing state-of-the-art model compression techniques. By staying abreast of LLM fine-tuning techniques, RLHF, and model evaluation metrics, you will contribute to Skyfall's mission of disrupting the AI landscape and providing enterprises with significant value through innovative solutions.,