Job Description

Senior Machine Learning Engineer (LLMs & Scalable Systems)

Location: Remote-first (with ~5 hours overlap with US Eastern Time)

Compensation: $200k base + equity + performance bonus

A fast-growing AI startup in the digital advertising space is looking for a Senior Machine Learning Engineer to lead the development and optimization of large language model (LLM) applications. This company is building transparent, customizable AI tools that allow advertisers to retain full control over their data while improving campaign efficiency across platforms. The company is NYC-based, but the technical teams are fully remote.

This is a unique opportunity to join a small, empowered technical team with a high degree of ownership, real impact, and no corporate red tape. Backed by a major global agency partner, the company is rapidly expanding and applying LLMs to uncover patterns in unstructured data, automate insights, and enable real-time optimization.

Key Responsibilities

• Design, build, and deploy machine learning solutions leveraging LLMs and foundational models
• Optimize embedding processes and reduce model runtime
• Work with large-scale systems to deliver scalable, production-ready solutions
• Run experiments and monitor model performance in live environments
• Utilize cloud tools such as AWS, Databricks, and Snowflake for deployment and ML lifecycle management

In the First 90 Days

• Build predictive models using demographic and behavioral data
• Consolidate embedding pipelines and streamline performance
• Significantly improve model efficiency and deployment workflows
• Contribute to the next generation of LLM-powered features

Ideal Candidate Profile

• Proven years of industry experience in machine learning, AI, or related fields
• Master’s or PhD in Computer Science, Statistics, or similar
• Deep experience with LLMs, foundation models, and libraries like Hugging Face
• Skilled in writing production-level code, with experience in performance monitoring and testing
• Proficient in object-oriented programming and working with APIs (REST, GraphQL, gRPC, etc.)
• Background in large-scale system development is essential
• Previous exposure to advertising or mentoring junior engineers is a plus

The Company Offers

• Remote-first setup with flexible work hours
• Competitive compensation: $200k base + equity + performance bonus
• Unlimited PTO
• Support for continuing education and professional growth
• Two company off-sites per year
• Collaborative, non-corporate environment

How to Apply

If this opportunity sounds interesting, and you fit the above requirements, send your resume to Virginia via the Apply link on this page.

Keywords:

LLMs | Foundation Models | Hugging Face | Embedding Optimization | Neural Networks | AWS | Databricks | Snowflake | Scalable Systems | Distributed Systems | GraphQL | REST APIs | gRPC | Model Deployment | Model Monitoring | MLOps | Predictive Modeling | Unstructured Data | Behavioral Data

Job Tags

Similar Jobs