Senior Software Engineer, Infrastructure

About the company

Our client is a data infrastructure company.

The role

Raydar is recruiting for this role on behalf of our client. Own the platform that runs many concurrent, stateful workloads for AI systems. The work covers job dispatch and reliability, designing realistic test scenarios, and extending the platform with new integrations as the field evolves.

What you'll do

• Run and scale the dispatch layer for many parallel, stateful workloads, including queueing, concurrency control and failure handling.
• Design realistic environments and test scenarios that probe system limits and measure what matters, not only what is easy to measure.
• Build new evaluation approaches and extend the platform to support additional environment types.
• Ship integrations with external orchestration frameworks.
• Keep pace with a fast-moving area and bring new ideas into the platform.

Requirements

What we're looking for

• A track record of designing, launching and growing production backend systems that handle heavy traffic and large volumes of data.
• Background at a startup that grew quickly or at a fast-paced large technology company.
• Comfort with cluster management tooling and event-driven system design.
• Experience maintaining distributed services and infrastructure for large language model workloads.

Bonus points

• Experience running AI or machine learning workloads at scale.
• Experience at both an early-stage startup and a large technology company.
• Extensive hands-on experience with Kubernetes.

Benefits

Compensation and benefits

• Base salary: USD 200,000 to 280,000 per year
• Equity

Location and work model

• New York, NY, United States
• Hybrid, 2-3 days per week in the office
• Remote option may be available for strong candidates
• Full-time