Senior AI Infrastructure & GPU Cluster Architect

Opportunity Overview

Location: 100% Remote (United States)
Employment Type: Full-Time Direct-Hire via Accel DNA
Compensation Range: $190,000 – $230,000 Base + Performance Bonus
Hiring Agency: Accel DNA – Premier Frontier Data & AI Talent Partner

Scale, manage, and optimize multi-node NVIDIA H100/A100 GPU clusters powering low-latency foundation model training and inference pipelines.

Key Responsibilities:

• Architect and maintain distributed GPU computing infrastructure across AWS, GCP, and specialized bare-metal GPU clouds.
• Configure InfiniBand/RoCE networking, CUDA driver stacks, and Kubernetes GPU operator daemonsets.
• Optimize cluster utilization, spot instance recovery strategies, and distributed storage IOPS for large-scale training runs.
• Establish automated cost monitoring and GPU allocation policies across machine learning research squads.

What You Bring:

• 6+ years of systems engineering or DevOps experience, with 2+ years dedicated to high-performance GPU cluster management.
• Deep mastery of Kubernetes, Terraform, NVIDIA Slurm / Run:ai, and Linux kernel networking.
• Experience supporting distributed training frameworks such as Megatron-LM and DeepSpeed.
• Strong track record reducing GPU idle time and cloud infrastructure expenditure.

How to Apply:

Interested in exploring this opportunity? Submit your profile or portfolio directly to contact@accel-dna.com or apply through https://accel-dna.com/contact-us/.