Lead Edge AI & Small Language Model (SLM) Optimization Engineer

Remote
USA
Posted 12 hours ago

Opportunity Overview

Location: 100% Remote (United States)
Employment Type: Full-Time Direct-Hire via Accel DNA
Compensation Range: $185,000 – $220,000 Base + Performance Bonus
Hiring Agency: Accel DNA – Premier Frontier Data & AI Talent Partner

Drive high-efficiency deployment of sub-8B parameter language and vision models on resource-constrained edge hardware, laptops, and localized compute appliances.

Key Responsibilities:

  • Compress, distill, and quantize frontier foundation models into lightweight 1B–7B SLMs using AWQ, GPTQ, and EXL2 formats.
  • Implement speculative decoding, KV-cache compression, and flash-attention kernels tailored to edge GPUs and Apple Silicon (MLX).
  • Deploy offline, zero-latency inference engines using llama.cpp, ONNX Runtime, and TensorRT-LLM.
  • Benchmark accuracy tradeoffs against full-scale models across standardized domain-specific evaluation suites.

What You Bring:

  • 5+ years in deep learning deployment and systems optimization with strong C++ and Python programming fundamentals.
  • Deep expertise in model quantization, knowledge distillation, and hardware-accelerated inference runtimes.
  • Experience optimizing LLMs for edge platforms (NVIDIA Jetson, Qualcomm Snapdragon, Apple M-series chips).
  • BS/MS in Computer Engineering, Electrical Engineering, or Computer Science.

How to Apply:

Interested in exploring this opportunity? Submit your profile or portfolio directly to contact@accel-dna.com or apply through https://accel-dna.com/contact-us/.

Job Features

Job Category

AI/ML

Apply For This Job

loader

Submit Your Resume

Our team will get in touch within 24 working hours.
Sign Up for Email and Phone Calls