Senior Streaming Data Engineer – Real-Time AI Pipelines & Kafka

Opportunity Overview

Location: 100% Remote (United States)
Employment Type: Full-Time Direct-Hire via Accel DNA
Compensation Range: $165,000 – $195,000 Base + Bonus
Hiring Agency: Accel DNA – Premier Frontier Data & AI Talent Partner

Build high-throughput event streaming pipelines feeding real-time context and continuous data ingestion into generative AI inference applications.

Key Responsibilities:

• Design and maintain fault-tolerant event streaming backbones using Apache Kafka, Apache Flink, or Redpanda.
• Implement real-time feature transformation and streaming document ingestion pipelines updating vector search indexes in sub-second latency.
• Ensure strict schema evolution management using Avro/Protobuf and Confluent Schema Registry.
• Build robust backpressure handling, dead-letter queues, and exactly-once processing semantics across streaming topologies.

What You Bring:

• 5+ years of data engineering experience with strong production focus on real-time stream processing.
• Proficiency in Java, Scala, or Python with deep operational expertise in Kafka and Flink.
• Hands-on experience integrating streaming event platforms with cloud data warehouses (Snowflake, BigQuery).
• Strong understanding of distributed consensus, stateful streaming, and disaster recovery.

How to Apply:

Interested in exploring this opportunity? Submit your profile or portfolio directly to contact@accel-dna.com or apply through https://accel-dna.com/contact-us/.