Senior Streaming Data Engineer – Real-Time AI Pipelines & Kafka

Remote
USA
Posted 3 hours ago

Opportunity Overview

Location: 100% Remote (United States)
Employment Type: Full-Time Direct-Hire via Accel DNA
Compensation Range: $165,000 – $195,000 Base + Bonus
Hiring Agency: Accel DNA – Premier Frontier Data & AI Talent Partner

Build high-throughput event streaming pipelines feeding real-time context and continuous data ingestion into generative AI inference applications.

Key Responsibilities:

  • Design and maintain fault-tolerant event streaming backbones using Apache Kafka, Apache Flink, or Redpanda.
  • Implement real-time feature transformation and streaming document ingestion pipelines updating vector search indexes in sub-second latency.
  • Ensure strict schema evolution management using Avro/Protobuf and Confluent Schema Registry.
  • Build robust backpressure handling, dead-letter queues, and exactly-once processing semantics across streaming topologies.

What You Bring:

  • 5+ years of data engineering experience with strong production focus on real-time stream processing.
  • Proficiency in Java, Scala, or Python with deep operational expertise in Kafka and Flink.
  • Hands-on experience integrating streaming event platforms with cloud data warehouses (Snowflake, BigQuery).
  • Strong understanding of distributed consensus, stateful streaming, and disaster recovery.

How to Apply:

Interested in exploring this opportunity? Submit your profile or portfolio directly to contact@accel-dna.com or apply through https://accel-dna.com/contact-us/.

Job Features

Job Category

Data Architect

Apply For This Job

loader

Submit Your Resume

Our team will get in touch within 24 working hours.
Sign Up for Email and Phone Calls