Staff Engineer, Replication

DDN is seeking a Staff Replication Development Engineer to lead the design and development of the replication engine for the Infinia AI Data Platform. This role focuses on building enterprise-grade asynchronous replication capabilities that enable reliable and secure disaster recovery for large-scale data systems.

You will work on developing high-performance replication pipelines, efficient data synchronization mechanisms, and secure data transfer systems. This role requires deep expertise in distributed systems and strong technical leadership to deliver a scalable and resilient replication foundation.

Key Responsibilities

• Design and develop multi-threaded asynchronous replication systems with parallel streaming capabilities

• Build object-level delta replication with checkpointing and resume functionality

• Develop replication engines supporting bucket/share-level replication controls

• Implement secure data transfer mechanisms using TLS 1.3 with mutual authentication

• Ensure end-to-end data integrity through checksum validation and verification pipelines

• Design and implement manual failover workflows for disaster recovery scenarios

• Build and maintain REST APIs for replication configuration, control, and automation

• Develop metadata tracking and change detection systems to enable efficient replication

• Implement RPO visibility, alerting, and operational insights for replication status

• Contribute to monitoring dashboards focused on replication health and performance

• Ensure systems are designed for high availability, fault tolerance, and scalability

• Partner with QA teams to drive performance, resiliency, and scale validation

• Collaborate with backend, security, and platform teams to deliver end-to-end replication workflows

• Participate in debugging, production issue resolution, and continuous improvement of replication reliability

• Provide technical leadership, architectural guidance, and mentorship to the engineering team

Required Qualifications

• 8+ years of experience in distributed systems, storage systems, or backend software engineering

• Strong programming skills in one or more languages: C++, Go, Java, or Rust

• Experience designing and building data replication systems, data pipelines, or distributed data services

• Deep understanding of distributed systems concepts (consistency, availability, scalability, fault tolerance)

• Strong expertise in multi-threading, concurrency, and parallel processing

• Knowledge of networking protocols and secure communication (TCP/IP, HTTP/HTTPS, TLS)

• Experience implementing data integrity mechanisms (checksums, validation, consistency checks)

• Experience designing and building REST APIs and service-based architectures

• Familiarity with checkpointing, failure recovery, and retry mechanisms in distributed systems

• Basic understanding of observability concepts (metrics, logging, alerting)

• Strong debugging, problem-solving, and system design skills

Preferred Qualifications

• Experience with asynchronous replication, disaster recovery (DR), or backup systems

• Familiarity with object storage or large-scale data storage systems

• Knowledge of delta encoding, change data capture, or incremental data synchronization techniques

• Experience building high-throughput, low-latency data movement systems

• Exposure to security practices including mutual TLS, encryption, and authentication

• Experience working on enterprise-scale data platforms or storage products

• Familiarity with performance optimization and large-scale system tuning