Lead Principal Network Developer - Internet Edge

Description

Lead Principal Network Engineer - Internet Edge

Key responsibilities

• Set the technical direction and roadmap for OCI’s Internet Edge, including internet transit, peering, private interconnects, internet exchanges, and connectivity to DDoS protection providers.

• Define routing policies and resilient connectivity designs that balance availability, performance, and cost across regions.

• Use traffic and performance data to guide peering, transit, and traffic engineering decisions and resolve complex routing issues.

• Plan for high-volume media workloads and other growing customer demand by forecasting traffic patterns and identifying internet connectivity and capacity needs.

• Partner with backbone and transport owners on capacity planning, edge deployments, and circuit changes.

• Lead cross-functional initiatives and technical reviews from design through rollout, managing risks associated with high-impact changes.

• Serve as an escalation point for complex incidents, improve visibility into service health, and drive lasting fixes for recurring problems.

• Advise leadership on technical and provider choices, document designs and operational practices, and mentor engineers.

Core Responsibilities

• Planning and execution: Own technical plans for complex initiatives, anticipate dependencies and delivery risks, and adjust priorities as business needs change.

• Problem solving: Lead investigations into ambiguous connectivity and routing problems and drive solutions that prevent recurrence.

• Continuous improvement: Use service and traffic data to identify opportunities to improve resilience, performance, visibility, and cost efficiency.

• Partnership: Build alignment across engineering teams and with external network and service providers when needed to deliver Internet Edge objectives.

• Technical development: Share expertise, develop other engineers, and contribute to technical reviews and hiring decisions.

Proactively consults on the design and development of the most advanced network systems for large-scale enterprise, data center, or cloud-based environments, driving strategic technological advancements and collaborating with vendors and internal groups for alignment and validation. Leads the development and maintenance of the most advanced automation frameworks for testing and operations, pioneering automation of critical network tasks and ensuring comprehensive monitoring and reliability. Spearheads the development of new and existing test cases and strategies, leading organizational testing efforts, and driving compliance and risk mitigation through standardized qualification processes. Develops new and advanced systems for monitoring network health, leads critical incident response and escalations, formalizes issue resolution practices, and pioneers innovative tools for frontline support teams. Ensures milestone achievement aligns with organizational strategies, mentors cross-functionally, leads high-visibility incident response and root cause analysis (RCA), and proactively resolves networking standards misalignment. Analyzes network performance metrics, architects capacity for future demand, and writes design papers to drive organizational change.

Responsibilities

Key Responsibilities

Network Design, Development, and Validation:

-Proactively consults on the design across internal teams to determine feasibility and development of the most advanced network fabric and systems to support large-scale enterprise, data center, or cloud-based networking environments, driving strategic technological advancements.

-Oversees the validation of production network and ensures scaling strategies are optimized, ensuring alignment with strategic goals and organizational impact.

-Influences the network solution and architecture design/validation process, providing industry-leading insights and validation.

-Anticipates and mitigates highly complex, critical risks in network design prior to deployment, developing strategic recommendations that ensure future-proof solutions.

-Leads high-level collaborations with vendors and cross functional internal groups (e.g., quality assurance) to ensure alignment with comprehensive firmware/software, complex network configuration validation and resolution of critical bugs, impacting overall product reliability.

-Designs playbooks for highly complex issues with the widest blast radius related to network areas.

-Leads the design and optimization of network processes to drive efficiency.

Automation and Scripting:

-Leads the development and maintenance of the most advanced automation frameworks for testing and operations, driving significant efficiency improvements across the organization.

-Pioneers the automation of critical network tasks, including production and lab environments and drives optimization of repetitive support functions to significantly enhance processes.

-Spearheads the creation and customization of highly complex dashboards, telemetry systems, and alerting mechanisms, proactively ensuring network health and reliability.

-Leads the development and enhancement of the most advanced scripts driving automation of tasks across multiple teams and business units, driving organizational efficiency.

-Architects and scales infrastructure pipelines, configuration items, defining Playbooks and organizing resources.

-Leads cross-functional efforts to extend or evolve tools that enable the scalable launch of new product functionality.

Testing and Quality Assurance:

-Updates and improves existing test cases and the strategic development of new test cases, and comprehensive test strategies, to ensure network integrity across the organization.

-Acts as the foremost technical leader for test practices and strategies, providing industry-leading guidance to develop robust testing protocols.

-Spearheads the implementation of new approaches to improve break-fix validation and post-event root cause analysis (RCA), ensuring resolution of issues and integration of lessons learned across the organization.

-Leads executive change management review board process.

-Drives the development of standardized qualification processes across teams (e.g., vendors, product teams, internal network qualification, quality assurance) to validate systems and environments through pre-production testing, and ensure compliance prior to deployment.

-Meets with auditor to provide Governance, Risk, and Compliance (GRC) data, answer questions, and provide walk-throughs, performing internal auditing based on team expectations.

Monitoring and Reliability:

-Leads the development of new dashboards, telemetry systems, and alerting mechanisms to monitor network health, including defining metrics, trends, and thresholds to ensure service level objectives (SLOs).

-Leads the development and customization of the most advanced monitoring and alerting systems and the enhancement of the detection and diagnosis of network anomalies.

-Provides technical expertise on critical escalations during incident response.

-Formalizes practices for issue handoff, accountability, and closure, and responds to internal and external stakeholders when needed.

-Pioneers the development and continuous enhancement of innovative tools and solutions for frontline support teams, driving efficiencies in responding to network failure conditions.

Cross-Team Collaboration and Leadership:

-Partners with project/program managers to ensure the achievement of critical test and deployment milestones, aligning projects with overarching organizational strategies.

-Provides expert technical and non-technical mentorship cross-functionally, and industry-leading subject matter expertise to the team, driving technical excellence and innovation across functions.

-Drives high-visibility incident response cases and leads the delivery of root cause analysis (RCA) results, during major technical incidents.

…