HomeIncident briefing
Back to the library
INCIDENT #140 · SECURITY

Data center: Restore both services without opening the boundary

Expert35 minutesPro lab

The incident

Application workers connect to database and connection-pool subnets through separate access and service aggregation layers. Four routed leaves share two spines; clients and services use separate access handoffs while partner and monitoring traffic terminate on other leaves. Both authorized service transports fail after a policy rollout. ICMP still works, and untrusted clients must remain blocked from both services. Investigate database connectivity from R1: 10.168.96.0/24 to 10.168.110.0/24 (TCP/5432), and 10.168.97.0/24 to 10.168.111.0/24 (TCP/6432).

Your objective

Restore both authorized service transports and return reachability, including clients and service hosts in both halves of the primary subnet. Keep R5 blocked from both service transports, keep SSH blocked to both service subnets, and preserve monitoring between R1 and R6. Do not change physical topology or addressing. These are network forwarding checks, not application-level transactions.

The network

Network topology8 devices 10 links

Data center: Restore both services without opening the boundary — network topologyR1: Client edge. R2: Client leaf. R3: Spine A. R4: Spine B. R5: Partner leaf. R6: Monitoring leaf. R7: Service leaf. R8: Service gateway. R1 connects to R2. R2 connects to R3. R2 connects to R4. R5 connects to R3. R5 connects to R4. R6 connects to R3. R6 connects to R4. R7 connects to R3. R7 connects to R4. R7 connects to R8. Connections show physical links, not service health.R1 ↔ R2 · 10.168.112.0/30R2 ↔ R3 · 10.168.113.0/30R2 ↔ R4 · 10.168.114.0/30R5 ↔ R3 · 10.168.115.0/30R5 ↔ R4 · 10.168.116.0/30R6 ↔ R3 · 10.168.117.0/30R6 ↔ R4 · 10.168.118.0/30R7 ↔ R3 · 10.168.119.0/30R7 ↔ R4 · 10.168.120.0/30R7 ↔ R8 · 10.168.121.0/30R1Client edgeR1 · Client edge · Starting deviceR2Client leafR2 · Client leafR3Spine AR3 · Spine AR4Spine BR4 · Spine BR5Partner leafR5 · Partner leafR6MonitoringleafR6 · Monitoring leafR7Service leafR7 · Service leafR8ServicegatewayR8 · Service gateway
Physical links · Service health not shown
Link addressing (10)
  • R1 R210.168.112.0/30
  • R2 R310.168.113.0/30
  • R2 R410.168.114.0/30
  • R5 R310.168.115.0/30
  • R5 R410.168.116.0/30
  • R6 R310.168.117.0/30
  • R6 R410.168.118.0/30
  • R7 R310.168.119.0/30
  • R7 R410.168.120.0/30
  • R7 R810.168.121.0/30
8 devices · Cisco IOS syntax · Simulated network

What you’ll practice

acl policymulti service validationsafe remediation

Interview exercises are inspired by common industry competencies. They are not proprietary interview questions.