ESB Failover Runbook (2025-04-28)

Scope

ESB failover activities covering:

• database alignment
• filesystem copy
• backups
• Netscaler and DNS coordination

Tags: #esb #failover #runbook

Stakeholders

• Netscaler: Francisco Jose Vano Reig, Ignacio Azagra Miralles, Raoul Amodio
• ESB Dev: Siva Pokuri, Saurav Datta
• Decision maker: Baha Al Attia

Database alignment

Status: Completed

Tool used: HeidiSQL

Tables exported:

• activemq
• esb
• regdbam
• regdbcore

Primary DB host:

• un-api-p-db-001.edcv.un.org

Filesystem copy

Source paths:

• /opt/software/misc-files
• /opt/software/misc-folders

Primary cluster hosts:

• un-api-p-cl-001.edcv.un.org
• un-api-p-cl-002.edcv.un.org
• un-api-p-cl-003.edcv.un.org

Recovery cluster hosts:

• un-api-r-cl-001.edc.un.org
• un-api-r-cl-002.edc.un.org
• un-api-r-cl-003.edc.un.org

Connectivity checks:

nc -zv un-api-r-cl-001.edc.un.org 22
nc -zv un-api-r-cl-002.edc.un.org 22
nc -zv un-api-r-cl-003.edc.un.org 22

Copy + ownership commands:

# un-api-r-cl-001.edc.un.org
scp -r /opt/software/misc-folders/ "GLOBAL\\crodrigo2"@un-api-r-cl-001.edc.un.org:/opt/software/misc-folders/
chown -R oictadmin:oictadmin misc-f*

# un-api-r-cl-002.edc.un.org
scp -r /opt/software/misc-files/ "GLOBAL\\crodrigo2"@un-api-r-cl-002.edc.un.org:/opt/software/misc-files/
chown -R oictadmin:oictadmin misc-f*

# un-api-r-cl-003.edc.un.org
scp -r /opt/software/misc-files/ "GLOBAL\\crodrigo2"@un-api-r-cl-003.edc.un.org:/opt/software/misc-files/
chown -R oictadmin:oictadmin misc-f*

Backup requirements

Also back up:

• WSO2 folders
• Fuse folders

Netscaler

Service:

• api.un.org

Referenced IP visuals existed in source note (inline screenshots were not imported).

DNS

Action owner: Siva

Action:

• Contact team in New York for DNS verification/changes.

Open follow-ups

• Attach/export SQL script used in DB alignment (missing in source).
• Capture explicit cutover/rollback validation checks.