Edit page

ESB Failover Runbook (2025-04-28)

Title

Slug

Status

Context

Categories

Topics

Markdown

# ESB Failover Runbook (2025-04-28)

## Scope
ESB failover activities covering:
- database alignment
- filesystem copy
- backups
- Netscaler and DNS coordination

Tags: #esb #failover #runbook

## Stakeholders
- Netscaler: Francisco Jose Vano Reig, Ignacio Azagra Miralles, Raoul Amodio
- ESB Dev: Siva Pokuri, Saurav Datta
- Decision maker: Baha Al Attia

## Database alignment
Status: Completed

Tool used: HeidiSQL

Tables exported:
- activemq
- esb
- regdbam
- regdbcore

Primary DB host:
- un-api-p-db-001.edcv.un.org

## Filesystem copy
Source paths:
- /opt/software/misc-files
- /opt/software/misc-folders

Primary cluster hosts:
- un-api-p-cl-001.edcv.un.org
- un-api-p-cl-002.edcv.un.org
- un-api-p-cl-003.edcv.un.org

Recovery cluster hosts:
- un-api-r-cl-001.edc.un.org
- un-api-r-cl-002.edc.un.org
- un-api-r-cl-003.edc.un.org

Connectivity checks:
```bash
nc -zv un-api-r-cl-001.edc.un.org 22
nc -zv un-api-r-cl-002.edc.un.org 22
nc -zv un-api-r-cl-003.edc.un.org 22
```

Copy + ownership commands:
```bash
# un-api-r-cl-001.edc.un.org
scp -r /opt/software/misc-folders/ "GLOBAL\\crodrigo2"@un-api-r-cl-001.edc.un.org:/opt/software/misc-folders/
chown -R oictadmin:oictadmin misc-f*

# un-api-r-cl-002.edc.un.org
scp -r /opt/software/misc-files/ "GLOBAL\\crodrigo2"@un-api-r-cl-002.edc.un.org:/opt/software/misc-files/
chown -R oictadmin:oictadmin misc-f*

# un-api-r-cl-003.edc.un.org
scp -r /opt/software/misc-files/ "GLOBAL\\crodrigo2"@un-api-r-cl-003.edc.un.org:/opt/software/misc-files/
chown -R oictadmin:oictadmin misc-f*
```

## Backup requirements
Also back up:
- WSO2 folders
- Fuse folders

## Netscaler
Service:
- api.un.org

Referenced IP visuals existed in source note (inline screenshots were not imported).

## DNS
Action owner: Siva

Action:
- Contact team in New York for DNS verification/changes.

## Open follow-ups
- Attach/export SQL script used in DB alignment (missing in source).
- Capture explicit cutover/rollback validation checks.

Cancel