storage migration
2 posters
Page 1 of 1
storage migration
Hi,
I am pretty new in the Vxfs and VCS stuff as its usually not used on AIX - but I have to upgrade the powerpath software and migrate the whole storage to another symmetrix next week.
I already tried the powerpath upgrade a couple of weeks ago but somehow it failed and corrupted my RAC cluster - shared disks had no longer been shared and one of the nodes did not come up at all, and the storage was not really accessible - we could not even write into new created and mounted filesystems.
Does anyone have a slight idea what I did wrong - to avoid similar issues next week? Is there a way to protect the cluster config from being overwritten?
Thanks in advance for any hint you can give me ...
Kind regards
Nicki
I am pretty new in the Vxfs and VCS stuff as its usually not used on AIX - but I have to upgrade the powerpath software and migrate the whole storage to another symmetrix next week.
I already tried the powerpath upgrade a couple of weeks ago but somehow it failed and corrupted my RAC cluster - shared disks had no longer been shared and one of the nodes did not come up at all, and the storage was not really accessible - we could not even write into new created and mounted filesystems.
Does anyone have a slight idea what I did wrong - to avoid similar issues next week? Is there a way to protect the cluster config from being overwritten?
Thanks in advance for any hint you can give me ...
Kind regards
Nicki
Re: SAN Migration
Nicky,
its unclear from the post, but was the migration performed on an AIX server or Solaris and what steps did u take? It, should not make any difference - I am just curious
What did you do to recover the situation, perhaps it may help us to figure out what went wrong..
its unclear from the post, but was the migration performed on an AIX server or Solaris and what steps did u take? It, should not make any difference - I am just curious
What did you do to recover the situation, perhaps it may help us to figure out what went wrong..
Re: storage migration
Hi Spanner,
the powerpath upgrade was on AIX ... and I am really not sure what I did wrong ... I stated already I am not that experienced in these things. To recover the whole thing I had to change the diskgroup that was no longer shared back to shared, remove / recreate the fencing disks (as the command that should clean the split brain condition I had, did not fix the problem - the cluster still did not come up after the reboot), manually mount the disks, manually start rac, re-activate cssd in the clusterconfiguration to bring up oracle and boot a couple of times. I am not even sure hat really fixed the problems - but I am scared that it happens again next time.
Thats why I am asking how-to-do-it the right way. I think I messed something up by throwing away the disks - on AIX LVM pretty easy but seems I have done something wrong with the veritas disks ... But most confusing for me was that even the backout (booting from cloned disks) not fixed the problem ...
Rgds
Nicki
the powerpath upgrade was on AIX ... and I am really not sure what I did wrong ... I stated already I am not that experienced in these things. To recover the whole thing I had to change the diskgroup that was no longer shared back to shared, remove / recreate the fencing disks (as the command that should clean the split brain condition I had, did not fix the problem - the cluster still did not come up after the reboot), manually mount the disks, manually start rac, re-activate cssd in the clusterconfiguration to bring up oracle and boot a couple of times. I am not even sure hat really fixed the problems - but I am scared that it happens again next time.
Thats why I am asking how-to-do-it the right way. I think I messed something up by throwing away the disks - on AIX LVM pretty easy but seems I have done something wrong with the veritas disks ... But most confusing for me was that even the backout (booting from cloned disks) not fixed the problem ...
Rgds
Nicki
Re: storage migration
Hmm - sorry Nicki but I do not know how to answer your question on this one. Hope you do not experience the same issue with your other migration.
Re: storage migration
Hi,
today I retried the powerpath upgrade and this time everything went ok
the steps I did :
BRING DOWN CLUSTER AND ALL NON-CLUSTER-MANAGED VOLUMEGROUPS
# hastop -all
# umount -a
# varyoffvg <volumegroup>
- if required upgrade firmware at this stage -
BRING STORAGE OUT OF VERITAS CONTROL
# vxdisk list
# vxdisk offline <all devices that are shown as online>
BRING STORAGE OUT OF POWERPATH CONTROL
# for i in $(lspv| awk '/power/ {print $1}') ; do rmdev -dl $i ; done
# for i in $(lspv| awk '!/rootvg/ {print $1}') ; do rmdev -dl $i ; done
# rmdev -Rdl fscsi0
# rmdev -Rdl fscsi1
# rmdev -Rdl powerpath0
*** REMOVE / REINSTALL POWERPATH SOFTWARE ***
BRING STORAGE UNDER POWERPATH CONTROL
# /usr/sbin/powermt check_registration
# cfgmgr
# /usr/lpp/EMC/Symmetrix/bin/emc_cfgmgr
# powermt config
# powermt save
# for i in $(lspv| awk '/power/ {print $1}') ; do rmdev -dl $i ; done
# for i in $(lspv| awk '!/rootvg/ {print $1}') ; do rmdev -dl $i ; done
# rmdev -Rdl fscsi0
# rmdev -Rdl fscsi1
# rmdev -Rdl powerpath0
# /usr/lpp/EMC/Symmetrix/bin/emc_cfgmgr
# powermt config
# powermt save
VARYON AND MOUNT ALL NON-VERITAS-MANAGED VOLUMEGROUPS
# varyonvg <volumegroup>
# mount -a
BRING STORAGE INTO VERITAS CONTROL WITHOUT ONLINING
# vxdctl enable
REBOOT ALL CLUSTERNODES AT THE SAME TIME
After the restart all clusternodes came up properly and RAC started without any issues.
today I retried the powerpath upgrade and this time everything went ok
the steps I did :
BRING DOWN CLUSTER AND ALL NON-CLUSTER-MANAGED VOLUMEGROUPS
# hastop -all
# umount -a
# varyoffvg <volumegroup>
- if required upgrade firmware at this stage -
BRING STORAGE OUT OF VERITAS CONTROL
# vxdisk list
# vxdisk offline <all devices that are shown as online>
BRING STORAGE OUT OF POWERPATH CONTROL
# for i in $(lspv| awk '/power/ {print $1}') ; do rmdev -dl $i ; done
# for i in $(lspv| awk '!/rootvg/ {print $1}') ; do rmdev -dl $i ; done
# rmdev -Rdl fscsi0
# rmdev -Rdl fscsi1
# rmdev -Rdl powerpath0
*** REMOVE / REINSTALL POWERPATH SOFTWARE ***
BRING STORAGE UNDER POWERPATH CONTROL
# /usr/sbin/powermt check_registration
# cfgmgr
# /usr/lpp/EMC/Symmetrix/bin/emc_cfgmgr
# powermt config
# powermt save
# for i in $(lspv| awk '/power/ {print $1}') ; do rmdev -dl $i ; done
# for i in $(lspv| awk '!/rootvg/ {print $1}') ; do rmdev -dl $i ; done
# rmdev -Rdl fscsi0
# rmdev -Rdl fscsi1
# rmdev -Rdl powerpath0
# /usr/lpp/EMC/Symmetrix/bin/emc_cfgmgr
# powermt config
# powermt save
VARYON AND MOUNT ALL NON-VERITAS-MANAGED VOLUMEGROUPS
# varyonvg <volumegroup>
# mount -a
BRING STORAGE INTO VERITAS CONTROL WITHOUT ONLINING
# vxdctl enable
REBOOT ALL CLUSTERNODES AT THE SAME TIME
After the restart all clusternodes came up properly and RAC started without any issues.
Page 1 of 1
Permissions in this forum:
You cannot reply to topics in this forum
|
|