Sunday, November 13, 2016

Data Migration from EMC to Hitachi in VXvm set up.

In this project I’m trying to migrate data from EMC to HDS from the
operating system side. Once the migrating is complete, remove EMC drive
from the system and totally depend upon Hitachi.
Here are the steps that I took for this process.

1) Get new Hitachi LUNs from your SAN Admin.
2) Verify that from format command. ( You might even need to reboot the server)
3) Install required ASL for Hitachi support in VxDMP.
4) Verify all the paths are seen from Veritas Dynamic Multipathing.
5) Label new drives with format utility.
6) Assign new drive name and group.(Bring in Veritas control)
7) Mirror Veritas Volume using VxVM commands.
8 )Break the mirror plex of EMC drives.
9) Remove EMC drives from Veritas control.
10) As your SAN admin to remove EMC drives from the server.

This is what it looks like before getting new Hitachi drives

# vxdisk list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 sliced rootdisk rootdg online
c1t1d0s2 sliced rootmirror rootdg online
c2t0d0s2 sliced vgora01_01 vgora01 online
c2t0d1s2 sliced vgora01_02 vgora01 online
c2t0d2s2 sliced vgora01_03 vgora01 online
c2t0d3s2 sliced vgora01_04 vgora01 online
c2t0d4s2 sliced vgora01_05 vgora01 online

# vxdmpadm listctlr all
CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME
=====================================================
c1 SENA ENABLED INTERNAL_DISKS
c2 EMC_CLARiiON ENABLED EMC_CLARiiON0
c3 EMC_CLARiiON ENABLED EMC_CLARiiON0

This is how it should look like after installing Hitachi Array Support
Library and getting new Hitachi Drives.

# vxdmpadm listctlr all
CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME
=====================================================
c1 SENA ENABLED INTERNAL_DISKS
c2 EMC_CLARiiON ENABLED EMC_CLARiiON0
c3 EMC_CLARiiON ENABLED EMC_CLARiiON0
c2 USP ENABLED USP0
c3 USP ENABLED USP0

Verify New Hitachi drives.In the following 5 EMC and Hitachi drives are
over 2 paths each.

#echo | format
Searching for disks…done

AVAILABLE DISK SELECTIONS:
0. c1t0d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w21000014c3c3c968,0
1. c1t1d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w21000014c3e176e5,0
3. c2t0d0 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@8,700000/lpfc@5/sd@0,0
4. c2t0d1 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@8,700000/lpfc@5/sd@0,1
5. c2t0d2 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@8,700000/lpfc@5/sd@0,2
6. c2t0d3 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@8,700000/lpfc@5/sd@0,3
7. c2t0d4 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@8,700000/lpfc@5/sd@0,4
8. c3t0d0 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@9,600000/lpfc@2/sd@0,0
9. c3t0d1 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@9,600000/lpfc@2/sd@0,1
10. c3t0d2 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@9,600000/lpfc@2/sd@0,2
11. c3t0d3 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@9,600000/lpfc@2/sd@0,3
12. c3t0d4 <DGC-RAID10-0205 cyl 64190 alt 2 hd 256 sec 17>
/pci@9,600000/lpfc@2/sd@0,4
13. c2t2d0 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@8,700000/lpfc@5/sd@2,0
14. c2t2d1 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@8,700000/lpfc@5/sd@2,1
15. c2t2d2 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@8,700000/lpfc@5/sd@2,2
16. c2t2d3 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@8,700000/lpfc@5/sd@2,3
17. c2t2d4 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@8,700000/lpfc@5/sd@2,4
18. c3t2d0 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@9,600000/lpfc@2/sd@2,0
19. c3t2d1 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@9,600000/lpfc@2/sd@2,1
20. c3t2d2 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@9,600000/lpfc@2/sd@2,2
21. c3t2d3 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@9,600000/lpfc@2/sd@2,3
22. c3t2d4 <HITACHI-OPEN-V*5-SUN-5009 cyl 37048 alt 2 hd 30 sec 128>
/pci@9,600000/lpfc@2/sd@2,4

Bring Hitachi under Veritas control by assigning it drive names and group
with the following commands

#/etc/vx/bin/vxdisksetup -i c2t2d0
#/etc/vx/bin/vxdisksetup -i c2t2d1
#/etc/vx/bin/vxdisksetup -i c2t2d2
#/etc/vx/bin/vxdisksetup -i c2t2d3
#/etc/vx/bin/vxdisksetup -i c2t2d4
#/etc/vx/bin/vxdisksetup -i c2t2d5

#vxdg -g vgora01 adddisk vgora01_h1=c2t2d0 vgora01_h2=c2t2d1 \
vgora01_h3=c2t2d2 vgora01_h4=c2t2d4 vgora01_h5=c2t2d5

# vxdisk list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 sliced rootdisk rootdg online
c1t1d0s2 sliced rootmirror rootdg online
c2t0d0s2 sliced vgora01_01 vgora01 online
c2t0d1s2 sliced vgora01_02 vgora01 online
c2t0d2s2 sliced vgora01_03 vgora01 online
c2t0d3s2 sliced vgora01_04 vgora01 online
c2t0d4s2 sliced vgora01_05 vgora01 online
c2t0d5s2 sliced vgora01_06 vgora01 online
c2t2d0s2 sliced vgora01_h0 vgora01 online
c2t2d1s2 sliced vgora01_h1 vgora01 online
c2t2d2s2 sliced vgora01_h2 vgora01 online
c2t2d3s2 sliced vgora01_h3 vgora01 online
c2t2d4s2 sliced vgora01_h4 vgora01 online
c2t2d5s2 sliced vgora01_h5 vgora01 online

Mirror the drives using following commands

#vxassist -g vgora01 mirror u01 vgora01_h1
#vxassist -g vgora01 mirror u02 vgora01_h2
#vxassist -g vgora01 mirror u03 vgora01_h3
#vxassist -g vgora01 mirror u04 vgora01_h4
#vxassist -g vgora01 mirror u05 vgora01_h5

Verigy mirroring

#vxtask list

#vxprint -hrt

dg vgora01 default default 102000 1090932623.1376.
dm vgora01_h0 c2t2d0s2 sliced 7423 142252800 –
dm vgora01_h1 c2t2d1s2 sliced 7423 142252800 –
dm vgora01_h2 c2t2d2s2 sliced 7423 142252800 –
dm vgora01_h3 c2t2d3s2 sliced 7423 142252800 –
dm vgora01_h4 c2t2d4s2 sliced 7423 142252800 –
dm vgora01_h5 c2t2d5s2 sliced 7423 142252800 –
dm vgora01_01 c2t0d0s2 sliced 8447 279341824 –
dm vgora01_02 c2t0d1s2 sliced 8447 279341824 –
dm vgora01_03 c2t0d2s2 sliced 8447 279341824 –
dm vgora01_04 c2t0d3s2 sliced 8447 279341824 –
dm vgora01_05 c2t0d4s2 sliced 8447 279341824 –

v u01 – ENABLED ACTIVE 138412032 SELECT – fsgen
pl u01-01 u01 ENABLED ACTIVE 138415360 CONCAT – RW
sd vgora01_06-01 u01-01 vgora01_06 0 96470784 0 c2t0d5 ENA
sd vgora01_05-04 u01-01 vgora01_05 96470784 41944576 96470784 c2t0d4 ENA
pl u01-02 u01 ENABLED ACTIVE 138412800 CONCAT – RW
sd vgora01_h0-01 u01-02 vgora01_h0 0 138412800 0 c2t2d0 ENA

v u02 – ENABLED ACTIVE 467210240 SELECT – fsgen
pl u02-01 u02 ENABLED ACTIVE 467210240 CONCAT – RW
sd vgora01_01-01 u02-01 vgora01_01 0 138415360 0 c2t0d0 ENA
sd vgora01_03-03 u02-01 vgora01_03 54526208 83889152 138415360 c2t0d2 ENA
sd vgora01_01-03 u02-01 vgora01_01 276830720 2511104 222304512 c2t0d0 ENA
sd vgora01_02-03 u02-01 vgora01_02 276830720 2511104 224815616 c2t0d1 ENA
sd vgora01_03-04 u02-01 vgora01_03 276830720 2511104 227326720 c2t0d2 ENA
sd vgora01_04-03 u02-01 vgora01_04 276830720 2511104 229837824 c2t0d3 ENA
sd vgora01_05-03 u02-01 vgora01_05 276830720 2511104 232348928 c2t0d4 ENA
sd vgora01_06-03 u02-01 vgora01_06 276830720 2511104 234860032 c2t0d5 ENA
sd vgora01_04-04 u02-01 vgora01_04 117443072 20972288 237371136 c2t0d3 ENA
sd vgora01_04-05 u02-01 vgora01_04 255858432 16776960 258343424 c2t0d3 ENA
sd vgora01_06-07 u02-01 vgora01_06 245370112 31460608 275120384 c2t0d5 ENA
sd vgora01_02-04 u02-01 vgora01_02 117443072 20967936 306580992 c2t0d1 ENA
sd vgora0100-01 u02-01 vgora0100 0 139661312 327548928 c2t0d6 ENA
pl u02-02 u02 ENABLED ACTIVE 467212800 CONCAT – RW
sd vgora01_h1-01 u02-02 vgora01_h1 0 142252800 0 c2t2d1 ENA
sd vgora01_h2-01 u02-02 vgora01_h2 0 142252800 142252800 c2t2d2 ENA
sd vgora01_h3-01 u02-02 vgora01_h3 0 142252800 284505600 c2t2d3 ENA
sd vgora01_h4-01 u02-02 vgora01_h4 0 40454400 426758400 c2t2d4 ENA

v u03 – ENABLED ACTIVE 138412032 SELECT – fsgen
pl u03-01 u03 ENABLED ACTIVE 138415360 CONCAT – RW
sd vgora01_05-02 u03-01 vgora01_05 138415360 138415360 0 c2t0d4 ENA
pl u03-02 u03 ENABLED ACTIVE 138412800 CONCAT – RW
sd vgora01_h5-01 u03-02 vgora01_h5 0 138412800 0 c2t2d5 ENA

v u04 – ENABLED ACTIVE 173015040 SELECT – fsgen
pl u04-01 u04 ENABLED ACTIVE 173016320 CONCAT – RW
sd vgora01_01-02 u04-01 vgora01_01 138415360 138415360 0 c2t0d0 ENA
sd vgora0105-01 u04-01 vgora0105 0 34600960 138415360 c2t0d11 ENA
pl u04-02 u04 ENABLED ACTIVE 173015040 CONCAT – RW
sd vgora01_h4-02 u04-02 vgora01_h4 40454400 30762240 0 c2t2d4 ENA
sd vgora01_h6-01 u04-02 vgora01_h6 0 142252800 30762240 c2t2d6 ENA

v u05 – ENABLED ACTIVE 152043520 SELECT – fsgen
pl u05-01 u05 ENABLED ACTIVE 152044032 CONCAT – RW
sd vgora01_02-01 u05-01 vgora01_02 0 117443072 0 c2t0d1 ENA
sd vgora0105-02 u05-01 vgora0105 34600960 34600960 117443072 c2t0d11 ENA
pl u05-02 u05 ENABLED ACTIVE 152044800 CONCAT – RW
sd vgora01_h4-03 u05-02 vgora01_h4 71216640 9792000 0 c2t2d4 ENA
sd vgora01_h7-01 u05-02 vgora01_h7 0 142252800 9792000 c2t2d7 ENA

Once all the mirroring is complete use the following command to break plex from
EMC drive (Be very careful while breaking the mirror)
In our case we are breaking u01-01, u02-01, u03-01, u04-01 and u05-01

Disassociate plex

#vxplex -g vgora01 dis u01-01
#vxplex -g vgora01 dis u02-01
#vxplex -g vgora01 dis u03-01
#vxplex -g vgora01 dis u04-01
#vxplex -g vgora01 dis u05-01

See the dissociated plexes

# vxprint -hrt
dg vgora01 default default 102000 1090932623.1376.
dm vgora01_h0 c2t2d0s2 sliced 7423 142252800 –
dm vgora01_h1 c2t2d1s2 sliced 7423 142252800 –
dm vgora01_h2 c2t2d2s2 sliced 7423 142252800 –
dm vgora01_h3 c2t2d3s2 sliced 7423 142252800 –
dm vgora01_h4 c2t2d4s2 sliced 7423 142252800 –
dm vgora01_h5 c2t2d5s2 sliced 7423 142252800 –
dm vgora01_01 c2t0d0s2 sliced 8447 279341824 –
dm vgora01_02 c2t0d1s2 sliced 8447 279341824 –
dm vgora01_03 c2t0d2s2 sliced 8447 279341824 –
dm vgora01_04 c2t0d3s2 sliced 8447 279341824 –
dm vgora01_05 c2t0d4s2 sliced 8447 279341824 –

pl u01-01 – DISABLED – 138415360 CONCAT – RW
sd vgora01_06-01 u01-01 vgora01_06 0 96470784 0 c2t0d5 ENA
sd vgora01_05-04 u01-01 vgora01_05 96470784 41944576 96470784 c2t0d4 ENA

pl u02-01 – DISABLED – 467210240 CONCAT – RW
sd vgora01_01-01 u02-01 vgora01_01 0 138415360 0 c2t0d0 ENA
sd vgora01_03-03 u02-01 vgora01_03 54526208 83889152 138415360 c2t0d2 ENA
sd vgora01_01-03 u02-01 vgora01_01 276830720 2511104 222304512 c2t0d0 ENA
sd vgora01_02-03 u02-01 vgora01_02 276830720 2511104 224815616 c2t0d1 ENA
sd vgora01_03-04 u02-01 vgora01_03 276830720 2511104 227326720 c2t0d2 ENA
sd vgora01_04-03 u02-01 vgora01_04 276830720 2511104 229837824 c2t0d3 ENA
sd vgora01_05-03 u02-01 vgora01_05 276830720 2511104 232348928 c2t0d4 ENA
sd vgora01_06-03 u02-01 vgora01_06 276830720 2511104 234860032 c2t0d5 ENA
sd vgora01_04-04 u02-01 vgora01_04 117443072 20972288 237371136 c2t0d3 ENA
sd vgora01_04-05 u02-01 vgora01_04 255858432 16776960 258343424 c2t0d3 ENA
sd vgora01_06-07 u02-01 vgora01_06 245370112 31460608 275120384 c2t0d5 ENA
sd vgora01_02-04 u02-01 vgora01_02 117443072 20967936 306580992 c2t0d1 ENA
sd vgora0100-01 u02-01 vgora0100 0 139661312 327548928 c2t0d6 ENA

pl u03-01 – DISABLED – 138415360 CONCAT – RW
sd vgora01_05-02 u03-01 vgora01_05 138415360 138415360 0 c2t0d4 ENA

pl u04-01 – DISABLED – 173016320 CONCAT – RW
sd vgora01_01-02 u04-01 vgora01_01 138415360 138415360 0 c2t0d0 ENA
sd vgora0105-01 u04-01 vgora0105 0 34600960 138415360 c2t0d11 ENA

pl u05-01 – DISABLED – 152044032 CONCAT – RW
sd vgora01_02-01 u05-01 vgora01_02 0 117443072 0 c2t0d1 ENA
sd vgora0105-02 u05-01 vgora0105 34600960 34600960 117443072 c2t0d11 ENA

v u01 – ENABLED ACTIVE 138412032 SELECT – fsgen
pl u01-02 u01 ENABLED ACTIVE 138412800 CONCAT – RW
sd vgora01_h0-01 u01-02 vgora01_h0 0 138412800 0 c2t2d0 ENA

v u02 – ENABLED ACTIVE 467210240 SELECT – fsgen
pl u02-02 u02 ENABLED ACTIVE 467212800 CONCAT – RW
sd vgora01_h1-01 u02-02 vgora01_h1 0 142252800 0 c2t2d1 ENA
sd vgora01_h2-01 u02-02 vgora01_h2 0 142252800 142252800 c2t2d2 ENA
sd vgora01_h3-01 u02-02 vgora01_h3 0 142252800 284505600 c2t2d3 ENA
sd vgora01_h4-01 u02-02 vgora01_h4 0 40454400 426758400 c2t2d4 ENA

v u03 – ENABLED ACTIVE 138412032 SELECT – fsgen
pl u03-02 u03 ENABLED ACTIVE 138412800 CONCAT – RW
sd vgora01_h5-01 u03-02 vgora01_h5 0 138412800 0 c2t2d5 ENA

v u04 – ENABLED ACTIVE 173015040 SELECT – fsgen
pl u04-02 u04 ENABLED ACTIVE 173015040 CONCAT – RW
sd vgora01_h4-02 u04-02 vgora01_h4 40454400 30762240 0 c2t2d4 ENA
sd vgora01_h6-01 u04-02 vgora01_h6 0 142252800 30762240 c2t2d6 ENA

v u05 – ENABLED ACTIVE 152043520 SELECT – fsgen
pl u05-02 u05 ENABLED ACTIVE 152044800 CONCAT – RW
sd vgora01_h4-03 u05-02 vgora01_h4 71216640 9792000 0 c2t2d4 ENA
sd vgora01_h7-01 u05-02 vgora01_h7 0 142252800 9792000 c2t2d7 ENA

Remove plex

#vxedit -g vgora01 -rf rm u01-01
#vxedit -g vgora01 -rf rm u02-01
#vxedit -g vgora01 -rf rm u03-01
#vxedit -g vgora01 -rf rm u04-01
#vxedit -g vgora01 -rf rm u05-01

Remove drives from Veritas Control

#vxdg -g vgora01 rmdisk vgora01_01
#vxdg -g vgora01 rmdisk vgora01_02
#vxdg -g vgora01 rmdisk vgora01_03
#vxdg -g vgora01 rmdisk vgora01_04
#vxdg -g vgora01 rmdisk vgora01_05

Verify disks after its out of Veritas Control

#vxdisk list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 sliced rootdisk rootdg online
c1t1d0s2 sliced rootmirror rootdg online
c2t0d1s2 sliced – – online
c2t0d2s2 sliced – – online
c2t0d3s2 sliced – – online
c2t0d4s2 sliced – – online
c2t0d5s2 sliced – – online
c2t2d0s2 sliced vgora01_h0 vgora01 online
c2t2d1s2 sliced vgora01_h1 vgora01 online
c2t2d2s2 sliced vgora01_h2 vgora01 online
c2t2d3s2 sliced vgora01_h3 vgora01 online
c2t2d4s2 sliced vgora01_h4 vgora01 online
c2t2d5s2 sliced vgora01_h5 vgora01 online

Remove EMC drives completely from the Operating System

#vxdisk rm c2t0d0s2
#vxdisk rm c2t0d1s2
#vxdisk rm c2t0d2s2
#vxdisk rm c2t0d3s2
#vxdisk rm c2t0d4s2

#vxdisk list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 sliced rootdisk rootdg online
c1t1d0s2 sliced rootmirror rootdg online
c2t2d0s2 sliced vgora01_h0 vgora01 online
c2t2d1s2 sliced vgora01_h1 vgora01 online
c2t2d2s2 sliced vgora01_h2 vgora01 online
c2t2d3s2 sliced vgora01_h3 vgora01 online
c2t2d4s2 sliced vgora01_h4 vgora01 online
c2t2d5s2 sliced vgora01_h5 vgora01 online

No comments:

Post a Comment