Very Computer

> I have:

> V880, Solaris 8 2/02 u7, Kernelpatch 117350-06 (August 2004)
> Veritas VxVM 3.2 with latest patch (3.2t_p5.3:14-Jan-2004).

> I got a new Partnergroup of StorEdge 6120 (T4) and a 2 Gb FC PCI Dual
> Channel Network 2Gb Fibrechannel controller (SG-XPCI2FC-QF2 375-3108). I
> installed the controller, SUNWsan, SUNWcfpl and SUNWcfplx, plus all
> required patches stated in the  FC Adapter Release Notes. So i have each
> tray of my storage attached to one controller on the host, as usual.

> I applied the latest firmware (3.1.2) to the 6120 RAID and cabled the
> loop properly to PG configuration, enabled mp_support=rw and created two
> volumes on each tray. These four volumes are visible through both FC
> controllers in the output of format on my host:

>     17. c7t2d0 <SUN-T4-0301 cyl 53246 alt 2 hd 40 sec 128>
>           /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,0
>       18. c7t2d1 <SUN-T4-0301 cyl 43180 alt 2 hd 80 sec 128>
>           /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,1
>       19. c7t2d2 <SUN-T4-0301 cyl 61438 alt 2 hd 40 sec 128>
>           /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,2
>       20. c7t2d3 <SUN-T4-0301 cyl 39084 alt 2 hd 80 sec 128>
>           /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,3
>       21. c8t1d0 <SUN-T4-0301 cyl 53246 alt 2 hd 40 sec 128>
>           /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,0
>       22. c8t1d1 <SUN-T4-0301 cyl 43180 alt 2 hd 80 sec 128>
>           /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,1
>       23. c8t1d2 <SUN-T4-0301 cyl 61438 alt 2 hd 40 sec 128>
>           /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,2
>       24. c8t1d3 <SUN-T4-0301 cyl 39084 alt 2 hd 80 sec 128>
>           /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,3

> So far, everything looks fine.

> Then I configured all devices/volumes on c7t2dX as VxVM disks (see
> below), in order to have DMP (dynamic multipathing) enabled (i.e
> configuring c8t1dX as the alternate path). But I never got VxVM to talk
> to these Volumes through both FC channels. vxdisk list on each of these
> volumes says 'numpaths:   1'

> On the same host I have an old T3A Partnergroup (Firmware 1.1803)
> attached, with two Volumes managed also by VxVM, and multipathing was
> enabled automatically, as soon as the param mp_support on the
> RAID-Controller was set to rw. Below is a comparison of the DMP
> pertinent information of VxVM, first for the correctly working  T3A,
> then for the failing dmp on the 6120(T4).

> I have two observations:

> - vxdisk list doesn't show the working alternate controller c5tXdX for
> the T3A PG, but it does show the second path c8tXdX to the T4 volumes,
> which doesn't work as alternate path.

> - The enclosure type of T4 is only recognized as OTHER_DISKS in
> vxdmpadm, whereas all T3s are recognized correctly as enclosure type T3.

> Help is greatly appreciated, as I need to get this working ASAP!

> TIA
> Paul

> ==============================
> VxVM Disk info
> ==============================

> [root@aleph2 adm]# vxdisk list
> DEVICE       TYPE      DISK         GROUP        STATUS
> c1t0d0s2     sliced    -            -            error
> c1t1d0s2     sliced    -            -            error
> c1t2d0s2     sliced    -            -            error
> c1t3d0s2     sliced    -            -            error
> c1t4d0s2     sliced    -            -            error
> c1t5d0s2     sliced    -            -            error
> c1t8d0s2     sliced    -            -            error
> c1t9d0s2     sliced    -            -            error
> c1t10d0s2    sliced    -            -            error
> c1t11d0s2    sliced    -            -            error
> c1t12d0s2    sliced    reserve1     rootdg       online
> c1t13d0s2    sliced    reserve2     rootdg       online
> c2t1d0s2     sliced    t3dg01       t3dg         online
> c4t2d0s2     sliced    t300-1       t3pgdg       online
> c4t2d1s2     sliced    t300-2       t3pgdg       online
> c7t2d0s2     sliced    t4dg01       t4dg         online
> c7t2d1s2     sliced    t4dg02       t4dg         online
> c7t2d2s2     sliced    t4dg03       t4dg         online
> c7t2d3s2     sliced    t4dg04       t4dg         online
> c8t1d0s2     sliced    -            -            online
> c8t1d1s2     sliced    -            -            online
> c8t1d2s2     sliced    -            -            online
> c8t1d3s2     sliced    -            -            online

> [root@aleph2 /root]# vxprint -Aht

> [...]

> Disk group: t3pgdg

> DG NAME         NCONFIG      NLOG     MINORS   GROUP-ID
> DM NAME         DEVICE       TYPE     PRIVLEN  PUBLEN   STATE
> RV NAME         RLINK_CNT    KSTATE   STATE    PRIMARY  DATAVOLS  SRL
> RL NAME         RVG          KSTATE   STATE    REM_HOST REM_DG    REM_RLNK
> V  NAME         RVG          KSTATE   STATE    LENGTH   READPOL PREFPLEX
> UTYPE
> PL NAME         VOLUME       KSTATE   STATE    LENGTH   LAYOUT NCOL/WID
> MODE
> SD NAME         PLEX         DISK     DISKOFFS LENGTH   [COL/]OFF DEVICE
>   MODE
> SV NAME         PLEX         VOLNAME  NVOLLAYR LENGTH   [COL/]OFF AM/NM
>    MODE
> DC NAME         PARENTVOL    LOGVOL
> SP NAME         SNAPVOL      DCO

> dg t3pgdg       default      default  0        992004501.1025.aleph2

> dm t300-1       c4t2d0s2     sliced   7167     244737024 -
> dm t300-2       c4t2d1s2     sliced   7167     244744192 -

> v  aleph        -            ENABLED  ACTIVE   186009600 SELECT   -    
> fsgen
> pl aleph-01     aleph        ENABLED  ACTIVE   186009600 CONCAT   -    RW
> sd t300-2-04    aleph-01     t300-2   58734592 186009600 0        c4t2d1
>   ENA

> v  aleph1       -            ENABLED  ACTIVE   209715200 SELECT   -    
> fsgen
> pl aleph1-01    aleph1       ENABLED  ACTIVE   209721344 CONCAT   -    RW
> sd t300-1-02    aleph1-01    t300-1   8393728  209721344 0        c4t2d0
>   ENA

> v  archive      -            ENABLED  ACTIVE   41943040 SELECT    -    
> fsgen
> pl archive-01   archive      ENABLED  ACTIVE   41947136 CONCAT    -    RW
> sd t300-2-02    archive-01   t300-2   8393728  41947136 0         c4t2d1
>   ENA

> v  redo3        -            ENABLED  ACTIVE   3072000  SELECT    -    
> fsgen
> pl redo3-01     redo3        ENABLED  ACTIVE   3075072  CONCAT    -    RW
> sd t300-2-03    redo3-01     t300-2   50340864 3075072  0         c4t2d1
>   ENA

> v  swap         -            ENABLED  ACTIVE   8388608  SELECT    -    
> fsgen
> pl swap-01      swap         ENABLED  ACTIVE   8393728  CONCAT    -    RW
> sd t300-1-01    swap-01      t300-1   0        8393728  0         c4t2d0
>   ENA

> v  swap1        -            ENABLED  ACTIVE   8388608  SELECT    -    
> fsgen
> pl swap1-01     swap1        ENABLED  ACTIVE   8393728  CONCAT    -    RW
> sd t300-2-01    swap1-01     t300-2   0        8393728  0         c4t2d1
>   ENA

> v  usr_local    -            ENABLED  ACTIVE   20971520 SELECT    -    
> fsgen
> pl usr_local-01 usr_local    ENABLED  ACTIVE   20973568 CONCAT    -    RW
> sd t300-1-03    usr_local-01 t300-1   218115072 20973568 0        c4t2d0
>   ENA

> Disk group: t4dg

> DG NAME         NCONFIG      NLOG     MINORS   GROUP-ID
> DM NAME         DEVICE       TYPE     PRIVLEN  PUBLEN   STATE
> RV NAME         RLINK_CNT    KSTATE   STATE    PRIMARY  DATAVOLS  SRL
> RL NAME         RVG          KSTATE   STATE    REM_HOST REM_DG    REM_RLNK
> V  NAME         RVG          KSTATE   STATE    LENGTH   READPOL PREFPLEX
> UTYPE
> PL NAME         VOLUME       KSTATE   STATE    LENGTH   LAYOUT NCOL/WID
> MODE
> SD NAME         PLEX         DISK     DISKOFFS LENGTH   [COL/]OFF DEVICE
>   MODE
> SV NAME         PLEX         VOLNAME  NVOLLAYR LENGTH   [COL/]OFF AM/NM
>    MODE
> DC NAME         PARENTVOL    LOGVOL
> SP NAME         SNAPVOL      DCO

> dg t4dg         default      default  124000   1096470388.1783.aleph3

> dm t4dg01       c7t2d0s2     sliced   5119     272609280 -
> dm t4dg02       c7t2d1s2     sliced   10239    442142720 -
> dm t4dg03       c7t2d2s2     sliced   5119     314552320 -
> dm t4dg04       c7t2d3s2     sliced   10239    400199680 -

> v  aleph1       -            ENABLED  ACTIVE   272609280 SELECT   -    
> fsgen
> pl aleph1-01    aleph1       ENABLED  ACTIVE   272609280 CONCAT   -    RW
> sd t4dg01-01    aleph1-01    t4dg01   0        272609280 0        c7t2d0
>   ENA

> v  exlibris     -            ENABLED  ACTIVE   400199680 SELECT   -    
> fsgen
> pl exlibris-01  exlibris     ENABLED  ACTIVE   400199680 CONCAT   -    RW
> sd t4dg04-01    exlibris-01  t4dg04   0        400199680 0        c7t2d3
>   ENA

> v  exlibris1    -            ENABLED  ACTIVE   314552320 SELECT   -    
> fsgen
> pl exlibris1-01 exlibris1    ENABLED  ACTIVE   314552320 CONCAT   -    RW
> sd t4dg03-01    exlibris1-01 t4dg03   0        314552320 0        c7t2d2
>   ENA

> v  reserve      -            ENABLED  ACTIVE   442142720 SELECT   -    
> fsgen
> pl reserve-01   reserve      ENABLED  ACTIVE   442142720 CONCAT   -    RW
> sd t4dg02-01    reserve-01   t4dg02   0        442142720 0        c7t2d1
>   ENA

> =====================
> DMP Info T3 PG (Good)
> =====================

> [root@aleph2 /]# vxdisk list t300-1
> Device:    c4t2d0s2
> devicetag: c4t2d0
> type:      sliced
> hostid:    aleph3
> disk:      name=t300-1 id=1095429937.1621.aleph3
> group:     name=t3pgdg id=992004501.1025.aleph2
> flags:     online ready private autoconfig autoimport imported
> pubpaths:  block=/dev/vx/dmp/c4t2d0s4 char=/dev/vx/rdmp/c4t2d0s4
> privpaths: block=/dev/vx/dmp/c4t2d0s3 char=/dev/vx/rdmp/c4t2d0s3
> version:   2.2
> iosize:    min=512 (bytes) max=2048 (blocks)
> public:    slice=4 offset=0 len=244737024
> private:   slice=3 offset=1 len=7167
> update:    time=1096428634 seqno=0.13
> headers:   0 248
> configs:   count=1

> V880, Solaris 8 2/02 u7, Kernelpatch 117350-06 (August 2004)
> Veritas VxVM 3.2 with latest patch (3.2t_p5.3:14-Jan-2004).

>>I have:

>>V880, Solaris 8 2/02 u7, Kernelpatch 117350-06 (August 2004)
>>Veritas VxVM 3.2 with latest patch (3.2t_p5.3:14-Jan-2004).

> If I remember correctly you need VxVM 3.5 or 4.0 and VxVM array
> support library for 6120 (VxVM 4.0 might already have this builtin)
> to enable VxDMP. ASL is freely available at Sun website.

> Or you can always use MPXIO with VxVM 3.2.