Replacing a drive that is multipathed on two Sun Fire 6800's with A500 arrays.

Replacing a drive that is multipathed on two Sun Fire 6800's with A500 arrays.

Post by Brewsk » Fri, 04 Jul 2003 03:52:36



We would like to know the recommended procedure to replace a failed and/or
failing drive on 2 - 6800's with two multi-pathed A5000's. We have
experienced multiple devices when doing a "vxdctl enable", thus not being
able to import the drive back into Veritas control - Unless we reboot the
servers with a"boot -r" (last resort). If the drive is dead and/or
failing.....

Does luxadm remove_device & insert device need to be run on both servers
simultaneouly?
Thanks.

 
 
 

Replacing a drive that is multipathed on two Sun Fire 6800's with A500 arrays.

Post by Anthony Mandi » Fri, 04 Jul 2003 19:42:06



> > We would like to know the recommended procedure to replace a failed and/or
> > failing drive on 2 - 6800's with two multi-pathed A5000's.

> Near as I can remember, there's two parts:

> 1) disable the disk in Veritas
> 2) luxadm remove_device

        Try remembering a little harder, Rolfie. The A5000 is FCAL. FCAL
        disks have unique WWNs so you need to also run devfsadm (or disks
        on older version of Solaris) for the OS to "see" the replaced drives.

-am     ? 2003

 
 
 

Replacing a drive that is multipathed on two Sun Fire 6800's with A500 arrays.

Post by Mr. Johan Andersso » Fri, 04 Jul 2003 20:13:55



> We would like to know the recommended procedure to replace a failed and/or
> failing drive on 2 - 6800's with two multi-pathed A5000's. We have
> experienced multiple devices when doing a "vxdctl enable", thus not being
> able to import the drive back into Veritas control - Unless we reboot the
> servers with a"boot -r" (last resort). If the drive is dead and/or
> failing.....

> Does luxadm remove_device & insert device need to be run on both servers
> simultaneouly?
> Thanks.

Yes, if its to work properly, you should do it simultaneosly in that the
luxadm command will update paths and inof for a5000.

However, it can be done out of sync, but its just better to fix both at
once, normally no downtime is needed for this, i.e. everuthing is mirrored
or raid5.

Main question is, why do they share A5000?
If it is  a cluster, procedures shoudl be written for this at site.
If not, I assume the two 6800 are mirroring their separate data, normally
I would have used the A5000 in split mode and made the systems just see
their disks, but perhaps this is not possible?

Otherwise...

1) disable disk from veritas use on both hosts.
2) start luxadm remove_device on both hosts
3) remove the disk
4) finish remove on both hosts
5) luxadm insert_device on both hosts
6) insert a new disk
7) finish insert on both hosts
8) vxdctl enable on both host

When I say on both hosts, it doesnt mean exaclty the same time, because
that will just confuse the A5000, in each step...

A) do host A, wait until it finishes,
B) do host B, wait until it finishes,
C) continue to next step.

Works for me.

If the disk is faulty in that it doesnt answer, you might have some
problems, but I wont go in to the resolution if thoose problems here.

/Johan A

 
 
 

Replacing a drive that is multipathed on two Sun Fire 6800's with A500 arrays.

Post by Mr. Johan Andersso » Fri, 04 Jul 2003 20:15:51


On Wed, 2 Jul 2003, it was written:

<snip snip>

Quote:> I haven't seen this in a dual-attached system where I assume you're
> using a filesystem that supports simultaneous access, i.e. something
> other than UFS which won't all both systems to mount the volume at the
> same time.

He just said he had them dual-attached, didnt even mention cluster.

Quote:> I'd disable the disk in Veritas in both systems.  Since you're attached
> to the A5000 on both systems, I guess when you remove_device on one, the
> other would figure it out.

Nope, it wont, has to be doen on both nodes.

Quote:> Why haven't you run this by Sun?  It's really a support-contract kinda
> thing.  If you running this sort of configuration without a contract,
> your PHB is out of their mind and they deserve all the downtime that's
> coming to them...

That he shoudl indeed.

/Johan A

 
 
 

Replacing a drive that is multipathed on two Sun Fire 6800's with A500 arrays.

Post by Mr. Johan Andersso » Fri, 04 Jul 2003 20:27:15




> > > We would like to know the recommended procedure to replace a failed and/or
> > > failing drive on 2 - 6800's with two multi-pathed A5000's.

> > Near as I can remember, there's two parts:

> > 1) disable the disk in Veritas
> > 2) luxadm remove_device

>    Try remembering a little harder, Rolfie. The A5000 is FCAL. FCAL
>    disks have unique WWNs so you need to also run devfsadm (or disks
>    on older version of Solaris) for the OS to "see" the replaced drives.

Luxadm handles the devfsadm/disks when you use remove/insert
At least its supposed to, it removes the device as part of remove_device
and builds the new ones as part of the insert_device.

/Johan A

 
 
 

1. Sun Fire 6800

Hi all,

This is something new for me.

My company just ordered a brand new Sun Fire 6800. My admins told me to
study about domains?? as I am going to shift to a bit higher level team
to manage Mid range and High end servers.

Any idea what domains are for??

Also someone asked me that if a server has 3 domains and if 1 domain
fails then how the other domain takes over??Is this somewhat related
DNS??

I am having an interview next week from internal tech team and it would
be like a dream coming true....by joining the team.

Also tell me, what typical question one can ask on Sun hardware like
that Sun Fire 6800.

Many thanks for help in advance.

-Vin.

2. Crontab problem

3. Sun Fire 6800 temperature sensors

4. Qt Programming in SunOS

5. Toggle between Sun Fire 6800 domains - Question.

6. END GAME: Dirksen 106

7. Sunfire 6800 - Fan's rotation speed...

8. How to add my targets to the kernels' Makefiles

9. replacing E4000 with a Sun Fire 480

10. Sun Fire V210 and A1000 Storage Array

11. I need a decent full tower case with 9+ slots to replace inwin A500

12. Serial ports 'stuck' on a Sun Fire 280

13. How to replace a disk in Sun A5000 Disk Array