Solaris - stripe at O/S or stripe at EMC?

Solaris - stripe at O/S or stripe at EMC?

Post by korik » Fri, 04 Jan 2002 23:10:15



I was hoping someone in the group could clarify a question that I had
about striping.

Would it be better to stripe at the storage level (EMC) or at the O/S
level (Solaris 2.6/2.8)?  The reason I ask is that if striping is done
at the EMC level, a single striped device (LUN) is presented to the
O/S.  If striping at the O/S, EMC will present multiple LUNs to the
O/S which will then be striped.  Are there any bottlenecks introduced
by not making the O/S aware of the actual devices that are being
striped across?  In other words, even though the single striped device
presented by EMC would be striped, do we lose any performance since it
a single I/O device being presented to the O/S?

Thanks for any information.
Haig

 
 
 

Solaris - stripe at O/S or stripe at EMC?

Post by Aleksandar Milivojevi » Fri, 04 Jan 2002 23:35:45



> Would it be better to stripe at the storage level (EMC) or at the O/S
> level (Solaris 2.6/2.8)?  The reason I ask is that if striping is done
> at the EMC level, a single striped device (LUN) is presented to the
> O/S.  If striping at the O/S, EMC will present multiple LUNs to the
> O/S which will then be striped.  Are there any bottlenecks introduced
> by not making the O/S aware of the actual devices that are being
> striped across?  In other words, even though the single striped device
> presented by EMC would be striped, do we lose any performance since it
> a single I/O device being presented to the O/S?

There's no point in doing software striping if you can do it in
hardware.  If you wanted softwer striping, why giving $$$$$$ for
something like EMC?  Do striping in hardware and use CPU cycles on
your servers for something more usefull.

--

Opinions expressed herein are my own.
Statements included here may be fiction rather than truth.

 
 
 

Solaris - stripe at O/S or stripe at EMC?

Post by -wisegu » Sat, 05 Jan 2002 01:37:36




Quote:> I was hoping someone in the group could clarify a question that I had
> about striping.

> Would it be better to stripe at the storage level (EMC) or at the O/S
> level (Solaris 2.6/2.8)?  The reason I ask is that if striping is done
> at the EMC level, a single striped device (LUN) is presented to the
> O/S.  If striping at the O/S, EMC will present multiple LUNs to the
> O/S which will then be striped.  Are there any bottlenecks introduced
> by not making the O/S aware of the actual devices that are being
> striped across?  In other words, even though the single striped device
> presented by EMC would be striped, do we lose any performance since it
> a single I/O device being presented to the O/S?

> Thanks for any information.
> Haig

I could tell you the answer but then you wouldn't learn as much.  Test both
scenarios (using raw disk i/O since the filesystem caching would skew the
results).

--
-wiseguy
slummin it in Colorado ski country, while watching the IT industry move
to India, and thinking about retraining as a Sanitation Engineer

-----= Posted via Newsfeeds.Com, Uncensored Usenet News =-----
http://www.newsfeeds.com - The #1 Newsgroup Service in the World!
-----==  Over 80,000 Newsgroups - 16 Different Servers! =-----

 
 
 

Solaris - stripe at O/S or stripe at EMC?

Post by korik » Sat, 05 Jan 2002 06:53:24



> I could tell you the answer but then you wouldn't learn as much.  Test both
> scenarios (using raw disk i/O since the filesystem caching would skew the
> results).

> --
> -wiseguy
> slummin it in Colorado ski country, while watching the IT industry move
> to India, and thinking about retraining as a Sanitation Engineer

> -----= Posted via Newsfeeds.Com, Uncensored Usenet News =-----
> http://www.newsfeeds.com - The #1 Newsgroup Service in the World!
> -----==  Over 80,000 Newsgroups - 16 Different Servers! =-----

Well, we did some tests and were a little surprised by the results.
It turned out that using 36G LUNs striped across 8 disks ended up
being slower than striping with VxFS.  We're trying to figure this
out, and while we are digging around on our side, I thought I'd post
to the group.
 
 
 

Solaris - stripe at O/S or stripe at EMC?

Post by Darren Dunha » Sat, 05 Jan 2002 07:03:42




>> Would it be better to stripe at the storage level (EMC) or at the O/S
>> level (Solaris 2.6/2.8)?  The reason I ask is that if striping is done
>> at the EMC level, a single striped device (LUN) is presented to the
>> O/S.  If striping at the O/S, EMC will present multiple LUNs to the
>> O/S which will then be striped.  Are there any bottlenecks introduced
>> by not making the O/S aware of the actual devices that are being
>> striped across?  In other words, even though the single striped device
>> presented by EMC would be striped, do we lose any performance since it
>> a single I/O device being presented to the O/S?
> There's no point in doing software striping if you can do it in
> hardware.  If you wanted softwer striping, why giving $$$$$$ for
> something like EMC?  Do striping in hardware and use CPU cycles on
> your servers for something more usefull.

Depends on lots of things.  For instance, if you're using SCSI, you
could saturate a channel.  If you stripe at the OS level across the
channels, then you get an I/O win.

Even with faster channels like FC-AL and Fabric FC, you might still get
a boost.

The OS has to do all the work to figure out which disk gets the I/O.  It
is not likely to be much more work to do a stripe.

Some configurations of EMC may limit your future flexibility.  Can you
change the stripe size later without taking your data offline?

--

Unix System Administrator                    Taos - The SysAdmin Company
Got some Dr Pepper?                           San Francisco, CA bay area
          < How are you gentlemen!! Take off every '.SIG'!! >

 
 
 

Solaris - stripe at O/S or stripe at EMC?

Post by Joe Blogg » Sat, 05 Jan 2002 07:07:58


Quote:> Well, we did some tests and were a little surprised by the results.
> It turned out that using 36G LUNs striped across 8 disks ended up
> being slower than striping with VxFS.  We're trying to figure this
> out, and while we are digging around on our side, I thought I'd post
> to the group.

Strange.  Did the 36G LUNs striped across 8 disks also use VxFS, or plain
old UFS?
 
 
 

Solaris - stripe at O/S or stripe at EMC?

Post by Aleksandar Milivojevi » Sat, 05 Jan 2002 19:58:19



> Well, we did some tests and were a little surprised by the results.
> It turned out that using 36G LUNs striped across 8 disks ended up
> being slower than striping with VxFS.  We're trying to figure this
> out, and while we are digging around on our side, I thought I'd post
> to the group.

Striping with VxFS?  Or you ment VxVM?  VxFS is just a file system,
VxVM is volume manager (the one that should do the striping thing).

If you have license for VxFS, did you used VxFS for testing both
software (on server side) and hardware (on EMC side) striping?  If you
didn't, difference in speed is probably result of different file
system overhead for UFS and VxFS.

--

Opinions expressed herein are my own.
Statements included here may be fiction rather than truth.

 
 
 

1. Veritas striped-mirror (Striped Pro) question

Ok,

I am trying to create a striped-mirror here on an A5200 array with 22 16.9g
drives in it.  I have never used a striped-mirror before so I want to make
sure I get it right the first time (hence this email).  I used the first two
disks on each controller (one as the root disk the other as the root mirror)
and the next 9 disks on each controller I want in a raid 1+0 config (the
last disk on each controller being a hotspare).  I want this to be one large
partition to store a database on (152gb).  I will be using standard DRL
(writes are not always sequential so I want to avoid any IO hosing such as
that you can get with drlseq.  I would like to mirror it like this:

c0t17--c0t18--c0t19...c0t25--c0t26 - controller one (c0)
    |           |           |           |           |
   m         m         m         m         mirrors to
    |           |           |           |           |
c2t01--c2t02--c2t03...c2t08--c2t09 - controller two (c2)

Would the following command be correct to create it with DRL enabled and
mirror it in the fashion i stated above?

vxassist -o ordered -g vsnt01 make vsnt 152g layout=striped-mirror
logtype=drl nmirror=2 ncol=9 c0t17 c0t18...c0t26 c2t01 c2t02...c2t09

(where vsnt01 is the diskgroup name and vsnt is the partition i want to lay
out)

also, do you guys have any preferences on the stripewidth or will the
default do fine for an array this size?  Any other recommendations would be
appreciated.  Thanks.

Michael J. Ayers

-----=  Posted via Newsfeeds.Com, Uncensored Usenet News  =-----
http://www.newsfeeds.com - The #1 Newsgroup Service in the World!
 Check out our new Unlimited Server. No Download or Time Limits!
-----==  Over 80,000 Newsgroups - 19 Different Servers!  ==-----

2. DHCP/firewall/router Setup, but not Telnet

3. Stripe'ing Oracle Filesystem on EMC disks

4. About Linux flavor?

5. Solaris Volume Manager striping performance

6. Miscellaneous UML bug fixes

7. Resizing Stripe-Pro Volumes (Solaris 8 & VxVm 3.1)

8. HELP! Unixware 2.1 doesn't see my CD-ROM drive

9. Promise 378 SATA Raid controller stripe configuration MBFastTrack78

10. Stripe width/size/chunk size etc

11. Using the concatentation/striping driver (cd.c)

12. idiots guide to striping?

13. LVM Question: Mirrored Stripes?