Creating 2 TB volumes and 2 TB filesystems on HP-UX 11i

[Björn Lundström]

Hi,

We have a server running HP-UX 11i (23) on which we would like to create a 2
TB filesystem.

We are able to create a volume of 2 TB, but we are not able to create a 2 TB
filesystem.

Is there something that we are doing wrong or is it just not possible ?

///Björn

[Trond Eirik Aune]

Post by Björn Lundström
Hi,
We have a server running HP-UX 11i (23) on which we would like to create a 2
TB filesystem.
We are able to create a volume of 2 TB, but we are not able to create a 2 TB
filesystem.
Is there something that we are doing wrong or is it just not possible ?
///Björn

What kind of file system are you trying to make and what is the error
msg you recive. What is the excact command line you use to make the file
system with?

[Alan D]

Post by Trond Eirik Aune

Post by Björn Lundström
Hi,
We have a server running HP-UX 11i (23) on which we would like to create a 2
TB filesystem.
We are able to create a volume of 2 TB, but we are not able to create a 2 TB
filesystem.
Is there something that we are doing wrong or is it just not possible ?
///Björn

What kind of file system are you trying to make and what is the error
msg you recive. What is the excact command line you use to make the file
system with?

make sure you have JFS 3.3 w/ patches, I think there were issues w/
lvcreate.

[Paul Sure]

What were the

vgcreate
lvcreate
newfs

options you used?


Paul

[Björn Lundström]

Hi,

The following commands are used to create the volume(s) and filesystem ,
right now we are below 2 TB since we

we unable to create 2 TB filesystem. we are now using 2 x 1.5 TB
filesystems.

bash-2.05b# mkdir /dev/vg01

bash-2.05b# mknod /dev/vg01/group c 64 0x010000

bash-2.05b# pvcreate -f /dev/rdsk/c5t12d0

Physical volume "/dev/rdsk/c5t12d0" has been successfully created.

bash-2.05b# pvcreate -f /dev/rdsk/c5t12d1

Physical volume "/dev/rdsk/c5t12d1" has been successfully created.

bash-2.05b# vgcreate -e 30000 -s 256 vg01 /dev/dsk/c5t12d0 /dev/dsk/c5t12d1

Volume Group configuration for /dev/vg01 has been saved in
/etc/lvmconf/vg01.conf

bash-2.05b# lvcreate -L 1430272 /dev/vg01

Logical volume "/dev/vg01/lvol1" has been successfully created with

character device "/dev/vg01/rlvol1".

Logical volume "/dev/vg01/lvol1" has been successfully extended.

Volume Group configuration for /dev/vg01 has been saved in
/etc/lvmconf/vg01.conf

bash-2.05b# lvcreate -L 1430272 /dev/vg01

Logical volume "/dev/vg01/lvol2" has been successfully created with

character device "/dev/vg01/rlvol2".

Logical volume "/dev/vg01/lvol2" has been successfully extended.

Volume Group configuration for /dev/vg01 has been saved in
/etc/lvmconf/vg01.conf

bash-2.05b# newfs -F vxfs -o largefiles /dev/vg01/rlvol1

version 5 layout

1464598528 sectors, 1464598528 blocks of size 1024, log size 16384 blocks

unlimited inodes, largefiles supported

1464598528 data blocks, 1464213344 free data blocks

44696 allocation units of 32768 blocks, 32768 data blocks

bash-2.05b# newfs -F vxfs -o largefiles /dev/vg01/rlvol2

version 5 layout

1464598528 sectors, 1464598528 blocks of size 1024, log size 16384 blocks

unlimited inodes, largefiles supported

1464598528 data blocks, 1464213344 free data blocks

44696 allocation units of 32768 blocks, 32768 data blocks





The following warnings are received at boot time:

LVM Warning: Logical volume exceeds 2 terabytes. I/O requests beyond this
limit will fail.

LVM Warning: Logical volume exceeds 2 terabytes. I/O requests beyond this
limit EFI version 1.10 [14.61]

EFI64 Running on Intel(R) Itanium Processor Family

EFI 1.10 IPF zx6000/rx2600/zx2000 1.22 [Wed Aug 20 12:33:11 2003] - HP

Any ideas ?

///Björn

Post by Paul Sure
What were the
vgcreate
lvcreate
newfs
options you used?
Paul

[Paul Sure]

Post by Björn Lundström
LVM Warning: Logical volume exceeds 2 terabytes. I/O requests beyond this
limit will fail.
LVM Warning: Logical volume exceeds 2 terabytes. I/O requests beyond this
limit EFI version 1.10 [14.61]
EFI64 Running on Intel(R) Itanium Processor Family
EFI 1.10 IPF zx6000/rx2600/zx2000 1.22 [Wed Aug 20 12:33:11 2003] - HP
Any ideas ?

I didn't look at it yet but what about the veritas stuff you can get for HP?

Those numbers are beyond my companies needs :). Once I configured an IBM ESS
with 6 Tb but that had a max lun size of 200 Gb. I could put those in 1
volume group but made the file systems never bigger as a lun to keep things
simple.

I have no idea why you would need a file system of 2 Tb. Now you made 2 of
1.5 Tb you could also make 2 volume groups to keep below the 2 Tb limit
since you have 2 disk devices. What kind of disk cabinet you have? I never
seen a cabinet supporting such large luns.

Most times performance is a issue too and you benefit from having multiple
luns that you can spread over multiple fiber/scsi paths.

what's HP opinion about your configuration? I guess they are a bit supprised
:)

Paul

[Björn Lundström]

We want only to use one LUN (or two) due to the fact that we are using this
device for as a backup device on the backup server.
We want as much flexibility as possible at the filesystem level, and hence
we want one
filesystem.

Data is primarily written to the backup disk and then copied to tape.
This way we are able to do most restores from disk, which is faster.
We are using Legato Networker 7.1.

The storage system we are using is a Nexsan Ataboy II, a cheap IDE based
RAID system,
we are only using one scsi card in the server towards the storage system.

To keep this a pretty high Performing, but very low cost solution.

Post by Paul Sure
I have no idea why you would need a file system of 2 Tb. Now you made 2 of
1.5 Tb you could also make 2 volume groups to keep below the 2 Tb limit
since you have 2 disk devices. What kind of disk cabinet you have? I never
seen a cabinet supporting such large luns.
Most times performance is a issue too and you benefit from having multiple
luns that you can spread over multiple fiber/scsi paths.
what's HP opinion about your configuration? I guess they are a bit supprised
:)
Paul

[Trond Eirik Aune]

Hi

Make sure you have the latest version of OnlineJFS/Veritas File system.
Default HP-UX ships with version 3.3 HP Product Number B3929CA and i am
not sure if HP has included the upgrade to 3.5. If not, just download
and install the 3.5 version.

http://docs.hp.com/cgi-bin/fsearch/framedisplay?top=/hpux/onlinedocs/5187-1878/5187-1878_top.html&con=/hpux/onlinedocs/5187-1878/00/00/1-con.html&toc=/hpux/onlinedocs/5187-1878/00/00/1-toc.html&searchterms=onlinejfs&queryid=20031218-030622


The maximum file size and file system size supported by the VERITAS File
System 3.5 (HP OnlineJFS/JFS 3.5) product on HP-UX 11i is 2TB.

I know version 3.3 supports max 1TB, but since you maanged to make 1.5TB
i assume you have a later version, but it might not be 3.5

You could try to make the filesystem 1.99TB just incase the limit is

2TB and not <=2TB

So, let us know what version you have.

,
TEA

[Alan D]

Post by Trond Eirik Aune
Hi
Make sure you have the latest version of OnlineJFS/Veritas File system.
Default HP-UX ships with version 3.3 HP Product Number B3929CA and i am
not sure if HP has included the upgrade to 3.5. If not, just download
and install the 3.5 version.
http://docs.hp.com/cgi-bin/fsearch/framedisplay?top=/hpux/onlinedocs/5187-1878/5187-1878_top.html&con=/hpux/onlinedocs/5187-1878/00/00/1-con.html&toc=/hpux/onlinedocs/5187-1878/00/00/1-toc.html&searchterms=onlinejfs&queryid=20031218-030622
The maximum file size and file system size supported by the VERITAS File
System 3.5 (HP OnlineJFS/JFS 3.5) product on HP-UX 11i is 2TB.
I know version 3.3 supports max 1TB, but since you maanged to make 1.5TB
i assume you have a later version, but it might not be 3.5
You could try to make the filesystem 1.99TB just incase the limit is

2TB and not <=2TB

So, let us know what version you have.
,
TEA

Trying to push the limits w/o even using the real stuff, gotta love it!

You should spend the extra $250 to buy an extra controller for the
system and daul path it to the array(s), amazing what you can do! you
dont need BIG lvols.

[Alan D]

Post by Björn Lundström
Hi,
The following commands are used to create the volume(s) and filesystem ,
right now we are below 2 TB since we
we unable to create 2 TB filesystem. we are now using 2 x 1.5 TB
filesystems.
bash-2.05b# mkdir /dev/vg01
bash-2.05b# mknod /dev/vg01/group c 64 0x010000
bash-2.05b# pvcreate -f /dev/rdsk/c5t12d0
Physical volume "/dev/rdsk/c5t12d0" has been successfully created.
bash-2.05b# pvcreate -f /dev/rdsk/c5t12d1
Physical volume "/dev/rdsk/c5t12d1" has been successfully created.
bash-2.05b# vgcreate -e 30000 -s 256 vg01 /dev/dsk/c5t12d0 /dev/dsk/c5t12d1
Volume Group configuration for /dev/vg01 has been saved in
/etc/lvmconf/vg01.conf
bash-2.05b# lvcreate -L 1430272 /dev/vg01
Logical volume "/dev/vg01/lvol1" has been successfully created with
character device "/dev/vg01/rlvol1".
Logical volume "/dev/vg01/lvol1" has been successfully extended.
Volume Group configuration for /dev/vg01 has been saved in
/etc/lvmconf/vg01.conf
bash-2.05b# lvcreate -L 1430272 /dev/vg01
Logical volume "/dev/vg01/lvol2" has been successfully created with
character device "/dev/vg01/rlvol2".
Logical volume "/dev/vg01/lvol2" has been successfully extended.
Volume Group configuration for /dev/vg01 has been saved in
/etc/lvmconf/vg01.conf
bash-2.05b# newfs -F vxfs -o largefiles /dev/vg01/rlvol1
version 5 layout
1464598528 sectors, 1464598528 blocks of size 1024, log size 16384 blocks
unlimited inodes, largefiles supported
1464598528 data blocks, 1464213344 free data blocks
44696 allocation units of 32768 blocks, 32768 data blocks
bash-2.05b# newfs -F vxfs -o largefiles /dev/vg01/rlvol2
version 5 layout
1464598528 sectors, 1464598528 blocks of size 1024, log size 16384 blocks
unlimited inodes, largefiles supported
1464598528 data blocks, 1464213344 free data blocks
44696 allocation units of 32768 blocks, 32768 data blocks
LVM Warning: Logical volume exceeds 2 terabytes. I/O requests beyond this
limit will fail.
LVM Warning: Logical volume exceeds 2 terabytes. I/O requests beyond this
limit EFI version 1.10 [14.61]
EFI64 Running on Intel(R) Itanium Processor Family
EFI 1.10 IPF zx6000/rx2600/zx2000 1.22 [Wed Aug 20 12:33:11 2003] - HP
Any ideas ?
///Björn

Post by Paul Sure
What were the
vgcreate
lvcreate
newfs
options you used?
Paul

Really silly question.... if U use Posix sh does it work??! hmmmm