2TB HDD x 4

Support for the other architectures (X86_64, IA-64, and PowerPC)
Post Reply
encoded_9
Posts: 3
Joined: 2007/12/17 15:02:07

2TB HDD x 4

Post by encoded_9 » 2010/02/26 08:01:20

Hi guys,

I bought a HP ProLiant ML115 G5 (NVIDIA NFP3400 / Athlon1640B / PC2-6400 unbuffered 1GB ECC / 160GB SATA HDD).
[url=http://tinyurl.com/5qgffy]HP ProLiant ML115 G5[/url]
[url=http://h50146.www5.hp.com/products/servers/proliant/ml115g5/qu.html]HP ProLiant ML115 G5 (Japanese)[/url]

I chose CentOS 5.4 x86_64 as the operating system for my machine.
I installed a 16GB of USB flash (Buffalo RMUM-16GH/BK) as boot drive, instead of using default 160GB HDD above.
[url=http://buffalo.jp/products/catalog/flash/rmum-h_bk/]Buffalo RMUM-16GH/BK (only in Japanese)[/url]
And I installed 4 of 2TB SATA HDD to SATA1 to SATA4 as big storage.
[url=http://www.hitachigst.com/portal/site/en/products/deskstar/7K2000/]Deskstar 7K2000[/url]
[url=http://www.hitachigst.com/portal/site/jp/products/deskstar/7K2000/]Deskstar 7K2000 (Japanese)[/url]

I chose only "base installation" for default without any of extra programs.
System installation was successfully finised, and the USB flash works well.
It is actually micro SD reader, though.

But I am in trouble with 4 of HDDs.

I planed to use those 4 of HDDs as 2 of LVMs.
Such as :
/dev/sdb1 + /dev/sdc1 = LogVol00 for /home
and
/dev/sdd1 + /dev/sde1 = LogVol01 for /home_backup

I expected those 2 LVMs will be mounted as 4TB for each.
But system recognized only as 1.9TB (nearly equal to 2TB) for each.

Does CentOS 5.4 x86_64 NOT recognise over 2TB ?

Here, I show you how they are mounted below.

[code][root@localhost ~]# df -ah
Filesystem Size Used Avail Use% Mounted on
/dev/sda1 14G 1.7G 12G 14% /
proc 0 0 0 - /proc
sysfs 0 0 0 - /sys
devpts 0 0 0 - /dev/pts
/dev/mapper/VolGroup00-LogVol00
2.0T 199M 1.9T 1% /home
/dev/mapper/VolGroup01-LogVol00
2.0T 199M 1.9T 1% /home_backup
tmpfs 502M 0 502M 0% /dev/shm
none 0 0 0 - /proc/sys/fs/binfmt_misc
sunrpc 0 0 0 - /var/lib/nfs/rpc_pipefs[/code]

I need tips, your help and advises.
Thanks in advance.

User avatar
jlehtone
Posts: 2383
Joined: 2007/12/11 08:17:33
Location: Finland

2TB HDD x 4

Post by jlehtone » 2010/02/26 09:52:31

Perhaps
[code]# pvdisplay
# vgdisplay -v[/code]
And what filesystems do you use?

encoded_9
Posts: 3
Joined: 2007/12/17 15:02:07

Re: 2TB HDD x 4

Post by encoded_9 » 2010/02/26 11:01:17

Hi jlehtone,

Thanks for replying. I am using ext3.
And here, I show you.
Here, for the first, the result from "# pvdisplay".

[code][root@localhost ~]# pvdisplay
--- Physical volume ---
PV Name /dev/sdd1
VG Name VolGroup01
PV Size 1.82 TB / not usable 14.56 MB
Allocatable yes (but full)
PE Size (KByte) 32768
Total PE 59616
Free PE 0
Allocated PE 59616
PV UUID RcYT7e-FU2K-8Cn9-1BSQ-M3W7-UPDX-fpgFRw

--- Physical volume ---
PV Name /dev/sde1
VG Name VolGroup01
PV Size 1.82 TB / not usable 14.56 MB
Allocatable yes
PE Size (KByte) 32768
Total PE 59616
Free PE 53696
Allocated PE 5920
PV UUID AwVF9Q-Vejk-04S0-LacT-Zs4D-X9Mr-hcAmxp

--- Physical volume ---
PV Name /dev/sdb1
VG Name VolGroup00
PV Size 1.82 TB / not usable 14.56 MB
Allocatable yes (but full)
PE Size (KByte) 32768
Total PE 59616
Free PE 0
Allocated PE 59616
PV UUID 7C5tAb-0O0t-rfYR-wFUi-LC4p-nGfv-laujiN

--- Physical volume ---
PV Name /dev/sdc1
VG Name VolGroup00
PV Size 1.82 TB / not usable 14.56 MB
Allocatable yes
PE Size (KByte) 32768
Total PE 59616
Free PE 53696
Allocated PE 5920
PV UUID ShGSHv-dt7B-83Ol-4AW0-x4pU-k9N6-oSNm11[/code]

And here, the result from "# vgdisplay -v".

[code][root@localhost ~]# vgdisplay -v
Finding all volume groups
Finding volume group "VolGroup01"
--- Volume group ---
VG Name VolGroup01
System ID
Format lvm2
Metadata Areas 2
Metadata Sequence No 2
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 1
Open LV 1
Max PV 0
Cur PV 2
Act PV 2
VG Size 3.64 TB
PE Size 32.00 MB
Total PE 119232
Alloc PE / Size 65536 / 2.00 TB
Free PE / Size 53696 / 1.64 TB
VG UUID r7XBZk-kYhv-iY3I-i5t0-FbAM-QzgH-ZPyoWU

--- Logical volume ---
LV Name /dev/VolGroup01/LogVol00
VG Name VolGroup01
LV UUID doLTcL-luDa-zCFs-o9H8-MOml-mLSP-5LLY3j
LV Write Access read/write
LV Status available
# open 1
LV Size 2.00 TB
Current LE 65536
Segments 2
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 253:0

--- Physical volumes ---
PV Name /dev/sdd1
PV UUID RcYT7e-FU2K-8Cn9-1BSQ-M3W7-UPDX-fpgFRw
PV Status allocatable
Total PE / Free PE 59616 / 0

PV Name /dev/sde1
PV UUID AwVF9Q-Vejk-04S0-LacT-Zs4D-X9Mr-hcAmxp
PV Status allocatable
Total PE / Free PE 59616 / 53696

Finding volume group "VolGroup00"
--- Volume group ---
VG Name VolGroup00
System ID
Format lvm2
Metadata Areas 2
Metadata Sequence No 2
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 1
Open LV 1
Max PV 0
Cur PV 2
Act PV 2
VG Size 3.64 TB
PE Size 32.00 MB
Total PE 119232
Alloc PE / Size 65536 / 2.00 TB
Free PE / Size 53696 / 1.64 TB
VG UUID F3ev5B-kIFj-eS7h-S55k-EJTy-qism-YUzwTl

--- Logical volume ---
LV Name /dev/VolGroup00/LogVol00
VG Name VolGroup00
LV UUID gShKAL-2yS3-ruQl-4db5-u4f3-oNu3-0NjefQ
LV Write Access read/write
LV Status available
# open 1
LV Size 2.00 TB
Current LE 65536
Segments 2
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 253:1

--- Physical volumes ---
PV Name /dev/sdb1
PV UUID 7C5tAb-0O0t-rfYR-wFUi-LC4p-nGfv-laujiN
PV Status allocatable
Total PE / Free PE 59616 / 0

PV Name /dev/sdc1
PV UUID ShGSHv-dt7B-83Ol-4AW0-x4pU-k9N6-oSNm11
PV Status allocatable
Total PE / Free PE 59616 / 53696[/code]

While I was searching and asking to Mr.Google,
I learned that I have to use /sbin/parted
instead of using /sbin/fdisk to handle over 2TB of volumes.

"# vgdisplay -v" says that the sizes of the each Volume groups are 3.64 TB.
Then, I guess that the system recognizes those physical volume sizes correctly.

So, now, what should I do to fix this?

Thanks in advance.

User avatar
jlehtone
Posts: 2383
Joined: 2007/12/11 08:17:33
Location: Finland

Re: 2TB HDD x 4

Post by jlehtone » 2010/02/26 12:15:23

First, 'fdisk' should be fine for partitioning a 2 TB hard drive. Actually, these not being
a system volume, would not [i]need[/i] a partition at all; just defining LVM physical
volumes to each of /dev/sd[bcde]. But that is irrelevant.

The question is how the logical volumes ended up being 65536 LE each. I thought that
the LVM can span volumes. (It does for me, but smaller volumes.)

The documentation of LVM does describe the routine to resize/expand a logical volume.
'lvextend' looks like the command. After that you have to expand the ext3 as well.

Tools like 'GParted' (epel-repo has it) might make the resizing an easier "one button solution".

encoded_9
Posts: 3
Joined: 2007/12/17 15:02:07

Re: 2TB HDD x 4

Post by encoded_9 » 2010/03/02 13:53:34

Hi jlehtone,

Thanks for your advices. And excuse me that I'm quite lazy to feed back.
To let long story short, I finally could handle those 2TB dirives, successfully.
I did NOT understand the concept of what "/usr/sbin/pvcreate" does.
I just thought that "/usr/sbin/pvcreate" does literally "create" physical volumes.
But actually, it tells to the Logical-Volume-Manager about physical volumes "existence" and submit to the record of them.
That is what I learned. I'm not very sure if I am still "wrong" or not.
Well, "/usr/sbin/pvcreate" does NOT create physical volumes, in literal meaning.

By the way, I have never use such a huge storage spaces like this.
Hugeness, or bigness is a kind of justice.
That's the another thing what I learned.


Thank you very much.
Bless you!

Post Reply

Return to “CentOS 5 - X86_64,s390(x) and PowerPC Support”