Monthly Archives: May 2007

GlusterFS 1.3.0-pre4

Posted on by
4

I recently upgraded from TLA patch 164 in the mainline 2.4 prepository of glusterfs to 1.3.0-pre4… and I notice that the load avg on the cluster nodes have gown down a fraction. I also enabled a few more translaters (about time)… stat-prefetch, io-threads, read-ahead. Things like ls -l are much quicker now. Bandwidth utilization across the backend network has gone down a bit. I expect that at some point we need to get 10Gbit/sec switches and NICs. For now we’re good.

Spec files for a 4 node cluster with AFR (*:2) and Cluster/Unify, posix/locks, read-ahead, io-thread, stat-prefetch, round robin algorithm:

#### SERVER.VOL (same on all 4 except for IPs) ####
volume brick
type storage/posix
option directory /GlusterFS
end-volume

volume locks
type features/posix-locks
subvolumes brick
end-volume

volume brick-afr
type storage/posix
option directory /GlusterFS-AFR
end-volume

volume locks-afr
type features/posix-locks
subvolumes brick-afr
end-volume

volume server
type protocol/server
option transport-type tcp/server
option bind-address 10.175.175.134
option listen-port 6996
subvolumes locks locks-afr
option auth.ip.locks.allow 10.175.175.*
option auth.ip.locks-afr.allow 10.175.175.*
end-volume

#### CLIENT.VOL ####
volume brick1
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.134
option remote-port 6996
option remote-subvolume locks
end-volume

volume brick1-afr
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.135
option remote-port 6996
option remote-subvolume locks-afr
end-volume

volume brick2
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.135
option remote-port 6996
option remote-subvolume locks
end-volume

volume brick2-afr
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.136
option remote-port 6996
option remote-subvolume locks-afr
end-volume

volume brick3
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.136
option remote-port 6996
option remote-subvolume locks
end-volume

volume brick3-afr
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.137
option remote-port 6996
option remote-subvolume locks-afr
end-volume

volume brick4
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.137
option remote-port 6996
option remote-subvolume locks
end-volume

volume brick4-afr
type protocol/client
option transport-type tcp/client
option remote-host 10.175.175.134
option remote-port 6996
option remote-subvolume locks-afr
end-volume

volume afr1
type cluster/afr
subvolumes brick1 brick1-afr
option replicate *:2
end-volume

volume afr2
type cluster/afr
subvolumes brick2 brick2-afr
option replicate *:2
end-volume

volume afr3
type cluster/afr
subvolumes brick3 brick3-afr
option replicate *:2
end-volume

volume afr4
type cluster/afr
subvolumes brick4 brick4-afr
option replicate *:2
end-volume

volume unify1
type cluster/unify
subvolumes afr1 afr2 afr3 afr4
option readdir-force-success on
option scheduler rr
option rr.limits.min-free-disk 10GB
end-volume

volume iothreads
type performance/io-threads
option thread-count 8
subvolumes unify1
end-volume

volume readahead
type performance/read-ahead
option page-size 131072
option page-count 16
subvolumes iothreads
end-volume

volume stat-performance
type performance/stat-prefetch
option cache-seconds 1
subvolumes readahead
end-volume

Fiber Connectivity

Posted on by
Reply

Our ISP just ran a cat 6 cable from the fiber MPOE through to the server room through a conduit. Can’t wait to hook up the pair of PIXes to this uplink and test the speed… it should be just over 10Mbps. That’s a nice jump from our bonded 6Mbps T1 connection.

Cool Stuff

Posted on by
Reply

Just installed Sun 900-38 cabinet, Kantech entrapass security system, 2 more cabinets, raceway wiremold G6000 electrical in our computer room.. Looks nice. Tripp Lite Upses (4 x 5000W) are sturdy and worked right away.

900-38