One of the more underplanned aspects of the LiveJournal move was not having enough disks for MogileFS data. We had enough disk space, but not enough spindles
( Read more... )
automatic cascading redistribution?dossyNovember 23 2005, 03:27:46 UTC
Brad, my understanding of MogileFS is that it's essentially a "network RAID 1" type data distribution mechanism, right?
If some spindles are too busy while others are nearly idle, couldn't you track what assets are being accessed and replicate that data onto the spindles that are less busy? Or, is that what your weighting is doing? Weighting sounds like a way to guide new read/write operations, but doesn't help with old data, right? MogileFS is WORM, right? So, wouldn't "intelligently" redistributing previously written data have a measurable impact on performance, too?
And after I did my 90-100 mph trip down the Fry's the other day to get 10 new 300 GB drives to add more spindles, that just made it even further uneven.
That's a funny image, you bursting into the store, out of breath, wad of cash in your fist, desperate for a three terabyte fix. (Double entendre intended.)
Comments 12
If some spindles are too busy while others are nearly idle, couldn't you track what assets are being accessed and replicate that data onto the spindles that are less busy? Or, is that what your weighting is doing? Weighting sounds like a way to guide new read/write operations, but doesn't help with old data, right? MogileFS is WORM, right? So, wouldn't "intelligently" redistributing previously written data have a measurable impact on performance, too?
Reply
Reply
That's a funny image, you bursting into the store, out of breath, wad of cash in your fist, desperate for a three terabyte fix. (Double entendre intended.)
Reply
Leave a comment