What’s under the hood – Part 1

Every once and a while, I like to post a little about what I have running in my “server room” (basement shelf).

I have a rather large shelf in the back corner of my basement that looks a lot like this.

[peg-image src=”http://lh3.googleusercontent.com/-0IKXqhQVz_Y/VkkXkD1xY8I/AAAAAAACI7A/oOSpH-Wk2tw/s144-o/IMG_20151115_183852.jpg” href=”https://picasaweb.google.com/102474139899968458086/20151115?authkey=1TN7tINkEL0#6217526668835251138″ caption=”” type=”image” alt=”IMG_20151115_183852.jpg” image_size=”4160×3120″ ]

Describing everything goes like this…

Top Right:

[peg-image src=”http://lh3.googleusercontent.com/-u_IJYWrTQiw/VkkXanML3AI/AAAAAAACI6w/s7QuPd7xPDI/s144-o/IMG_20151115_183802.jpg” href=”https://picasaweb.google.com/102474139899968458086/20151115?authkey=1TN7tINkEL0#6217526506525809666″ caption=”” type=”image” alt=”IMG_20151115_183802.jpg” image_size=”4160×3120″ ]

3 APC UPS’: 2 Back-UPS XS-1300-LCD’s, one Back-UPS XS-1500.

Obviously those guys handle back-up power and are labeled appropriately. On average, I get about 45 minutes of standby power from them, which is plenty of time to either shut down, or get the generator running.

I also recently acquired an Avocent DVR4020. I know it’s overkill, but I LOVE having remote access to the console of my machines.

Next, Bottom Left:

[peg-image src=”http://lh3.googleusercontent.com/-QLPm_qNwkVo/VkkXbVB8gqI/AAAAAAACI6o/fn6PIMhPW2E/s144-o/IMG_20151115_183808.jpg” href=”https://picasaweb.google.com/102474139899968458086/20151115?authkey=1TN7tINkEL0#6217526518830891682″ caption=”” type=”image” alt=”IMG_20151115_183808.jpg” image_size=”4160×3120″ ]

This is kinda my pride and joy… Goomba—

He runs a little hot for you to see why he’s named Goomba, but he’s the storage pod.

He’s got 6x3TB Drives, 3x2TB Drives and 4x5TB Drivesdrives

They are broken down as follows:



[peg-image src=”http://lh3.googleusercontent.com/-8Xb8PIJ3vHA/VkkXeHiRu3I/AAAAAAACI64/q4YMNnaqXAM/s144-o/IMG_20151115_183820.jpg” href=”https://picasaweb.google.com/102474139899968458086/20151115?authkey=1TN7tINkEL0#6217526566748011378″ caption=”” type=”image” alt=”IMG_20151115_183820.jpg” image_size=”4160×3120″ ]

The VMware Boxes, Spiny and Bowser… Bowser is a remnant of an old AMD VMware cluster that I ran, but he’s alright, but I am migrating to Intel NUCs like Spiny.

Spiny is an Intel NUC5I5MYHE, which for those that aren’t capable of googling, is a 5th generation Intel i5 NUC. the MYHE version of the NUC is the beefier processor version. He acts liek he has a quad core, even though he’s only a dual. I have had phenominal performance from this guy, and I hope to replace Bowser with another one soon.


Soon I will have to break down each box individually, mostly because all of them required a little TLC in order to make them purr like a kitten. Additionally, I will soon break down all of the VMs I have running, which will hopefully provide some clarity for those looking to mimic my setup.



I’d like to thank friends of Goomba for making him fatter!
This brings the total drive count to 13, and once fully reconfigured, 27TB of redundant storage.

[peg-image src=”http://lh3.googleusercontent.com/-qJzvnKcXKO4/Vf8NH5aUyMI/AAAAAAAB4WM/mtgT8SkIb5s/s144-o/IMAG0188.jpg” href=”https://picasaweb.google.com/102474139899968458086/20151027?authkey=zlQ78RWN-WI#6196686041606572226″ caption=”” type=”image” alt=”IMAG0188.jpg” image_size=”2688×1520″ ]

Service Restoration

Alright Friends of Yoshi —
The data drives on goomba are back online, and I am bringing all services back online slowly over the next 30 minutes.

Things will be slow for the next day or so, as the data drives do their thing.

[******@goomba ~]$ zpool status ThreeStore
pool: ThreeStore
state: ONLINE
status: One or more devices has experienced an error resulting in data corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the entire pool from backup.
scan: scrub in progress since Sun Sep 6 14:06:10 2015
258G scanned out of 16.9T at 227M/s, 21h24m to go
0 repaired, 1.49% done

Expansion Advice

Calling all nerds…. I need help… I have a big problem, I need to find a cost efficient way to “fix” my poorly configured NAS server.

Here’s the dilemma: I have a server with 9 Hard drives: 6x3TB drives, 3x2TB drives, it’s configured to about 66% efficiency beacause I acquired all of those drives over time… long story short, I need to “Temporarily” store 11TB of stuff somewhere.

My machine can only hold 3 more drives without significant modification, and my budget to fix is about $300, which limits my purchases to about 3x3TB drives…

So my questions are as follows: does anyone have any large hard drives laying around that I can borrow?

Does anyone know of any good hard drive deals?