I've been watching Joyent and SmartOS in particular with interest for a while.
A few questions to satisfy my curiosity.
First, I'm assuming that you're running SmartOS on your own dedicated servers, not a public cloud like Joyent. Is that correct? If not, the rest doesn't apply.
Do you use Ansible in the global zone, in individual non-global zones, or both?
Do you build a new zone for each deploy of an application and each new version of a piece of infrastructure? I imagine this is the way to achieve the idea of immutable infrastructure.
And one other little thing: Do you boot SmartOS via a USB key, PXE, or something else?
I use Ansible for both global and non-global zones. You are correct, both the deploys and the new pieces get new zones (the old are destroy after the migration). The idea of raising entire new zones for simple migrations sounds like a pain in the butt on multiple fronts. In actuality, it is much easier. Zero downtime migrations too.
I personally use USB keys, however it is expected that any one zone and/or server could fail at any moment. Servers are dirt cheap if you do it right. I bet some pay more in RAM costs per month than an entire node costs me with 32GB RAM, E3-1230v3, SSD, etc. There are multiple server types. The E3s are the non-persistent processing nodes... 3RU chassis 8 possible nodes in said chassis... each about 1k with the specs above and they are about 40 ECUs per. Each microcloud is typically around 10RU (1/4 rack). Place at separate datacenters and you get some interesting stuff. I have a whole different approach to the homebase DC. Stuff that REALLY reduce costs.
A few questions to satisfy my curiosity.
First, I'm assuming that you're running SmartOS on your own dedicated servers, not a public cloud like Joyent. Is that correct? If not, the rest doesn't apply.
Do you use Ansible in the global zone, in individual non-global zones, or both?
Do you build a new zone for each deploy of an application and each new version of a piece of infrastructure? I imagine this is the way to achieve the idea of immutable infrastructure.
And one other little thing: Do you boot SmartOS via a USB key, PXE, or something else?