arohner_ has joined #rubygems
arohner_ has quit [Remote host closed the connection]
arohner has joined #rubygems
havenn is now known as havenwood
arohner has quit [Ping timeout: 240 seconds]
Briareos1 has joined #rubygems
huoxito has joined #rubygems
havenwood has quit [Remote host closed the connection]
havenwood has joined #rubygems
havenwood has quit [Ping timeout: 245 seconds]
arohner has joined #rubygems
arohner has quit [Ping timeout: 245 seconds]
huoxito has quit [Remote host closed the connection]
huoxito has joined #rubygems
huoxito has quit [Ping timeout: 272 seconds]
jonahR has quit [Quit: jonahR]
DanKnox_away is now known as DanKnox
arohner has joined #rubygems
huoxito has joined #rubygems
huoxito has quit [Remote host closed the connection]
huoxito has joined #rubygems
imperator has joined #rubygems
jaimef has quit [Excess Flood]
huoxito has quit [Ping timeout: 272 seconds]
jaimef has joined #rubygems
dwknoxy has joined #rubygems
dwradcliffe_m has joined #rubygems
dwradcliffe_m has quit [Client Quit]
dwknoxy has quit [Quit: Computer has gone to sleep.]
imperator has quit [Ping timeout: 240 seconds]
dwknoxy has joined #rubygems
dwknoxy has quit [Client Quit]
josh-k has quit [Remote host closed the connection]
josh-k has joined #rubygems
josh-k has quit [Ping timeout: 245 seconds]
DanKnox is now known as DanKnox_away
DanKnox_away is now known as DanKnox
Briareos1 has quit [Remote host closed the connection]
josh-k has joined #rubygems
josh-k has quit [Ping timeout: 260 seconds]
baburdick has quit [Quit: Leaving.]
baburdick has joined #rubygems
baburdick has quit [Ping timeout: 240 seconds]
baburdick has joined #rubygems
josh-k has joined #rubygems
arohner has quit [Remote host closed the connection]
lsegal has quit [Quit: Quit: Quit: Quit: Stack Overflow.]
einarj has joined #rubygems
tbuehlmann has joined #rubygems
adambeynon has joined #rubygems
workmad3 has joined #rubygems
DanKnox is now known as DanKnox_away
Emily has quit [Ping timeout: 260 seconds]
josh-k has quit [Remote host closed the connection]
josh-k has joined #rubygems
Emily has joined #rubygems
einarj has quit [Remote host closed the connection]
josh-k has quit [Ping timeout: 245 seconds]
einarj has joined #rubygems
einarj has quit [Ping timeout: 272 seconds]
weeb1e has quit [Read error: Connection reset by peer]
weeb1e has joined #rubygems
einarj has joined #rubygems
josh-k has joined #rubygems
josh-k has quit [Read error: Connection reset by peer]
josh-k_ has joined #rubygems
tbuehlmann has quit [Ping timeout: 264 seconds]
tbuehlmann has joined #rubygems
maveonair has joined #rubygems
maveonair has quit [Ping timeout: 272 seconds]
havenwood has joined #rubygems
maveonair has joined #rubygems
dvu has quit [Ping timeout: 264 seconds]
huoxito has joined #rubygems
stevenharman has quit [Quit: Leaving...]
stevenharman has joined #rubygems
stevenharman has quit [Ping timeout: 240 seconds]
maveonair has quit [Ping timeout: 240 seconds]
jonahR has joined #rubygems
stevenharman has joined #rubygems
maveonair has joined #rubygems
knappe has joined #rubygems
ZachBeta has joined #rubygems
maveonair has quit [Ping timeout: 240 seconds]
maveonair has joined #rubygems
dvu has joined #rubygems
ZachBeta has joined #rubygems
huoxito has quit [Remote host closed the connection]
huoxito has joined #rubygems
dwknoxy has joined #rubygems
huoxito has quit [Ping timeout: 248 seconds]
imperator has joined #rubygems
tbuehlmann has quit [Quit: Konversation terminated!]
maveonair has quit [Ping timeout: 272 seconds]
TheMoonMaster has quit [Excess Flood]
TheMoonMaster has joined #rubygems
huoxito has joined #rubygems
huoxito has quit [Remote host closed the connection]
baburdick has quit [Quit: Leaving.]
<
evan>
we need to do a maint period this morning/afternoon and switch to dbmaster02
<
evan>
dwradcliffe: did you get it setup?
<
dwradcliffe>
yeah, server should be ready
<
evan>
ok, I'd like to go ahead and do it in about 30 mins
<
evan>
anyone have any objections?
<
dwradcliffe>
I'm heading out in about 30 mins
<
evan>
when will you return?
<
evan>
it has to be done before 4pm this afternoon PST
<
evan>
and i've got some things this afternoon
jonahR has quit [Quit: jonahR]
jonahR has joined #rubygems
<
dwradcliffe>
I should be back around 3 EST
<
evan>
thats when I have to take off.
<
evan>
if you've got everything setup, I can do the switch
<
dwradcliffe>
should be fine. samkottler is probably lurking around here too
<
evan>
samkottler: pokes
<
samkottler>
I have calls from 12:30-3:20 today
<
samkottler>
I'm around after that, though
<
evan>
thats basically into when i'm not around.
<
evan>
shall I just do it now?
<
evan>
thats the common denominator
<
evan>
the next 20 mins.
<
evan>
I screwed up
<
evan>
we should have done this last week
<
dwradcliffe>
tonight?
<
evan>
and now it has to be done by 4pm
<
evan>
it has to be done by 4pm PST
<
samkottler>
is the instance getting terminated this afternoon or something?
<
dwradcliffe>
I thought it was Nov 5
<
evan>
let me double check.
<
samkottler>
TBH I'd rather not fuck around with getting close to the deadline because we have no backup
<
evan>
thats why I want to do it now.
<
samkottler>
yeah, +1
<
evan>
even though I know it's annoying.
<
evan>
"Retiring: This instance is scheduled for retirement after November 4, 2013 4:00:00 PM UTC-8. "
<
samkottler>
okay yeah let's do it
<
evan>
ok, doing it now.
<
dwradcliffe>
should I enable maint mode?
<
evan>
looks like we can do maint on lb01 now
<
evan>
did you do it on lb01
<
dwradcliffe>
lb01 via meg command
almostwhitehat has joined #rubygems
<
samkottler>
lb01 is dead, though
<
samkottler>
all the traffic flows through lb02
<
dwradcliffe>
I meant balancer02
<
samkottler>
ah okay
<
evan>
sorry, yeah.
<
evan>
ok, dumping dbs
<
evan>
maybe I should just move the PG data files
<
evan>
isn't it on EBS
<
evan>
can't I just remount the volume?
<
evan>
we should have talked though this first!
<
dwradcliffe>
yes it's on EBS, but I wouldn't want to detatch without a good dump first
<
dwradcliffe>
just in case
<
evan>
ok, got the dump
<
evan>
i'm going to do an EBS volume migration dance now
<
evan>
hold onto your butts.
<
dwradcliffe>
you will need to unmount/detatch the new one I made
<
evan>
doing that now.
<
evan>
went smoothly.
<
evan>
data now mounted on dbmaster02
<
dwradcliffe>
awesome
<
evan>
changing the configuration for app01
<
evan>
cooking app01 with changed config...
<
evan>
why the fuck is it asking me for my pasword....
<
evan>
fails saying chef isn't installed.
<
dwradcliffe>
can you change the db config manually for now?
<
dwradcliffe>
I'll debug when I'm back later
<
evan>
so frusterated with our deployment.
einarj has quit [Remote host closed the connection]
<
evan>
ok, we're back.
<
dwradcliffe>
awesome thanks evan
arohner has joined #rubygems
<
dwradcliffe>
looks good
<
evan>
we've got to get deployment smoothed out soon.
<
evan>
it feels undependable atm.
<
evan>
we've got 3 new gems in the last 2 minutes
<
evan>
so pushes are working.
<
samkottler>
evan: nice work
<
evan>
here is an issue
<
evan>
everyone that deploys needs to update their secret databag
<
evan>
because that is where the postgres IP is atm.
<
evan>
or we can move it out of that secret databag into a non-secret one and check it in.
<
evan>
the new IP is: 10.224.39.18
* dwradcliffe
is heading out
x1337807x has joined #rubygems
x1337807x has quit [Client Quit]
x1337807x has joined #rubygems
workmad3 has quit [Ping timeout: 245 seconds]
imperator has quit [Ping timeout: 240 seconds]
jonahR has joined #rubygems
jonahR has quit [Quit: jonahR]
ZachBeta has quit [Quit: Computer has gone to sleep.]
stepheneb_ has joined #rubygems
einarj has joined #rubygems
stepheneb_ has quit [Quit: stepheneb_]
DanKnox_away is now known as DanKnox
redmenace has joined #rubygems
einarj has quit [Ping timeout: 272 seconds]
ZachBeta has joined #rubygems
jonahR has joined #rubygems
einarj has joined #rubygems
einarj has quit [Remote host closed the connection]
josh-k_ has quit [Remote host closed the connection]
dwknoxy has quit [Quit: Computer has gone to sleep.]
x1337807x has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
baburdick has joined #rubygems
imperator has joined #rubygems
dwknoxy has joined #rubygems
retro|cz has joined #rubygems
calmyournerves has joined #rubygems
calmyournerves has joined #rubygems
stevenharman has quit [Quit: Leaving...]
chouhoulis has joined #rubygems
einarj has joined #rubygems
josh-k has joined #rubygems
einarj has quit [Ping timeout: 262 seconds]
x1337807x has joined #rubygems
tcopeland has joined #rubygems
cmeiklejohn has quit [Remote host closed the connection]
johnmwilliams___ has quit [Remote host closed the connection]
qrush has quit [Remote host closed the connection]
guilleiguaran_ has quit [Remote host closed the connection]
capen has quit [Remote host closed the connection]
xerxas has quit [Remote host closed the connection]
randym_ has quit [Read error: Connection reset by peer]
Guest85414___ has quit [Write error: Broken pipe]
JSharp has quit [Remote host closed the connection]
nz has quit [Remote host closed the connection]
gazoombo has quit [Remote host closed the connection]
priyam_ has quit [Read error: Connection reset by peer]
abuiles has quit [Read error: Connection reset by peer]
wycats has quit [Write error: Connection reset by peer]
ckrailo has quit [Remote host closed the connection]
almostwhitehat has quit [Remote host closed the connection]
Sc0rp10n has joined #rubygems
x1337807x has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
imperator has quit [Ping timeout: 272 seconds]
calmyournerves is now known as luxflux____
luxflux____ is now known as luxflux_________
luxflux_________ is now known as calmyournerves
x1337807x has joined #rubygems
tcopeland has quit [Quit: Leaving.]
einarj has joined #rubygems
jonahR has quit [Quit: jonahR]
Guest85414___ has joined #rubygems
qrush has joined #rubygems
cmeiklejohn has joined #rubygems
guilleiguaran_ has joined #rubygems
capen has joined #rubygems
JSharp has joined #rubygems
workmad3 has joined #rubygems
xerxas has joined #rubygems
johnmwilliams___ has joined #rubygems
stevenharman has joined #rubygems
randym_ has joined #rubygems
dwknoxy has quit [Quit: Computer has gone to sleep.]
nz has joined #rubygems
abuiles has joined #rubygems
priyam_ has joined #rubygems
gazoombo has joined #rubygems
imperator has joined #rubygems
workmad3 has quit [Ping timeout: 245 seconds]
adam_ is now known as adam12
einarj has quit [Remote host closed the connection]
einarj has joined #rubygems
tcopeland has joined #rubygems
einarj has quit [Ping timeout: 260 seconds]
ZachBeta has quit [Quit: Computer has gone to sleep.]
x1337807x has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
wycats has joined #rubygems
ckrailo has joined #rubygems
x1337807x has joined #rubygems
Briareos1 has joined #rubygems