asheesh changed the topic of #sandstorm to: Welcome to #sandstorm: home of all things sandstorm.io. Say hi! | Channel glossary: "i,i" means "I have no point, I just want to say". b == thumbs up. | Public logs at https://botbot.me/freenode/sandstorm/ & http://logbot.g0v.tw/channel/sandstorm/today
TwoJames2 has quit [Ping timeout: 244 seconds]
wolcen has joined #sandstorm
wolcen has quit [Ping timeout: 248 seconds]
KooBaa has quit [Remote host closed the connection]
wolcen has joined #sandstorm
TwoJames has joined #sandstorm
sydney_untangle has joined #sandstorm
sknebel has quit [Ping timeout: 260 seconds]
sknebel has joined #sandstorm
neynah has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
wolcen has quit [Ping timeout: 276 seconds]
<ocdtrekkie> Security thought reasonability question. Is it useful to compensate for potential flaws in an IP camera's software by setting an invalid default gateway and DNS address, when you only want to use it on the local network?
<asheesh> Yes.
neynah has joined #sandstorm
<ocdtrekkie> That's what I figured. I have an INSTEON camera, which is basically a rebranded Foscam. I'm not sure if my version is vulnerable to the recent HN article issues, but I was thinking it'd be a lot harder to pull data from it if it doesn't know where my router is. And the callouts that were detected sounded like they were by hostname, not IP.
neynah has quit [Client Quit]
<zarvox> Sandstorm browser JS size, by package size in minified, production JS bundle: https://gist.github.com/zarvox/eb20b813be3e18096ee2
<kentonv> zarvox: hopefully that's pre-compression?
<zarvox> That is minified, but not gzipped on the wire
<kentonv> I'd love to get rid of jquery since we hardly use it.
<kentonv> probably dependencies do, though. :/
<zarvox> That would be great. The best way to do that would be to drop Blaze, since it uses it in its implementation.
<zarvox> If we went all-in on React... ;)
<kentonv> oh, you
<dwrensha> yeah, where does that jquery dependency come from?
<zarvox> Meteor uses it for like everything
GeorgeHahn has joined #sandstorm
<dwrensha> I'm wondering how accounts-identity ends up being 11K.
jemc has quit [Ping timeout: 240 seconds]
frigginglorious has joined #sandstorm
<zarvox> dwrensha: accounts-identity.html gets compiled into Blaze javascript
<zarvox> (and somewhat oddly, it appears to preserve whitespace in templates)
<zarvox> (I guess you have to do that when your templates are strings, rather than structured objects)
<asheesh> FWIW, the entire bundle presumably has to be loaded to every client before they can see a grain.
<asheesh> So, like, mrdomino chat is a Rocket.Chat grain, and it's a little sad to load all this stuff before the grain can load itself.
rustyrazorblade has quit [Ping timeout: 264 seconds]
<asheesh> I don't claim to know yet how we should prioritize decreasing the page load speed, but I wanted to clarify that this affects people who get a grain shared with them and don't really know what Sandstorm is.
<asheesh> p.s. I do see introjs there, hmm.
rustyrazorblade has joined #sandstorm
axx_ has quit [Ping timeout: 260 seconds]
axx_ has joined #sandstorm
ecloud_ has joined #sandstorm
Jan7 has joined #sandstorm
Try`0xff_ has joined #sandstorm
niekie has quit [Quit: No Ping reply in 180 seconds.]
KooBaa has joined #sandstorm
niekie has joined #sandstorm
<zarvox> jquery (96811) + blaze (37920) + htmljs (10007) + templating (3017) + spacebars (2903) = 150658
<zarvox> vs 135581 for react-min.js (okay okay I'm done now)
_keturn has quit [Ping timeout: 248 seconds]
Jan\ has quit [Ping timeout: 248 seconds]
Try`0xff has quit [Ping timeout: 248 seconds]
ecloud has quit [Ping timeout: 248 seconds]
keturn__ has joined #sandstorm
KooBaa has quit [Ping timeout: 244 seconds]
<dwrensha> the good news is that gitlab is successfully launching from vagrant-spk
<dwrensha> the bad news is that the first request always returns 500 becuase of a weird sqlite locking issue
<dwrensha> ... and launching takes several minutes
<dwrensha> (in dev mode)
neynah has joined #sandstorm
<zarvox> yiiiiiikes that's a long time
<zarvox> is it just spending all that time doing syscalls and getting ENOENT, or what?
<dwrensha> I don't know
<dwrensha> I could try some strace
<zarvox> strace is one of my favorite tools
<dwrensha> I know that it consumes a lot of cpu while launching
<kentonv> dwrensha: the ruby process consumes a lot of CPU, or the spk process, or...?
<zarvox> I wonder how much of that is doing work vs. waiting on the kernel to dispatch a stat to fuse
<dwrensha> top indicates that I have an spk process using 98% cpu
<dwrensha> and three ruby processes each consuming about 20% cpu
<kentonv> interesting
<dwrensha> one reason I'd like to update gitlab is that the new version claims to need fewer Ruby processes
<zarvox> oooh, which drops memory usage
<kentonv> it sounds like spk is being unexpectedly slow
<kentonv> in its fuse layer
<kentonv> I wonder if it's doing something weird and unexpected
<zarvox> time to break out perf + flamecharts?
<kentonv> maybe we should profile it
<zarvox> :)
<dwrensha> (probably unrelated) from the debug log: "Error, do this: mount -t proc proc /proc"
<kentonv> I tend to prefer sampling profilers
<zarvox> ^ sampling profiler ;)
<kentonv> I suggest google-perftools. :P
neynah has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
<kentonv> though poormansprofiler is pretty impressively simple
<dwrensha> launching gitlab through `spk dev` outside of vagrant-spk has a similar cpu usage breakdown among its processes
<dwrensha> ... where it looks like `spk` is the bottleneck
<zarvox> it is amusing that a single bash script that runs gdb to capture stacks can provide actually useful output
<kentonv> yeah clearly we're doing something wrong in spk
<kentonv> zarvox: oh, I believe it
<dwrensha> which process needs to do all of the cap'n proto shuffling of data / FUSE layer stuff?
<kentonv> dwrensha: spk
<zarvox> does google-perftools require you rebuild your binaries with additional profiling stuff enabled?
<dwrensha> so then is it so surprising that that's where we're seeing the usage?
<kentonv> zarvox: you can LD_PRELOAD it
<kentonv> though I guess spk is statically-linked so that's problematic
<kentonv> dwrensha: I'm surprised that it is taking significantly more CPU than Ruby
<kentonv> dwrensha: it may be that there's no way around this because Ruby is just calling stat() too many times in a tight loop, but I think we should look into it
<dwrensha> I'll continue investigating
<zarvox> does spk dev cache the output of stat()?
<zarvox> if not, then we're doing (num_processes)x the amount of work necessary
<zarvox> (of course, there could be correctness issues if we did it all the time)
<kentonv> zarvox: no caching is possible. Each stat() is on a unique path.
<zarvox> even across the three ruby processes?
<zarvox> they don't ask for the same paths, despite probably loading the same code?
<kentonv> `spk dev -c` will enable aggressive caching
<dwrensha> can I do `vagrant-spk dev -c`?
<zarvox> no, but you can vagrant-spk ssh and run the command that `vagrant-spk dev` prints with an additional -c
<kentonv> zarvox: I've never actually used flamegraphs. Is the x-axis time?
<zarvox> width of a bar is how much (relative) time you spent with that frame on the stack
<kentonv> no, my question is, is the X axis absolute time? Like is this basically an ordered log of what the process did?
<zarvox> no
<zarvox> for that you'd need hooks on function enter/leave
<kentonv> not necessarily
<kentonv> samples could be arranged in order with the assumption that the shard prefix of the stack is an ongoing call
jemc has joined #sandstorm
<zarvox> I mean, I guess you could split things up based on offset in the frame (and it's possible that the flamechart *does* organize things in that kind of order)
<zarvox> but if you make dozens of calls to the same function, then do you want those to be grouped, or split?
<kentonv> if most time is spent in foo() but it gets called from several different places, how does that show up? Wouldn't there end up being lots of little foo() slivers, which makes it hard to tell that foo() is a hot spot?
<zarvox> Yes.
<zarvox> Though other profiling tools tend to be pretty good at showing things like that, but not which callstacks led to them.
<kentonv> ok. I may be biased since I've used pprof a lot and not ever used flamegraphs, but I feel like pprof output is strictly better.
<kentonv> pprof output shows call stacks
<zarvox> more tools more power!
<zarvox> I should learn to pprof too, sounds like :)
<kentonv> pprof shows each function as as a box in a graph with edges being calls. Each box shows # of samples where that function was currently being executed and # of samples where the function was on the stack (follow the arrows to find out what was above/below it)
<kentonv> this is what Jeff and Sanjay threw together when they wanted to optimize. :)
<kentonv> I used it a lot for optimizing protobufs
<kentonv> it is open source as part of google-perftools but no one actually advertises how powerful google-perftools is to the outside world. :)
<kentonv> at Google every binary automatically had the profiler built-in so you could profile any running server in production with one command-line. It was pretty great.
<kentonv> also heap profiles -- for finding memory leaks, or just where memory is being used. Same visualization turns out to be great for that.
<zarvox> ahhh, https://gperftools.googlecode.com/svn/trunk/doc/cpuprofile.html is the guide I was looking for
<kentonv> I definitely agree that profiles without stack traces are worse than useless, fwiw. :)
_whitelogger has quit [Ping timeout: 260 seconds]
_whitelogger_ has joined #sandstorm
XgF has joined #sandstorm
derf- has joined #sandstorm
nwf_ has joined #sandstorm
keturn__ has joined #sandstorm
mrshu has joined #sandstorm
nwf_ is now known as nwf
wolcen has joined #sandstorm
frigginglorious has quit [Quit: frigginglorious]
neynah has joined #sandstorm
KooBaa has joined #sandstorm
KooBaa has quit [Ping timeout: 244 seconds]
ecloud_ is now known as ecloud_wfh
<ocdtrekkie> asheesh: Lisa16 CFP is definitely already open. In fact, part of it's already closed: Early proposals deadline*: Monday, February 29, 2016, 11:59 pm PST
<ocdtrekkie> That page is cool, BTW. I probably won't do one this year because I have some specific trips I wanna do this year, and limited vacation time to do them in. But I will keep said list in mind. Might want to start putting 2017 dates on there though, since so many 2016 CFPs are already closed!
_whitelogger_ has quit [Excess Flood]
_whitelogger has joined #sandstorm
<ocdtrekkie> asheesh: Did I ever show you the awful video from the talk I gave? I forgot if I did or not. I told YouTube to stitch it together.
<ocdtrekkie> (Finally.)
GeorgeHahn has quit [Read error: Connection reset by peer]
phildini_ is now known as phildini
jadewang has quit [Remote host closed the connection]
jemc has quit [Ping timeout: 264 seconds]
neynah has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
jadewang has joined #sandstorm
jadewang_ has joined #sandstorm
jadewang has quit [Read error: Connection reset by peer]
jadewang_ has quit [Ping timeout: 264 seconds]
xet7 has quit [Quit: Leaving]
xet7b has joined #sandstorm
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
xet7b has quit [Quit: Leaving]
xet7 has joined #sandstorm
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 244 seconds]
raoulzecat has joined #sandstorm
KooBaa has joined #sandstorm
KooBaa has quit [Ping timeout: 244 seconds]
jon1012 has joined #sandstorm
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 260 seconds]
joshbuddy has quit [Quit: joshbuddy]
synchrone has joined #sandstorm
raoulzecat has quit [Ping timeout: 250 seconds]
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 264 seconds]
joshbuddy has joined #sandstorm
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
tannercollin has quit [Ping timeout: 250 seconds]
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 276 seconds]
Try`0xff_ is now known as Tryum
raoulzecat has joined #sandstorm
amyers has joined #sandstorm
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 240 seconds]
raoulzecat has quit [Ping timeout: 240 seconds]
raoulzecat has joined #sandstorm
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 260 seconds]
frigginglorious has joined #sandstorm
_whitelogger has quit [Ping timeout: 260 seconds]
_whitelogger has joined #sandstorm
raoulzecat has quit [Ping timeout: 240 seconds]
synchrone has quit [Quit: Leaving.]
synchrone has joined #sandstorm
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 248 seconds]
synchrone has quit [Ping timeout: 260 seconds]
synchrone has joined #sandstorm
jemc has joined #sandstorm
raoulzecat has joined #sandstorm
tierce has joined #sandstorm
raoulzecat has quit [Read error: Connection reset by peer]
synchrone has quit [Quit: Leaving.]
synchrone has joined #sandstorm
jadewang has joined #sandstorm
mnutt has joined #sandstorm
jadewang has quit [Ping timeout: 240 seconds]
jon1012 has quit [Ping timeout: 248 seconds]
Tryum is now known as Try`0xff
digitalcircuit has quit [Ping timeout: 250 seconds]
mnutt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
digitalcircuit has joined #sandstorm
mnutt has joined #sandstorm
jadewang has joined #sandstorm
_whitelogger has quit [Ping timeout: 260 seconds]
_whitelogger has joined #sandstorm
jadewang has quit [Ping timeout: 248 seconds]
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
notevil has joined #sandstorm
mnutt has joined #sandstorm
Rym has joined #sandstorm
tierce has quit [Ping timeout: 268 seconds]
eglimi has joined #sandstorm
bodisiw has joined #sandstorm
amyers has quit [Ping timeout: 276 seconds]
amyers has joined #sandstorm
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 276 seconds]
amyers has quit [Ping timeout: 250 seconds]
jadewang has joined #sandstorm
joshbuddy has quit [Quit: joshbuddy]
eglimi has quit [Ping timeout: 244 seconds]
amyers has joined #sandstorm
nowhere_man has joined #sandstorm
<nowhere_man> Hi, I finally installed a dev Sandstorm on my home computer and tried installing a production one on a remote server
<nowhere_man> but on the remote, I get this mysterious error in the logs:
<pdurbin> "mongod failed to start" anything in mongo.log?
<asheesh> Hi nowhere_man
<asheesh> (1) Sorry you're having troubles
<asheesh> (2) There's a link in that error message to a faq page here: https://docs.sandstorm.io/en/latest/administering/faq/#mongod-failed-to-start-whats-going-on
<asheesh> But that basically shouldn't happen, so it's good if we can get to the bottom of the issue.
joshbuddy has joined #sandstorm
<asheesh> nowhere_man: if you're willing to share your mongodb log file (see that FAQ item) I'd love to help diagnose the issue.
<asheesh> Feel free to email support@sandstorm.io instead if you want more privacy!
eglimi has joined #sandstorm
<nowhere_man> there's no mongodb log in /opt/sandstorm/var/log :-(
<asheesh> Huh. What's the output of:
<asheesh> sudo ls -l /opt/sandstorm/var/log/mongo.log
<nowhere_man> also, I have 2.7Gb free and it's a fresh install (so hopefully not a corruption)
<asheesh> I wonder if your filesystem does something weird from mongo's perspective.
<nowhere_man> no such file…
<asheesh> That is super strange.
<nowhere_man> happy to find new corner cases :-)
<asheesh> I must AFK a little bit for a meeting; back in 20-30 minutes.
<asheesh> Can you email us so we don't lose track of you? support@sandstorm.io
<asheesh> Thank you!
mnutt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
mnutt has joined #sandstorm
neynah has joined #sandstorm
tannercollin has joined #sandstorm
tannercollin has quit [Max SendQ exceeded]
tannercollin has joined #sandstorm
tannercollin has quit [Max SendQ exceeded]
tannercollin has joined #sandstorm
tannercollin has quit [Max SendQ exceeded]
tannercollin has joined #sandstorm
tannercollin has quit [Max SendQ exceeded]
tannercollin has joined #sandstorm
tannercollin has quit [Max SendQ exceeded]
tannercollin has joined #sandstorm
tannercollin has quit [Max SendQ exceeded]
tannercollin has joined #sandstorm
tannercollin has quit [Max SendQ exceeded]
wolcen has quit [Ping timeout: 240 seconds]
jadewang has quit [Remote host closed the connection]
neynah has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
eglimi has quit [Ping timeout: 250 seconds]
sknebel_ is now known as sknebel
mnutt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
mnutt has joined #sandstorm
mnutt has quit [Read error: Connection reset by peer]
mnutt__ has joined #sandstorm
jadewang has joined #sandstorm
joshbuddy has quit [Quit: joshbuddy]
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
joshbuddy has joined #sandstorm
neynah has joined #sandstorm
jadewang has quit [Remote host closed the connection]
tierce has joined #sandstorm
amyers has quit [Ping timeout: 240 seconds]
tierce has quit [Ping timeout: 276 seconds]
_whitelogger has quit [Ping timeout: 260 seconds]
_whitelogger_ has joined #sandstorm
notevil has quit [Quit: shutdown -h now]
<zarvox> Hmm. My vagrant-spk Piwik VM, after installing capnproto from git master, can't seem to use the pkg-config files.
<zarvox> They specify `libdir=${exec_prefix}/lib` but don't specify exec_prefix anywhere.
<zarvox> Which trips up pkg-config.
<asheesh> Or 0.5.149 and have the last digit be == the sandstorm release number
<asheesh> Gotta say, I </3 our lack of capnproto releases.
<asheesh> 0.5.30.149 or whatever.
<asheesh> Maybe we can make point releases that lack Windows builds, or something, whose release time corresponds to a Sandstorm release time.
_whitelogger_ has quit [Excess Flood]
_whitelogger has joined #sandstorm
_whitelogger has joined #sandstorm
_whitelogger has quit [Excess Flood]
_whitelogger has joined #sandstorm
bodisiw has quit [Quit: This computer has gone to sleep]
tierce has joined #sandstorm
frigginglorious has quit [Quit: frigginglorious]
<zarvox> dwrensha: yeah, that's the one. Adding the exec_prefix=@exec_prefix@ lines back in fixes thing under autotools. I'm looking into whether that causes a regression with CMake or if it was just an oversight in that commit.
<zarvox> looks like the latter - the CMake build makes explicit paths of all the variables that autotools makes reference other variables
sydney_untangle has quit [Changing host]
sydney_untangle has joined #sandstorm
frigginglorious has joined #sandstorm
mnutt__ has quit [Quit: Textual IRC Client: www.textualapp.com]
mnutt has joined #sandstorm
frigginglorious has quit [Quit: frigginglorious]
sydney_untangle is now known as mozilla
mozilla is now known as sydney_untangle
synchrone has quit [Ping timeout: 260 seconds]
bodisiw has joined #sandstorm
bodisiw has quit [Client Quit]
frigginglorious has joined #sandstorm
tierce has quit [Ping timeout: 244 seconds]