dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
<lidel>
xcm, AFAIK right now pinning ipns path will resolve it to current /ipfs/ path and pin that. ipns->ipfs mapping is announced to dht every X hours by the owner of private key, so others can't help with that. And to answer another popular question, "following" ipns and dynamically pinning new stuff as the pointer gets updated is planned at some point: https://github.com/ipfs/go-ipfs/issues/4435 :)
treethought has quit [Remote host closed the connection]
treethought has joined #ipfs
<Bat`O_>
xcm: resolving the ipns address will put the dht record in cache, so you make it available for other for some time
<xcm>
lidel: i see, thanks. it's a matter of keeping the entry warm then. it seems to me that for now, with refs+resolve it's trivial to mirror whatever is current. i will go through that issue eventuall though
dolphy has joined #ipfs
treethought has quit [Ping timeout: 276 seconds]
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
phritz has joined #ipfs
pcardune has joined #ipfs
Gytha has joined #ipfs
Lymkwi has quit [Ping timeout: 245 seconds]
phritz has quit [Ping timeout: 240 seconds]
Steverman has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
pcardune has quit [Ping timeout: 260 seconds]
dominic__ has joined #ipfs
Lymkwi has joined #ipfs
treethought has joined #ipfs
dzjkb has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
chrios has joined #ipfs
chrios_ has quit [Ping timeout: 256 seconds]
SOO7 has quit [Quit: Quit]
treethought has quit [Ping timeout: 240 seconds]
treethought has joined #ipfs
dvim has quit [Quit: WeeChat 2.1]
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
toxync01- has joined #ipfs
toxync01- is now known as toxync01_
toxync01 has quit [Ping timeout: 248 seconds]
toxync01_ is now known as toxync01
dzjkb has quit [Ping timeout: 256 seconds]
dominic__ has quit [Ping timeout: 276 seconds]
Lymkwi has quit [Ping timeout: 260 seconds]
dzjkb has joined #ipfs
Lymkwi has joined #ipfs
SOO7 has joined #ipfs
pcardune has joined #ipfs
pcardune has quit [Ping timeout: 256 seconds]
gmoro has joined #ipfs
gmoro has quit [Remote host closed the connection]
gmoro has joined #ipfs
gmoro has quit [Remote host closed the connection]
treethought has quit [Ping timeout: 268 seconds]
Steverman has quit [Ping timeout: 276 seconds]
tenchooo has quit [Remote host closed the connection]
tenchooo has joined #ipfs
chrios_ has joined #ipfs
chrios has quit [Ping timeout: 268 seconds]
nek0 has quit [Ping timeout: 256 seconds]
nek0 has joined #ipfs
toxync01- has joined #ipfs
toxync01- is now known as toxync01_
toxync01 has quit [Ping timeout: 240 seconds]
toxync01_ is now known as toxync01
Steverman has joined #ipfs
phritz has joined #ipfs
toxync01- has joined #ipfs
toxync01- is now known as toxync01_
Lieuwex has quit [Remote host closed the connection]
phritz has quit [Ping timeout: 268 seconds]
toxync01 has quit [Ping timeout: 264 seconds]
lord| has quit [Quit: WeeChat 2.0.1]
toxync01_ is now known as toxync01
pcardune has joined #ipfs
geoah has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
Taoki has joined #ipfs
pcardune has quit [Ping timeout: 260 seconds]
dzjkb has quit [Ping timeout: 276 seconds]
mog- has joined #ipfs
treethought has joined #ipfs
mog has quit [Ping timeout: 264 seconds]
mog- is now known as mog
chrios has joined #ipfs
chrios_ has quit [Ping timeout: 276 seconds]
toxync01- has joined #ipfs
toxync01- is now known as toxync01_
toxync01 has quit [Ping timeout: 256 seconds]
toxync01_ is now known as toxync01
Lieuwex has joined #ipfs
pcardune has joined #ipfs
pcardune has quit [Remote host closed the connection]
pcardune_ has joined #ipfs
treethought has quit [Ping timeout: 240 seconds]
apiarian has quit [Quit: zzz]
Gytha has quit [Remote host closed the connection]
Fessus has quit [Ping timeout: 264 seconds]
JCaesar has quit [Remote host closed the connection]
Sekhmet_ has joined #ipfs
<Sekhmet_>
hey, how is list of pinned files stored? I'm using ipfs docker container on the server with mounted ipfs data folder. I synced that folder to other device and tried running container with this folder but ipfs pin ls doesn't show anything
rngkll_ has joined #ipfs
<kristjan96[m]>
good question, I'd like to know that aswell.
<kristjan96[m]>
I have another one. Probably quite stupid question but still.
rodlogic has quit [Ping timeout: 256 seconds]
<kristjan96[m]>
when accessing IPFS files from my local node, I get data from many peers who happen to host the file with that hash.
<kristjan96[m]>
but when accessing the file via web browser using the gateway ipfs.io/ipfs/<hash>
<kristjan96[m]>
the gateway gets data from other nodes (in case it doesnt host it). and then transmits it to me
rodlogic has joined #ipfs
<kristjan96[m]>
it that right?
<sknebel>
Yes. The gateway is just like the local node, except it accepts HTTP requests from everybody
<voker57>
Sekhmet_: it's stored in DAG storage with all other data, and key is stored in key-value store
<voker57>
if you copied over .ipfs it should be there
ruby32 has quit [Ping timeout: 240 seconds]
clemo has quit [Quit: clemo]
JCaesar has joined #ipfs
ansuz has quit [Read error: Connection reset by peer]
geoah has joined #ipfs
<Sekhmet_>
I copied exposed volume (which is set to $IPFS_PATH) so it should be the same as .ipfs, maybe rsync skipped some files. I will try to archive it first and then transfer it
Adbray has quit [Quit: Quit]
<James_Epp>
The way files are pinned is what gives me a bad taste for ipfs. You effectively duplicate all data if you have the original stored somewhere in your 'parent' filesystem.
<voker57>
that's not the way they are pinned, that's way they are stored
<voker57>
and you can use filestore to avoid this
<James_Epp>
voker57: Good point, and I'll look up filestore!
raynold has quit [Quit: Connection closed for inactivity]
jkrone has joined #ipfs
Adbray has joined #ipfs
pedrovian has joined #ipfs
treethought has joined #ipfs
<Sekhmet_>
voker57: as it turns out for some reason rsync didn't sync everything properly, if I archive IPFS_PATH and then move it then it works just fine, thanks a lot
treethought has quit [Ping timeout: 276 seconds]
Taoki has quit [Ping timeout: 240 seconds]
treethought has joined #ipfs
Taoki has joined #ipfs
treethought has quit [Ping timeout: 264 seconds]
gmoro has joined #ipfs
fazo96 has joined #ipfs
fazo96_ has quit [Remote host closed the connection]
Sekhmet_ has quit [Quit: Page closed]
pedrovian_ has joined #ipfs
treethought has joined #ipfs
pedrovian has quit [Ping timeout: 276 seconds]
pedrovian_ has quit [Max SendQ exceeded]
pedrovian_ has joined #ipfs
pedrovian_ has quit [Max SendQ exceeded]
pedrovian_ has joined #ipfs
pedrovian_ has quit [Max SendQ exceeded]
pedrovian_ has joined #ipfs
pedrovian_ has quit [Max SendQ exceeded]
pedrovian_ has joined #ipfs
_whitelogger has joined #ipfs
jkrone has quit [Quit: Leaving]
newhouse has joined #ipfs
TrUsT_n1 has joined #ipfs
ulrichard_ has quit [Remote host closed the connection]
halfhand[m] has joined #ipfs
rodolf0 has joined #ipfs
anewuser has joined #ipfs
pcardune_ has quit [Remote host closed the connection]
ansuz has joined #ipfs
pcardune has joined #ipfs
pcardune has quit [Ping timeout: 240 seconds]
gregz has joined #ipfs
pcardune has joined #ipfs
treethought has quit [Ping timeout: 256 seconds]
ylp has left #ipfs [#ipfs]
xzha has quit [Remote host closed the connection]
pcardune has quit [Remote host closed the connection]
treethought has joined #ipfs
pcardune has joined #ipfs
newhouse has quit [Ping timeout: 264 seconds]
pcardune has quit [Remote host closed the connection]
pcardune has joined #ipfs
detran has quit [Ping timeout: 276 seconds]
anewuser has quit [Quit: anewuser]
bomb-on has quit [Quit: SO LONG, SUCKERS!]
ygrek has quit [Ping timeout: 263 seconds]
erictapen has quit [Remote host closed the connection]
spread has joined #ipfs
erictapen has joined #ipfs
erictapen has quit [Remote host closed the connection]
erictapen has joined #ipfs
RSF has joined #ipfs
<RSF>
Hi
<RSF>
is it possible to create a folder hash from a list of ipfs urls?
<RSF>
but I meant without copying the actual files
<voker57>
this does not copy actual files
<RSF>
it should be possible to derive the folder hash just from the other hashes right?
<voker57>
yes
<voker57>
and that's what the command does
<RSF>
ah..ok tehn
<voker57>
ipfs files operates on a virtual file system
<RSF>
great...thanks :)
phritz has joined #ipfs
TrUsT_n1 has quit [Ping timeout: 276 seconds]
bomb-on has joined #ipfs
hph^ has joined #ipfs
chjk6x has joined #ipfs
Steverman has quit [Ping timeout: 256 seconds]
gmoro has quit [Ping timeout: 264 seconds]
j0sh has joined #ipfs
gregz has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
geoah has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<j0sh>
Hi, Josh from Livepeer here, we're using libp2p. Found an issue with go-libp2p-peerstore that seems to have been resolved in the latest version, but I'm not sure how to update our project (and all the upstream/downstream deps) with gx. `gx update` will work for our specific project, but doesn't help with the global dependency chain, so we get type errors when compiling with golang. Any ideas?
gregz has joined #ipfs
Mateon1 has quit [Ping timeout: 265 seconds]
Mateon1 has joined #ipfs
<j0sh>
For reference, I'm updating peerstore with this `gx update QmXauCuJzmzapetmC6W4TuDJLL1yFFrVzSHoWv8YdbmnxH` which should point to go-libp2p-peerstore 1.2.15
<d10r>
ok thanks. But is there a way to monitor it's activity on a higher level? E.g. figure lists which files are requested?
<d10r>
And is there a way to limit the nr of peers it connects to? It's connected to more then 800 peers which seems excessive to me.
<iamruinous>
I'm having a lot of problems with pubsub hanging after sending a lot of messages, (https://github.com/ipfs/go-ipfs/issues/4744). I tried it out with 0.4.14-rc3 and same results. I have to restart the ipfs daemon to get things working again. Anyone else seeing this?
maxzor has joined #ipfs
dolphy has quit [Ping timeout: 276 seconds]
<voker57>
d10r: what's your version?
<d10r>
0.4.14-rc3
<d10r>
So, to give a quick overview: the stack trace lists 5513 goroutines, 2575 of which are annoted with "minutes" (mostly "select, x minutes"). What does that tell me?
<d10r>
796 are in state "IO wait"
}ls{ has quit [Ping timeout: 264 seconds]
<voker57>
not much, if you problem is not something hanging up
<d10r>
my .ipfs/blocks is about 850 MB (I'm not sure what's in there. I'm running an IPFS daemon for over a year and have played around a bit).
<voker57>
you might be interested in CPU profile and event log (ipfs log tail)
<voker57>
unfortunately not more refined tools are available atm
<d10r>
The problem is that this server has pretty slow storage (ordinary HDDs) and IPFS eats just too much of its resources. It's often 10+ GB per day (I'm not so much concerned with bandwidth, but with the I/O it causes to the server)
<d10r>
is there a way to limit the peer count? I guess that could solve my problem.
<voker57>
if IO is bottleneck you probably have some high demand data in there
<d10r>
wow, "ipfs log tail" was a very useful hint. Why is that not listed in usage output?
spread has quit [Remote host closed the connection]
TrUsT_n1 has joined #ipfs
}ls{ has joined #ipfs
<d10r>
Do I need to manually restart the daemon after editing the config with "ipfs config edit"?
drrty2 has joined #ipfs
<TrUsT_n1>
d10r: Yes.
kthnnlg has joined #ipfs
treethought has quit [Remote host closed the connection]
treethought has joined #ipfs
Trieste has quit [Ping timeout: 260 seconds]
James_Epp has quit [Quit: Leaving]
<j0sh>
I' not having much luck with gx-workspace to update deps. Went through a dozen `update next` steps and I see the package.json file is updated but `gx update next` is segfaulting now. How do I update the actual hashes throughout the project? `gx-go update old new` doesn't seem to actually do anything
Trieste has joined #ipfs
treethought has quit [Ping timeout: 268 seconds]
phritz has quit []
rendar has quit []
elevated has quit [Quit: bye]
d10r has quit [Ping timeout: 265 seconds]
treethought has joined #ipfs
treethought has quit [Ping timeout: 276 seconds]
Steverman has joined #ipfs
tenchooo has quit [Remote host closed the connection]
tenchooo has joined #ipfs
treethought has joined #ipfs
<voker57>
j0sh: iirc it's something like gx-go rewrite
dominic__ has joined #ipfs
<j0sh>
voker57: as far as I can tell `gx-go rewrite` works if the imports are something like github paths, like `github.com/ipfs/go-libp2p-peerstore` but not if the imports are already gx'ified (and they're all pointing to old versions... hundreds of them)
treethought has quit [Ping timeout: 276 seconds]
treethought has joined #ipfs
MDude has quit [Quit: Going offline, see ya! (www.adiirc.com)]
geoah has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
treethought has quit [Ping timeout: 240 seconds]
TrUsT_n1 has quit [Remote host closed the connection]
tec__ has quit [Ping timeout: 256 seconds]
tec__ has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
cxl000 has quit [Ping timeout: 240 seconds]
qzo has quit [Ping timeout: 252 seconds]
Ecran has joined #ipfs
clemo has quit [Ping timeout: 240 seconds]
treethought has joined #ipfs
colatkinson has quit [Ping timeout: 276 seconds]
Encrypt has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
fazo96 has quit [Quit: Konversation terminated!]
RSF has quit [Ping timeout: 260 seconds]
colatkinson has joined #ipfs
colatkinson has quit [Client Quit]
colatkinson has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
cxl000 has joined #ipfs
chowie has joined #ipfs
dolphy has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
maxzor has quit [Remote host closed the connection]
dominic__ has joined #ipfs
treethought has quit [Remote host closed the connection]
dominic__ has quit [Ping timeout: 240 seconds]
James_Epp has joined #ipfs
muravey has joined #ipfs
treethought has joined #ipfs
<j0sh>
Is there any way to `gx workspace update` go-libp2p-kbucket without running an ipfs daemon? For some reason it's trying to do a gx release for that package, all I want to do is update it (part of a larger chain of dep upgrades)
treethought has quit [Ping timeout: 240 seconds]
muravey has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
muravey has joined #ipfs
muravey has quit [Client Quit]
treethought has joined #ipfs
henke has joined #ipfs
muravey has joined #ipfs
treethought has quit [Ping timeout: 268 seconds]
Fessus has joined #ipfs
treethought has joined #ipfs
rodolf0 has quit [Quit: Leaving]
cxl000 has quit [Quit: Leaving]
MDude has joined #ipfs
tec__ has quit [Ping timeout: 276 seconds]
treethought has quit [Ping timeout: 276 seconds]
tec__ has joined #ipfs
geoah has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
chjk6x has quit [Ping timeout: 276 seconds]
treethought has joined #ipfs
geoah has joined #ipfs
James_Epp has quit [Quit: Leaving]
geoah has quit [Client Quit]
dominic__ has joined #ipfs
chjk6x has joined #ipfs
geoah has joined #ipfs
espadrine has joined #ipfs
treethought has quit [Ping timeout: 260 seconds]
geoah has quit [Client Quit]
chjk6x has quit [Remote host closed the connection]
chjk6x has joined #ipfs
colatkinson has quit [Quit: colatkinson]
pfista has joined #ipfs
pfista has quit [Remote host closed the connection]
dolphy has quit [Ping timeout: 246 seconds]
xelra has quit [Remote host closed the connection]
treethought has joined #ipfs
treethought has quit [Ping timeout: 276 seconds]
xelra has joined #ipfs
kaotisk has quit [Ping timeout: 240 seconds]
colatkinson has joined #ipfs
tec__ has quit [Ping timeout: 256 seconds]
geoah has joined #ipfs
tec__ has joined #ipfs
colatkinson has quit [Quit: colatkinson]
colatkinson has joined #ipfs
colatkinson has quit [Client Quit]
hph^ has quit [Ping timeout: 240 seconds]
treethought has joined #ipfs
tec__ has quit [Ping timeout: 256 seconds]
tec__ has joined #ipfs
alexgr has joined #ipfs
rngkll_ has quit [Remote host closed the connection]
Encrypt has quit [Quit: Quit]
voker57 has quit [Read error: Connection reset by peer]
<petersjt014[m]>
Does IPFS have boot hooks at all? I have two instances on a VM/host and and I want to scan the link-local address space and connect to anything with the host's id.
gregz has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
treethou_ has joined #ipfs
treethought has quit [Ping timeout: 276 seconds]
<Icefoz>
petersjt014[m]: Seems like an init service and DNS would be the easy solution there.
kthnnlg has quit [Remote host closed the connection]
James_Epp has joined #ipfs
Lymkwi has quit [Quit: No Ping reply in 180 seconds.]
treethou_ has quit [Ping timeout: 256 seconds]
<petersjt014[m]>
I was sorta trying to do that, but did kind of want to avoid it since IPv6 has really nice auto-discovery properties
treethought has joined #ipfs
Lymkwi has joined #ipfs
ianopolous has joined #ipfs
<ianopolous>
G'day everyone, I've been trying out the bootstrap list command, and it's returning things like /dnsaddr/bootstrap.libp2p.io/ipfs/QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN which look like a multiaddr, but I can't see any dnsaddr protocol in https://github.com/multiformats/go-multiaddr/blob/master/protocols.go
<petersjt014[m]>
Weird that it's not on multiformats.io
jesse22 has quit [Ping timeout: 276 seconds]
<petersjt014[m]>
only the other two apparently
treethought has quit [Ping timeout: 264 seconds]
<ianopolous>
Thanks, hadn't seen that. I don't see why those aren't in multiaddr itself though
treethought has joined #ipfs
<petersjt014[m]>
Prob something to do w/ how the spec's not finalized
dimitarvp has quit [Quit: Bye]
<ianopolous>
lgierth: is there a reason dnsaddr, dns4 and dns6 aren't in go-multiaddr?
treethought has quit [Ping timeout: 265 seconds]
treethought has joined #ipfs
James_Epp has quit [Quit: Leaving]
<lgierth>
ianopolous: we didn't wanna stick every last multiaddr scheme directly into go-multiaddr, it lives in go-multiaddr-dns
<lgierth>
oh man we gave dnsaddr the code 12345 in there lol
<lgierth>
silly oversight
<ianopolous>
ok, but if I'm writing code to parse a generic multiaddr, I now don't have a source of truth
<lgierth>
if you want to support /dnsaddr addresses, import go-multiaddr-dns
<petersjt014[m]>
That'd be assuming your're writing it in go
<lgierth>
the more multiaddr protocols there are, the higher the likelihood that a given impl of multiaddr is incomplete
<ianopolous>
the problem arise for me because in the java-http api we parse the result of bootstrap list as multiaddrs, but that include dnsaddr entries that we can't handle
<lgierth>
you can always just through them away :)
<lgierth>
or if you're only gonna display them as-is, there's no strong need for parsing them as multiaddrs
treethought has quit [Ping timeout: 263 seconds]
<ianopolous>
well we're trying to enforce types in the few places we can, and not have a stringly typed api
<lgierth>
well you'll always have to assume that the set of known/supported multiaddr protocols expands over time, and that your impl will at times encounter protocols it doesn't (yet) know about
<lgierth>
and you can't parse a multiaddr protocol if you don't how many value parts it has
Ekho has quit [Ping timeout: 265 seconds]
<lgierth>
are you just looking for /dnsaddr, /dns4, /dns6 support in java-ipfs-api?
<ianopolous>
sure, but will go-multiaddr eventually include these types, just that now that aren't complete?
<ianopolous>
I'm trying to fix tests that have been broken for a few ipfs versions now
<lgierth>
it'll probably always live in go-multiaddr-dns
<lgierth>
and protocols for some libp2p transports live in the respective transport packages
<lgierth>
e.g. /ws and /wss
alexgr has quit [Ping timeout: 240 seconds]
<lgierth>
my advice with multiaddrs would be to only parse them if you wanna work with them -- if it's only for display, best leave them as strings
<ianopolous>
that's not really a satisfactory answer for an api though
<lgierth>
and if you wanna enforce the type just so you can safely POST or so, then the endpoint will validate it anyway
<lgierth>
so, even if you do add support for /dns*, the problem remains that you will at one point encounter multiaddrs that you don't know about, and thus can't parse
<ianopolous>
that's fine, but we should be able to parse the bootstrap addresses
<lgierth>
and also the other way around: you build multiaddrs which look valid to you that you write to some ipfs api endpoint who doesn't know about them
<lgierth>
what's blocking you from just implementing go-multiaddr-dns in java?
<lgierth>
(or was it just that the go package was hard to find)
<lgierth>
totally agreed about linking stuff in the docs -- we're working on a general docs overhaul too
Ecran has quit [Quit: Going offline, see ya! (www.adiirc.com)]
<ianopolous>
nothing is blocking me apart from I only just discovered that repo :-)
<lgierth>
:)
colatkinson has joined #ipfs
<lgierth>
and you surfaced a super good point that deserves a good answer in the docs with advice what to do
<lgierth>
(what to do if i can't parse a multiaddr)
<ianopolous>
could you point me to the ws and wss encodings too?
<lgierth>
libp2p/go-ws-transport
<lgierth>
and libp2p/go-libp2p-circuit for the /p2p-circuit protocol