stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.4.18 and js-ipfs 0.33 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of Con
pecastro has quit [Read error: Connection reset by peer]
sammacbeth has quit [Ping timeout: 250 seconds]
sammacbeth has joined #ipfs
thomasanderson has joined #ipfs
mazeto has joined #ipfs
<postables[m]>
i think that largely would depend on your CPU power, and disk throughput
<postables[m]>
i dont believe repo conversion has to query the network so you should be good on that front
<bitspill>
it's a pretty good cpu, disk will probably be what holds me back I'm still waiting for the backup `cp -R .ipfs ipfsBackup` to finish
IRCsum has quit [Read error: Connection reset by peer]
thomasanderson has quit [Ping timeout: 250 seconds]
IRCsum has joined #ipfs
<postables[m]>
should use rsync with that 😄
<bitspill>
guess I should have
<bitspill>
it took 36 minutes to convert a repo with 100k NumObjects I'm scared what 16million is gonna be like
<bitspill>
although, they're completely different spec'd machines so hopefully it's not too bad
spinza has quit [Quit: Coyote finally caught up with me...]
dimitarvp has quit [Quit: Bye]
thomasanderson has joined #ipfs
<postables[m]>
that should be interesting haha, I'd be curious to hear how that fares out
thomasanderson has quit [Ping timeout: 252 seconds]
thomasanderson has quit [Ping timeout: 250 seconds]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
gmoro has joined #ipfs
JSH has joined #ipfs
xcm has quit [Ping timeout: 250 seconds]
florianH has joined #ipfs
JSH has quit [Client Quit]
hellwolf has joined #ipfs
hellwolf has quit [Client Quit]
xcm has joined #ipfs
<TeeCee>
Hi
rendar has joined #ipfs
thomasanderson has joined #ipfs
thomasanderson has quit [Ping timeout: 264 seconds]
<cyberwolf[m]>
0/
woss_io has quit [Ping timeout: 246 seconds]
spinza has quit [Quit: Coyote finally caught up with me...]
<dobrosketchkun[m>
Hello! Can someone tell me how long pubsub messages live in the swarm in common?
shalokshalom_ is now known as ShalokShalom
thomasanderson has joined #ipfs
gmoro has quit [Ping timeout: 246 seconds]
thomasanderson has quit [Ping timeout: 260 seconds]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
spinza has joined #ipfs
spinza has quit [Quit: Coyote finally caught up with me...]
andrelom has joined #ipfs
spinza has joined #ipfs
gmoro has joined #ipfs
thomasanderson has joined #ipfs
cwahlers_ has joined #ipfs
cwahlers has quit [Ping timeout: 240 seconds]
andrelom has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
thomasanderson has quit [Ping timeout: 250 seconds]
rcat has joined #ipfs
andrelom has joined #ipfs
andrelom has quit [Ping timeout: 252 seconds]
konubinix_ has joined #ipfs
thomasanderson has joined #ipfs
konubinix has quit [Ping timeout: 245 seconds]
thomasanderson has quit [Ping timeout: 252 seconds]
joseminao has joined #ipfs
joseminao has left #ipfs [#ipfs]
thomasanderson has joined #ipfs
thomasanderson has quit [Ping timeout: 260 seconds]
pecastro has joined #ipfs
aarshkshah1992 has joined #ipfs
<aarshkshah1992>
Hey guys
<aarshkshah1992>
If I understand correctly, IPFS only stores the provider IDs/addresses in kademelia DHT, not the actual data
<aarshkshah1992>
Why is that ? Why not store the data itself in the DHT ?
<aarshkshah1992>
So for example, if I want to save data `d` with content ID `c`, I'll (kademelia) just look up the 20 `closest` (XOR distance) neighbours to `c` and store the data in those 20 nodes rather than just storing my nodeId there.
zeden has joined #ipfs
thomasanderson has joined #ipfs
thomasanderson has quit [Ping timeout: 250 seconds]
ShalokShalom has quit [Quit: Konversation terminated!]
Steverman has joined #ipfs
malaclyps has quit [Read error: Connection reset by peer]
malaclyps has joined #ipfs
reit has quit [Ping timeout: 240 seconds]
thomasanderson has joined #ipfs
kapil____ has quit [Quit: Connection closed for inactivity]
thomasanderson has quit [Ping timeout: 268 seconds]
xcm has quit [Remote host closed the connection]
tsglove2 is now known as tsglove
xcm has joined #ipfs
ONI_Ghost has quit [Read error: Connection reset by peer]
ONI_Ghost has joined #ipfs
ONI_Ghost has quit [Read error: Connection reset by peer]
ONI_Ghost has joined #ipfs
spencer has joined #ipfs
clemo has joined #ipfs
dimitarvp has joined #ipfs
ccll7 has joined #ipfs
ccll7 has quit [Quit: Leaving]
spencer has quit [Remote host closed the connection]
thomasanderson has joined #ipfs
cwahlers_ has quit [Quit: Gone fishing]
ccll7 has joined #ipfs
thomasanderson has quit [Ping timeout: 252 seconds]
thomasanderson has quit [Ping timeout: 268 seconds]
MDude has quit [Quit: Going offline, see ya! (www.adiirc.com)]
IRCsum has quit [Ping timeout: 250 seconds]
cratliff has joined #ipfs
<daftaupe>
thanks lidel
<aschmahmann[m]>
aarshkshah1992: There are a few answers here, but the simplest is that DHT nodes are run by people as effectively a "donation" to keep the service up and running. At the end of the day people's bits have to be stored somewhere and if you're not going to want to pay someone to store the data you should either/both A) make sure the amount of data you want stored is quite B) offer up excess storage, compute, or some other
<aschmahmann[m]>
resources that you have to the network
<aschmahmann[m]>
for these reasons one of the use cases of filecoin that I'm excited by is effectively having free data backup by offering storage space on my desktop and using that income to pay for storing data on the network. It gives me the benefits of data backup (my data is safe even if my computer catches fire) but costs me very little.
IRCsum has joined #ipfs
cwahlers_ has joined #ipfs
cwahlers has quit [Ping timeout: 252 seconds]
talpers has joined #ipfs
thomasanderson has joined #ipfs
talpers has left #ipfs [#ipfs]
arbiter34 has joined #ipfs
thomasanderson has quit [Ping timeout: 250 seconds]
Steverman has joined #ipfs
cudencuden has joined #ipfs
cudencuden has quit [Remote host closed the connection]
cudencuden has joined #ipfs
detran has joined #ipfs
<mntr0[m]>
which one of you guys is working on ipfs for openbsd?
detran has quit [Quit: ERC (IRC client for Emacs 26.1)]
detran has joined #ipfs
<Kolonka[m]>
I do hope Filecoin gives the opportunity to select for redundancy over say, storage time
<Kolonka[m]>
e.g. if I want 20mb of content pinned for a week, I could pin 20mb of content for other people for a week
<Kolonka[m]>
I could also pin 40mb, but rather than paying what I earn to store my content for twice as long, I could ask for twice as many nodes to seed it
<Kolonka[m]>
(since, if I'm constantly pinning at least 20mb for others, I earn enough to store my content indefinitely anyway, presumably)
<daftaupe>
mntr0[m], I actually compiled it from source on DragonFlyBSD today
<daftaupe>
but I'm not "working on" ipfs
zeden has quit [Quit: WeeChat 2.2]
zeden has joined #ipfs
<mntr0[m]>
daftaupe: obsd guys are working on it you should join them. im just an interested bystander trying to be a cheerleader. look into "pledge" and "unveil" and youll see why openbsd is the most important target for ipfs.
kapil____ has quit [Quit: Connection closed for inactivity]
}ls{ has joined #ipfs
<daftaupe>
I don't use OpenBSD, I'll check that later mntr0[m]
<daftaupe>
thanks !
maxzor has quit [Quit: Leaving]
Mateon3 has joined #ipfs
Mateon1 has quit [Ping timeout: 268 seconds]
Mateon3 is now known as Mateon1
thomasanderson has joined #ipfs
thomasanderson has quit [Ping timeout: 264 seconds]
ylp has quit [Quit: Leaving.]
clemo has quit [Ping timeout: 272 seconds]
<mntr0[m]>
daftaupe: no problem dude. pledge and unveil make openbsd the only ideal platform for ipfs but it needs dev work and im being a cheerleader right now
<mntr0[m]>
i think ipfs devs are out of their minds for not seeing that
infinitesum has joined #ipfs
thomasanderson has joined #ipfs
thomasanderson has quit [Remote host closed the connection]
thomasanderson has joined #ipfs
inetic has quit [Ping timeout: 252 seconds]
<detran>
how do you generate additional ipns addresses on one node?
clemo has joined #ipfs
thomasanderson has quit [Ping timeout: 260 seconds]
dolphy has quit [Read error: Connection reset by peer]
dolphy has joined #ipfs
petroav has joined #ipfs
cwahlers_ has quit [Ping timeout: 250 seconds]
cwahlers has joined #ipfs
workfellow has joined #ipfs
chjk6x has joined #ipfs
thomasanderson has joined #ipfs
xcm has quit [Remote host closed the connection]
graphene has quit [Remote host closed the connection]
graphene has joined #ipfs
xcm has joined #ipfs
thomasanderson has quit [Ping timeout: 250 seconds]
rhalff has quit [Remote host closed the connection]
rcat has quit [Remote host closed the connection]
xcm has quit [Remote host closed the connection]
clemo has quit [Remote host closed the connection]
xcm has joined #ipfs
random_yanek has quit [Read error: Connection reset by peer]
<Kolonka[m]>
1 node = 1 peer id
stoopkid has joined #ipfs
<Kolonka[m]>
you could probably run several concurrent instances of the ipfs daemon from a single device, but I wouldn't know how to use separate keys for each of them
<Kolonka[m]>
mntr0: what are pledge and unveil?
infinitesum has quit [Quit: infinitesum]
deLta30 has quit [Quit: Leaving.]
ygrek has joined #ipfs
andrelom has joined #ipfs
benaszab[m] has joined #ipfs
random_yanek has joined #ipfs
spinza has quit [Quit: Coyote finally caught up with me...]
thomasanderson has joined #ipfs
andrelom has quit [Ping timeout: 252 seconds]
thomasanderson has quit [Ping timeout: 268 seconds]
graphene has quit [Remote host closed the connection]
graphene has joined #ipfs
spinza has joined #ipfs
andrelom has joined #ipfs
rendar has quit []
Jesin has quit [Quit: Leaving]
petroav has quit [Ping timeout: 250 seconds]
Jesin has joined #ipfs
petroav has joined #ipfs
andrelom has quit [Ping timeout: 252 seconds]
clemo has joined #ipfs
xcm is now known as Guest41444
Guest41444 has quit [Killed (card.freenode.net (Nickname regained by services))]
Jesin has quit [Quit: Leaving]
xcm has joined #ipfs
Jesin has joined #ipfs
petroav has quit [Ping timeout: 244 seconds]
graphene has quit [Remote host closed the connection]
graphene has joined #ipfs
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
cwahlers has quit [Read error: Connection reset by peer]
cwahlers has joined #ipfs
sleo9 has joined #ipfs
sleo9 has quit [Remote host closed the connection]
Fessus has quit [Ping timeout: 250 seconds]
<mntr0[m]>
Kolonka: pledge is kernel systemcall whitelisting and pledge is filesystem access whitelisting. makes it so your applications cant misbehave at the kernel level and removes a whole range of security vulnerabilities... for ipfs its literally like cookies and milk.
<Kolonka[m]>
interesting
<mntr0[m]>
i want pledged and unveiled ipfs on openbsd NOW. gonna take a lot of work for the fuse implementation because go is pretty much an experimental language. probably need to rewrite it in C
<mntr0[m]>
err the filesystem whitelisting is called unveil
<daftaupe>
mntr0[m], why do you think it's so critically important for ipfs ?
thomasanderson has joined #ipfs
<mntr0[m]>
why would i run something like ipfs on some bullshit platform that isnt secure? also why would i want to pass up on the architectural advantages that come from writing the code in a way that is compatible with pledge and unveil on other platforms like linux that dont support it?
<mntr0[m]>
also having openbsd developers look at the code is good
<mntr0[m]>
because theyre better programmers than the ipfs programmers
<mntr0[m]>
so if ipfs is popular on openbsd it will be a better product
thomasanderson has quit [Ping timeout: 250 seconds]
<mntr0[m]>
im a big fan of ipfs taking over the world but if it isnt pledged and unveiled its useless for most interesting use cases
<daftaupe>
are all the software available on openbsd using unveil and pledge ?
<xelra>
What's unveil and pledge`
<xelra>
?
<mntr0[m]>
> are all the software available on openbsd using unveil and pledge ?
<mntr0[m]>
most
<mntr0[m]>
well unveil is newer but most stuff is pledged
<mntr0[m]>
xelra: scroll up i just answered somone else who asked that
<xelra>
I read it, but I still don't get the concept.
<xelra>
Kolonka[m]: About filecoin, yes, it should.
<mntr0[m]>
pledge is similar to capsicum and seccomp except not stupid
<mntr0[m]>
you tell the kernel what kind of systemcalls are acceptable for the process so if theres a security bug it is likely to fail
<xelra>
I think I understand now.
<mntr0[m]>
its like containerization at the systemcall level on a per subroutine basis
<xelra>
So does this need "the whitelist" programmed into the kernel?
<xelra>
Or can you tell it at init during runtime?
dolphy has quit [Remote host closed the connection]
<mntr0[m]>
kernel has to support loading rules at runtime
<mntr0[m]>
but linux does this with seccomp
<xelra>
So you're requesting this security feature for ipfs?
<xelra>
Right?
<mntr0[m]>
and freebsd does it w capsicum
<mntr0[m]>
both suck ass
<mntr0[m]>
im requesting that the ipfs team maintains a port of ipfs for openbsd as the highest priority platform, with pledge and unveil support.
<daftaupe>
well I'm not sure that will happen, it's more a matter of openbsd devs to support it
<mntr0[m]>
i want to see ipfs reimplement in c too but you cant have everything lol.
<xelra>
I think that you're right that historically apps who've made OpenBSD their primary target have fared very well.
<mntr0[m]>
i think ipfs should prioritize openbsd and all ipfs devs should have to run openbsd on their workstations
<xelra>
There's nothing stopping you from making an implementation in c.
<daftaupe>
ok, you do are a troll :D
<mntr0[m]>
well my goal is to share my opinions right now thats all.
dolphy has joined #ipfs
<mntr0[m]>
if ipfs makes openbsd its priority platform it will take over the world immediately because everyone who runs linix and osx and windows and freebsd will have to start using it
<xelra>
Well, please don't do it in that way. This channel is a pretty serious platform for discussion and we'd like to keep it that way.
<mntr0[m]>
the connection isnt obvious of course
<mntr0[m]>
and i sound like a troll to you but that doesnt change the fact that i am correct
ONI_Ghost has quit [Ping timeout: 244 seconds]
<mntr0[m]>
there is no real good distributed secure filesystem solution. it doesnt exist. the day openbsd says "this is it guys" everybody else will use it
Tiez has quit [Quit: WeeChat 2.3]
<xelra>
I kinda agree on that.
<mntr0[m]>
ok so dont call me a troll
<xelra>
I didn't.
plexigras has joined #ipfs
<xelra>
In the past I've looked at OpenBSD many times and wondered what I could use it for. In the end I always took the lazy and comfortable way and chose other unixes though.
florianH has quit [Quit: Connection closed for inactivity]
thomasanderson has joined #ipfs
<mntr0[m]>
xelra: the day ipfs announces that the ipfs devs run openbsd is the day google and microsoft and oracle have executives meeting to discuss their ipfs strategy
<mntr0[m]>
until then ipfs is a toy that will e replaced by whoever supports pledge and unveil and capsicum and seccomp
Encrypt has joined #ipfs
<mntr0[m]>
ipfs is by far the most likely contender for the worlds distributed secure file system
<mntr0[m]>
by a looooong shot
neuthral has quit [Ping timeout: 245 seconds]
thomasanderson has quit [Ping timeout: 252 seconds]
<mntr0[m]>
i want the actual developer workstations for the whole ipfs team running openbsd
neuthral has joined #ipfs
ygrek has quit [Ping timeout: 240 seconds]
<mntr0[m]>
i want ipfs developers sending cat videos to their own family members with openbsd
<mntr0[m]>
if that happens then ipfs will eventually be mainlined into every kernel just like nfs
<mntr0[m]>
i want ipfs support to be like fat32 support
<mntr0[m]>
windows linux bsd android ios osx and everything supports fat32. same shoukd be true for ipfs.
Fessus has joined #ipfs
graphene has quit [Remote host closed the connection]
graphene has joined #ipfs
thomasanderson has joined #ipfs
<mntr0[m]>
you know what? i will PERSONALLY roll a custom distro with everything nice and pretty for the ipfs devs so it has everything they could want in a developer operating system with a beautiful gui madenin the openbsd opinionated tradition
<mntr0[m]>
ill even test it on their machines and help them install it
<mntr0[m]>
ill even do a presentation webinar explaining the benefits and introducing them to the ecosystem
<mntr0[m]>
ill fucking send them ipenbsd bumper stickers
thomasanderson has quit [Ping timeout: 250 seconds]
<lidel>
two stickers and i am sold
<jrabbit>
lol
<detran>
Is there an alternative to IPNS for mutable pointers? I'd like to be able to generate arbitrary pub/priv keypairs and use those to create new IPNS namespaces
<jrabbit>
detran: ipns values can change!
<detran>
I think I get that, what I'd like is for a single node to be able to publish on behalf of multiple users
<jrabbit>
detran: I think you might want to look at the dns conenction and making your own offshoot or specifically the pubsub stuff?
<jrabbit>
detran: oh.
<jrabbit>
detran: might need to write some go... donno if you could use the api hopefully yes b/c the internals are a bit hard to cut your teeth on i've found
<detran>
does that also mean that IPNS namespaces are tied to physical machines? i.e. if my server blows up would I be able to set up the same IPNS hash on another one?
<detran>
or can you export the keys?
<lidel>
mntr0[m], afaik the long term plan is to create libp2p daemon (and eventually move it to kernels) that can be used/shared by ipfs and other apps, just like tor (userland) or tcp/ip (kernel) can be used by various software to reach other machines
<jrabbit>
detran: good q; no clue
<bigs>
that's not far off the mark lidel
<lidel>
bigs, its a cool plan :)
<bigs>
hahaha :D
<postables[m]>
detran: you just need access to the keys and yes it's possible to export keys
<postables[m]>
I wrote some code to export IPFS keys as mnemonic phrases. Works for RSA and ED25519 keys
<postables[m]>
Althoug RSA ends up being many words and unwieldy
<postables[m]>
That should work with Sec1p keys as well
<postables[m]>
As long as you have access to the key you can control the IPNS records that are published to the DHT. However publishing from different machines can result in certain nodes having different versions of your records
Papa_Alpaka has joined #ipfs
hph^^ has quit []
cwahlers_ has joined #ipfs
thomasanderson has joined #ipfs
<postables[m]>
Be warned though IPNS is EXTREMELY slow at the moment lol
cwahlers has quit [Ping timeout: 244 seconds]
thomasanderson has quit [Ping timeout: 264 seconds]
cratliff has quit [Ping timeout: 268 seconds]
Encrypt has quit [Quit: Quit]
Cavedude has joined #ipfs
Cavedude_ has quit [Ping timeout: 246 seconds]
godlike74[m] has joined #ipfs
MDude has joined #ipfs
<Magik6k>
detran: you can push multiple IPNS names from a single node using `ipfs key` and `ipfs name publish --key=<somekey>` apis. As for making it fast - it really depends on your usecase, but there are workarounds for some cases - if clients check for changes frequently you should be able to benefit from `--enable-namesys-pubsub` enabled on publishers/clients. If your app publishes data that builds on older data (like git repos or
<Magik6k>
blockchains) you may benefit from `ipfs name resolve --stream` which may get you old values first, but is usually really quick to first result
<detran>
Magik6k: thanks, this looks really promising.
<detran>
If it is what I think it is, I should be able to have an arbitrary number of IPNS names on a node.
<postables[m]>
magik6k: it doesn't look like my client has `ipfs name resolve --stream`, it has --dhtrc, and --dhtt
<postables[m]>
*edit:* ~~magik6k: it doesn't look like my client has `ipfs name resolve --stream`, it has --dhtrc, and --dhtt~~ -> magik6k: it doesn't look like my client has `ipfs name resolve --stream`, it has `--dhtrc`, and `--dhtt`
thomasanderson has joined #ipfs
graphene has quit [Remote host closed the connection]
graphene has joined #ipfs
thomasanderson has quit [Ping timeout: 268 seconds]
<Magik6k>
It should be in 0.4.18
<postables[m]>
ah there it is. was checking on my laptop which has 0.4.17, but my server nodes have it. thanks
spinza has quit [Quit: Coyote finally caught up with me...]
spinza has joined #ipfs
zeden has quit [Quit: WeeChat 2.2]
thomasanderson has joined #ipfs
thomasanderson has quit [Ping timeout: 250 seconds]
detran has quit [Ping timeout: 250 seconds]
arbiter34 has quit [Quit: arbiter34]
graphene has quit [Remote host closed the connection]
graphene has joined #ipfs
lifeofguenter has joined #ipfs
lifeofguenter has quit [Remote host closed the connection]
cgie11 has joined #ipfs
lassulus has quit [Ping timeout: 245 seconds]
lassulus has joined #ipfs
cgie11 has quit [Read error: Connection reset by peer]
graphene has quit [Remote host closed the connection]
thomasanderson has joined #ipfs
graphene has joined #ipfs
chjk6x has quit [Ping timeout: 250 seconds]
thomasanderson has quit [Ping timeout: 252 seconds]
vyzo has quit [Quit: Leaving.]
cwahlers has joined #ipfs
cwahlers_ has quit [Ping timeout: 244 seconds]
sammacbeth has quit [Ping timeout: 250 seconds]
Steverman has quit [Ping timeout: 246 seconds]
graphene has quit [Remote host closed the connection]