alanshaw changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.4.22 and js-ipfs 0.40 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of
mithilarun has quit [Remote host closed the connection]
mithilarun has joined #ipfs
mithilarun has quit [Ping timeout: 268 seconds]
fleeky has quit [Ping timeout: 260 seconds]
<c0ncord>
it's not an issue, more like a feature request
KeiraT has quit [Remote host closed the connection]
<c0ncord>
"For now, we have to accept, that neither encryption nor any sort of authorization and authentication is part of IPFS. So we have to find a way to deal with this — or just sit back, relax and wait for better times."
plexigras has quit [Ping timeout: 248 seconds]
smith-e has joined #ipfs
fleeky has joined #ipfs
turona has quit [Ping timeout: 272 seconds]
turona has joined #ipfs
turona has quit [Max SendQ exceeded]
turona has joined #ipfs
smith-e_ has joined #ipfs
smith-e has quit [Ping timeout: 265 seconds]
smith-e_ has quit [Quit: Going offline, see ya! (www.adiirc.com)]
The_8472 has quit [Ping timeout: 248 seconds]
The_8472 has joined #ipfs
mauz555 has joined #ipfs
_jrjsmrtn has quit [Ping timeout: 260 seconds]
__jrjsmrtn__ has joined #ipfs
mithilarun has quit [Remote host closed the connection]
maggotbrain has quit [Remote host closed the connection]
zeden has quit [Quit: WeeChat 2.6]
maggotbrain has joined #ipfs
zeden has joined #ipfs
shizy has quit [Ping timeout: 272 seconds]
brianhoffman_ has joined #ipfs
KeiraT has joined #ipfs
tsrt^ has joined #ipfs
brianhoffman has quit [Ping timeout: 265 seconds]
brianhoffman_ is now known as brianhoffman
KeiraT has quit [Client Quit]
KeiraT has joined #ipfs
Ai9zO5AP has quit [Quit: WeeChat 2.5]
JCaesar has quit [Quit: irc_error]
derpadmin has joined #ipfs
mowcat has quit [Remote host closed the connection]
Clarth3 has quit [Quit: Leaving]
KeiraT has quit [Quit: KeiraT]
KeiraT has joined #ipfs
KeiraT has quit [Remote host closed the connection]
KeiraT has joined #ipfs
_whitelogger has joined #ipfs
lalilulelo has quit [Quit: Leaving]
CCR5-D32 has quit [Quit: ZZZzzz…]
thelounge078 has quit [Ping timeout: 260 seconds]
thelounge078 has joined #ipfs
thelounge078 has quit [Ping timeout: 260 seconds]
derpadmin has quit [Quit: Leaving]
<odisseus[m]>
That article is wrong, at least in some statements.
<odisseus[m]>
For example it says that by invoking `ipfs add` on your data, you publish those data "on 17 different sites", because there are 17 IPFS gateways at the moment
user_51 has quit [Ping timeout: 265 seconds]
kakra has joined #ipfs
user_51 has joined #ipfs
hurikhan77 has quit [Ping timeout: 265 seconds]
Belkaar_ has quit [Ping timeout: 265 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
elfatherbrown has joined #ipfs
zeden has quit [Quit: WeeChat 2.6]
delli3 has joined #ipfs
andi- has quit [Ping timeout: 245 seconds]
maxzor has joined #ipfs
verin0x8 has joined #ipfs
verin0x has quit [Ping timeout: 240 seconds]
verin0x8 is now known as verin0x
jcea has quit [Quit: jcea]
_whitelogger has joined #ipfs
mauz555 has quit [Remote host closed the connection]
andi- has joined #ipfs
mauz555 has joined #ipfs
c0ncord has quit [Ping timeout: 246 seconds]
mauz555 has quit []
AbramAdelmo_ has joined #ipfs
AbramAdelmo has quit [Read error: Connection reset by peer]
joocain2 has quit [Ping timeout: 240 seconds]
joocain2 has joined #ipfs
flacks has quit [Quit: Leaving]
c0ncord has joined #ipfs
<ShokuninDiscord[>
only 17? We run one of them
<JorropoDiscord[m>
that false anyway
maxzor has quit [Ping timeout: 260 seconds]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
elfatherbrown has quit [Ping timeout: 246 seconds]
maxzor has quit [Remote host closed the connection]
bader515[m] has joined #ipfs
Trieste has quit [Ping timeout: 268 seconds]
Trieste has joined #ipfs
ljmf00 has quit [Ping timeout: 258 seconds]
ljmf00 has joined #ipfs
_whitelogger has joined #ipfs
Trieste has quit [Ping timeout: 268 seconds]
}ls{ has joined #ipfs
Trieste has joined #ipfs
Newami has joined #ipfs
Newami has quit [Remote host closed the connection]
stoopkid_ has quit [Quit: Connection closed for inactivity]
smith-e_ has joined #ipfs
cxl000 has quit [Ping timeout: 260 seconds]
cxl000 has joined #ipfs
ygrek_ has quit [Ping timeout: 240 seconds]
ipfs-stackbot has quit [Remote host closed the connection]
Jybz has joined #ipfs
ipfs-stackbot has joined #ipfs
bornjre has joined #ipfs
insanity[m]1 has joined #ipfs
pecastro has joined #ipfs
smith-e_ has quit [Quit: Going offline, see ya! (www.adiirc.com)]
smith-e has joined #ipfs
mortdeus has joined #ipfs
joocain2 has quit [Remote host closed the connection]
joocain2 has joined #ipfs
Guest69112 has joined #ipfs
fiiirree has quit [Ping timeout: 265 seconds]
rendar has joined #ipfs
CCR5-D32 has joined #ipfs
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
joocain2 has quit [Ping timeout: 240 seconds]
joocain2 has joined #ipfs
mowcat has joined #ipfs
RamRanRa has joined #ipfs
<swedneck>
<odisseus[m] "For example it says that by invo"> well they're sort of correct, the data is at least theoretically available from any public gateway
<swedneck>
though it's a fairly misleading statement
thelounge078 has joined #ipfs
smith-e has left #ipfs ["Closing Window"]
smith-e has joined #ipfs
Trieste has quit [Ping timeout: 260 seconds]
AbramAdelmo_ has quit [Read error: Connection reset by peer]
AbramAdelmo has quit [Remote host closed the connection]
joocain2 has quit [Remote host closed the connection]
joocain2_ has joined #ipfs
altoria has joined #ipfs
<altoria>
hi folks - I am trying to interact with the IPFS MFS via JS API and I would like to update my MFS nodes with new CIDs: for example change the CID of ''/abcd/" from Qm1234 to Qm5678. I think it is at least theoretically possible according to how the MFS is built, anyone knows how can I implement such a change? Thanks :)
_whitelogger has joined #ipfs
AbramAdelmo_ has joined #ipfs
clemo has joined #ipfs
CCR5-D32 has quit [Quit: ZZZzzz…]
plexigras has quit [Quit: WeeChat 2.6]
llorllale has joined #ipfs
lord| has quit [Read error: Connection reset by peer]
lord| has joined #ipfs
<odisseus[m]>
swedneck:permaweb.io:
<odisseus[m]>
* swedneck:permaweb.io, the article implies that anything you publish into IPFS gets replicated to at least 17 different hosts
<odisseus[m]>
This is obviously not true
<odisseus[m]>
It doesn't matter, whether there are 17 or 9000 gateways, as long as the data is pinned on a single node — your own.
<odisseus[m]>
As soon as that single node goes offline, all those gateways become unable to serve your data
<aphelionz[m]>
*after a garbage collection grace period if the data were replicated (typically 30 days)
hello23786a has quit [Remote host closed the connection]
hello23786a has joined #ipfs
<swedneck>
and presuming no one else has replicated the data
clemo has quit [Remote host closed the connection]
clemo has joined #ipfs
shizy has joined #ipfs
elfatherbrown has joined #ipfs
jokoon has joined #ipfs
<odisseus[m]>
Yes, but it is not guaranteed that your data is replicated even once, let alone 17 times
smith-e_ has joined #ipfs
stoopkid_ has joined #ipfs
elfatherbrown has quit [Quit: Leaving]
smith-e__ has quit [Ping timeout: 268 seconds]
gumupho has joined #ipfs
bengates has joined #ipfs
cp- has quit [Quit: Disappeared in a puff of smoke]
hello23786a has quit [Remote host closed the connection]
smith-e_ has joined #ipfs
smith-e__ has quit [Ping timeout: 268 seconds]
letty has left #ipfs [#ipfs]
bornjre has quit [Read error: Connection reset by peer]
bengates has quit [Remote host closed the connection]
mortdeus has quit [Remote host closed the connection]
mortdeus has joined #ipfs
altoria has quit [Remote host closed the connection]
internetman[m] has joined #ipfs
internetman[m] has left #ipfs [#ipfs]
Guest69112 has quit [Max SendQ exceeded]
fiiirree has joined #ipfs
jokoon has quit [Read error: Connection reset by peer]
Adbray has joined #ipfs
jokoon has joined #ipfs
mithilarun has joined #ipfs
AbramAdelmo_ has quit [Remote host closed the connection]
AbramAdelmo has joined #ipfs
KempfCreative has joined #ipfs
AbramAdelmo has quit [Remote host closed the connection]
llorllale has joined #ipfs
bornjre has joined #ipfs
rendar has quit []
jokoon has quit [Read error: Connection reset by peer]
jokoon has joined #ipfs
tec__ has quit [Remote host closed the connection]
tec__ has joined #ipfs
piltii-heiskanen has joined #ipfs
AbramAdelmo_ has joined #ipfs
smith-e__ has joined #ipfs
cheet has quit [Quit: ZNC 1.8.x-nightly-20190530-13450c7f - https://znc.in]
smith-e___ has joined #ipfs
smith-e_ has quit [Ping timeout: 268 seconds]
smith-e__ has quit [Ping timeout: 265 seconds]
gumupho has quit [Quit: Leaving]
hello23786a has joined #ipfs
Ai9zO5AP has joined #ipfs
cheet has joined #ipfs
cheet has quit [Remote host closed the connection]
malfort has joined #ipfs
developer24 has joined #ipfs
clemo has quit [Ping timeout: 260 seconds]
hello23786a has quit [Remote host closed the connection]
developer24 has quit [Client Quit]
cheet has joined #ipfs
mithilarun has quit [Remote host closed the connection]
AbramAdelmo_ has quit [Remote host closed the connection]
AbramAdelmo has joined #ipfs
Newami has joined #ipfs
developer24 has joined #ipfs
Newami has quit [Remote host closed the connection]
MAUMAURICEDU45 has joined #ipfs
MAUMAURICEDU45 has quit [Remote host closed the connection]
MDude has quit [Ping timeout: 240 seconds]
ColinG[m] has joined #ipfs
MDude has joined #ipfs
llorllale has quit [Quit: WeeChat 1.9.1]
CCR5-D32 has joined #ipfs
cheet has quit [Read error: Connection reset by peer]
cheet has joined #ipfs
AbramAdelmo has quit [Remote host closed the connection]
nasostr[m] has joined #ipfs
delli3 has quit [Quit: Leaving]
ljmf00 has quit [Ping timeout: 260 seconds]
stoopkid_ has quit [Quit: Connection closed for inactivity]
ljmf00 has joined #ipfs
ljmf00 has quit [Client Quit]
Ecran has joined #ipfs
ljmf00 has joined #ipfs
jokoon has quit [Quit: Leaving]
AbramAdelmo has joined #ipfs
AbramAdelmo has quit [Read error: Connection reset by peer]
AbramAdelmo_ has joined #ipfs
brianhoffman has quit [Ping timeout: 240 seconds]
brianhoffman has joined #ipfs
hqdruxn08_ has quit [Ping timeout: 256 seconds]
cyberguy999[m] has joined #ipfs
hqdruxn08 has joined #ipfs
Ai9zO5AP has quit [Ping timeout: 240 seconds]
ipfs-stackbot has quit [Remote host closed the connection]
Ai9zO5AP has joined #ipfs
Clarth3 has joined #ipfs
ipfs-stackbot has joined #ipfs
legatus has joined #ipfs
legatus has quit [Quit: Leaving]
<bonedaddyDiscord>
@eleitle: I wrote a client in go that in benchmark is roughly 10x faster than go-ipfs when handling large amounts of data
<bonedaddyDiscord>
lastdigitofpi: I've already got a client that could handle that 😉
<bonedaddyDiscord>
personally speaking there are a number of things that lead to go-ipfs' poor performance. most notably is it's pinning system, which stores the pinset as a dag itself. Easy fix to this is reference counting. Then there's issues like `jbenet/goprocess` which make turning a goroutine from a lightweight op to a non-lightweight op. When you spin up 10k+ goroutines the allocs that goprocess does start to become noticeable.
<bonedaddyDiscord>
There's a lot of inefficient interface abstractions at dozens of levels which dont need to be done, and lead to performance impacts due to needing to handle type conversions.
caskd has quit [Quit: Freeman you fool!!]
<bonedaddyDiscord>
also go-ipfs is very very hungry for physical CPU threads. I think partly due to the usage of `goprocess` which creates 2 goroutiens for every 1 that's created, so the runtime spends a lot of time on context-switching the goroutines. If you have afford a large number of threads you can increase go-ipfs performance to a noticeable degree, but ultimately there's an upper limit to this because at some point you'll be
<bonedaddyDiscord>
storing so many objects that iterating over the pinset becomes an extremely non-trivial task
<bonedaddyDiscord>
after adding 1TB of of unixsfs data at deafult chunk-size, go-ipfs data ingestion performance drops by about 50%
<mortdeus>
is ipfs supposed to be like a global fs for everyone, or a bunch of little decentralized networks inside the one that already exsists?
<bonedaddyDiscord>
a global one
mowcat has quit [Remote host closed the connection]
caskd has joined #ipfs
caskd has quit [Client Quit]
caskd has joined #ipfs
<mortdeus>
and the goal being to allow for others to tell everybody that they already have the data they need or something before they copy it?
<bonedaddyDiscord>
should probs read the docs tbh
<bonedaddyDiscord>
they talk about this stuff
<mortdeus>
right, i glanced over it awhile back, ill refresh myself on it real quick.
<mortdeus>
im just curious the nature of it being global, how exactly that works.
<bonedaddyDiscord>
one thing to note, you can easily make little decentralized ipfs networks, but the default behavior is "one global swarm"
<bonedaddyDiscord>
basically if you want `QmCat` you ask your peers if they have `QmCat` or if they know who has `QmCat`. Repeat until you find source of `QmCat` or you timeout
<bonedaddyDiscord>
for specific details on that, you will want to read about `bitswap`
smith-e_ has joined #ipfs
smith-e___ has quit [Ping timeout: 268 seconds]
Clarth3 has quit [Ping timeout: 265 seconds]
stoopkid_ has joined #ipfs
shizy has joined #ipfs
joocain2_ has quit [Ping timeout: 240 seconds]
joocain2 has joined #ipfs
Jybz has quit [Quit: Konversation terminated!]
Minimons_ has joined #ipfs
Minimons has quit [Read error: Connection reset by peer]
caskd has quit [Quit: Freeman you fool!!]
caskd has joined #ipfs
Discord[m]1 is now known as CCP-nCov8431[m]
hqdruxn08_ has joined #ipfs
hqdruxn08 has quit [Ping timeout: 256 seconds]
shizy has quit [Ping timeout: 268 seconds]
Soo_Slow has joined #ipfs
delli3 has joined #ipfs
lord| has quit [Read error: Connection reset by peer]
lord| has joined #ipfs
plexigras has joined #ipfs
ice has quit [Read error: Connection reset by peer]