joocain2 has quit [Remote host closed the connection]
morteza_ has joined #ipfs
joocain2 has joined #ipfs
morteza has quit [Ping timeout: 252 seconds]
joseminao has joined #ipfs
joseminao has quit [Read error: Connection reset by peer]
joseminao has joined #ipfs
gmoro has quit [Ping timeout: 276 seconds]
ONI_Ghost has quit [Read error: Connection reset by peer]
SunflowerSociety has joined #ipfs
reit has quit [Ping timeout: 252 seconds]
Mateon2 has joined #ipfs
Mateon1 has quit [Ping timeout: 252 seconds]
Mateon2 is now known as Mateon1
fazo has joined #ipfs
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
BeerHall has joined #ipfs
ismay has joined #ipfs
BeerHall has quit [Quit: BeerHall]
asymptotically2 has joined #ipfs
bomb-on has joined #ipfs
graphene has joined #ipfs
asymptotically has quit [Ping timeout: 256 seconds]
mauz555 has joined #ipfs
asymptotically2 has quit [Ping timeout: 256 seconds]
malaclyps has quit [Read error: Connection reset by peer]
malaclyps has joined #ipfs
<svitx>
I'm struggling a bit with 'pin' trying to extract a large dataset; I have a 'largeish' 2 TB dataset that contains data inserted via ipfs add -r on directories with ~2gb each. Pinning to another node just seems to fail to complete, whereas pulling it out via /api/v0/get?archive=true succeeds every time.
<svitx>
I did fill up the disk at one point during the initial ingest -- but I'm confused how one path to retrieve the data is having no issue, whereas the other is failing.
plexigras has joined #ipfs
<r0kk3rz>
'fail to complete' how exactly
kaminishi has joined #ipfs
<svitx>
The blocks count up when I do a pin --progress, but the command never returns, and the file is never successfully pinned.
ismay has quit [Ping timeout: 250 seconds]
hugbubby has joined #ipfs
<svitx>
If I pull it out via archive, extract the tarball and re-add it via 'add -r', it comes back with the same key that I tried to pin, and is then present in a 'pin ls --type=recursive' on the new node
<hugbubby>
so if I have a program in Rust that I want to access IPFS what would I need? a client or an implemmentation?
<hugbubby>
All I need really need is persistent data storage over a reliable P2P network.
<r0kk3rz>
hugbubby: if you run an go-ipfs node you just need to access the http api
<hugbubby>
I see, so the Client is an HTTP Api to access an implemmentation running on the host machine
}ls{ has quit [Ping timeout: 252 seconds]
tombusby has quit [Remote host closed the connection]
tombusby has joined #ipfs
<r0kk3rz>
yeah thats it, you need to have an IPFS node somewhere
<hugbubby>
How big would the go-ipfs be as a dependency for the application I'm working on?
<svitx>
r0kk3rz: the source node is running 0.4.14, which I saw had some problems around ipfs-cluster with pinning (i.e. https://github.com/ipfs/ipfs-cluster/issues/280), maybe the manual pinning is triggering the same code path.
<svitx>
I'm very reluctant to try upgrading a node that isn't behaving well without it mirroring first, so I guess I'll stick with this tar/re-pin process...
<hugbubby>
the problem I'm solving is definitely persistent data storage. I'm just wondering what it would entail to make installing an ipfs node a dependency
joocain2 has quit [Remote host closed the connection]
SunflowerSociety has quit [Read error: Connection reset by peer]
ONI_Ghost has joined #ipfs
joocain2 has joined #ipfs
<r0kk3rz>
svitx: its hard to say whether its not completing or just really slow
<r0kk3rz>
2TB in blocks is going to be a lot of blocks
mauz555 has quit [Remote host closed the connection]
asymptotically has joined #ipfs
<svitx>
r0kk3rz: right, but I'm having it fail and never return when doing a single recursive pin for ~2gb
<svitx>
across GigE, and me leaving it alone for half the day
<svitx>
I'm pretty sure it's my source node having filled up at one point + issues with 0.4.14, as I assume other people are moving around large datasets too and succeeding. It's just a painful failure mode to find myself in without the tools to debug it.
<r0kk3rz>
i wouldnt assume that too much, generally ipfs is not super fast
<r0kk3rz>
not for point to point transfers anyway
<svitx>
Is that by design, or just something that's not been optimized for?
<r0kk3rz>
imo its a trade-off, if you chunk files into addressable 256kb blocks, then you can get blocks from many locations
<r0kk3rz>
if you only have one source, then thats just overhead you dont need
<r0kk3rz>
so if you wanted to share your dataset with many nodes, then perhaps that trade off would be worth it
hugbubby has quit [Quit: Lost terminal]
The_8472 has quit [Ping timeout: 252 seconds]
The_8472 has joined #ipfs
user_51 has joined #ipfs
user_51 has quit [Client Quit]
user_51 has joined #ipfs
Steverman has joined #ipfs
Modding has quit [Ping timeout: 252 seconds]
Modding has joined #ipfs
jahjahmc77[m] has quit [Ping timeout: 252 seconds]
Steverman has quit [Ping timeout: 252 seconds]
<Swedneck>
why does /ipns/ resolve dnslink instead of there being a separate /dnslink/ for that?
jahjahmc77[m] has joined #ipfs
panpharmacon has quit [Remote host closed the connection]
cratliff has joined #ipfs
Encrypt has joined #ipfs
Naughtylus[m] has joined #ipfs
dimitarvp has joined #ipfs
<victorbjelkholm>
deltab: yeah, it's not really maintained atm. Try https://peerpad.net instead, way better with realtime collaboration as well
MDead has joined #ipfs
MDude has quit [Ping timeout: 245 seconds]
MDead is now known as MDude
mauz555 has joined #ipfs
mauz555 has quit [Read error: Connection reset by peer]
asymptotically has quit [Ping timeout: 256 seconds]
asymptotically has joined #ipfs
niuxxd[m] has quit [Ping timeout: 246 seconds]
niuxxd[m]1 has joined #ipfs
jouni[m] has quit [Ping timeout: 246 seconds]
jouni[m] has joined #ipfs
cratliff has quit [Ping timeout: 245 seconds]
testaccountyolo[ has quit [Ping timeout: 246 seconds]
testaccountyolo[ has joined #ipfs
victorbjelkholm[ has quit [Ping timeout: 246 seconds]
victorbjelkholm[ has joined #ipfs
joseminao has left #ipfs [#ipfs]
null1337 has quit [Ping timeout: 272 seconds]
HeWhois has quit [Ping timeout: 252 seconds]
null1337 has joined #ipfs
HeWhois has joined #ipfs
notkhris[m]1 has joined #ipfs
danielfranca[m]1 has joined #ipfs
anonymous_user[4 has joined #ipfs
lskhr[m]1 has joined #ipfs
DavidStrauss[m]1 has joined #ipfs
xMajedz[m]1 has joined #ipfs
Manu[m]11 has joined #ipfs
thistest[m]1 has joined #ipfs
timokau[m]1 has joined #ipfs
Naughtylus[m]1 has joined #ipfs
nico202[m]1 has joined #ipfs
exothermic[m]11 has joined #ipfs
jahjahmc77[m]1 has joined #ipfs
jookovjook[m]1 has joined #ipfs
stefan[m]21 has joined #ipfs
alexpuig[m]1 has joined #ipfs
danielfranca[m] has quit [Ping timeout: 246 seconds]
notkhris[m] has quit [Ping timeout: 246 seconds]
xMajedz[m] has quit [Ping timeout: 246 seconds]
anonymous_user[m has quit [Ping timeout: 246 seconds]
DavidStrauss[m] has quit [Ping timeout: 246 seconds]
thistest[m] has quit [Ping timeout: 246 seconds]
Manu[m]1 has quit [Ping timeout: 246 seconds]
lskhr[m] has quit [Ping timeout: 246 seconds]
timokau[m] has quit [Ping timeout: 246 seconds]
Naughtylus[m] has quit [Ping timeout: 246 seconds]
ftraverse[m] has quit [Ping timeout: 246 seconds]
nico202[m] has quit [Ping timeout: 246 seconds]
exothermic[m]1 has quit [Ping timeout: 246 seconds]
jahjahmc77[m] has quit [Ping timeout: 246 seconds]
jookovjook[m] has quit [Ping timeout: 246 seconds]
tragique[m] has quit [Ping timeout: 246 seconds]
grossverdiener[4 has quit [Ping timeout: 246 seconds]
indefini[m] has quit [Ping timeout: 246 seconds]
alexpuig[m] has quit [Ping timeout: 246 seconds]
jcgruenhage has quit [Ping timeout: 246 seconds]
stefan[m]2 has quit [Ping timeout: 246 seconds]
volver17[m] has quit [Ping timeout: 246 seconds]
volver17[m]1 has joined #ipfs
piajesse[m]2 has joined #ipfs
piajesse[m] has quit [Ping timeout: 246 seconds]
drp1338[m] has quit [Ping timeout: 246 seconds]
indefini[m] has joined #ipfs
drp1338[m] has joined #ipfs
jcgruenhage has joined #ipfs
tragique[m] has joined #ipfs
grossverdiener[4 has joined #ipfs
ftraverse[m] has joined #ipfs
null1337 has quit [Ping timeout: 244 seconds]
null1337 has joined #ipfs
HeWhois has quit [Ping timeout: 244 seconds]
HeWhois has joined #ipfs
<Naughtylus[m]1>
Is there an index of pinned sites?
<Naughtylus[m]1>
appart from `ipfs pin ls --type direct`
azy has joined #ipfs
xcm has quit [Remote host closed the connection]
fazo has quit [Quit: fazo]
xcm has joined #ipfs
joseminao has joined #ipfs
joseminao has left #ipfs [#ipfs]
pecastro has joined #ipfs
cratliff has joined #ipfs
<Powersource[m]>
Naughtylus: how do you mean? i think there's also a list in the web ui
<deltab>
victorbjelkholm: maybe link to that from github?
<Naughtylus[m]1>
Well that's what I thought as well, but I can't seem to find it again
<deltab>
Swedneck: I guess because of similar semantics (mutablility) and convenience of implementation
<Swedneck>
hmm, alright
ONI_Ghost has quit [Read error: Connection reset by peer]
ONI_Ghost has joined #ipfs
rjharmon has joined #ipfs
HeWhois has quit [Quit: Hello, 911? Yeah, it's caught in the window this time.]
null1337 has quit [Quit: Live long and prosper \v//]
<cyberwolf[m]>
how did you raise the gateway have a guide?
<Swedneck>
how i set up my ipfs gateway?
<cyberwolf[m]>
yes
<Swedneck>
run ipfs like normal, and use nginx to reverse proxy connections from some domain to 127.0.0.1:8080
ipfsuser has joined #ipfs
<ipfsuser>
hello
<ipfsuser>
why is ipfs so uesless
<ipfsuser>
it has been around for 5 years now
<ipfsuser>
but nobody is using it for anything
<ipfsuser>
the choice of go as a programming language
<ipfsuser>
has been most unfortunate
<Swedneck>
in my case i have nginx redirect http to https, and then any https from gateway.swedneck.net is proxied to 127.0.0.1:8080
<Swedneck>
you seem quite biased my friend
<ipfsuser>
i dont want to hear it my fellow gay friend
<Swedneck>
it appears you came here with your mind already made up
<ipfsuser>
i am frustrated
<Swedneck>
alright into the ignore list we go
<Swedneck>
lgierth: mind banning this guy?
<ipfsuser>
that an awesome project like this
<ipfsuser>
would be held back
<ipfsuser>
by these minor issues
ipfsuser has left #ipfs [#ipfs]
<Fns[m]1>
Troll hatchlings do not have genetic memory, unfortunately, thus have to learn the hard way
<cyberwolf[m]>
swedneck: okey. thx
<Fns[m]1>
swedneck: Do you gather load stats?
<lgierth>
hey
<lgierth>
sorry about that, was on a bus
<Swedneck>
hooray for public transportation
<lgierth>
came back 3 minutes too late, it seems :)
<lgierth>
thanks for pinging me though
<Swedneck>
Fеnикs: nope, too lazy
<Fns[m]1>
swedneck: Me too. Was just wandering how much resources riot-web in ipfs consumes
<Swedneck>
well it's just static files
<Swedneck>
so the same amount of resources as anything else of that size
Oatmeal has joined #ipfs
Encrypt has quit [Quit: Quit]
<Fns[m]1>
Everything is static files for IPFS, as far as I know. Even more static then most kinds of file systems, since it's immutable.
<Fns[m]1>
Anyway, I was more interested about how many people use it this way. Through the gateway or via IPFS itself. Or, actually, how much network and disc it uses to serve the content
<Swedneck>
pretty sure i was the first
<Swedneck>
i think like 3-4 people use riot via ipfs, via riot.swedneck.xyz 😆
rendar has quit []
<Fns[m]1>
I use it since it was mentioned in recent TWIM
<Swedneck>
:0
<Swedneck>
i didn't expect that to actually do anything
<Fns[m]1>
Was actally thinking of 'hosting' it on my server in IPFS this way some time ago, but my server is a bit overloaded disk-wise as it is, and people keep saying IPFS gateway can be pretty heavy on disk
<Swedneck>
oh really?
<Swedneck>
maybe i should get an ssd
<Fns[m]1>
Well, it actually did. Keeping it pinned on all my devices also. Not sure how to tell if I'm sharing it with anyone, beside myself, though.
<Swedneck>
god i wish there were 32GB ssds available for like 30 bucks
<Icefoz>
There's 120 GB SSD's being sold for $40?
<Fns[m]1>
Why? It's a pefect way to run out of slots
<Swedneck>
as if i'm using more than 1 sata port :P
<Swedneck>
literally just a single 1TB HDD
<cyberwolf[m]>
2.5 or 3.5?
<Swedneck>
3.5 i think
<Swedneck>
inches confuse me
<Icefoz>
an inch is 2.5ish cm
<Fns[m]1>
Desktop size or Laptop size?
<Swedneck>
desktop
<Fns[m]1>
swedneck: So you're hosting it all on a single 1TB drive? Not even raid10 or something?
<Swedneck>
nervous smile
<Swedneck>
it's an old pc my grandma had when i was like, 10
<Fns[m]1>
Guess it's not that heavy on disk after all, then
gmoro has joined #ipfs
* Swedneck
shrugs
<Swedneck>
i mean it seems to be nigh-unusable for people outside of sweden
<Fns[m]1>
It is pretty usable and useful for me. Can't say it's slow to download or anything. It actually is a good example of how matrix and ipfs can be used together
<Swedneck>
i wish people at least had consistent experiences 😄
<Swedneck>
some people say it takes several minutes to load some simple HTML, yet it's somehow fine for you
<Fns[m]1>
That is surprising, yes, but depends on a lot of things, I suppose. There are a lot of hashes that take unbelievable amounts of time to download. Yet, some things are just fine
<Fns[m]1>
So, I will not speak for others. I will be glad if you keep it up, though. Not only hosting it and keeping the ipns record up to date, but also updating and building the client itself. Even though I did work with nodejs a lot, I still find it frustrating and outlandish.
<Swedneck>
i'll definitely keep the domain up to date with the latest riot, i'm even using 0.17.0-rc.1 now, but i won't touch development with a 5m pole
<Swedneck>
all the versions i've added can be found at riot-all.swedneck.xyz btw
<Naughtylus[m]1>
I'm in France, and I have it pinned as well. It took a long time the first time to load it all. I don't know if that'll make a difference now for close-by nodes
<cyberwolf[m]>
swedneck: zeronet do you not want to see?
<Swedneck>
?
<cyberwolf[m]>
to establish
<unroute>
what the fuck is zeronet
<Swedneck>
zeronet is kind of like ipfs
<Swedneck>
except extremely focused around websites and not even a fraction as easy to use
unroute has left #ipfs [#ipfs]
ubicq[m] has joined #ipfs
cratliff has quit [Quit: Leaving]
}ls{ has joined #ipfs
graphene has quit [Remote host closed the connection]
graphene has joined #ipfs
makeworld has joined #ipfs
<makeworld>
Is there a way to store arbritary data in the IPFS dht?
<r0kk3rz>
why in the dht?
joocain2 has quit [Remote host closed the connection]
joocain2 has joined #ipfs
wakko1 has joined #ipfs
cwahlers_ has joined #ipfs
cwahlers has quit [Ping timeout: 272 seconds]
plexigras has quit [Ping timeout: 252 seconds]
plexigras has joined #ipfs
Oatmeal has quit [Ping timeout: 244 seconds]
mthiel_ has quit [Remote host closed the connection]
<Kolonka[m]>
``ipfs dht put``
<Kolonka[m]>
i think
<sander>
check ``ipfs dht put --help``, the key type must be ``/ipns``, meaning that the only type of keys you can store are ipns entries... making this command a lower level version of ``ipfs name publish``
Mikaela has quit [Read error: Connection reset by peer]
Mikaela has joined #ipfs
mauz555 has joined #ipfs
asymptotically has quit [Quit: Leaving]
gmoro has quit [Ping timeout: 252 seconds]
Oatmeal has joined #ipfs
The_8472 has quit [Ping timeout: 260 seconds]
The_8472 has joined #ipfs
vandemar has quit [Remote host closed the connection]
kanej_ has joined #ipfs
vandemar has joined #ipfs
jamesaxl has quit [Quit: WeeChat 2.2]
plexigras has quit [Ping timeout: 272 seconds]
SamM has quit [Ping timeout: 246 seconds]
plexigras has joined #ipfs
kanej_ has quit []
kanej has joined #ipfs
Taoki has quit [Ping timeout: 268 seconds]
Jesin has joined #ipfs
Jesin has quit [Remote host closed the connection]
SamM has joined #ipfs
Taoki has joined #ipfs
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
Jesin has joined #ipfs
adin_ has joined #ipfs
adin_ has quit [Client Quit]
adin_ has joined #ipfs
Jesin has quit [Quit: Leaving]
adin__ has joined #ipfs
adin__ has quit [Client Quit]
adin__ has joined #ipfs
adin_ has quit [Disconnected by services]
Jesin has joined #ipfs
adin__ has left #ipfs [#ipfs]
aschmahmann has joined #ipfs
SamM has quit [Ping timeout: 268 seconds]
SamM has joined #ipfs
spinza has quit [Quit: Coyote finally caught up with me...]
<Swedneck>
anyone know what the ipfs livestream latency is like?
mauz555 has quit [Remote host closed the connection]
mauz555 has joined #ipfs
mauz555 has quit [Ping timeout: 250 seconds]
hurikhan77 has quit [Ping timeout: 252 seconds]
spinza has joined #ipfs
kaminishi has quit [Remote host closed the connection]
graphene has quit [Remote host closed the connection]