#dat

/

      • pfrazee
        jhand: that wouldn't surprise me
      • blahah
        karissa: ah ok it's because utp-native require fails silently so there's no utp, and I had tcp turned off
      • there should be some catch probably for when there's neither tcp nor utp
      • caiogondim joined the channel
      • iml_ joined the channel
      • jhand
        pfrazee: ok think I see where its coming from. It is an importing bug of some sort. The downloader is expecting 4 blocks but there should only be 2.
      • pfrazee: if you clear the .dat folder between tests it works for now
      • pfrazee
        jhand: ok good deal
      • mafintosh
        blahah: aaaaaaaaa____ 95% sure i fixed the bug. Release coming up
      • blahah
        mafintosh: nice, I'm just making a PR to make append-tree compatible witn windows
      • mafintosh
        blahah: yea i saw. that should go in hyperdrive tho
      • blahah: as in, hyperdrive should convert windows path to unix style
      • like tar
      • blahah
        ah ok
      • blahah retracts his PR
      • pbrooks has quit
      • mafintosh
        blahah: i still want that pr tho
      • but in hyperdrive
      • blahah, aaaaaaaaa____: okay, released. try re-install deps and let me know if it helps
      • blahah
        mafintosh: you still want PR for append-tree?
      • and thanks RE fix
      • mafintosh
        blahah: i want the pr but in hyperdrive. basically just run paths through that unixify module
      • blahah
        OK
      • mafintosh
        pfrazee, jhand try reinstalling deps. i fixed a bug that could be related to what you describe
      • pfrazee
        mafintosh: kk
      • blahah
        mafintosh: for the fix do I need to update both the origin and downloader?
      • mafintosh
        blahah: yea
      • blahah
        cool thx
      • mafintosh
        it was one of those bugs where it is hard to believe it ever worked
      • i messed up a bisect
      • but dat is integrety checking everything so it would just fail and reconnect and then work lol
      • #failover
      • pfrazee
        mafintosh: hah nice. I just call that "writing software"
      • blahah
        mafintosh I'm still getting EBADF
      • mafintosh: do I need to delete the original .dat dir?
      • mafintosh
        blahah: yea that one is not fixed haha
      • blahah
        ah ok
      • :)
      • mafintosh
        blahah: using dat-next-next right?
      • blahah
        yeah
      • mafintosh
        blahah: just use dat-next, me and jhand made it up to date
      • blahah
        oh cool, but does it do --seed?
      • mafintosh
        jhand: o/
      • blahah
        that's all I want it for rn
      • the original source is working OK with sciencefair
      • mafintosh
        blahah: ah ok, workaround for the dat-next-next issue is passing the key as well
      • blahah
        but trying to add more seed nodes isn't working
      • mafintosh
        that fixed that EBAD thing
      • blahah
        huh, so it did!
      • :D
      • pfrazee
        mafintosh: I reinstalled deps but I still get incomplete sync issue unless I delete the .dat for the test files on each run
      • jhand
        pfrazee: ya think it's a mirror folder thing. I'll look after lunch.
      • pfrazee
        jhand: cool
      • mafintosh
        pfrazee: ok
      • aaaaaaaaa____: very curious to fix helped your issue
      • blahah: o/ same
      • blahah
        mafintosh: eh?
      • mafintosh
        blahah: if my fixed helped with your speed issue
      • blahah
        for me just including the hash worked
      • oh, hmm I'm not sure - I'm getting good speed but takes a long time to establish the connection
      • I think same speed as before - 2MB/s, but it took over a minute for the dl to start
      • back in 30
      • mafintosh
        blahah: but the speed is consistent now?
      • Gonna start improving network perf now that everything else seems stable
      • blahah
        yeah speed seems solid for dat-next-next to dat-next-next - I'll check for electron consumer tomorrow
      • mafintosh
        blahah: awesome
      • pbrooks joined the channel
      • ogd
        karissa: chatting with nokome and bmpvieira today and had a good idea for a grant proposal centered around building a software dependency management system using dat
      • karissa
        nice
      • who might be pitch that to?
      • we*
      • jhand
      • aaaaaaaaa____
        mafintosh: it didn't :( but everything looks the same, so investigating if it was updated
      • bret
        ogd: whaaaaaa. that would be so cool
      • aaaaaaaaa____
        mafintosh: dat-storage@1.0.1 & hyperdrive@9.2.1 , still get a key and error (Error: EISDIR: illegal operation on a directory, read) when i `dat-next-next . `
      • TheLink
        aaaaaaaaa____: dat-next-next doesn't take any folder argument as far as I know - it's just "dat-next-next" within the folder you want to share
      • jhand
        ya mafintosh and I really made that confusing with the two next things, sorry
      • TheLink
        will be great if dat-cli lands soon :)
      • jhand
        mafintosh: so sparse + latest works now?
      • blahah
        oooh same question \o
      • jhand
        pfrazee: so I can't get that test failure to reproduce anymore, didn't change anything 😕
      • ogd
        blahah: trying to figure out how to convert links in markdown source to a .bib file (arxiv told me i needed one of these, i dont know what it is). i just wanna have 1 markdown file
      • blahah
        ogd oh haha - how are you currently making references?
      • ogd
        blahah: i just have markdown links
      • blahah
        ah, yeah arxiv requires fuller citation metadata
      • sure you wanna put it on arxiv?
      • ogd
        blahah: i dont know lol everyone says its the cool preprint
      • blahah: just trying to be like the cool kids
      • blahah
        haha
      • what's the paper?
      • ogd
      • blahah
      • todrobbins joined the channel
      • ogd so if you want it to be like a full academic style preprint you should probably have some citations - kademlia for example probably has a paper
      • ogd
        blahah: yea i figured, i just wanted to figure out how to do it in markdown
      • blahah
        ogd you can do the citations in yaml frontmatter
      • and pandoc will convert them to bib
      • ogd
        blahah: oh cool
      • blahah: got an example?
      • blahah
      • ogd
        blahah: how would the markdown link look to refer to the citation key or whatever?
      • blahah
        just @key
      • ogd
        blahah: is this normal pandoc or pandoc-citeproc? i was hoping to find a working github w/ all this cause the implicit knowledge required is pretty harsh
      • blahah: i figured im not the only person in the world to ever create a citation friendly pdf from markdown
      • blahah
        citeproc is only needed for applying citation styles I think
      • in general @key cites inline, [@key] is a formatted braced citation
      • mafintosh
        aaaaaaaaa____: yea just dat-next-next no key :)
      • blahah
        suppress the author with -@ so like "Ogden asserted in his tweet (-@ogdentweet)"
      • mafintosh
        jhand, blahah ya fixed the sparse issue as well. forgot to mention that
      • blahah
        mafintosh: woop
      • mafintosh
        aaaaaaaaa____: is the reconnect issue fixed?
      • blahah
        ogd: I like to use bib files, or some external file of references, because you can export them easily from a ref manager
      • ogd: I think the conf papers I linked are about as simple as it gets, but you can move the citations into yaml frontmatter
      • aaaaaaaaa____
        mafintosh:
      • oops sorry about the second one
      • oh wait no I'm not, the second one is `dat-next-next .`
      • indutny
        mafintosh: I was thinking about discovery-channel last night
      • heya
      • it may sound lame
      • but I think it could potentially run over http2
      • just on a custom port
      • ogd
        blahah: yea --filter pandoc-citeproc is needed to make the yaml frontmatter thing render correctly, i just got it working
      • indutny
        because, truth is - it needs to be multiplexed
      • and http2 is quite a good multiplexing solution
      • where you can pause individual streams
      • mafintosh
        aaaaaaaaa____: that first one is weird. is that just trying to share a folder?
      • indutny
        it will help to discovery-swarm too
      • since feed id will be known ahead of time
      • and will be sent by connecting party
      • aaaaaaaaa____
        mafintosh: yes
      • cd cool-dir && dat-next-next
      • second one blahah suggested, i.e. cd cool-dir && dat-next-next .
      • mafintosh
        aaaaaaaaa____: there is no old dat in thete
      • blahah
        ogd: ah sorry
      • mafintosh
        ?
      • aaaaaaaaa____
        no, it is a directory with a few files and no dat
      • mafintosh
        got it
      • indutny: for browser support?
      • indutny
        no, for everyone
      • see
      • right now you need separate discovery swarm for every feed
      • because it won't connect to the peer that it has already seen
      • this is a waste of resources
      • mafintosh
        indutny: no you can reuse the connection to share multiple
      • we do that in hypercore
      • hyperdrive i mean
      • indutny
        hm....