#dat

has anyone done an type of progress transform stream with folder-walker?

bret: not sure I get what you mean

bret: (you at moz tonight btw?)

oh no whats going on at mom?

moz*

bret: lol

bret: data refuge hack night

oh crap no

im on dinner duty

datproject/dat-desktop - run in electron - errored - https://travis-ci.org/datproject/dat-desktop/bu...

basically im looking for a way to do a progress bar for a folder-walker object stream that does work with the objects

so something to look ahead and count how many total files there are while the worker stream kicks off work with backpressure

bret: this for dats?

no not directly

but seems similar

err similar type of work

most of the progress bar type libs need a total count

uehhhh, wouldn't know of any of that - in planet dat there's currently a metadata stream which holds a ref to a file ahead of time

bret: and in the next version iirc there'll be a dir walk function that gives back all the files

i mean, i can do that already with concat-stream or whatever

just wondering if anyone else has done something similar yet before i go reinvent a wheel

datproject/dat - ui importer updates from dat-next - failed - https://travis-ci.org/datproject/dat/builds/198...

I think I did that but not following 100% what you are trying to do.

for file importing, I start a count of all the files in the dir and separately start importing them.

(not using folder walker right now)

jhand: basically i have folder-walker object stream that pipes into a slowish worker writable object stream, and I want to get a percentage complete value out of the stream as it works based on the total files that folder-walker will find

i could just count the files and then start the work, but it would be cool to do it in parallel

bret: ah ya. that was part of why I stopped using folder-walker. it seemed faster to walk the directories twice - once for the counting and once for importing (slow worker).

ya definitely

using https://github.com/joehand/count-files for our counting

let me know if you figure out a nice way to do it in parallel though

it would be cool API if you could throw some transform streams in the beginning and middle of the pipeline to monitor progrees of a folder-walker stream

what do you use instead of folder-walker/

?

hmm ya. no folder walking module, just manually doing recursive listing. wasn't quite an explicit decision we just stopped using it. https://github.com/juliangruber/hyperdrive-impo...

introducing parallelism to object streams is a little weird i guess

err concurrency sorry

ya I think i tried to do that at some point with folder walker and got confused so stopped =)

getting the count done as quick as possible was kinda important too for the UI

ogd: https://github.com/dthree/cash

ogd: think this should be good

cc/ jhand

yoshuawuyts: fix part #1 https://github.com/datproject/dat-node/pull/91 throw an error!

datproject/dat-desktop - more tests - errored - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - fix main-view reducer - errored - https://travis-ci.org/datproject/dat-desktop/bu...

[dat] greenkeeperio-bot opened pull request #614: Update dat-node to version 1.3.4 🚀 (master...greenkeeper-dat-node-1.3.4) https://git.io/vDnMn

datproject/dat - set cachedb config for server tests - failed - https://travis-ci.org/datproject/dat/builds/198...

datproject/dat-desktop - more test stuff - errored - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - more test stuff - errored - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - reset welcome screen - errored - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - reset welcome screen - errored - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - reset welcome screen - passed - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - more test stuff - failed - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat - chore(package): update dat-node to version 1.3.4 - failed - https://travis-ci.org/datproject/dat/builds/198...

datproject/dat-desktop - fix bugggssss - passed - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - finish like most of this stuff - errored - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - finish like most of this stuff - passed - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - rm unused deps - passed - https://travis-ci.org/datproject/dat-desktop/bu...

datproject/dat-desktop - default progress to 0 - errored - https://travis-ci.org/datproject/dat-desktop/bu...

ghm, found an issue when restarting dat-node keys don't match https://github.com/datproject/dat-node/commit/5...

hi folks, I'm just learning about the dat protocol and just installed the beaker browser. Super cool stuff. Is it possible to get a 'nice' URL for a dat address?

Also, this website: https://www.datprotocol.com/ states that its contents come from "dat://ff34725120b2f3c5bd5028e4f61d14a45a22af48a7b12126d5d588becde88a93/" but when I visit that address in the Beaker Browser I get a 408 time out

interestingly I only cloned 62% of that dat o/

[dat] joehand closed pull request #614: Update dat-node to version 1.3.4 🚀 (master...greenkeeper-dat-node-1.3.4) https://git.io/vDnMn

[dat] joehand closed pull request #609: Transfer dat-next codebase and remove old code (master...dat-next-code) https://git.io/vDYCH

[dat] joehand closed pull request #612: Update readme for dat-next (master...dat-next-docs) https://git.io/vDYzJ

jhand: congrats!

pfrazee: 🎉

jhand: btw I've got dat://www.datprotocol.com working (in the latest beaker master)

datproject/dat - Transfer dat-next codebase and remove old code (#609) - failed - https://travis-ci.org/datproject/dat/builds/198...

jhand: dat version is hosting from my cloud server. I added the .well-known/dat file and pushed to github, netlify hosts, done

pfrazee: awesome!

took me awehile to see that wasn't http lol

hah yeah