#dat

bmpvieira: got a favorite streaming xml parser?

bmpvieira: its for http://www.fcc.gov/files/ecfs/14-28/ecfs-files.htm, ~160mb xml files

After trying some, I went for this one for bionode: https://www.npmjs.org/package/xml2js

I don't use it with default settings in tool-stream

bmpvieira: im playing around with xml-nodes and xml-objects, just updated https://github.com/maxogden/xml-json to use them

mafintosh: i think i found another gasket bug https://github.com/datproject/gasket/issues/6

importing millions of lines of xml into dat, weeee

time curl "http://www.fcc.gov/files/ecfs/14-28/14-28-RAW-Solr-2.xml" | xml-json doc | jsonmap "var self = this; this.arr.map(function(a){ self[a.name] = a; delete self[a.name].name; }); delete this.arr; this.score = this.float._; delete this.float; Object.keys(this).map(function(k) { if (typeof self[k] === 'string') return; var type =

Object.keys(self[k])[0]; self[k] = self[k][type] })" | dat import --json --primary=id

doesnt work on a small droplet (gets "Killed") but works on a bigger one

probably a memory leak in the xml to json module