#fdroid-dev

/

      • Tovok7 has quit
      • Tovok7 joined the channel
      • ShinFuji joined the channel
      • TC01 has quit
      • TC01 joined the channel
      • ShapeShifter499 joined the channel
      • ShapeShifter499 has quit
      • ShapeShifter499 joined the channel
      • captainepoch joined the channel
      • _hc joined the channel
      • mimi89999_m
        What do you think about fdroidserver#284 ?
      • NOTICE: [server] #284: Flattr no longer issues numeric IDs - https://gitlab.com/fdroid/fdroidserver/issues/284
      • ShapeShifter499 joined the channel
      • ShapeShifter499 has quit
      • l4mRh4X0r has quit
      • _hc joined the channel
      • Tovok7 joined the channel
      • Tovok7
        meeting anyone?
      • cdesai present
      • pserwylo, uniq[m], thezero, NicoAlt ?
      • _hc: ?
      • pserwylo
        hi
      • _hc
        hi
      • pserwylo
        just gathering my thoughts
      • _hc
        uniq[m] and I cna only staty for a short bit, the Netidee deadline is today, so we're cranking away at that
      • I merged some stuff and tagged client v1.0-alpha1
      • fdroidserver 0.8 is basically ready
      • I'll do that release next week
      • so get any last bugs/fixes in
      • pserwylo
        cool. Will you be available to tag website releases when on holiday?
      • _hc
        pserwylo: yes, but really, you should just tag them as needed, since you're on the whitelist
      • pserwylo
        oh, didn't realise that.
      • didn't CiaranG say something about only having verified your key?
      • _hc
        it was a fluke that i was the tagger, I just happend to be present when CiaranG did the final setup
      • pserwylo
        I still haven't imported the signatures from FOSDEM, so that should be high on my todo list to bump my web of trust a little.
      • _hc
        yeah
      • maybe double check about whether you can tag
      • pserwylo: I'd prefer it if you were the main releaes tagger for website
      • pserwylo
        i'm not even sure how. other than doing a release and seeing if it works or not. I guess that is a relatively safe thing to do anyway. If it doesn't work, so be it.
      • regarding grants - i haven't touched the mozilla stuff, so I should really put some time into that perhaps over the weekend, maybe tomorrow a little too.
      • _hc
        yeah, I guess just browsing through https://fdroid.gitlab.io/fdroid-website and making sure its alright
      • I can help with MOSS next week some
      • that's it for me
      • pserwylo
        cool. I'll get as far as I can, then fling it your way.
      • _hc
        if anyone needs gpg sigs on their key, we can do fingerprint verification via jit.si
      • pserwylo
        right, i can dump my thoughts now.
      • Website stuff:
      • * Working on launching localizations.
      • * Also fixing regressions.
      • We accidentally forgot to deploy the "Get it on F-Droid" /badge/ directory to the new website, so now the deploy process (for f-droid.org, but not dev builds) downloads the relevant folder from gitlab.com/fdroid/artwork and puts it in the webroot.
      • The general theme with this and other tasks, is to automate as many as possible so that we don't need to ping CiaranG to manually update things
      • e.g. updating the "Download F-Droid" link at /FDroid.apk to point to the latest version (a#2, w#104).
      • As Tovok7, _hc and I discussed earlier this week, the key is to do all this, but make sure we don't end up accepting MRs from people which maliciously (but subtly) change things like the download link on the home page.
      • NOTICE: [client] #2: Notification should contain more information on I… - https://gitlab.com/fdroid/fdroidclient/issues/2
      • It is a fine line between making it easier for CiaranG, but ensuring that all of the important content on the webserver is immutable-ish.
      • NOTICE: [website] #104: Automatically link from /FDroid.apk to latest ver… - https://gitlab.com/fdroid/fdroid-website/issues/104
      • i'd like to implement some sort of lint-tools which can run in CI, and which will ask whether certain things have changed since the last release tag (e.g. .htaccess files) because these require extra scrutiny
      • i'm also most the way through implementing index-v1 support for jekyll-fdroid and hence the new website, meaning localized translations, screenshots, and feature images for the web browser (hooray!)
      • adding some tests to make sure that it parses indexes correctly and choses the correct locale from the metadata.
      • only other news is random fixes for fdroidclient (hence the 1.0-alpha1 tagged by _hc)
      • and a few more pending MRs.
      • _hc
        pserwylo: fyi, fdroidserver's .gitlab-ci.yml has a test like that
      • pserwylo
        For those interested, I accidentally reduced the index update time in fdroidclient by about 10x in the latest MR which should be in 1.0-alpha1 :)
      • EOF
      • Tovok7
        me next?
      • awesome 10x speed improvement! :)
      • pserwylo
        you next
      • Tovok7
        Last week, I finished the translation work-flow for repomaker which got merged as rm!134
      • Then I tackled some smaller issues like showing a informative page to the user if the database is blocked, not deleting the app icon from the repo if the user deletes all APKs of an app. Also fixing a redirect after deleting APKs.
      • NicoAlt fixed some font URLs that changed after an update in an upstream library. He also improved the back navigation in the 'adding remote apps' work-flow.
      • Currently, I am doing some research about deployment methods we can use for repomaker. Any feedback to rm#160 is appreciated. I would be especially interested in gratis one-click app install platforms.
      • For this, I was also playing around with docker and updated our CI image (thanks _hc for merging that in so quickly). Turns out our test APKs were signed with MD5, so I resigned them myself for our CI to survive the migration (which I will do today).
      • Regarding a potential Docker "cloud" deployment, I am still not sure whether it is good to use several containers (think DB and web separate) or do everything in one container.
      • NOTICE: [repomaker] !134: Implement Workflow for Translating App Metadata - https://gitlab.com/fdroid/repomaker/merge_requests/134
      • NOTICE: [repomaker] #160: Research Deployment Strategies - https://gitlab.com/fdroid/repomaker/issues/160
      • _hc
        1.0-alpha1 is built but not yet deployed https://f-droid.org/wiki/page/org.fdroid.fdroid...
      • Tovok7
        pserwylo: I remember you had a platform for one-click installs. Remember the name?
      • pserwylo
        Tovok7: Unfortunately I don't have enough knowledge about docker to comment intelligently on the best strategy (re db + web).
      • Will read through rm#160 though
      • NOTICE: [repomaker] #160: Research Deployment Strategies - https://gitlab.com/fdroid/repomaker/issues/160
      • Tovok7: I have come across "Bitnami" before.
      • mimi89999_m joined the channel
      • then when you search for alternatives to that, you'll probably find a whole bunch more.
      • Tovok7
        thanks!
      • l4mRh4X0r joined the channel
      • pserwylo
      • l4mRh4X0r is now known as Guest696
      • not all directly relevant, but some of the alternatives seem to be similar
      • _hc
        Tovok7: any chance of embeding the fonts into repomaker installs? I.e. instead of using google fonts or other similar services. those are used to track people
      • pserwylo
        The key is to find the one supported by AWS and other big providers.
      • (is that even a thing?)
      • (i.e. log into AWS and click "New Bitnami server -> Wordpress")
      • cdesai
        Tovok7: I recently came across 'docker compose' while searching for a docker wordpress deploy. - those had multiple containers, one per app.
      • haven't really used it, just read about it while doing a quick search.
      • Tovok7
        cdesai: yeah I have a prototype with that running
      • bitnami seems to be using docker-compose and kubernetes. nice to see to source to their "apps" available
      • if nobody has more helpful comments, then that's EOF for me
      • pserwylo
        Tovok7: "AWS Marketplace" is the model I was thinking about. Create an "F-Droid" account on there, then list "Repomaker" as an app. People can then easily launch instances of it within that particularly walled garden
      • _hc
        Tovok7: is repomaker using fonts from some service provider?
      • BubuIIC joined the channel
      • pserwylo
        If I search for "WordPress" in the AWS Marketplace, I get all sorts of providers offering pre-configured images with wordpress: https://aws.amazon.com/marketplace/search/resul...
      • Tovok7
        _hc: repomaker is using the roboto fonts which we don't load remotely of course, but the case of the filenames in the upstream repo (which we include in our source deps) changed, so we needed to adapt out references and tests.
      • _hc
        ok, good :)
      • jiust checking
      • Tovok7
        hehe
      • _hc
        it is a frequent omission in web papps
      • Tovok7
        looks like we could even "sell" repomaker on the AWS marketplace
      • pserwylo
        Tovok7: and also "Azure App Service" which I believe is similar
      • _hc
        Tovok7: for the grant, some kind of desktop app thing that runs OSX should be the first thing
      • Tovok7
        yeah I know, everybody is just loading stuff from CDNs (because it is fast and browser caches one file over many sites)
      • OSX is gonna be tricky without an actual OSX to try things on
      • _hc
        you can use OSX via travis-ci on github
      • though no GUI
      • pserwylo
        I'd suggest that whatever "Python web app wrapper -> desktop app thing" you choose will likely be cross platform anyway, so get it working on your dev machine, then ask someone with a mac to try.
      • My mum has an old one which may be floating around for instance.
      • _hc
        which reminds me, I should push to the github fork to run the fdroidserver tests on OSX: https://github.com/fdroidtravis/fdroidserver
      • cdesai
        I could test sometimes at my college too, there's an apple lab.
      • _hc
        I also have an old mac running 10.9 for testing
      • Tovok7
        problem is the sqlite database blocking issue. this requires a full-blown DB at the moment. one solution to that would be to not do background task, but let he user trigger everything manually and wait for stuff to complete. Worse user experience and requires more work, but it would make deployment easier since it is almost only python we need.
      • _hc
        you think its not usable with sqlite?
      • yeah, its not great, but so bad it won't work?
      • Tovok7
        if an f-droid repo upgrade (fresh) takes 3h, the user might not want to wait for that before interacting with the application...
      • also currently, all changes to the repo trigger a repo update which also blocks the db, so you can not do any other write operations.
      • uniq[m]
        django
      • Tovok7
        tl;dr when using repomaker with sqlite you will sooner or later get DB blocked problems. Worse at the first start when remote repos initialize
      • but it would be possible to scrape background tasks and replace them with screens with progress bars.
      • _hc
        you could embed a copy of index-v1.jar in the app, or even a pre-configured sqlite db file
      • Tovok7
        most time is spent downloading app icons ;) and while this would help (a bit with) initial remote repo setup, it wouldn't solve the problem
      • _hc
        that hits the db?
      • pserwylo
        that was going to be my question, what is it about icon donwlaods that hangs db?
      • Tovok7
        when django starts a background task, it just locks the db and oinly releases it when it is done
      • there's DB writes in these tasks such as updating etags
      • pserwylo
        Oh, so perhaps there is a change we can make to the background-task library which makes that a bit more refined?
      • _hc
        that's like 30 bytes
      • pserwylo
        or is there alternative libraries to do the samet hing, which are more liberal with their database locking?
      • Tovok7
        I looked into whether I can reduce the time these tasks lock the DB, but didn't find any possibility
      • pserwylo
        okay
      • Tovok7
        (doesn't mean there isn't one I haven't found yet, though)
      • _hc
        seems like preloading the app with a sqlite file and icons shouldn't be hard
      • would make repomaker leak a little less info then
      • Tovok7
        but it would just help with some of the symptons instead of solving the problem more fundamentally
      • _hc
        this is a prototype, we need to deliver some kind of a desktop app
      • mimi89999_m joined the channel
      • the current architecture with pre-loaded sqlite and icons sounds like it would work totally fine for a desktop prototype
      • Tovok7
        I can give you a desktop app with blocking DB right away ;)
      • _hc
        sure, let's try it!
      • pserwylo
        I need to run off now, but I'll check the logs later and add anything if I have something to contribute.
      • Tovok7
        But for a better solution, we either require an existing real database on the desktop or make all background tasks blocking user interaction.
      • _hc
        Tovok7: if it really that easy, please publish a test ubuntu/debian app
      • maybe it'll be good enough only as a web site