Sprint: March 21 → April 6

[RichardLitt]

Sprint March 21st through April 6th

Sprint Goals

Sprint Discussions

Schedule

Please take notes in a separate pad, if you can, and link it here.

Endeavour	Lead	Time (PDT - UTC/Z - CET)	Pad
sync	@RichardLitt	10:00PDT 17:00Z 18:00CET	IRC: #ipfs on Freenode
apps on ipfs	@dignifiedquire	11:30PDT 18:30Z 19:30CET	https://public.etherpad-mozilla.org/p/ipfs-march-21-apps-on-ipfs
infrastructure	@lgierth	12:00PDT 19:00Z 20:00CET	https://public.etherpad-mozilla.org/p/ipfs-march-21-infrastructure
libp2p	@diasdavid	12:30PDT 19:30Z 20:30CET	https://public.etherpad-mozilla.org/p/ipfs-march-21-libp2p
js-ipfs	@diasdavid	13:00PDT 20:00Z 21:00CET	https://public.etherpad-mozilla.org/p/ipfs-march-21-js-ipfs
go-ipfs	@whyrusleeping	13:30PDT 20:30Z 21:30CET	https://public.etherpad-mozilla.org/p/ipfs-march-21-go-ipfs

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

• Add your tasks below in a comment, that way we only have people listed who are really in the sprint
• Add links to issues down here. Only add things you can finish this sprint.

[RichardLitt]

Go-ipfs notes:

This week in go-ipfs, we prepped for finally shipping version 0.4.0. This included lots of testing, writing of information, and verification of different aspects of ipfs. I wrote a test for the fs-repo-migrations that adds a very large number of objects (over 200,000) and pins a couple thousand of them, runs the migration, verifies ​_everything_​, runs a gc, and then verifies everything again. Once that got working, I kicked off a test run of that with the numbers bumped by a factor of 10 (over two million objects!) and everything (eventually) completed just fine.
During our hangout, @dignifiedquire brought up how much he really doesn't like our config file. We talked about this for a little while and decided to add in validation functions for various config keys, so that when the user is editing the config, they can be more sure about not breaking anything.

[RichardLitt]

Anyone mind if we move the Monday hangout next week to Tuesday?

[dignifiedquire]

SGTM

[daviddias]

libp2p

Lead: @diasdavid

Participants

Agenda & Nodes

• update
  • js-libp2p-swarm
  • js-libp2p-tcp
  • js-libp2p-websockets
  • js-libp2p-multiplex
• stream-muxing headache
  • https://github.com/diasdavid/js-libp2p-multiplex/
  • https://github.com/diasdavid/js-libp2p-spdy
• uTP, "why u no half closed streams"

[daviddias]

js-ipfs

Lead: @diasdavid

Agenda

• update
  • jsipfs swarm
  • jsipfs files add
  • js-libp2p-ipfs
  • js-ipfs-data-importing
• standardizing JS development accross IPFS org repos, with all that we learned
• ipfs init
• files + mfs API
• update documentation (readme) with examples in every module
• ipld upgrade
• bitswap
• ask about this line https://github.com/nginnever/js-ipfs-merkle-dag/blob/master/src/dag-service.js#L27 (path should be checked for more than just exist?)

[daviddias]

DAVID DIAS TODO

js-ipfs

• management
  • roadmap
  • estimate time for completion of remaining components
  • captain.log entry - 🚣 captain.log - IPFS JavaScript implementation 🌟 js-ipfs#30 (comment)
• jsipfs swarm
  • peers
  • addrs
  • connect
  • disconnect
  • interop
• jsipfs files
• js-libp2p-ipfs
• js-ipfs-data-importing
  • add badgers ipfs-inactive/js-ipfs-unixfs-engine#11
  • greeen update merkle-dag dep ipfs-inactive/js-ipfs-unixfs-engine#12
  • CR+M README and API improvements ipfs-inactive/js-ipfs-unixfs-engine#8
• js-multiaddr
• js-mafmt
• js-peer-id
• js-ipfs-repo
• CR+M renames ipfs-core to just core js-ipfs#88
• CR+M 'init' implementation. js-ipfs#91
• CR+M tests use random ports for gateways now js-ipfs#94
• CR+M Add object patch endpoints and cli commands js-ipfs#99
• CR+M moves temp-repo creation into its own module js-ipfs#98
• R and W more for js-project-guidelines Update the IPFS org JavaScript projects guidelines community#111

js-ipfs-api

libp2p

• webrtc-explorer
• js-libp2p-swarm
  • fix dirty identify bug with websockets fix dirty identify bug libp2p/js-libp2p-switch#32
  • tests with multiplex add multiplex to the mix libp2p/js-libp2p-switch#33
• js-libp2p-tcp
• js-libp2p-utp
• js-libp2p-websockets
• js-libp2p-multiplex
  • WIP clean up libp2p/js-libp2p-mplex#7

npm on IPFS

• fix ipfs-blob-store fix dep of js-ipfs-api ipfs-shipyard/ipfs-blob-store#10 (due to updates on js-ipfs-api)
• add more info add resources to learn more to the readme ipfs-shipyard/npm-on-ipfs#34
• fix deps fix deps ipfs-shipyard/npm-on-ipfs#35

IPLD

webui

specs

• http-api-spec
• specs

extra

• R post: 0.4.0 release ipfs-inactive/blog#37
• RDM#2 http://www.meetup.com/ipfs-lisbon-meetup/events/229807984/
• R 0.4.0 blog post release
• Files API section for 0.4.0 blog post release ipfs-inactive/blog@a2358b1
• add coverage reports to test suites print coverage report aegir#4

[dignifiedquire]

@dignifiedquire TODO

• Ship dignified.js for all of js-ipfs

[RichardLitt]

To do

• Sprint Management
• Write the weekly roundup
• js-ipfs block jsipfs block http-api and cli js-ipfs#81
• [~] http-api-spec work
• 0.4.0 blogpost checking

[nginnever]

TODO

- dignified.js - [x] PR https://github.com/multiformats/js-multihash/pull/5 - [x] PR https://github.com/ipld/js-ipld-dag-cbor/pull/9 - [x] PR https://github.com/ipfs-shipyard/is-ipfs/pull/5 - [x] PR https://github.com/libp2p/js-libp2p-distributed-record-store/pull/3 - js-ipfs-data-importing - [ ] exporter - js-ipfs-merkle-dag - [x] add is-ipfs to check valid multihashes - [ ] needs CR - is-ipfs - [x] add buffer support - [X] use dignified.js tests - js-ipfs - [ ] cat command - [ ] get command - Webui - [ ] write tests - [ ] document in contibuting.md

[RichardLitt]

Apps on IPFS

Lead: @dignifiedquire

Participants

Agenda

• webui
• orbit -- we should discuss orbit and orbit-db in this hangout (+2)
• ip-wiki prototype (https://github.com/search?q=user%3Anoffle+ip-wiki)
• ongoing pubsub discussion
• I think the MediaChain folks want to talk a bit here, too

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Notes

• webui
  • no drag and drop of folders into the webui - (browsers (chrome) will stop supporting drag and drop of folders)
  • needs a more helpful config menu for the ipfs config (to avoid users making mistakes and crashing their nodes)
  • webui release process will be deferred to 0.4.1 release. It needs to be a) documented b) audited (signed releases, etc)
  • dignifiedquire will make webui mockups available so that others can give feedback on the design. Might be better to use some tool for this job, a service perhaps?
• orbit
  • orbit discussion was postponed to next week
• pubsub
  • we have https://github.com/noffle/pubsub-swarm, but next want to build something on top of libp2p that benefits from the IPFS network (connection sharing, etc)
• ip-wiki
  • (live demo)
  • still very young, can't publish new content yet, but fully usable using only the browser + public gateway
  • could benefit from research on existing CRDT-based wiki and git-based wiki ideas

After sprint meeting is finished, create the respective action items on the Github sprint issue

[haadcode]

@haadcode sprint goals - 21 Mar - 1 Apr

Summary

This sprint I'll continue the work on Orbit. Plan to refactor the UI code, improve the messaging (it's a little broken atm), fix broken UX feedback elements (such as loading bars) and fix bugs as I go. Really just a lot of grunt work.

Tasks

orbit-db

• Use ipfs-log module
• Stretch goal: Add pinning to db and ipfs-log objects
• Stretch goal: try replacing current pubsub with @noffle's pubsub-swarm

ipfs-log

• Fix message history fetching
• Stretch goal: Stream API for ipfs-log

Orbit

• Make message history more reliable
• Continue UI refactoring
• Fix broken UX elements and UI bugs

@lgierth todo

• dns outage
  • firefighting
  • post mortem ipfs/ops-private#4
• metrics
  • deploy mtail-nginx to all hosts Prometheus metrics from nginx logs infra#158
  • make gateway dashboard use nginx metrics
  • gateway content-type metrics
  • ipfs open FDs metrics
  • ipfs.io/blog and /version response time metrics (using ipfswatch)
  • bring back ipfs_p2p_peers metrics
• pages
  • ssh <pagename>@pages.ipfs.team publish <hash>
  • blog@pages.ipfs.team
  • versioning via previous link
• go-ipfs
  • security: harden gateway path prefix gateway: harden path prefix kubo#1988
  • v04x/v03x paragraph for 0.4.0 blog post
  • discuss extension of v03x EOL
  • test fs-repo-migrations stress test
  • test distributions immutability try to run make deps if it exists distributions#58
• infrastructure
  • finally write down infrastructure goals TODO infra#157
  • identity validation for *.ipfs.io cert taken over by @whyrusleeping
  • debug automatic GC
  • parallel upload for provsn
  • migrate rest of ansible playbooks to provsn
• errands
  • deploy weekly Sprint G #8
  • deploy fix to weekly Sprint E #6
  • deploy website
  • more yubikeys
  • meet with nycmesh.net
  • update whyrusleeping on vpn allowlist
  • reinstate update.ipfs.io
  • transfer domains to gandi account Provision resources for hosting OSM infra#84
  • pin geoip on v03x, for station
• reminder to self
  • github assignments: https://github.com/issues/assigned

[hackergrrl]

Summary

I'm aiming to finish js-ipfs init this week, and have been making fixes and documentation improvements to various js- and libp2p- modules along the way. I'm also reflecting on libp2p and where it'll fit in for IPFS app developers in the near future.

Tasks

js-ipfs

• init: add default assets (intro docs) to repo
• init: tests tests tests
• init: CLI and HTTP init routes
• separate repo setup/teardown into its own module

js-ipfs-data-importing

• write a readme & example
• various bug fixes

js-libp2p-multiplex

• update readme & add example

libp2p

• thinking & note taking on how libp2p and IPFS apps will work together