Sprint: March 7-20

[RichardLitt]

Sprint March 7th -- 20th

Sprint Goals

Sprint Discussions

Schedule

Please take notes in a separate pad, if you can, and link it here.

Endeavour	Lead	Time (PDT - UTC/Z - CET)	Pad
sync	@RichardLitt	9:00pDT 17:00Z 18:00CET	IRC: #ipfs on Freenode
apps on ipfs	@dignifiedquire	10:30PDT 18:30Z 19:30CET	https://public.etherpad-mozilla.org/p/ipfs-mar-7-apps-on-ipfs
infrastructure	@lgierth	11:00PDT 19:00Z 20:00CET	https://public.etherpad-mozilla.org/p/ipfs-mar-7-infrastructure
libp2p	@diasdavid	11:30PDT 19:30Z 20:30CET	https://public.etherpad-mozilla.org/p/ipfs-mar-7-libp2p
js-ipfs	@diasdavid	12:00PDT 20:00Z 21:00CET	https://public.etherpad-mozilla.org/p/ipfs-mar-7-js-ipfs
go-ipfs	@whyrusleeping	12:30PDT 20:30Z 21:30CET	https://public.etherpad-mozilla.org/p/ipfs-mar-7-go-ipfs

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

• Add your tasks below in a comment, that way we only have people listed who are really in the sprint
• Add links to issues down here. Only add things you can finish this sprint.

[dignifiedquire]

Apps on IPFS

Lead: @dignifiequire

Participants

• @dignifiedquire
• @diasdavid
• @haad
• @nginever

Agenda

• Webui
• dignified hacks (on the webui)
• Station @ RaspberryPi
• orbitDB

Notes

• Webui
  • Files is WIP, more progress this week
  • Logs are crashing the browser, too much data
    • TODO: allow for filtering on ipfs log tail
• Station working on RaspberryPi
  • TODO: Add to weekly
• OrbitDb
  • https://github.com/haadcode/orbit-db
  • https://github.com/haadcode/anonymous-networks/tree/refactor/orbit-db
  • EventLog and KV-store

[daviddias]

Library Peer to Peer!

Lead: David Dias - @diasdavid

Participants

Agenda

Update

• Redo a lot of old code to new patterns
• Lot's of new improvements, e.g. less stream wrapping
• APIs are changing a bit, less magic

Next

• Finish Swarm update simplify libp2p-swarm libp2p/js-libp2p-switch#20
• Get js-libp2p-ipfs and go-ipfs examples

[daviddias]

IPFS JavaScript Implementation

Lead: David Dias - @diasdavid

Participants

Agenda

Update

• Foundations
• Contributions
• data-importing (voxelot)

Next

• jsipfs swarm (dependent on libp2p stuff)
• complete jsipfs files
• bitswap

Infrastructure

Lead: @lgierth

Participants

• @daviddias
• @dignifiedquire
• @lgierth
• @RichardLitt
• @whyrusleeping

Agenda

• multireq
• metrics
• fetching & pinning

Notes

• jbenet still seeing glitches with multireq
  • nginx metrics will hopefully shed some light
• more metrics from go-ipfs!
  • number of peers by transport, bitswap wants/provs/bw, etc.
• pinning performance
  • pinbot is not the issue
  • multireq neither
  • likely it's the fetching
• fetch performance
  • some merkledags with depth>1 get stuck
  • it continues only after a restart, then gets stuck again later
  • reproducible with geoip
  • also reproducible with a certain gx import set
  • gets stuck on the same hash reproducibly
  • whyrusleeping is on it

[daviddias]

DAVID DIAS TODO

js-ipfs

• Have a good discussion with @dignifiedquire and @nginnever on how to improve our JS development process, write down notes and guidelines at - https://github.com/ipfs/community/pull/111/files notes from the meeting - https://public.etherpad-mozilla.org/p/javascript-things-at-ipfs
• CR + M Refactor HTTP API routes js-ipfs#84
• CR + M Add getIPFS util and refactor id command to use it js-ipfs#83
• CR + M Fix linting issues and correct cli command descriptions and log names spaces js-ipfs#80
• CR + M Add object endpoints and cli commands js-ipfs#85
• CR + M upgrades peer-id to 0.6.0 js-ipfs#86
• CR + M test: Teamcity report for karma js-ipfs#89
• CR 'init' implementation. js-ipfs#91
• management
  • estimate time for completion of remaining components
• jsipfs swarm
  • listen when daemon is on jsipfs swarm js-ipfs#87
  • peers
  • addrs
  • connect
  • disconnect
  • interop
• jsipfs files
  • add feature/files add js-ipfs#67
• js-libp2p-ipfs
  • Write examples, like in go-libp2p Set of examples libp2p/go-libp2p#19
  • start func ipfs-inactive/js-libp2p-ipfs-nodejs#3
• js-ipfs-data-importing
  • CR added buffer importer ipfs-inactive/js-ipfs-unixfs-engine#6
  • CR README and API improvements ipfs-inactive/js-ipfs-unixfs-engine#8
  • Work + CR + M added buffer importer ipfs-inactive/js-ipfs-unixfs-engine#6 Taaaake ooonnnn meeeeee 🎵
• js-multiaddr
  • update deps, fix badgers update deps multiformats/js-multiaddr#7
  • move tests to mocha, set up karma, webpack and dist npm script move tests to mocha, set up karma, webpack and dist npm script multiformats/js-multiaddr#9
  • support all the protocols \o/ (varint sheneningams) update/match go multiaddr multiformats/js-multiaddr#10
  • fix protoCodes missed the protoCodes called, now fixed multiformats/js-multiaddr#11
• js-mafmt
  • add support for UTP and WebSockets Add UTP and WebSockets to the mix multiformats/js-mafmt#2
• js-peer-id
  • CR+M exposes opts + bits libp2p/js-peer-id#11
• js-ipfs-repo
  • CR+M No longer considers a non-existant repo an error. js-ipfs-repo#30
  • CR+M Shorthand for a single store; README updates. js-ipfs-repo#31
  • CR fix: Upgrade dependencies, use strict and fix /blocks pathing js-ipfs-repo#29

js-ipfs-api

libp2p

• R and comment on https://gist.github.com/noffle/89c3dd4273d8075398ff#libp2p-tcp-libp2p--api
• webrtc-explorer
• js-libp2p-swarm
  • Complete the simplify refactor - simplify libp2p-swarm libp2p/js-libp2p-switch#20
  • fix a silly passthrough bug - silly passthrough bug libp2p/js-libp2p-switch#25
  • multiaddr filtering to avoid collisions filter the multiaddrs that are passed to avoid collision  libp2p/js-libp2p-switch#26
  • add tests with libp2p-utp
  • add tests with libp2p-websockets add websockets to the battery of tests, everything checks out libp2p/js-libp2p-switch#27
  • add tests for tcp+ws+identify+spdy all together All together now 🎵 libp2p/js-libp2p-switch#28
  • CR+M Dial fixes libp2p/js-libp2p-switch#30
• js-libp2p-tcp
  • add getObservedAddrs to every yielded conn add getObservedAddrs feature to every returned conn libp2p/js-libp2p-tcp#5
  • find nasty bug on identify, caused by peer-id changes Incoherent pubkey type libp2p/js-peer-id#9
  • CR+M buffer the public key for consistency libp2p/js-peer-id#10
  • add addr filtering func add filter feature libp2p/js-libp2p-tcp#6
• js-libp2p-utp
  • update to new libp2p transport scheme
• js-libp2p-websockets
  • update to new libp2p transport scheme Update/new libp2p transport scheme libp2p/js-libp2p-websockets#1
  • CR+M Add echo tests libp2p/js-libp2p-websockets#2
  • CR+M browser integration tests! Add browser tests libp2p/js-libp2p-websockets#3
  • CR+M webpack 2 Update dependencies libp2p/js-libp2p-websockets#4
  • CR+M Rename callback to ready again libp2p/js-libp2p-websockets#5
• js-libp2p-multiplex
  • Work together + CR + M Add browser tests libp2p/js-libp2p-mplex#4
  • CR+M Make multicodec also available at the module leve libp2p/js-libp2p-mplex#6

npm on IPFS

IPLD

• IPLD hangout

webui

• test and review Webui for 0.4.0 release

specs

• http-api-spec
• specs
  • R IPFS Node Init: 1st Draft specs#83
  • CR+M #66 - Fix some dead links. Imported Juan's paper into the repo. specs#79

extra

• Add more items do the IPFS Weekly - Weekly #6: March 1st-7th newsletter#25 (comment)
• Organize and Host the 1st Research & Development Meetup http://www.meetup.com/ipfs-lisbon-meetup/events/229530492/

[haadcode]

@haadcode sprint goals - 7-20 Mar

Summary

I'll be working on integrating orbit-db (1) to Orbit (2) in order to make sure orbit-db provides an easy embeddable p2p database for apps on IPFS. It also means I can refactor a huge bunch of the Orbit code and simplify the "backend" logic of the app as well as refactor the UI to a more manageable state. The overall goal is to make Orbit a little cleaner so that others can start contributing to is.

1. https://github.com/haadcode/orbit-db
2. https://github.com/haadcode/anonymous-networks

Tasks

Orbit

• Integrate with orbit-db
• Refactor everything
• Make a stable build/release after the first two
• Candy: App icon for Orbit

Pubsub

• Test @noffle's pubsub prototype and give feedback (https://github.com/noffle/pubsub-swarm)

[dignifiedquire]

@dignifiedquires TODO

• Webui
  • Work on the files screen
  • Review and merge config PR
• Station
  • Use latest ipfs-geoip + failure handling
• WebRTC
  • Reading and research on the current landscape of implementations
  • Spec reading
• Randor
  • Add nested files api operations
  • Fix parallel bug with pin-rm

[RichardLitt]

Summary

I am going to focus on copy editing some of our blog posts that need to go out, because we should publish them and I think a little elbow grease will get them out the door. I will also be diving into js-ipfs and seeing if I can help out with building ipfs block there. Along with these I am going to be generally working through my backlog of issues and things to do.

Tasks

• Sprint Management
• Write the weekly roundup
  • [+] Get feedback from @jbenet
  • Publish
• js-ipfs block
• Writing:
  • Review 0.4.0 post
  • Reveiw ipscend post Static Web Publishing with IPFS - Simpler and Decentralized ipfs-inactive/blog#31

[hackergrrl]

@noffle Sprint Goals

Summary

I want to make headway on the "init" process for js-ipfs: this means getting a clear understanding of what initializing a repo means with respect to IPFS, resolving any non-existant dependencies, and implementing the initialization logic. I don't have a clear view yet on the full dependency graph for this, so I'll try and update this list as the amount of work involved becomes clearer.

I'd also like to build hyperarray: an ordered list CRDT built on a hyperlog. This will form the underlying document model for an ipfs-pad document. I've been largely inspired by r-array's design and API.

Tasks

js-ipfs

• spec document of 'ipfs init' process (started here)
• outline work for 'repo init'
• outline work for 'ipfs init' for js-ipfs

ipfs-pad

• hyperarray
• start an Architecture document

pm

• update OKR document with my goals for the rest of Q1

[nginnever]

Summary

I want to continue to make progress with my understanding of IPFS. I feel I am at around 70% knowledge and this is keeping me from awnsering some of the bigger questions about data importing like what structures should a browser be able to use in lack of an fs.. yet should we use unixfs and such. I will be moving towards more defined tasks from the go implementation like building out more commands. Also starting to take a look at libp2p and networking. And spending some time with react and the webui to keep my application development chops in line.

P.S. Also want to work with those geniuses up there on pub/sub and CRDT systems

TODO

- js-ipfs - [~] command cat (meow) - [~] command object get - js-ipfs-data-importing (js-ipfs issue #41) - [ ] streamImporter (more questions) - [X] BufferImporter (CR) - [~] export function - [X] browser / mocha tests - js-ipfs-merkle-dag - [X] web tests (needs https://github.com/ipfs/js-ipfs-repo/pull/29) - Webui - [ ] write some tests for new components - [~] document in contibuting.md to help others get involved

@lgierth todo

• infrastructure
  • nginx metrics
  • identity validation for *.ipfs.io cert taken over by @whyrusleeping
  • migrate from docker to runc+runit
  • write down docker issues
• fc00/cjdns
  • cryptoauth spec draft
  • switch spec draft
  • debug cjdns crashes
  • cjdns peering dignifiedquire & whyrusleeping
  • cjdns vs. tinc What are some notable differences between cjdns and tinc? hyperboria/bugs#112
• pages / dnslink
  • ssh blog@pages.i.ipfs.io publish <hash>
• go-ipfs
  • bring back ipfs_* metrics
  • harden gateway path prefix
• errands
  • deploy weekly Sprint D #5 and Sprint E #6 and Sprint F #7
  • pin geoip on v03x, for station
• reminder to self
  • github assignments: https://github.com/issues/assigned
• org stuff

[jbenet]

@nicola and I will be having a hangout about IPLD this monday 3/14. interested researchers feel free to join. time TBD, probably after the general hangout. (@RichardLitt if you can assign a time that would be great) cc @mildred if interested

[nicola]

@rychipman will join the IPLD meeting ^

[RichardLitt]

Set up for 3pm Eastern Time (Should be 8 CET, 7GMT) on Monday. In the calendar.