DHT implementation

[jbenet]

The next major subsystem to do is the DHT.

The rough plan in order of importance:

• basic kademlia alg (ipfs-dht) <-- enough for now.
• coral locality clusters (ipfs-dht)
• s/kademlia disjoint path lookups (ipfs-dht)
• s/kademlia peer addressing (ipfs-peer)
• s/kademlia signatures (ipfs-msgproto-crypto)

Note that this module should work on top of a msgproto packet stream. msgproto handles all standard encapsulation (network, integrity, signing, etc).

[jbenet]

There are several implementations of kademlia out there. @feross recently wrote https://github.com/feross/bittorrent-dht which implements mainlineDHT. Unfortunately the ipfs-dht is altogether different, but the basic kademlia algorithm is the same-- so should be able to take inspiration from that module.

[feross]

@jbenet, I would definitely appreciate feedback on bittorrent-dht. Let me know if you see anything that could be more efficient or simpler.

[martindale]

There is now also gordonwritescode/kad. Solid.

[jbenet]

@martindale thanks!

[daviddias]

@jbenet if you happen to have something on the DHT spec written down already, please feel free to push it so I can start on it tomorrow fresh and early :)

[daviddias]

Closing this issue as it referes to the 1st impl of node-ipfs that is no longer supported (as we are building the new one compliant with the spec :) ).