Saturday, September 09, 2006

Talk on the future of networking

Van Jacobson (Research Fellow at PARC, former Chief Scientist at Cisco Systems) gave a nice, high-level, visionary Google Tech Talk called "A New Way to look at Networking".

He says that networking needs to move from focusing on a connection between two computers to focusing on movements of data. He refers to this new type of network as a dissemination-based network.

In this vision, the network is optimized to retrieve named chunks of data from any available resource nearby over any available communication channel (e.g. "Someone, send me X."). This is in contrast with current networks that emphasize setting up a connection between two specific machines over a specific communication channel (e.g. "Connect to machine A.B.C.D.").

Van mentions BitTorrent and other examples as early but ad hoc progress toward this type of network structure. He criticized weaknesses in these early systems, saying, for example, that BitTorrent only worked well for very large files.

Far be it for me to disagree with Van about anything related to networking, but I have to admit this is where I started to question the proposal.

It seems to me it is exactly large data -- big, mostly unchanging video and audio files -- that is amenable to a data sharing infrastructure like Van is proposing. I would think that e-mails, dynamic web pages, and other types of rapidly changing, more personal data would get little benefit from the dissemination-based network proposed.

But, I may be thinking too small. This is not merely a way to share files.

I could imagine a world where every machine was part of a global mesh, data chunks encrypted and replicated across the cloud when the data is born, individual machines joining and dropping out on a millisecond basis, data migrating on demand and fading when no longer needed. This seems to be closer to the vision laid out in this talk.

It is a fun and worthwhile talk. If you watch it and have comments on it or what I said above, I would enjoy hearing your thoughts.

3 comments:

Kevin said...

Its a fair criticism but a bit naive to cite this as an issue without proposing an alternative.

Building a fully distributed swarming system without the bootup time is a research issue.

There are ways to solve it but most involve centralizing the protocol.

You could of course keep long term peer info but then you enter another realm of research where peers need to maintain identity and the issues involved with forged identity and anonymity.

Anonymous said...

Hi!

Nice talk, but i don't understood why he talked about Snakebite and not about Globe ( http://www.cs.vu.nl/~philip/globe/) or the MS Project IceCube or the dozens of other 'distributed object systems'.

Heiko

Heiko Wengler said...

Hi!

I found a system that implements the ideas from the talk.
Haggle ( http://www.haggleproject.org/index.php/Main_Page )

Short Intro: http://www.haggleproject.org/images/4/4d/Haggleposter-email.pdf


Heiko