Improving the networking code

Goals and todos for improving the networking code

• Threaded IO

• Use httplib2 as backend (See httplib2 - Issues below)

Threaded IO

Please note that this branch has already been merged into the trunk.

You can test branches using the following command:

•  STRAW_IN_SOURCE_DIR=1 STRAW_THREAD_DNS=1 src/straw

Networking cleanup - prototype of threaded network IO (URLFetch_threaded.py)

• The branch with the code is available with the command

  •    svn co http://svn.gnome.org/svn/straw/branches/threaded_io straw-threaded_io

• The initial motivation: Fixing async IO reliability

• Status reports:

  1. 2006-12-04, b. 2006-12-12

• Patches before the branch

httplib2

httplib2 is an almost complete HTTP library that has no third-party library requirement other than the ones in the Python standard library.

Issues

1. Proxy support
2. Caches images as well which duplicates what we already have in the cache DB

Solution

1. Implement proxy support ASAP
   1. Done for basic proxy support (no authentication)
2. Either use httplib2's cache for images or hack httplib2 to have a generic Cache interface and extend it for Straw