Product Release Finder failing?

[Jeroen Vermeulen <jtv@xxxxxxxxxxxxx>]

Should we be seeing this error in the nightly.sh output?

== Product Release Finder Wed Jul 2 09:07:25 UTC 2008 ==
2008-07-02 09:08:46 ERROR   could not retrieve directory listing for /files/
 -> 
http://launchpadlibrarian.net/15753137/zRJMGgKIFJZRyrixxWXCxdl8e4w.txt 
(HTTP Error 404: Not Found)
Traceback (most recent call last):
  File "product-release-finder.py", line 26, in ?
    script.lock_and_run()
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/canonical/launchpad/scripts/base.py", 
line 264, in lock_and_run
    implicit_begin=implicit_begin, isolation=isolation)
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/canonical/launchpad/scripts/base.py", 
line 224, in run
    self.main()
  File "product-release-finder.py", line 21, in main
    prf.findReleases()
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/canonical/launchpad/scripts/productreleasefinder/finder.py", 
line 35, in findReleases
    self.handleProduct(product_name, filters)
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/canonical/launchpad/scripts/productreleasefinder/finder.py", 
line 72, in handleProduct
    for series_name, url in hose:
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/canonical/launchpad/scripts/productreleasefinder/hose.py", 
line 59, in run
    for dirpath, dirnames, filenames in walk(base_url, self.log):
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/canonical/launchpad/scripts/productreleasefinder/walker.py", 
line 112, in walk
    (dirnames, filenames) = self.list(subdir)
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/canonical/launchpad/scripts/productreleasefinder/walker.py", 
line 334, in list
    soup = BeautifulSoup(response.read())
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/BeautifulSoup.py", 
line 1326, in __init__
    BeautifulStoneSoup.__init__(self, *args, **kwargs)
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/BeautifulSoup.py", 
line 973, in __init__
    self._feed()
  File 
"/srv/launchpad.net/production/launchpad/cronscripts/../lib/BeautifulSoup.py", 
line 998, in _feed
    SGMLParser.feed(self, markup or "")
  File "/usr/lib/python2.4/sgmllib.py", line 95, in feed
    self.goahead(0)
  File "/usr/lib/python2.4/sgmllib.py", line 134, in goahead
    k = self.parse_endtag(i)
  File "/usr/lib/python2.4/sgmllib.py", line 296, in parse_endtag
    self.finish_endtag(tag)
  File "/usr/lib/python2.4/sgmllib.py", line 334, in finish_endtag
    method = getattr(self, 'end_' + tag)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 
5-8: ordinal not in range(128)


Jeroen