kicad-developers team mailing list archive

[Adam Wolf <adamwolf@xxxxxxxxxxxxxxxxxxxx>]

Hi folks!

Interesting observation.  When I send a single file, I get a few
errors and those chunks are retried and things are fine.  When I send
multiple files in one s3cmd, s3cmd appears to die on the first error.
This does not really explain why I'm getting "bad response" errors
relatively often, but it does not appear to be a blocking issue for me
anymore.

I have converted my scripts over.

Adam


On Mon, Apr 22, 2019 at 9:52 AM Adam Wolf <adamwolf@xxxxxxxxxxxxxxxxxxxx> wrote:
>
> Interesting.  I didn't change anything that I know of on my side...
> definitely didn't change anything related to syntax.
>
> I wonder if a brew update broke s3cmd.
>
> I may just upload a few of these nightlies by hand in order to get
> people new stuff before KiCon.
>
> Adam
>
> On Mon, Apr 22, 2019 at 8:38 AM Nick Østergaard <oe.nick@xxxxxxxxx> wrote:
> >
> > But it seems like you can also use the aws-cli as follows:
> >
> > aws s3 cp your.dmg s3://kicad-downloads/osx/nightly/ --endpoint-url https://s3.cern.ch
> >
> > After you configured the access and secrect key with aws configure.
> >
> > On Mon, 22 Apr 2019 at 15:30, Nick Østergaard <oe.nick@xxxxxxxxx> wrote:
> >>
> >> I guess s3cmd does not work with python3.
> >>
> >> Then I took at look at https://s3tools.org/s3cmd and it says that version 2 do work with python3 and it looks like are using verison 2...
> >>
> >> Does it work if you put just one file?
> >>
> >> On Mon, 22 Apr 2019 at 15:19, Adam Wolf <adamwolf@xxxxxxxxxxxxxxxxxxxx> wrote:
> >>>
> >>> Hi folks!
> >>>
> >>> Apologies if I should send this to someone else rather than the whole
> >>> list, but I have been getting this error for the past few days:
> >>>
> >>> s3cmd put kicad-extras-20190422-020027.dmg
> >>> kicad-nightly-20190422-014543-53437fe36.dmg
> >>> kicad-unified-20190422-022513-3c0012449.dmg
> >>> s3://kicad-downloads/osx/nightly/
> >>> ERROR: Error parsing xml: syntax error: line 1, column 0
> >>> ERROR: b'Error 400: Bad Request\nClient sent malformed request'
> >>>
> >>>
> >>> Invoked as: /usr/local/Cellar/s3cmd/2.0.2_1/libexec/bin/s3cmd put
> >>> kicad-extras-20190422-020027.dmg
> >>> kicad-nightly-20190422-014543-53437fe36.dmg
> >>> kicad-unified-20190422-022513-3c0012449.dmg
> >>> s3://kicad-downloads/osx/nightly/
> >>> Problem: ParseError: syntax error: line 1, column 0
> >>> S3cmd:   2.0.2
> >>> python:   3.7.2 (default, Jan 13 2019, 12:51:54)
> >>> [Clang 9.0.0 (clang-900.0.39.2)]
> >>> Traceback (most recent call last):
> >>> File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/bin/s3cmd", line 3092, in <module>
> >>>      rc = main()
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/bin/s3cmd", line 3001, in main
> >>>      rc = cmd_func(args)
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/bin/s3cmd", line 421,
> >>> in cmd_object_put
> >>>      response = s3.object_put(full_name, uri_final, extra_headers,
> >>> extra_label = seq_label)
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/S3.py",
> >>> line 677, in object_put
> >>>      return self.send_file_multipart(src_stream, headers, uri, size,
> >>> extra_label)
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/S3.py",
> >>> line 1603, in send_file_multipart
> >>>      upload.upload_all_parts(extra_label)
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/MultiPart.py",
> >>> line 119, in upload_all_parts
> >>>      self.upload_part(seq, offset, current_chunk_size, labels,
> >>> remote_status = remote_statuses.get(seq))
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/MultiPart.py",
> >>> line 176, in upload_part
> >>>      response = self.s3.send_file(request, self.file_stream, labels,
> >>> buffer, offset = offset, chunk_size = chunk_size)
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/S3.py",
> >>> line 1531, in send_file
> >>>      self.send_file, request, stream, labels, buffer, offset = offset,
> >>> chunk_size = chunk_size, use_expect_continue = use_expect_continue)
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/S3.py",
> >>> line 1181, in _http_400_handler
> >>>      failureCode = getTextFromXml(response['data'], 'Code')
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/Utils.py",
> >>> line 142, in getTextFromXml
> >>>      tree = getTreeFromXml(xml)
> >>>    File "/usr/local/Cellar/s3cmd/2.0.2_1/libexec/lib/python3.7/site-packages/S3/Utils.py",
> >>> line 106, in getTreeFromXml
> >>>      tree = ET.fromstring(xml)
> >>>    File "/usr/local/Cellar/python/3.7.2_1/Frameworks/Python.framework/Versions/3.7/lib/python3.7/xml/etree/ElementTree.py",
> >>> line 1315, in XML
> >>>      parser.feed(text)
> >>>  xml.etree.ElementTree.ParseError: syntax error: line 1, column 0
> >>>
> >>> I have tried a few times over a few days. It used to work for me.  Any thoughts?
> >>>
> >>> Adam
> >>>
> >>> _______________________________________________
> >>> Mailing list: https://launchpad.net/~kicad-developers
> >>> Post to     : kicad-developers@xxxxxxxxxxxxxxxxxxx
> >>> Unsubscribe : https://launchpad.net/~kicad-developers
> >>> More help   : https://help.launchpad.net/ListHelp