kicad-developers team mailing list archive
-
kicad-developers team
-
Mailing list archive
-
Message #39842
Re: Download Server AWS CLI access?
-
To:
<kicad-developers@xxxxxxxxxxxxxxxxxxx>
-
From:
Maciej Suminski <maciej.suminski@xxxxxxx>
-
Date:
Thu, 21 Mar 2019 09:56:30 +0100
-
Autocrypt:
addr=maciej.suminski@xxxxxxx; keydata= mQENBFKfmAwBCAC9tak+4mDO1WiNnAwegusPBMEdl+sV35XeaU4PGSt33mPSlXB2klamg4ih QUykvuWqNEg2KyTvCSKNfnHTpzeeFegEsIwWFdhbIc4uUAD6CHl4+uGTXQiMh1+IJkgLmwuD RCEx9mSKbdzzTKz05w+fzzT3mNfko8NICWlcmhFgo2RXnQRTqFg7CNNBpx4kr4+AWIvb+Rha AVMLVJj1s05+STGyFucu6sZmTmOC53ZtkV8HchJeGuQL0LPkjvX0VKGE3gkvuP4iLBcgFtNC Kcu/L6FmWd24m2IhWaHXoWLBiVFw7gGzUdB7gSAiNO1+SoWX+99rbud7RvqV49vOgoqbABEB AAG0KU1hY2llaiBTdW1pbnNraSA8bWFjaWVqLnN1bWluc2tpQGNlcm4uY2g+iQE5BBMBAgAj BQJSn5gMAhsDBwsJCAcDAgEGFQgCCQoLBBYCAwECHgECF4AACgkQFHAa7WGlsnU/JQf5AYW0 oFH+jOykZvlRkRZMoqw1vZGOHeRPK92vbjeiau/hALYX1FBvZMx+JMmVHN7DkRIY7bVoiJ6N n4Byn//BSd9F9eXjAphYVuBg2Xe5wp3/l9/z2Iw8KeLpfKAtfIybgpycvTuUxFIxm9mtpPt+ AoNFKBDhfLcpZLJTW7AwwpnzP+GDdjszjnW6rMt8Aq55liR+y/TZfz/tTEDcUcSPLlJBTmda TmkO5aPxPmeCeDMOT3YEd+bK57V5b7RgtqTdIT6CW7tjQKBPJbIGa8PQ0tUfz0yCBEPWghnY w+B/2JeArrRXDui78cGgTDy1ocQNAm3havk2WO2qykxziY6OwbkBDQRSn5gMAQgAxw+MRllT IPNnCeOAbRgX1KRzo7+7WpSIbmhrBzLY0O1SyIa7U05E6+4jDHDfDpSLqc61an1+M69e6l9Z E3ve3hymtj5ucXZQnveQ5klD6z5FBC/04of/YyrS+h6iRSM0nOmu1JOIqM0S2OzwsKRsS86r jCtRE5OxoBDCIB4xNPitezs4uvLoVfO3mVYUhiPRZMtTCInEi+tlM+AmaPjRkPAfhd0wsOjk oxkuJWEnZ8U8oHpeL0uqANZgLlIiT5yJMWsyyqlK01hdFbuIydIFFiyXJw1HDTXWX+tMxJrX VEvQJZALof9RU/jntqGltnQXArUgPMSGGu1f+7AH/CuMyQARAQABiQEfBBgBAgAJBQJSn5gM AhsMAAoJEBRwGu1hpbJ1maAH/RZPbvXaNIOouHZlnlkq/WORHxjkKfve+AbE62Ed8yFIwlAj tyZGKeEG9hDJl6f9BxDv+9qunTfWfXQuHxNIpdXstkxQIx4m043Kx3h7VdEmg53ybeGNgpvz BYk5HdgCH3yP6UbGNiel6xZOywmvpru3pEKNg4mJhzxm9JCG+djrvbRh+BZNOkDBgaSiCAuJ q6Ffo9Qk/qfl6Uim9G7GKSS4930ZQ2GoVObe+jXixOhWXFSDhGKX5meABmELJ9XTcW3Pp6XC 0KXOE2p0EHQPmFvXdU6OePI72jTgRzPJXRXbPkL0/NUfbZfxS/xnAG8jmODc2ufbtrvE2jPu INX35u4=
-
In-reply-to:
<CANVzLNuzSp_HfVnjJUUYUThygx-QjDWyvgyy=6XkXfAfN-dPUg@mail.gmail.com>
-
Openpgp:
preference=signencrypt
-
User-agent:
Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0
Hi Tedd,
I use s3cmd [1] to interact with the server, but I could not force
anonymous access - it works only when access and secret keys are provided.
I am no S3 expert, but there are two lines in my s3cmd config file that
may help you:
host_base = s3.cern.ch
host_bucket = %(bucket)s.s3.cern.ch
If it does not change anything, then another option is to process XML
data directly [2]. I am quite sure there are Python libraries that can
handle S3 data format.
Cheers,
Orson
1. https://s3tools.org/download
2. https://kicad-downloads.s3.cern.ch/ (note there is no /index.html)
On 3/21/19 7:03 AM, tedd.tedd@xxxxxxxxx wrote:
> Hi,
>
> I'm the guy who operate(s,d) the KiCad mirror on Sourceforge. Since
> your switch to Ceph and the CERN servers, I haven't been able to sync
> the mirror with the official servers.
>
> I originally used wget to download to my local file server, then rsync
> up to SF's servers, as they do not allow outgoing network connections.
> Now that you've got an S3 API, I'd like to mount the KiCad server with
> s3fs and delete my local copy.
>
> I have been trying to connect without credentials (so, anonymously),
> but whatever I do, I get the error "Unable to
> connect(host=https://kicad-downloads.s3.cern.ch) - result of checking
> service".
>
> So I try AWS CLI like so: "aws s3 cp --recursive s3://kicad-downloads
> /tmp/kicad-downlaods --endpoint-url https://kicad-downloads.s3.cern.ch
> --no-sign-request"
>
> And I get the error: "An error occurred (NuSuchKey) when calling the
> ListObjectsV2 operation: Unknown".
>
> As far as I know, Ceph with S3 API is supposed to work as-is with AWS
> CLI and other compatible utilities.
>
> Could I get some assistance please? I'd like to help out with getting
> releases to more people more quickly.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~kicad-developers
> Post to : kicad-developers@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~kicad-developers
> More help : https://help.launchpad.net/ListHelp
>
References