Poster | Thread |
walkero
| |
Amazon S3Cmd problem Posted on 26-Aug-2015 20:13:57
| | [ #1 ] |
|
|
|
Regular Member |
Joined: 4-Mar-2004 Posts: 397
From: Athens | | |
|
| I tried to use S3C (http://is.gd/OGWQ5h) on my AmigaOS 4.1 FE, but as soon as I run the command
s3cmd --configure
it shows the message "Can't find a config file. Please use --config option."
Unfortunately the above doesn't allow me to use the script further and upload backups to Amazon S3 server. The $HOME variable exists on my system.
Does anyone use it succesfully? _________________ Amiga-Look.org - Beautify your Workbench |
|
Status: Offline |
|
|
AlexC
| |
Re: Amazon S3Cmd problem Posted on 2-Sep-2015 9:59:51
| | [ #2 ] |
|
|
|
Super Member |
Joined: 22-Jan-2004 Posts: 1300
From: City of Lost Angels, California. | | |
|
| @walkero
I haven't used it in a while, I'll check what happens on my end and will let you know.
[edit] I checked and found that it fails to run --configure if the $HOME/.s3cfg file doesn't exist already. Not sure why, I don't remember having to follow additional steps, I thought it just created the file if needed.
What you can do for now is download my config files from http://s3.amazonaws.com/AMIGA/files/s3configs.lha and copy them to your HOME drawer.
Then run 'S3Cmd --configure' or just edit them to put your access and secret keys.
Make sure your $HOME drawer isn't accessible from the outside if you have some http/ftp/vnc/etc server running.
Hopefully you'll get it running now
[/edit]
Last edited by AlexC on 03-Sep-2015 at 12:33 PM.
_________________ AlexC's free OS4 software collection
AmigaOne XE/X1000/X5000/UAE-PPC OS4 laptop/X-10 Home Automation |
|
Status: Offline |
|
|
walkero
| |
Re: Amazon S3Cmd problem Posted on 3-Sep-2015 12:52:25
| | [ #3 ] |
|
|
|
Regular Member |
Joined: 4-Mar-2004 Posts: 397
From: Athens | | |
|
| @AlexC
Thank you AlexC... I will test it tonight. Is there a possibility to update the S3Cmd to the latest available version, or it is not possible? _________________ Amiga-Look.org - Beautify your Workbench |
|
Status: Offline |
|
|
walkero
| |
Re: Amazon S3Cmd problem Posted on 3-Sep-2015 21:02:39
| | [ #4 ] |
|
|
|
Regular Member |
Joined: 4-Mar-2004 Posts: 397
From: Athens | | |
|
| @alexc
first of all I would like to mention that the readme has some errors. It says to create a folder in envarc name 'HOME' and then set an env variable with the same name. This cannot be done. So, I created the HOME folder in a partition and the set the ENV Variable "HOME" just fine.
Tried the S3cmd with your config by running the > s3cmd --configure
It run fine and I copied the access key and the secret key. Then it asked me for an encryption password and then it asked my about GPG, which I skiped, as the readme says. Finally I selected https and run the tests it provides. Unfortunately, the tests failed with the following messages.
Quote:
Please wait, attempting to list all buckets... WARNING: Retrying failed request: /?delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 3 sec... WARNING: Retrying failed request: /?delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 6 sec... WARNING: Retrying failed request: /?delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 9 sec... WARNING: Retrying failed request: /?delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 12 sec... WARNING: Retrying failed request: /?delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 15 sec... ERROR: Test failed: Request failed for: /?delimiter=/
|
Any clue about this problem?_________________ Amiga-Look.org - Beautify your Workbench |
|
Status: Offline |
|
|
walkero
| |
Re: Amazon S3Cmd problem Posted on 3-Sep-2015 21:25:26
| | [ #5 ] |
|
|
|
Regular Member |
Joined: 4-Mar-2004 Posts: 397
From: Athens | | |
|
| @alexc
As soon as I disabled https from the config file, then I managed to use s3cmd just fine and uploaded a file at my S3 bucket.
So, it seems that our SSL library is not used at all by S3Cmd, or it is no more compatible with newer SSL certifications. Am I right?
At the Aminet (http://aminet.net/package/util/crypt/gpg-m68k) I found a GPG program for 68K. I didn't try it yet, but could that be used with S3Cmd? Did you ever try it?
_________________ Amiga-Look.org - Beautify your Workbench |
|
Status: Offline |
|
|
AlexC
| |
Re: Amazon S3Cmd problem Posted on 4-Sep-2015 14:02:18
| | [ #6 ] |
|
|
|
Super Member |
Joined: 22-Jan-2004 Posts: 1300
From: City of Lost Angels, California. | | |
|
| @walkero
Quote:
Is there a possibility to update the S3Cmd to the latest available version, or it is not possible? |
It should be possible as long as it still works with Python 2.5. There wasn't a whole lot I had to modify to make it work on the Amiga. I don't have enough time to do this ATM but if you search for "AlexC" in the .py files you should be able to find any changes I made which could possibly be reapplied to the latest version if you feel like trying.
I had also ported Boto and Swift which give access to more cloud-based protocols but I don't remember if I uploaded those ports.
Quote:
I would like to mention that the readme has some errors |
Thanks for letting me know, I hadn't noticed that error as my HOME drawer is elsewhere :-/
Quote:
Finally I selected https and run the tests it provides. Unfortunately, the tests failed |
Unfortunately I have no idea what could be wrong there. Here the test produces this output: Quote:
Use HTTPS protocol [Yes]:
New settings: Access Key: [snip] Secret Key: [snip] Encryption password: Path to GPG program: None Use HTTPS protocol: True HTTP Proxy server name: HTTP Proxy server port: 0
Test access with supplied credentials? [Y/n] Please wait, attempting to list all buckets... Success. Your access key and secret key worked fine [...] |
I have AmiSSLmaster.libray 3.7 here but I'm not sure what ssl library is used by Python, possibly the one in sobjs/libssl-0.9.8.so which is 2,312,048 bytes from 21-feb-2008 here, or perhaps libssl.so.1.0.0, 569,723b from 9-apr-2014. Also there is Python/Lib/lib-dynload/_ssl.so 165,338 bytes from 27-jul-2011 (I'm not running the latest python appearently) but that _ssl.so is probably calling libssl.so anyway. If you have the same ssl libraries maybe your aws account or buckets aren't setup to allow ssl connections but that seems unlikely.
Quote:
At the Aminet (http://aminet.net/package/util/crypt/gpg-m68k) I found a GPG program for 68K. I didn't try it yet, but could that be used with S3Cmd? Did you ever try it? |
I haven't tried using gpg with AWS but there should be a native OS4 version of GPG available somewhere because I have one in my PGP drawer
Quote:
> pgp:gpg --version gpg (GnuPG) 1.4.1 Copyright (C) 2005 Free Software Foundation, Inc. [...]
|
Ok I just tried pointing the test config at my pgp:gpg binary but it fails with: Quote:
Now verifying that encryption works... ERROR: Test failed: [Errno 78] Function not implemented |
I'm guessing that it's passing arguments not supported by this old version of GPG._________________ AlexC's free OS4 software collection
AmigaOne XE/X1000/X5000/UAE-PPC OS4 laptop/X-10 Home Automation |
|
Status: Offline |
|
|
salass00
| |
Re: Amazon S3Cmd problem Posted on 4-Sep-2015 14:53:48
| | [ #7 ] |
|
|
|
Elite Member |
Joined: 31-Oct-2003 Posts: 2707
From: Finland | | |
|
| @AlexC
Quote:
I have AmiSSLmaster.libray 3.7 here but I'm not sure what ssl library is used by Python, possibly the one in sobjs/libssl-0.9.8.so which is 2,312,048 bytes from 21-feb-2008 here, or perhaps libssl.so.1.0.0, 569,723b from 9-apr-2014.
|
If you have the SDK installed you can use "readelf -d" to find out what shared objects an executable or shared object file is linked with.
Quote:
8.RAM Disk:> readelf -d _ssl.so
Dynamic section at offset 0x10010 contains 20 entries: Tag Type Name/Value 0x00000001 (NEEDED) Shared library: [libpython25.so] 0x00000001 (NEEDED) Shared library: [libssl.so.1.0.0] 0x00000001 (NEEDED) Shared library: [libcrypto.so.1.0.0] 0x00000001 (NEEDED) Shared library: [libexpat.so] 0x00000001 (NEEDED) Shared library: [libpthread.so] 0x00000001 (NEEDED) Shared library: [libz.so.1] 0x00000001 (NEEDED) Shared library: [libgcc.so] 0x00000001 (NEEDED) Shared library: [libc.so] 0x00000004 (HASH) 0x10000094 0x00000005 (STRTAB) 0x10000798 0x00000006 (SYMTAB) 0x100002d8 0x0000000a (STRSZ) 1252 (bytes) 0x0000000b (SYMENT) 16 (bytes) 0x00000007 (RELA) 0x10000c7c 0x00000008 (RELASZ) 3864 (bytes) 0x00000009 (RELAENT) 12 (bytes) 0x00000016 (TEXTREL) 0x0 0x6000000e (AMIGAOS_DYNVERSION) 0x2 0x6ffffff9 (RELACOUNT) 2 0x00000000 (NULL) 0x0
|
Last edited by salass00 on 04-Sep-2015 at 02:55 PM. Last edited by salass00 on 04-Sep-2015 at 02:55 PM.
|
|
Status: Offline |
|
|
broadblues
| |
Re: Amazon S3Cmd problem Posted on 4-Sep-2015 15:13:17
| | [ #8 ] |
|
|
|
Amiga Developer Team |
Joined: 20-Jul-2004 Posts: 4447
From: Portsmouth England | | |
|
| |
Status: Offline |
|
|
walkero
| |
Re: Amazon S3Cmd problem Posted on 4-Sep-2015 15:23:07
| | [ #9 ] |
|
|
|
Regular Member |
Joined: 4-Mar-2004 Posts: 397
From: Athens | | |
|
| @AlexC Quote:
It should be possible as long as it still works with Python 2.5. There wasn't a whole lot I had to modify to make it work on the Amiga. I don't have enough time to do this ATM but if you search for "AlexC" in the .py files you should be able to find any changes I made which could possibly be reapplied to the latest version if you feel like trying. |
Until version 1.5.0-rc1 it seems that it requires python 2.4. After that it requires 2.6. I might try to "port" this version as soon as I find some time.
@broadblues Isn't the python ssl included at the AmigaOS 4.1FE? Is there a possibility to see an updated python, like 2.6?
_________________ Amiga-Look.org - Beautify your Workbench |
|
Status: Offline |
|
|
salass00
| |
Re: Amazon S3Cmd problem Posted on 4-Sep-2015 16:34:22
| | [ #10 ] |
|
|
|
Elite Member |
Joined: 31-Oct-2003 Posts: 2707
From: Finland | | |
|
| |
Status: Offline |
|
|
walkero
| |
Re: Amazon S3Cmd problem Posted on 11-Sep-2015 17:37:38
| | [ #11 ] |
|
|
|
Regular Member |
Joined: 4-Mar-2004 Posts: 397
From: Athens | | |
|
| @salass00
Tried today with the .so files under sobjs, but unfortunately, as soon as I re-enabled the HTTPS connection, I still get the errors
Quote:
WARNING: Retrying failed request: /?prefix=comica_proj&delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 3 sec... WARNING: Retrying failed request: /?prefix=comica_proj&delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 6 sec... WARNING: Retrying failed request: /?prefix=comica_proj&delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 9 sec... WARNING: Retrying failed request: /?prefix=comica_proj&delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 12 sec... WARNING: Retrying failed request: /?prefix=comica_proj&delimiter=/ ('module' object has no attribute 'ssl') WARNING: Waiting 15 sec...
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! An unexpected error has occurred. Please report the following lines to: s3tools-bugs@lists.sourceforge.net !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Problem: S3RequestError: Request failed for: /?prefix=comica_proj&delimiter=/ S3cmd: 1.1.0-beta3
Traceback (most recent call last): File "s3cmd", line 1800, in main() File "s3cmd", line 1741, in main cmd_func(args) File "s3cmd", line 90, in cmd_ls subcmd_bucket_list(s3, uri) File "s3cmd", line 120, in subcmd_bucket_list response = s3.bucket_list(bucket, prefix = prefix) File "Programs:Utilities/S3C/S3/S3.py", line 216, in bucket_list response = self.bucket_list_noparse(bucket, prefix, recursive, uri_params) File "Programs:Utilities/S3C/S3/S3.py", line 240, in bucket_list_noparse response = self.send_request(request) File "Programs:Utilities/S3C/S3/S3.py", line 600, in send_request return self.send_request(request, body, retries - 1) File "Programs:Utilities/S3C/S3/S3.py", line 600, in send_request return self.send_request(request, body, retries - 1) File "Programs:Utilities/S3C/S3/S3.py", line 600, in send_request return self.send_request(request, body, retries - 1) File "Programs:Utilities/S3C/S3/S3.py", line 600, in send_request return self.send_request(request, body, retries - 1) File "Programs:Utilities/S3C/S3/S3.py", line 600, in send_request return self.send_request(request, body, retries - 1) File "Programs:Utilities/S3C/S3/S3.py", line 602, in send_request raise S3RequestError("Request failed for: %s" % resource['uri']) S3RequestError: Request failed for: /?prefix=comica_proj&delimiter=/
|
Does it work for you?Last edited by walkero on 11-Sep-2015 at 05:39 PM.
_________________ Amiga-Look.org - Beautify your Workbench |
|
Status: Offline |
|
|