SFTP file resume failutres

When using SFTP and there is a blip of some sort, remote server or Internet the transfer Q will
restart a new connect but it will not resume the last file it was uploading when the blip happens.
Using FTPS it works fine however SFTP is the method I have to use, please advise what you
may need from me in the way of logs.

Thanks,

-j

I did several tests with multiple clients and SmartFTP seems to be the only one that won't resume with SFTP.
After reading several threads on the forum here I discovered the marvelous way of looking at the log entries
per file so here is the file I was resuming, I kicked the connection on the server side to simulate a failure
of network/server side and here is the results and the file is flagged as FINISHED even though it is not.

Thanks!

[log]

[07:56:54] Initializing. Transfer Queue v1.0.17.32.

[07:56:54] Resolving host name "2.168.5.111"

[07:56:54] Connecting to 2.168.5.111 Port: 22

[07:56:54] Starting SSH session. Remote Id: "SSH-2.0-http://www.sshtools.com J2SSH [SERVER]"

[07:56:54] SSH protocol version reply. Client Id: "SSH-2.0-SmartFTP"

[07:56:54] Computing session key.

[07:56:54] Key Exchange Algorithm: diffie-hellman-group1-sha1

[07:56:54] Key exchange completed.

[07:56:54] Host Key Algorithm: ssh-dss

[07:56:54] Client to Server Encryption: aes128-cbc

[07:56:54] Server to Client Encryption: aes128-cbc

[07:56:54] Session MAC: hmac-sha1

[07:56:54] Client to Server Compression: none

[07:56:54] Server to Client Compression: none

[07:56:54] Authentication request. Method: "none"

[07:56:55] Server supported authentications: password,publickey

[07:56:55] Authentication request. Method: "password"

[07:56:55] User authentication successful.

[07:56:55] SSH session established.

[07:56:55] Connected to 2.168.5.111.

[07:56:55] RTT: 198.471 ms

[07:56:55] SFTP protocol version 3

[07:56:55] Detected Server Software: Unknown

[07:56:55] Resolving path "/uploads/test-jc".

[07:56:55] Path successfully resolved.

[07:56:55] Remote file exist check: "Kfile_2_xfer.zip".

[07:56:55] Getting attributes of "/uploads/test-jc/Kfile_2_xfer.zip".

[07:56:55] Attributes successfully obtained.

[07:56:56] Source File: Size=72530900, SizeUnit=Byte, Time=2008-12-03T03:23:06, TimeFormat=Exact

[07:56:56] Destination File: Size=25591808, SizeUnit=Byte, Time=2008-12-03T12:55:55, TimeFormat=Exact

[07:56:56] RecentTime=2008-12-03T12:56:56

[07:56:56] Rule "IF Destination Time=No Matter AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".

[07:56:56] Uploading file to "/uploads/test-jc/Kfile_2_xfer.zip".

[07:56:56] Restarting at 25591808.

[07:57:10] SSH session closed.

[07:57:10] 4030464 bytes transferred. (281 KB/s) (00:00:14)

[07:57:10] Server closed connection

[07:57:10] File not found. Skipping file exist check.

Hello ..

Thank you for reporting this problem. It looks like a bug in SmartFTP to me. I will take a look at it.

Regards,
Mat

Please let me know if there is anything I can do to assist you. If you need or want me to setup an account
on my FTP server for you to test against and me to cause failures just let me know.

--John

John has reported that the latest version fixed the problem:
https://www.smartftp.com/download

sad success....

I was able to reproduce the same problems I mentioned above..

I had it happen but for some reason can't get it to happen again, but the
client I have that uses the same software we had the same issue over
and over again for him coming to my server.. I'll see if I can't talk him
through getting me logs from his client side.

Thanks for a great client and great support!

--John

Was able to generate the problem and have two logs, don't know if there is anything more I
can get you... After about 8 files this 98MB file transfers and then everything after that
fails..

successful log:

[16:02:14] Resolving path "/upload/testnew/".
[16:02:15] Path successfully resolved.
[16:02:15] Remote file exist check: "bed4.san".
[16:02:15] Getting attributes of "/upload/testnew/file.zip".
[16:02:15] 2 File not found!
[16:02:15] Uploading file to "/upload/testnew/file.zip".
[16:02:15] Restarting at 0.
[16:12:29] Timeout (60s).
[16:12:29] Client closed the connection.
[16:12:29] Transfer failed.
[16:12:29] Resolving host name "my.site.com"
[16:12:29] Connecting to 1.2.3.4 Port: 22
[16:12:30] Starting SSH session. Remote Id: "SSH-2.0-http://www.sshtools.com J2SSH [SERVER]"
[16:12:30] SSH protocol version reply. Client Id: "SSH-2.0-SmartFTP"
[16:12:31] Computing session key.
[16:12:31] Key Exchange Algorithm: diffie-hellman-group1-sha1
[16:12:31] Key exchange completed.
[16:12:31] Host Key Algorithm: ssh-dss
[16:12:31] Client to Server Encryption: aes128-cbc
[16:12:31] Server to Client Encryption: aes128-cbc
[16:12:31] Session MAC: hmac-sha1
[16:12:31] Client to Server Compression: none
[16:12:31] Server to Client Compression: none
[16:12:31] Authentication request. Method: "none"
[16:12:32] Server supported authentications: password,publickey
[16:12:32] Authentication request. Method: "password"
[16:12:32] User authentication successful.
[16:12:33] SSH session established.
[16:12:33] Connected to my.site.com.
[16:12:33] RTT: 316.762 ms
[16:12:33] SFTP protocol version 3
[16:12:33] Detected Server Software: Unknown
[16:12:33] Resolving path "/upload/testnew/".
[16:12:33] Path successfully resolved.
[16:12:33] Remote file exist check: "bed4.san".
[16:12:33] Getting attributes of "/upload/testnew/file.zip".
[16:12:33] Attributes successfully obtained.
[16:12:33] Source File: Size=98603472, SizeUnit=Byte, Time=2008-12-01T15:25:29, TimeFormat=Exact
[16:12:33] Destination File: Size=78053376, SizeUnit=Byte, Time=2008-12-05T21:10:56, TimeFormat=Exact
[16:12:33] RecentTime=2008-12-05T21:11:29
[16:12:33] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".
[16:12:33] Uploading file to "/upload/testnew/file.zip".
[16:12:33] Restarting at 78053376.
[16:17:33] 20550096 bytes transferred. (67.1 KB/s) (00:04:58)
[16:17:33] File successfully transferred.
[16:17:33] Setting attributes of "upload/testnew/file.zip".
[16:17:33] Attributes successfully set.
[16:17:33] Getting attributes of "upload/testnew/file.zip".
[16:17:34] Attributes successfully obtained.
[16:17:34] Source File Size = 98603472, Destination File Size = 98603472



failed two files (out of the 32 others that fail):


[16:17:35] Resolving path "/upload/testnew/".
[16:17:36] Path successfully resolved.
[16:17:36] Remote file exist check: "bed4.SUM".
[16:17:36] Getting attributes of "/upload/testnew/file.SUM".
[16:17:36] 2 File not found!
[16:17:36] Uploading file to "/upload/testnew/file.SUM".
[16:17:36] Restarting at 0.
[16:17:36] 4 Denied!
[16:17:36] Setting attributes of "/upload/testnew/file.SUM".
[16:17:37] 4
[16:17:37] Getting attributes of "/upload/testnew/file.SUM".
[16:17:37] 2 File not found!
[16:17:37] File not found. Skipping file exist check.



[16:17:37] Resolving path "/upload/testnew".
[16:17:37] Path successfully resolved.
[16:17:37] Remote file exist check: "file2.evt".
[16:17:37] Getting attributes of "/upload/testnew/file2.evt".
[16:17:37] 2 File not found!
[16:17:37] Uploading file to "/upload/testnew/file2.evt".
[16:17:37] Restarting at 0.
[16:17:38] 4 Denied!
[16:17:38] Setting attributes of "/upload/testnew/file2.evt".
[16:17:38] 4
[16:17:38] Getting attributes of "/upload/testnew/file2.evt".
[16:17:38] 2 File not found!
[16:17:38] File not found. Skipping file exist check.

Sorry I should have put this in the last post..

Able to fix this by turning OFF the reuse connection in the transfer queue...
Maybe a bug or an issue with the reuse now?


John

The server returns an access denied error. This looks more like a server problem to me.

[16:17:36] Remote file exist check: "bed4.SUM".
[16:17:36] Getting attributes of "/upload/testnew/file.SUM".
[16:17:36] 2 File not found!
[16:17:36] Uploading file to "/upload/testnew/file.SUM".
[16:17:36] Restarting at 0.
[16:17:36] 4 Denied!

Also did you hand edit the log file because it looks inconsistent. One time the file is called bed4.SUM and the other time it says file.SUM?

Regards,
Mat

Also did you hand edit the log file because it looks inconsistent. One time the file is called bed4.SUM and the other time it says file.SUM?

Regards,
Mat


Yes I used a search and replace to obfuscate the server IP, directory structure, etc...

I would agree with that only I don't see any error messages or denies on the server side.. I will crank up my debug level
on the server side... I can see that if disable the "reuse connections in Transfer Queue" it works fine. FileZilla seems to
reuse the connection fine. Taking that option off does allow files to transfer just opens up a new connection before sending
every file. It fills the logs but at least the data can flow.. Not sure what is causing it.. I'll try it again in FTPS mode which
worked before the SFTP fix..

John