Resume big upload

Hi.

This might be a trivial question, but I didn't find any answer so far (and I'm not an FTP expert ).

I have a big file (# 3 GB) to be uploaded to a FTP server (debian). My upload speed is very limited (max. 32 Mbps), hence it takes +1 days to upload the mentioned file. I'd like to upload the file in several steps. Every time I stop the transfer, it starts again from the scratch next time.

Is there any possibility to configure SmartFTP to resume upload, or does the server configuration (to which I have no rights) forbid this?

Thanks,

Hello ..

Please install the latest version from:
https://www.smartftp.com/download

It has improved resume logic.

Regards,
Mat

Nope. Didn't work

Nope. Didn't work
Correction ... seems to work now!

Thanks,

After several days of testing, I noticed the the resume basically works fine, but fails ...

1. after router restart (new WAN IP).
2. sometimes when resume is done (for no obvious reason). See log below ...

[16:11:24] Resolving host name "geohei.lu"

[16:11:24] Connecting to 208.113.220.35 Port: 21

[16:11:25] Connected to geohei.lu.

[16:11:25] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[16:11:25] USER gigafed

[16:11:25] 331 Password required for gigafed

[16:11:25] PASS (hidden)

[16:11:25] 230 User gigafed logged in

[16:11:25] SYST

[16:11:25] 215 UNIX Type: L8

[16:11:25] Detected Server Type: UNIX

[16:11:25] FEAT

[16:11:26] 211-Features:

[16:11:26]  MDTM

[16:11:26]  REST STREAM

[16:11:26]  SIZE

[16:11:26] 211 End

[16:11:26] PWD

[16:11:26] 257 "/" is the current directory

[16:11:26] CWD /_backups_harddisk_images

[16:11:26] 250 CWD command successful

[16:11:26] PWD

[16:11:26] 257 "/_backups_harddisk_images" is the current directory

[16:11:26] Remote file exist check: "movie.mpg".

[16:11:26] TYPE I

[16:11:27] 200 Type set to I

[16:11:27] SIZE movie.mpg

[16:11:27] 213 2310748160

[16:11:27] MDTM movie.mpg

[16:11:27] 213 20071213150628

[16:11:27] Source File: Size=2978502656, SizeUnit=Byte, Time=2006-07-06T06:52:47, TimeFormat=Exact

[16:11:27] Destination File: Size=2310748160, SizeUnit=Byte, Time=2007-12-13T15:06:28, TimeFormat=Exact

[16:11:27] No rule matched. Default Action="Overwrite".

[16:11:27] PASV

[16:11:27] 227 Entering Passive Mode (208,113,220,35,154,44).

[16:11:27] Opening data connection to 208.113.220.35 Port: 39468

[16:11:27] STOR movie.mpg

[16:11:28] 150 Opening BINARY mode data connection for movie.mpg

Hello ..

Post the entry of this item from the Transfer Queue.xml file. SmartFTP saves some metadata for the resume logic in the Transfer Queue data file. If there is no metadata the resume logic is not as reliable/efficient. The metadata gets lost if you remove the transfer queue item. For example: If yo upload a file using the transfer queue then delete the item and add the same item again some information which are required for the resume logic are lost.

The change of your WAN ip address does not influence the resume behavior.

Also we still need a reproducible case. Just stating that it doesn't work does not really help us.

Regards,
Mat

Hi.

1. Here the "Transfer Queue.xml" entry:
- <Item>

  <Version>1</Version> 

  <Id>{E760860F-98AA-4320-A7D0-7F8D78F3FC5A}</Id> 

  <Type>1</Type> 

  <Size>2978502656</Size> 

  <SizeUnit>1</SizeUnit> 

  <Time>127966423677812500</Time> 

  <TimePrecision>1</TimePrecision> 

  <TimeZone>2</TimeZone> 

  <Pause>0</Pause> 

  <MonitorFile>0</MonitorFile> 

  <Recurrence>0</Recurrence> 

  <RecurrenceTimeInterval>P0000-00-00T00:00:00</RecurrenceTimeInterval> 

  <Persistent>0</Persistent> 

  <Operation>1</Operation> 

  <Synchronization>1</Synchronization> 

  <OperationState>0</OperationState> 

  <LastWriteTime>128421710397500000</LastWriteTime> 

- <Source>

  <Version>1</Version> 

  <Type>1</Type> 

  <FavoriteId>{00000000-0000-0000-0000-000000000000}</FavoriteId> 

  <Path>G:\DVB-S Workspace\movie.mpg</Path> 

  </Source>

- <Destination>

  <Version>1</Version> 

  <Type>2</Type> 

  <FavoriteId>{24C5AC24-931F-43F8-AB9B-DD11984583E1}</FavoriteId> 

  <Path>/_backups_harddisk_images/movie.mpg</Path> 

  </Destination>

- <Childs>

  <Version>1</Version> 

  </Childs>

- <Hashs>

  <Version>1</Version> 

  </Hashs>

  </Item>

The log again:
[18:07:51] Resolving host name "geohei.lu"

[18:07:51] Connecting to 208.113.220.35 Port: 21

[18:07:51] Connected to geohei.lu.

[18:07:52] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[18:07:52] USER gigafed

[18:07:52] 331 Password required for gigafed

[18:07:52] PASS (hidden)

[18:07:52] 230 User gigafed logged in

[18:07:52] SYST

[18:07:52] 215 UNIX Type: L8

[18:07:52] Detected Server Type: UNIX

[18:07:52] FEAT

[18:07:52] 211-Features:

[18:07:52]  MDTM

[18:07:52]  REST STREAM

[18:07:52]  SIZE

[18:07:53] 211 End

[18:07:53] PWD

[18:07:53] 257 "/" is the current directory

[18:07:53] CWD /_backups_harddisk_images

[18:07:53] 250 CWD command successful

[18:07:53] PWD

[18:07:53] 257 "/_backups_harddisk_images" is the current directory

[18:07:53] Remote file exist check: "movie.mpg".

[18:07:53] TYPE I

[18:07:54] 200 Type set to I

[18:07:54] SIZE movie.mpg

[18:07:54] 213 2030514176

[18:07:54] MDTM movie.mpg

[18:07:54] 213 20071214165611

[18:07:54] Source File: Size=2978502656, SizeUnit=Byte, Time=2006-07-06T06:52:47, TimeFormat=Exact

[18:07:54] Destination File: Size=2030514176, SizeUnit=Byte, Time=2007-12-14T16:56:11, TimeFormat=Exact

[18:07:54] No rule matched. Default Action="Overwrite".

[18:07:54] PASV

[18:07:54] 227 Entering Passive Mode (208,113,220,35,176,175).

[18:07:54] Opening data connection to 208.113.220.35 Port: 45231

[18:07:54] STOR movie.mpg

[18:07:57] 150 Opening BINARY mode data connection for movie.mpg

[18:10:59] Resolving host name "geohei.lu"

[18:10:59] Connecting to 208.113.220.35 Port: 21

[18:10:59] Connected to geohei.lu.

[18:11:00] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[18:11:00] USER gigafed

[18:11:00] 331 Password required for gigafed

[18:11:00] PASS (hidden)

[18:11:00] 230 User gigafed logged in

[18:11:00] SYST

[18:11:00] 215 UNIX Type: L8

[18:11:00] Detected Server Type: UNIX

[18:11:00] FEAT

[18:11:00] 211-Features:

[18:11:00]  MDTM

[18:11:00]  REST STREAM

[18:11:00]  SIZE

[18:11:01] 211 End

[18:11:01] PWD

[18:11:01] 257 "/" is the current directory

[18:11:01] CWD /_backups_harddisk_images

[18:11:01] 250 CWD command successful

[18:11:01] PWD

[18:11:01] 257 "/_backups_harddisk_images" is the current directory

[18:11:01] Remote file exist check: "movie.mpg".

[18:11:01] TYPE I

[18:11:01] 200 Type set to I

[18:11:01] SIZE movie.mpg

[18:11:02] 213 329685504

[18:11:02] MDTM movie.mpg

[18:11:02] 213 20071214170943

[18:11:02] Source File: Size=2978502656, SizeUnit=Byte, Time=2006-07-06T06:52:47, TimeFormat=Exact

[18:11:02] Destination File: Size=329685504, SizeUnit=Byte, Time=2007-12-14T17:09:43, TimeFormat=Exact

[18:11:02] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".

[18:11:02] PASV

[18:11:02] 227 Entering Passive Mode (208,113,220,35,145,98).

[18:11:02] Opening data connection to 208.113.220.35 Port: 37218

[18:11:02] REST 329685504

[18:11:02] 350 Restarting at 329685504. Send STORE or RETRIEVE to initiate transfer

[18:11:02] STOR movie.mpg

[18:11:02] 150 Opening BINARY mode data connection for movie.mpg

[06:42:59] Transfer Timeout (60s). Closing data connection.

[06:42:59] 1107009536 bytes transferred. (23,9 KB/s) (12:31:56)

[06:43:59] Timeout (60s).

[06:43:59] Active Help: https://www.smartftp.com/support/kb/74

[06:43:59] Client closed the connection.

[06:44:10] CWD /_backups_harddisk_images

[06:44:11] 250 CWD command successful

[06:44:11] PWD

[06:44:11] 257 "/_backups_harddisk_images" is the current directory

[06:44:11] Remote file exist check: "movie.mpg".

[06:44:11] SIZE movie.mpg

[06:44:11] 213 1436688896

[06:44:11] MDTM movie.mpg

[06:44:11] 213 20071215054133

[06:44:11] Source File: Size=2978502656, SizeUnit=Byte, Time=2006-07-06T06:52:47, TimeFormat=Exact

[06:44:11] Destination File: Size=1436688896, SizeUnit=Byte, Time=2007-12-15T05:41:33, TimeFormat=Exact

[06:44:11] No rule matched. Default Action="Overwrite".

[06:44:11] PASV

[06:44:11] 227 Entering Passive Mode (208,113,220,35,222,236).

[06:44:11] Opening data connection to 208.113.220.35 Port: 57068

[06:44:11] STOR movie.mpg

[06:44:12] 150 Opening BINARY mode data connection for movie.mpg

[07:00:04] Resolving host name "geohei.lu"

[07:00:04] Connecting to 208.113.220.35 Port: 21

[07:00:04] Connected to geohei.lu.

[07:00:04] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[07:00:04] USER gigafed

[07:00:04] 331 Password required for gigafed

[07:00:04] PASS (hidden)

[07:00:04] 230 User gigafed logged in

[07:00:04] SYST

[07:00:04] 215 UNIX Type: L8

[07:00:04] Detected Server Type: UNIX

[07:00:04] FEAT

[07:00:05] 211-Features:

[07:00:05]  MDTM

[07:00:05]  REST STREAM

[07:00:05]  SIZE

[07:00:05] 211 End

[07:00:05] PWD

[07:00:05] 257 "/" is the current directory

[07:00:05] CWD /_backups_harddisk_images

[07:00:05] 250 CWD command successful

[07:00:05] PWD

[07:00:06] 257 "/_backups_harddisk_images" is the current directory

[07:00:06] Remote file exist check: "movie.mpg".

[07:00:06] TYPE I

[07:00:06] 200 Type set to I

[07:00:06] SIZE movie.mpg

[07:00:06] 213 1433690624

[07:00:06] MDTM movie.mpg

[07:00:06] 213 20071215055304

[07:00:06] Source File: Size=2978502656, SizeUnit=Byte, Time=2006-07-06T06:52:47, TimeFormat=Exact

[07:00:06] Destination File: Size=1433690624, SizeUnit=Byte, Time=2007-12-15T05:53:04, TimeFormat=Exact

[07:00:06] No rule matched. Default Action="Overwrite".

[07:00:06] PASV

[07:00:06] 227 Entering Passive Mode (208,113,220,35,162,140).

[07:00:06] Opening data connection to 208.113.220.35 Port: 41612

[07:00:06] STOR movie.mpg

[07:00:07] 150 Opening BINARY mode data connection for movie.mpg
2. I did not remove the item from the transfer queue. The only "interruptions" were a simple abort, restart of SmartFTP, reboot of the computer or router restart (new WAN IP).

3. I reproduced the new WAN IP issue 3 times. SmartFTP restartet the file upload everytime from the beginning.

Please let me know if you need anything else to track down the problem. Thanks.

Bye,

Thanks.

Can you post a screenshot from the File Exist rules of your favorite?
Favorites Settings -> File Exist -> Queue Rules
If you have set it to "Use Default Favorite" then post a screenshot from the rules in the Default Favorites.

Thanks a lot
Mat

Hi

Image

I didn't even know that such rules exist. Impressive what SmartFTP can do!

BTW ... just discovered that the direct upload works fine! (set to "Ask")

Thanks,

Thanks.

Is the server time in sync with the local time? To check this upload a small file to the server using the direct method. After the upload finished, quickly upload the same file again. The file exist dialog should pop up. Now compare the file time of the destination file (from the file exist dialog) with your computer time. The difference should be not more than a few seconds.

Regards,
Mat

Done!

Date on the server (located in Califiornia):
15.12.2007 00:34

Requester: Existing File:
15.12.2007 08:34:47
Requester: replace with:
22.01.2007 07:31:38

Bye,

These are not the information I requested. Please repeat the procedure in my previous post and provide the following values:

1. Time of your local computer at the time you look at the file exist dialog
2. Time of the existing/destination file as displayed in the file exist dialog

Mat

Oups ... sorry! Reread your procedure ...

Uploaded file.
Uploaded same file again.

Existing File: 10:24:37
Local Time on computer at that time (#5 seconds later): 10:25:19

I did it twice. The time difference is #30 seconds. It is for sure less that the '"Recent" time span' definition (120 seconds).

Strange ?!?!

Yep the feature should work as expected. Can you try to reproduce the resume problem with the latest version. The RecentTime value is now displayed in the log. The time representation is UTC. If no LastWriteTime value is found in the Transfer Queue.xml the current time is used for RecentTime.

.27
https://www.smartftp.com/download

Please post the new log. Thank you ;-)

Regards,
Mat

Hi.

I did a few tests right now and it seems to work fine ...

[08:22:32] Resolving host name "geohei.lu"

[08:22:32] Connecting to 208.113.220.35 Port: 21

[08:22:33] Connected to geohei.lu.

[08:22:33] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[08:22:33] USER gigafed

[08:22:33] 331 Password required for gigafed

[08:22:33] PASS (hidden)

[08:22:33] 230 User gigafed logged in

[08:22:33] SYST

[08:22:33] 215 UNIX Type: L8

[08:22:33] Detected Server Type: UNIX

[08:22:33] FEAT

[08:22:34] 211-Features:

[08:22:34]  MDTM

[08:22:34]  REST STREAM

[08:22:34]  SIZE

[08:22:34] 211 End

[08:22:34] PWD

[08:22:34] 257 "/" is the current directory

[08:22:34] CWD /_backup_movies

[08:22:34] 250 CWD command successful

[08:22:34] PWD

[08:22:34] 257 "/_backup_movies" is the current directory

[08:22:34] Remote file exist check: "movie.mpg".

[08:22:34] TYPE I

[08:22:35] 200 Type set to I

[08:22:35] SIZE movie.mpg

[08:22:35] 213 512753664

[08:22:35] MDTM movie.mpg

[08:22:35] 213 20071216072138

[08:22:35] Source File: Size=2219339776, SizeUnit=Byte, Time=2007-01-22T06:20:56, TimeFormat=Exact

[08:22:35] Destination File: Size=512753664, SizeUnit=Byte, Time=2007-12-16T07:21:38, TimeFormat=Exact

[08:22:35] RecentTime=2007-12-16T07:22:16

[08:22:35] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".

[08:22:35] PASV

[08:22:35] 227 Entering Passive Mode (208,113,220,35,144,215).

[08:22:35] Opening data connection to 208.113.220.35 Port: 37079

[08:22:35] REST 512753664

[08:22:35] 350 Restarting at 512753664. Send STORE or RETRIEVE to initiate transfer

[08:22:35] STOR movie.mpg

[08:22:36] 150 Opening BINARY mode data connection for movie.mpg

[08:24:08] Resolving host name "geohei.lu"

[08:24:08] Connecting to 208.113.220.35 Port: 21

[08:24:08] Connected to geohei.lu.

[08:24:09] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[08:24:09] USER gigafed

[08:24:09] 331 Password required for gigafed

[08:24:09] PASS (hidden)

[08:24:09] 230 User gigafed logged in

[08:24:09] SYST

[08:24:09] 215 UNIX Type: L8

[08:24:09] Detected Server Type: UNIX

[08:24:09] FEAT

[08:24:09] 211-Features:

[08:24:09]  MDTM

[08:24:09]  REST STREAM

[08:24:09]  SIZE

[08:24:10] 211 End

[08:24:10] PWD

[08:24:10] 257 "/" is the current directory

[08:24:10] CWD /_backup_movies

[08:24:10] 250 CWD command successful

[08:24:10] PWD

[08:24:10] 257 "/_backup_movies" is the current directory

[08:24:10] Remote file exist check: "movie.mpg".

[08:24:10] TYPE I

[08:24:10] 200 Type set to I

[08:24:10] SIZE movie.mpg

[08:24:11] 213 515364864

[08:24:11] MDTM movie.mpg

[08:24:11] 213 20071216072328

[08:24:11] Source File: Size=2219339776, SizeUnit=Byte, Time=2007-01-22T06:20:56, TimeFormat=Exact

[08:24:11] Destination File: Size=515364864, SizeUnit=Byte, Time=2007-12-16T07:23:28, TimeFormat=Exact

[08:24:11] RecentTime=2007-12-16T07:24:05

[08:24:11] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".

[08:24:11] PASV

[08:24:11] 227 Entering Passive Mode (208,113,220,35,138,71).

[08:24:11] Opening data connection to 208.113.220.35 Port: 35399

[08:24:11] REST 515364864

[08:24:11] 350 Restarting at 515364864. Send STORE or RETRIEVE to initiate transfer

[08:24:11] STOR movie.mpg

[08:24:11] 150 Opening BINARY mode data connection for movie.mpg
Thanks,

Thanks for the feedback but I didn't change anything beside the log output. Please let me know if you are able to reproduce it again.

Regards,
Mat

Here we go ...

[10:52:37] Resolving host name "geohei.lu"

[10:52:37] Connecting to 208.113.220.35 Port: 21

[10:52:37] Connected to geohei.lu.

[10:52:38] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[10:52:38] USER gigafed

[10:52:38] 331 Password required for gigafed

[10:52:38] PASS (hidden)

[10:52:38] 230 User gigafed logged in

[10:52:38] SYST

[10:52:38] 215 UNIX Type: L8

[10:52:38] Detected Server Type: UNIX

[10:52:38] FEAT

[10:52:38] 211-Features:

[10:52:38]  MDTM

[10:52:38]  REST STREAM

[10:52:38]  SIZE

[10:52:39] 211 End

[10:52:39] PWD

[10:52:39] 257 "/" is the current directory

[10:52:39] CWD /_backup_movies

[10:52:39] 250 CWD command successful

[10:52:39] PWD

[10:52:39] 257 "/_backup_movies" is the current directory

[10:52:39] Remote file exist check: "movie.mpg".

[10:52:39] TYPE I

[10:52:39] 200 Type set to I

[10:52:39] SIZE movie.mpg

[10:52:40] 213 593571840

[10:52:40] MDTM movie.mpg

[10:52:40] 213 20071216094344

[10:52:40] Source File: Size=2219339776, SizeUnit=Byte, Time=2007-01-22T06:20:56, TimeFormat=Exact

[10:52:40] Destination File: Size=593571840, SizeUnit=Byte, Time=2007-12-16T09:43:44, TimeFormat=Exact

[10:52:40] RecentTime=2007-12-16T09:44:21

[10:52:40] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".

[10:52:40] PASV

[10:52:40] 227 Entering Passive Mode (208,113,220,35,188,61).

[10:52:40] Opening data connection to 208.113.220.35 Port: 48189

[10:52:40] REST 593571840

[10:52:40] 350 Restarting at 593571840. Send STORE or RETRIEVE to initiate transfer

[10:52:40] STOR movie.mpg

[10:52:40] 150 Opening BINARY mode data connection for movie.mpg

[11:11:37] Transfer Timeout (60s). Closing data connection.

[11:11:37] 31432704 bytes transferred. (26,9 KB/s) (00:18:57)

[11:12:37] Timeout (60s).

[11:12:37] Active Help: https://www.smartftp.com/support/kb/74

[11:12:37] Client closed the connection.

[11:12:38] Resolving host name "geohei.lu"

[11:12:38] Connecting to 208.113.220.35 Port: 21

[11:12:38] Connected to geohei.lu.

[11:12:38] 220 ProFTPD 1.3.1rc2 Server (DreamHost FTP) [208.113.220.35]

[11:12:38] USER gigafed

[11:12:39] 331 Password required for gigafed

[11:12:39] PASS (hidden)

[11:12:39] 230 User gigafed logged in

[11:12:39] SYST

[11:12:39] 215 UNIX Type: L8

[11:12:39] Detected Server Type: UNIX

[11:12:39] FEAT

[11:12:39] 211-Features:

[11:12:39]  MDTM

[11:12:39]  REST STREAM

[11:12:39]  SIZE

[11:12:39] 211 End

[11:12:39] PWD

[11:12:40] 257 "/" is the current directory

[11:12:40] CWD /_backup_movies

[11:12:40] 250 CWD command successful

[11:12:40] PWD

[11:12:40] 257 "/_backup_movies" is the current directory

[11:12:40] Remote file exist check: "movie.mpg".

[11:12:40] TYPE I

[11:12:40] 200 Type set to I

[11:12:40] SIZE movie.mpg

[11:12:40] 213 624996352

[11:12:40] MDTM movie.mpg

[11:12:40] 213 20071216101003

[11:12:41] Source File: Size=2219339776, SizeUnit=Byte, Time=2007-01-22T06:20:56, TimeFormat=Exact

[11:12:41] Destination File: Size=624996352, SizeUnit=Byte, Time=2007-12-16T10:10:03, TimeFormat=Exact

[11:12:41] RecentTime=2007-12-16T10:12:37

[11:12:41] No rule matched. Default Action="Overwrite".

[11:12:41] PASV

[11:12:41] 227 Entering Passive Mode (208,113,220,35,225,2).

[11:12:41] Opening data connection to 208.113.220.35 Port: 57602

[11:12:41] STOR movie.mpg

[11:12:41] 150 Opening BINARY mode data connection for movie.mpg

Hello ..

You can see from the log that the difference between the Destination File Time and the RecentTime is 154s which is greater than RecentTimeSpan (120s).

[11:12:41] Destination File: Size=624996352, SizeUnit=Byte, Time=2007-12-16T10:10:03, TimeFormat=Exact
[11:12:41] RecentTime=2007-12-16T10:12:37

To workaround the problem increase the RecentTimeSpan from 120s to 180s in the File Exist dialog/settings.

Regards,
Mat

Hi Mat.

This raises questions ...

1. Why did you implement this time method? Isn't it enough just to check whether the file is there or not, and if yes, just start a resume?

2. What is "RecentTime". I understand that the file has a timestamp on the server, also on the local client and that both, server and local client have individual times, but what does "RecentTime" stand for?

Regards,

Hello ..

I cannot get into details but basically you only want to resume a file on the server if the local and the partial remote file are binary equal (have the same data). Without file hash functions (XCRC, XMD5, etc) the FTP client tries to make a guess whether this is likely the case or not. In SmartFTP we assume that if the last write time (also known as RecentTime in SmartFTP) is only slightly different from the destination file time that resuming is likely the right choice. The "Recent Time Span" value which you can configure in the File Exist settings acts as a threshold which controls whether the rule is triggered or not. The following formula is used:
If abs(RecentTime - DestinationFileTime) <= RecentTimeSpan then the rule is triggered.

Regards,
Mat

Ok. Thanks for the explanations.

This assumes however that server and local clock are +/- sync (disregarding local time and aylight saving).

So, to summarize, my "problem" with the overwrite was probably due to async clocks?

Regards,

Hello ...

Yeah the local time and the server time needs to be in sync. But this should not really be a problem as most servers automatically synchronize the time from a time server.
In your particular case I can't really say for sure what the problem is/was. Just try to increase the Recent Time Span and see if this "fixes" it.

Mat

Hi.

I had it again. The RecentTimeSpan 180 didn't help here!
I stopped the trasfer some hours ago and started rigth now again ...
...

[17:13:50] Source File: Size=3495260160, SizeUnit=Byte, Time=2007-03-21T14:15:53, TimeFormat=Exact

[17:13:50] Destination File: Size=2405888000, SizeUnit=Byte, Time=2007-12-22T14:09:27, TimeFormat=Exact

[17:13:50] RecentTime=2007-12-22T06:00:29

[17:13:50] No rule matched. Default Action="Overwrite".

...
After the overwrite, I stopped/started it and the transfer resumed properly!
...

[17:29:00] Source File: Size=3495260160, SizeUnit=Byte, Time=2007-03-21T14:15:53, TimeFormat=Exact

[17:29:00] Destination File: Size=25995264, SizeUnit=Byte, Time=2007-12-22T16:28:25, TimeFormat=Exact

[17:29:00] RecentTime=2007-12-22T16:28:53

[17:29:00] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".

...
I guess this lien in the first log is the problem.
[17:13:50] RecentTime=2007-12-22T06:00:29
How come RecentTime is stored as 06:00:29 ?!?!

Thanks,

Hello ..

I believe we reached a point where we can no longer offer free technical support. Please purchase a license for 36.95 USD and we will be able to look at your problems again.
https://www.smartftp.com/buy.php

Thank you
Regards,
Mat

Hello ..

All times are represented in UTC (GMT).
If you stop and save the transfer queue or exit SmartFTP while the transfer is running SmartFTP should write the "LastWriteTime" of each item into the Transfer Queue.xml. For uploads this is the last time the client sent data to the server. After you quit SmartFTP open the Transfer Queue.xml and look at the LastWriteTime. This time should be equal to the actual time (in UTC).

Regards,
Mat

Hi Mat.

<LastWriteTime>128427768394375000</LastWriteTime>

Don't know how I can retrace the actual time (UTC) out of this ?!?!

Besides this, since you have the logs (see 3 postings higher) ... are you able to determine by looking at these logs why the upload started with "overwrite" instead of "resume"? Something must be wrong since sometimes it works and sometimes it doesn't. The 120 -> 180 idea wasn't apparently the solution.

Thanks,

Merry x-mas.

The transfer restarts because the RecentTime (LastWriteTime) is too far in the past.
RecentTime=2007-12-22T06:00:29
Destination Time=2007-12-22T14:09:27
Difference > 180s
The destination time specifies the last time the file has been modified (on the server). According the logs this was about 2 hours ago.
The recent time specifies the last time SmartFTP uploaded the file. According to the log that was 10 hours ago.
In conclusion there are 2 possibilities I can think of.
1. The modified time of the file on the server has changed.
2. SmartFTP did not save the Transfer Queue.xml and therefore the LastWriteTime value was not updated.

I need detailed instructions on how to reproduce the problem as I'm unable to reproduce the problem here. For example if it happens every time you close SmartFTP without stopping/saving the queue then I will be able to reproduce it here as well. If it just happens randomly it's impossible (for me) to figure out what's going on.

Mat

It hit me several times again. Here a log from this morning.

...

[12:57:55] Source File: Size=1445253120, SizeUnit=Byte, Time=2007-10-17T15:37:55, TimeFormat=Exact

[12:57:55] Destination File: Size=39542156, SizeUnit=Byte, Time=2008-01-08T11:18:24, TimeFormat=Exact

[12:57:55] RecentTime=2008-01-07T08:41:44

[12:57:55] No rule matched. Default Action="Overwrite".

...

I rebooted at #12:10 local time, restarted SmartFTP at #12:55 local time.
The server is in California (local time -9 hours from local time).
Can you say anything regarding the reason of the overwrite?

If not, I keep on digging ...

With my limited knowledge ... if you say that RecentTime is the last time (in UTC) SmartFTP uploaded the file, then this one is wrong. I stopped the computer around 12:10 (local time), and not at 08:41 (UTC).

... for info only (no reply required) ...

This is a resume which worked properly. SmartFTP queue transfer was stopped, then computer was rebooted.

...

[10:51:11] Source File: Size=1445197824, SizeUnit=Byte, Time=2007-11-06T14:09:14, TimeFormat=Exact

[10:51:11] Destination File: Size=934286732, SizeUnit=Byte, Time=2008-01-12T09:44:58, TimeFormat=Exact

[10:51:11] RecentTime=2008-01-12T09:44:48

...
"Recent" time span = 10 seconds!

Hello ..

Please check the latest version:
https://www.smartftp.com/download

It should work better as it does save the LastWriteTime if the computer is rebooted without closing SmartFTP first.

Regards,
Mat