[9.0ß2] FTP is failing half way through for multi-GB files

The behaviour described in the bug report is either by design, or would be far too complex/time-consuming to be changed

Moderators: Hacker, petermad, Stefan2, white

Post Reply
ykhabins
Junior Member
Junior Member
Posts: 35
Joined: 2003-10-09, 13:12 UTC

[9.0ß2] FTP is failing half way through for multi-GB files

Post by *ykhabins »

Hello,

I am trying to FTP a large 2.2 GB file.
The FTP process starts without any problem.

But somewhere at 1.5 GB it stops.
I tried it already few times for the same 2.2 GB file with the same outcome.

It seems some kind of scalability issue.
User avatar
Dalai
Power Member
Power Member
Posts: 9968
Joined: 2005-01-28, 22:17 UTC
Location: Meiningen (Südthüringen)

Post by *Dalai »

Download or upload? Is this an internal (LAN) or external (internet) transfer? Does it work with other FTP clients? Which OS?

Regards
Dalai
#101164 Personal licence
Ryzen 5 2600, 16 GiB RAM, ASUS Prime X370-A, Win7 x64

Plugins: Services2, Startups, CertificateInfo, SignatureInfo, LineBreakInfo - Download-Mirror
ykhabins
Junior Member
Junior Member
Posts: 35
Joined: 2003-10-09, 13:12 UTC

Post by *ykhabins »

It is an Upload operation from US to Luxembourg.
It goes through the speedy and dedicated MPLS network.
User avatar
Dalai
Power Member
Power Member
Posts: 9968
Joined: 2005-01-28, 22:17 UTC
Location: Meiningen (Südthüringen)

Post by *Dalai »

So, what about the other questions?

Regards
Dalai
#101164 Personal licence
Ryzen 5 2600, 16 GiB RAM, ASUS Prime X370-A, Win7 x64

Plugins: Services2, Startups, CertificateInfo, SignatureInfo, LineBreakInfo - Download-Mirror
ykhabins
Junior Member
Junior Member
Posts: 35
Joined: 2003-10-09, 13:12 UTC

Post by *ykhabins »

TC 32-bit
OS - Windows 7 Professional, 64-bit
It works with FileZilla v.3.18.0
User avatar
Dalai
Power Member
Power Member
Posts: 9968
Joined: 2005-01-28, 22:17 UTC
Location: Meiningen (Südthüringen)

Post by *Dalai »

OK. What does the TC FTP log say? You can find it in the upper area of the window while the FTP connection is active, next to the Disconnect button. Double-click on the two lines area to open the full log in TC Lister.

Regards
Dalai
#101164 Personal licence
Ryzen 5 2600, 16 GiB RAM, ASUS Prime X370-A, Win7 x64

Plugins: Services2, Startups, CertificateInfo, SignatureInfo, LineBreakInfo - Download-Mirror
ykhabins
Junior Member
Junior Member
Posts: 35
Joined: 2003-10-09, 13:12 UTC

Post by *ykhabins »

Unfortunately, I am not in the office anymore.
So I cannot reproduce the same scenario.

If the TC's FTP log is persisted on the file system I can dig it up.
Please advise.
User avatar
Dalai
Power Member
Power Member
Posts: 9968
Joined: 2005-01-28, 22:17 UTC
Location: Meiningen (Südthüringen)

Post by *Dalai »

ykhabins wrote:If the TC's FTP log is persisted on the file system I can dig it up.
By default, TC doesn't write a persistent log file. You can enable it in TC's options: Operation > FTP > Create a log file (choose some place writeable and where it doesn't get accidentally deleted).

Regards
Dalai
#101164 Personal licence
Ryzen 5 2600, 16 GiB RAM, ASUS Prime X370-A, Win7 x64

Plugins: Services2, Startups, CertificateInfo, SignatureInfo, LineBreakInfo - Download-Mirror
ykhabins
Junior Member
Junior Member
Posts: 35
Joined: 2003-10-09, 13:12 UTC

Post by *ykhabins »

Today I am back to the environment where I can test the FTP with the logging.

I am already on TC v9.0b3

The FTP failed again.
Again, it stopped somewhere at 1.5 GB.
What is interesting is that after the re-connection to the FTP server, it shows *.iso file of 0 (zero) size. Few minutes later the FTP server correctly shows the transmitted file size.

Exact file sizes:
Source file: 2,206,040,064 bytes
Destination file: 1,612,382,208 bytes


1. TC showed this in the dialog box:
---------------------------
ftp
---------------------------
Transfer failed, continue operation?

en_sql_server_2016_developer_x64_dvd_8777069.iso
---------------------------
Yes No
---------------------------

2. TC FTP log content:
----------
Connect to: (06/27/2016 10:50:03 AM)
hostname=10.111.146.39
username=CDWTeam
startdir=/DEVELOPER/SQL SERVER 2016 Developer Edition
10.111.146.39=10.111.146.39
220 Welcome to FTP Server
USER CDWTeam
331 Password required for cdwteam
PASS ***********
230 Logged on
SYST
215 UNIX emulated by FileZilla
FEAT
211-Features:
MDTM
REST STREAM
SIZE
MLST type*;size*;modify*;
MLSD
UTF8
CLNT
MFMT
211 End
CLNT Total Commander (UTF-8)
200 Don't care
OPTS UTF8 ON
200 UTF8 mode enabled
Connect ok!
CWD /DEVELOPER/SQL SERVER 2016 Developer Edition
250 CWD successful. "/DEVELOPER/SQL SERVER 2016 Developer Edition" is current directory.
TYPE I
200 Type set to I
SIZE en_sql_server_2016_developer_x64_dvd_8777069.iso
213 0
PORT 192,168,123,41,244,117
200 Port command successful
STOR en_sql_server_2016_developer_x64_dvd_8777069.iso
150 Opening data channel for file transfer.
Upload
550 can't access file.
SIZE en_sql_server_2016_developer_x64_dvd_8777069.iso
213 0
PORT 192,168,123,41,244,118
200 Port command successful
STOR en_sql_server_2016_developer_x64_dvd_8777069.iso
150 Opening data channel for file transfer.
Upload
550 can't access file.
SIZE en_sql_server_2016_developer_x64_dvd_8777069.iso
213 0
PORT 192,168,123,41,244,119
200 Port command successful
STOR en_sql_server_2016_developer_x64_dvd_8777069.iso
150 Opening data channel for file transfer.
Upload
550 can't access file.
Get directory
TYPE A
200 Type set to A
PORT 192,168,123,41,244,150
200 Port command successful
MLSD
150 Opening data channel for directory list.
Download
Waiting for server...
226 Transfer OK
Last edited by ykhabins on 2016-06-27, 15:15 UTC, edited 1 time in total.
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 50550
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

550 can't access file.
This is an error coming from the server.

Here someone has this problem with FileZilla due to missing user rights. Since it happens only at 1.5GB, it may be due to quota settings.
Author of Total Commander
https://www.ghisler.com
Post Reply