Cloud plugin error copying, files >50Mb

[n3rd4i]

Trying to copy large files with Cloud plugin, say ~300Mb, after [50M/315M] you get error, e.g.:

---------------------------
Error downloading file!
---------------------------
C:\Big-file.ext
---------------------------
OK Cancel
---------------------------

Versions for reference:
- Total Commander Version 9.51 64 bit (2020-03-25)
- Cloud - 2.2 - 2020/02/09

[Hacker]

n3rd4i,
Which cloud service? What does the detailed log say?

Roman

[Horst.Epp]

I tested the upload and download of a 90MB Exe-File with Cload plugin 2.2
to Google Drive and OneDrive
No Problems

[Usher]

Trying to copy large files with Cloud plugin, say ~300Mb, after [50M/315M] you get error, e.g.:

Never heard about coronavirus, COVID-19, lockdown etc.?
Many companies shifted to remote/home working and internet connections are highly loaded so cloud providers have limited max file size:
https://www.theregister.co.uk/2020/03/12/remote_work_struggles/
Want to upload larger files? Split them into pieces.

[ghisler(Author)]

2n3rd4i
Some cloud services require to upload/download large files in smaller chunks. The cloud plugin should already do that, but maybe a service changed the rules. Therefore it would be helpful to know which cloud service you use.

[n3rd4i]

Oh, of course I forgot to mention the important piece of information, the cloud service is:
- Google Drive

Thanks for the replies

[Horst.Epp]

Oh, of course I forgot to mention the important piece of information, the cloud service is:
- Google Drive

Thanks for the replies

I have tested again, this time with a file size of 360MB
Again no problem to upload or download with Google drive.

[Ovg]

viewtopic.php?f=6&t=41512&p=383558#p383558

[n3rd4i]

Maybe also important I'm living in Netherlands (European country).

Never heard about coronavirus, COVID-19, lockdown etc.?

Maybe has to do with that. I don't fully understand it.

What does the detailed log say?

How to do that?

[Hacker]

n3rd4i,

How to do that?

Alt-Enter on the connection name.

Roman

[n3rd4i]

Also maybe worth to mention. Upload works. Download [of the same uploaded file] doesn't.

I believe this is the log. So the transaction starts, copies some MB's then gives this error.

Code: Select all

User-Agent: cloudplugin/2.0 TotalCommander/9.5 (Windows/10; en_EN)
Host: www.googleapis.com
Connection: Keep-Alive
Cache-Control: no-cache
TLS 1.2, AES128
******Received headers
HTTP/1.1 403 Forbidden
Content-Length: 1103
Content-Type: text/html; charset=UTF-8
Date: Wed, 15 Apr 2020 16:50:48 GMT
Alt-Svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,h3-T050=":443"; ma=2592000
Error: 403 Forbidden

Trying to download the file online, with GDrive web interface brings this message.

Code: Select all

"Can't scan file for viruses"

"my_file.ext" (313.9MB) exceeds the maximum file size that Google can scan. This file might harm your computer, so only download this file if you understand the risks.

CANCEL	DOWNLOAD_ANYWAY

[ghisler(Author)]

So it gives out an error 403 Forbidden now? How nice, Google is constantly playing around with these functions. Recently it was error 500 (internal server error). See this:
https://www.ghisler.ch/board/viewtopic.php?p=370762#p370762

I don't really know how to deal with this when I cannot detect it properly and ask the user for confirmation.

[n3rd4i]

Interesting enough maybe, Android version of totalcommander + cloud (gdrive) addon works as expected, no issue there.

The same implementation is in both plugins ? (PC vs Android)

[Usher]

1. The server side may use different solutions depending on User Agent passed by the browser.
2. I suspect, that "User-Agent: cloudplugin/2.0 TotalCommander/9.5 (Windows/10; en_EN)" means that you don't use the latest versions of cloud plugin (should be 2.2) and TC (should be 9.51).

[n3rd4i]

TL;DR version:
You sir are partial right, after manually removing the cloud plugin and installing fresh now it works.
By partial I mean, that TC version is incorrect still (the version is 9.5 not 9.51) and cloud plugin version differs between x86 and x64.

Before complete details, a bit of more background:
1. I was using the plugin before so I previously had an older version, could be 2.0 (not sure since the log is from x64 version of TC)
2. To "upgrade" to new version I was doing the following:
- Download new version of the plugin package somewhere
- Open the package within totalcmd64.exe
- Accept the plugin installation request.
I seems this process does not updated it correctly always? I would need back an older package to prove this somehow.

Complete details here: It seems that totalcmd.exe VS totalcmd64.exe reports different versions of cloud plugin.
1. I've deleted my cloud plugin and uninstall totalcommander
2. I've reinstalled totalcommander 9.51 from [official] website, installer checksum:

Code: Select all

T:\>%chocolateyinstall%\tools\checksum -t sha256 tcmd951x64.exe
B440EC35EA6C4FF7296B51C96E7BF55336A1CEBAF211524E6CAA2F4DB3FE60B2

3. I've downloaded the current [latest] cloud plugin, again opened the archive within totalcmd64.exe

Code: Select all

T:\>%chocolateyinstall%\tools\checksum -t sha256 cloudplugin2.20.zip
B47694B9DA8339B93D05E5CAD9C1A043B50AD28DD3C7D53797884D03960E2EF4

4. Downloading within x64 version of the plugin work with the following partial log, gives wrong plugin address (minor -1):

Code: Select all

=================
File receive: \pathto\folder\file.mkv
GET /drive/v2/files/REDACTED_STRING2?alt=media&source=downloadUrl&supportsAllDrives=true HTTP/1.1
User-Agent: cloudplugin/2.1 TotalCommander/9.5 (Windows/10; en_EN)
Host: www.googleapis.com
Connection: Keep-Alive
Cache-Control: no-cache
TLS 1.2, AES128
******Received headers
HTTP/1.1 200 OK
X-GUploader-UploadID: REDACTED_LONG_STRING2
Content-Type: video/x-matroska
Content-Disposition: attachment
ETag: "OTkwNTUyMzU4"
Vary: Origin
Vary: X-Origin
Expires: Sat, 18 Apr 2020 07:24:50 GMT
Date: Sat, 18 Apr 2020 07:24:50 GMT
Cache-Control: private, max-age=0, must-revalidate
Content-Length: 327267424
X-Goog-Hash: crc32c=SwZL9g==
Server: UploadServer
Alt-Svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,h3-T050=":443"; ma=2592000
200 OK
=================

4. Downloading within x86 version of the plugin work with the following partial log, gives correct plugin address:

Code: Select all

=================
File receive: \pathto\folder\file.mkv
GET /drive/v2/files/REDACTED_STRING1?alt=media&source=downloadUrl&supportsAllDrives=true HTTP/1.1
User-Agent: cloudplugin/2.2 TotalCommander/9.5 (Windows/10; en_EN)
Host: www.googleapis.com
Connection: Keep-Alive
Cache-Control: no-cache
TLS 1.2, AES128
******Received headers
HTTP/1.1 200 OK
X-GUploader-UploadID: REDACTED_LONG_STRING1
Content-Type: video/x-matroska
Content-Disposition: attachment
ETag: "OTkwNTUyMzU4"
Vary: Origin
Vary: X-Origin
Expires: Sat, 18 Apr 2020 07:28:42 GMT
Date: Sat, 18 Apr 2020 07:28:42 GMT
Cache-Control: private, max-age=0, must-revalidate
Content-Length: 327267424
X-Goog-Hash: crc32c=SwZL9g==
Server: UploadServer
Alt-Svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,h3-T050=":443"; ma=2592000
200 OK
=================