Slow Transfer Fish Private Network

[fabian3357]

Hello

I have a question regarding the maximum speed of fish transfers with mignight commander.

i have a private network between my servers with 10 Gigabit over fiber and have to transfer 46 TB and have selected fish as protocol but unfortunately the midnight commander only pulls max 113 MB/s over the 10 Giagbit connection is that normal or can i speed it up ?

[zaytsev]

I think it's a wonder that it reaches such very high speeds with the extreme overhead of the FISH protocol. You have to understand that FISH protocol is not about the speed of file transfer. It's about the ability to browse file systems and transfer files on systems where no specialized servers are installed, but only pure ssh and POSIX shell. Copying files is basically emulated via piping the data through shell commands. I would suggest to try SFTP server if it's enabled in your SSH server or FTP server. mc supports both. If they perform as you expect (minus the overhead of screen updates and non-optimal block size), you can try to check where is the bottleneck in FISH and fix it, but for us I think that's a wontfix.

[fabian3357]

thanks for the info

i just have another question, if a transfer is canceled and files are already present, and i then want to copy the remaining files, and i then select at the question how should existing files be treated only overwrite the files if size is different, it then overwrites only these and adds others ?

because when i look in the trasfer / progress window it shows 355 GB of 46 TB 46 TB would be the full size of the folder but 42 TB are already transferred. so it would transfer them all again or not?

[zaytsev]

so it would transfer them all again or not?

It should not transfer them all again, but if there is a reproducible bug, please reopen.