Hi guys! I have a server on a rather reliable network, with 1Gbps connection upload verified by different connections over the same area. However, in some countries where the connection is very unreliable, the connection slowly dies, and stays dead halfway through the transfer. Is there any client which would be prepared to adapt or detect an unreliable connection, and retry/resume as soon as it happens without losing the transfer? I find filezilla sometimes tends to stall halfway through, and it stays…hung without doign much. And sometimes after restarting the connection, it just overwrites the file from the beginning without prompting. Is there a better system or client to transfer large files in a resumeable way over the internet?

Thanks!

  • underpuddle@lemmy.worldEnglish
    3·
    18 hours ago

    It sounds to me like you’re gonna like rsync. It’s cool, you can copy 1 or multiple large files, resume interrupted transfers, and even keep entire directories in sync.

    Oh yes, and it’s a Linux tool. Not sure if it’s available with a GUI version, so you might need to get comfortable with using the terminal (which you probably already are if you’re using Linux).

  • klankin@piefed.caEnglish
    2·
    17 hours ago

    Pretty sure I heard somewhere SSHfs is pretty robust against flakey connections

    • iturnedintoanewt@lemmy.worldOPEnglish
      1·
      12 hours ago

      SSHfs

      Thanks…I need to look into this. Isn’t it integrated already with your average openssh-server install?

  • Menschlicher_Fehler@feddit.orgEnglish
    4·
    23 hours ago

    If you are on Windows, take a look at Robocopy.

    /z Copies files in restartable mode. In restartable mode, should a file copy be interrupted, robocopy can pick up where it left off rather than recopying the entire file.

    /r:<n> Specifies the number of retries on failed copies. The default value of n is 1,000,000 (one million retries).

    /w:<n> Specifies the wait time between retries, in seconds. The default value of n is 30 (wait time 30 seconds).

    • iturnedintoanewt@lemmy.worldOPEnglish
      2·
      22 hours ago

      Thanks! I’m looking for some Linux equivalent of this…Not sure if there’s an SFTP client that can reliably copy a bunch of large files, or I’d need to go with any other protocol.

  • fascicle@leminal.spaceEnglish
    3·
    23 hours ago

    I use syncthing to keep my photos from tablet backed up to server as I travel and stuff. But its more for a lot of smaller files and not one big file that might stop halfway

    • iturnedintoanewt@lemmy.worldOPEnglish
      2·
      22 hours ago

      Thanks…I’m actually considering this as an option, but it would make it a bit more…indirect than what I was intending to do, as it syncs a pre-defined folder, not specific files at will. But definitely I know it to be reliable transferring lots of files reliably.

  • Onomatopoeia@lemmy.cafeEnglish
    2·
    21 hours ago

    You can configure Syncthing for more ad-hoc, but it’s a little convoluted.

    Try Resilio Sync - it has a Selective Sync feature that allows you to select individual files to sync in the moment.

    I use Resilio this way to access my files at home - Resilio runs on a machine at home and indexes/shares the root folder on my NAS. Then from any device (including my phone) I can browse for any file and select sync. It will take as long as needed for the file size and network stability, but it will sync the file.

    This is especially useful for media files, since I can’t exactly keep my entire library (4 TB) synced to my phone, but using Resilio I can grab any movie/TV show/music at any time.

    Just don’t leave Resilio running your phone - it can be hard on memory as it keeps an index there, and it isn’t the most battery friendly app. So I close it when done syncing something.

  • RedBauble@sh.itjust.worksEnglish
    2·
    23 hours ago

    I have never done this, but maybe you can try creating a torrent and sharing it with your friend, or using plain http/https with a download client lile jDownloader, so that it automatically resumes the download and handles errors