8
rclone mount transfer speed help (lemmy.world)
submitted 9 months ago* (last edited 9 months ago) by retiolus@lemmy.world to c/selfhosted@lemmy.world
2 comments fedilink hide all child comments

Hi, I'm using rclone to mount an external backup storage (sftp). This is my rclone mount command:

/usr/bin/rclone mount Storage: /mnt/Storage --vfs-cache-mode full --vfs-cache-max-size 50G --vfs-cache-max-age 1h --vfs-read-chunk-size 512M --max-backlog 999999 --fast-list --transfers 16 --allow-other -vv

The issue I'm having is that I can't increase the file upload speed. Let me explain, I can increase the --transfers parameter and yes, it will be faster because more files are uploaded at the same time, but what I want is to increase the upload speed of a single file!

Ex:

  • --transfers 4 --> 700 KiB/s
  • --transfers 8 --> 1.8 MiB/s
  • --transfers 16 --> 3.8 MiB/s

Which is fine when there are a lot of files, but if there's only one big file, the upload speed will be around 200 KiB/s...

Does anyone have any idea how I can change this?

you are viewing a single comment's thread
view the rest of the comments
[-] WhatAmLemmy@lemmy.world 1 points 9 months ago

What's the upload speed from a regular sftp client to the same destination?

[-] retiolus@lemmy.world 1 points 9 months ago

Just tried that, using simple sftp command, a single file uploads at 4.5/5 MiB/s

this post was submitted on 13 Feb 2024
8 points (83.3% liked)

Selfhosted

40219 readers
978 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
ruud@lemmy.world
CannaVet@lemmy.world
Loki@lemmy.world
HybridSarcasm@lemmy.world
devve@lemmy.world
HybridSarcasm@lemmy.hybridsarcasm.xyz