2015-11-08 15:29:58 +00:00
|
|
|
---
|
|
|
|
title: "Hubic"
|
|
|
|
description: "Rclone docs for Hubic"
|
|
|
|
---
|
|
|
|
|
2021-07-20 18:45:41 +00:00
|
|
|
# {{< icon "fa fa-space-shuttle" >}} Hubic
|
2015-11-08 15:29:58 +00:00
|
|
|
|
|
|
|
Paths are specified as `remote:path`
|
|
|
|
|
|
|
|
Paths are specified as `remote:container` (or `remote:` for the `lsd`
|
2020-10-13 21:49:58 +00:00
|
|
|
command.) You may put subdirectories in too, e.g. `remote:container/path/to/dir`.
|
2015-11-08 15:29:58 +00:00
|
|
|
|
2021-10-14 13:40:18 +00:00
|
|
|
## Configuration
|
|
|
|
|
2015-11-08 15:29:58 +00:00
|
|
|
The initial setup for Hubic involves getting a token from Hubic which
|
|
|
|
you need to do in your browser. `rclone config` walks you through it.
|
|
|
|
|
|
|
|
Here is an example of how to make a remote called `remote`. First run:
|
|
|
|
|
|
|
|
rclone config
|
|
|
|
|
|
|
|
This will guide you through an interactive setup process:
|
|
|
|
|
|
|
|
```
|
|
|
|
n) New remote
|
2016-02-21 13:39:04 +00:00
|
|
|
s) Set configuration password
|
|
|
|
n/s> n
|
2015-11-08 15:29:58 +00:00
|
|
|
name> remote
|
2016-02-21 13:39:04 +00:00
|
|
|
Type of storage to configure.
|
|
|
|
Choose a number from below, or type in your own value
|
2019-08-26 09:47:17 +00:00
|
|
|
[snip]
|
|
|
|
XX / Hubic
|
2016-02-21 13:39:04 +00:00
|
|
|
\ "hubic"
|
2019-08-26 09:47:17 +00:00
|
|
|
[snip]
|
|
|
|
Storage> hubic
|
2016-02-21 13:39:04 +00:00
|
|
|
Hubic Client Id - leave blank normally.
|
2017-01-09 05:09:19 +00:00
|
|
|
client_id>
|
2016-02-21 13:39:04 +00:00
|
|
|
Hubic Client Secret - leave blank normally.
|
2017-01-09 05:09:19 +00:00
|
|
|
client_secret>
|
2015-11-08 15:29:58 +00:00
|
|
|
Remote config
|
2016-02-21 13:39:04 +00:00
|
|
|
Use auto config?
|
|
|
|
* Say Y if not sure
|
|
|
|
* Say N if you are working on a remote or headless machine
|
|
|
|
y) Yes
|
|
|
|
n) No
|
|
|
|
y/n> y
|
|
|
|
If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth
|
2015-11-08 15:29:58 +00:00
|
|
|
Log in and authorize rclone for access
|
|
|
|
Waiting for code...
|
|
|
|
Got code
|
|
|
|
--------------------
|
|
|
|
[remote]
|
2017-01-09 05:09:19 +00:00
|
|
|
client_id =
|
|
|
|
client_secret =
|
2015-11-08 15:29:58 +00:00
|
|
|
token = {"access_token":"XXXXXX"}
|
|
|
|
--------------------
|
|
|
|
y) Yes this is OK
|
|
|
|
e) Edit this remote
|
|
|
|
d) Delete this remote
|
|
|
|
y/e/d> y
|
|
|
|
```
|
|
|
|
|
2016-01-07 15:20:32 +00:00
|
|
|
See the [remote setup docs](/remote_setup/) for how to set it up on a
|
|
|
|
machine with no Internet browser available.
|
|
|
|
|
2015-11-08 15:29:58 +00:00
|
|
|
Note that rclone runs a webserver on your local machine to collect the
|
|
|
|
token as returned from Hubic. This only runs from the moment it opens
|
|
|
|
your browser to the moment you get back the verification code. This
|
|
|
|
is on `http://127.0.0.1:53682/` and this it may require you to unblock
|
|
|
|
it temporarily if you are running a host firewall.
|
|
|
|
|
|
|
|
Once configured you can then use `rclone` like this,
|
|
|
|
|
|
|
|
List containers in the top level of your Hubic
|
|
|
|
|
|
|
|
rclone lsd remote:
|
|
|
|
|
|
|
|
List all the files in your Hubic
|
|
|
|
|
|
|
|
rclone ls remote:
|
|
|
|
|
|
|
|
To copy a local directory to an Hubic directory called backup
|
|
|
|
|
|
|
|
rclone copy /home/source remote:backup
|
|
|
|
|
2016-05-27 17:12:28 +00:00
|
|
|
If you want the directory to be visible in the official *Hubic
|
|
|
|
browser*, you need to copy your files to the `default` directory
|
|
|
|
|
|
|
|
rclone copy /home/source remote:default/backup
|
|
|
|
|
2017-06-06 15:40:00 +00:00
|
|
|
### --fast-list ###
|
|
|
|
|
|
|
|
This remote supports `--fast-list` which allows you to use fewer
|
|
|
|
transactions in exchange for more memory. See the [rclone
|
|
|
|
docs](/docs/#fast-list) for more details.
|
|
|
|
|
2015-11-08 15:29:58 +00:00
|
|
|
### Modified time ###
|
|
|
|
|
|
|
|
The modified time is stored as metadata on the object as
|
|
|
|
`X-Object-Meta-Mtime` as floating point since the epoch accurate to 1
|
|
|
|
ns.
|
|
|
|
|
2019-03-27 19:12:24 +00:00
|
|
|
This is a de facto standard (used in the official python-swiftclient
|
2015-11-08 15:29:58 +00:00
|
|
|
amongst others) for storing the modification time for an object.
|
|
|
|
|
|
|
|
Note that Hubic wraps the Swift backend, so most of the properties of
|
|
|
|
are the same.
|
|
|
|
|
2020-05-22 11:22:52 +00:00
|
|
|
{{< rem autogenerated options start" - DO NOT EDIT - instead edit fs.RegInfo in backend/hubic/hubic.go then run make backenddocs" >}}
|
2021-11-01 15:42:05 +00:00
|
|
|
### Standard options
|
2018-10-01 19:48:54 +00:00
|
|
|
|
2022-07-09 17:08:20 +00:00
|
|
|
Here are the Standard options specific to hubic (Hubic).
|
2018-10-01 19:48:54 +00:00
|
|
|
|
|
|
|
#### --hubic-client-id
|
|
|
|
|
2021-11-01 15:42:05 +00:00
|
|
|
OAuth Client Id.
|
|
|
|
|
2018-10-01 19:48:54 +00:00
|
|
|
Leave blank normally.
|
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2018-10-01 19:48:54 +00:00
|
|
|
- Config: client_id
|
|
|
|
- Env Var: RCLONE_HUBIC_CLIENT_ID
|
|
|
|
- Type: string
|
2022-03-18 12:29:54 +00:00
|
|
|
- Required: false
|
2018-10-01 19:48:54 +00:00
|
|
|
|
|
|
|
#### --hubic-client-secret
|
|
|
|
|
2021-11-01 15:42:05 +00:00
|
|
|
OAuth Client Secret.
|
|
|
|
|
2018-10-01 19:48:54 +00:00
|
|
|
Leave blank normally.
|
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2018-10-01 19:48:54 +00:00
|
|
|
- Config: client_secret
|
|
|
|
- Env Var: RCLONE_HUBIC_CLIENT_SECRET
|
|
|
|
- Type: string
|
2022-03-18 12:29:54 +00:00
|
|
|
- Required: false
|
2018-10-01 19:48:54 +00:00
|
|
|
|
2021-11-01 15:42:05 +00:00
|
|
|
### Advanced options
|
2018-10-01 19:48:54 +00:00
|
|
|
|
2022-07-09 17:08:20 +00:00
|
|
|
Here are the Advanced options specific to hubic (Hubic).
|
2018-10-01 19:48:54 +00:00
|
|
|
|
2020-09-02 15:59:04 +00:00
|
|
|
#### --hubic-token
|
|
|
|
|
|
|
|
OAuth Access Token as a JSON blob.
|
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2020-09-02 15:59:04 +00:00
|
|
|
- Config: token
|
|
|
|
- Env Var: RCLONE_HUBIC_TOKEN
|
|
|
|
- Type: string
|
2022-03-18 12:29:54 +00:00
|
|
|
- Required: false
|
2020-09-02 15:59:04 +00:00
|
|
|
|
|
|
|
#### --hubic-auth-url
|
|
|
|
|
|
|
|
Auth server URL.
|
2021-11-01 15:42:05 +00:00
|
|
|
|
2020-09-02 15:59:04 +00:00
|
|
|
Leave blank to use the provider defaults.
|
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2020-09-02 15:59:04 +00:00
|
|
|
- Config: auth_url
|
|
|
|
- Env Var: RCLONE_HUBIC_AUTH_URL
|
|
|
|
- Type: string
|
2022-03-18 12:29:54 +00:00
|
|
|
- Required: false
|
2020-09-02 15:59:04 +00:00
|
|
|
|
|
|
|
#### --hubic-token-url
|
|
|
|
|
|
|
|
Token server url.
|
2021-11-01 15:42:05 +00:00
|
|
|
|
2020-09-02 15:59:04 +00:00
|
|
|
Leave blank to use the provider defaults.
|
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2020-09-02 15:59:04 +00:00
|
|
|
- Config: token_url
|
|
|
|
- Env Var: RCLONE_HUBIC_TOKEN_URL
|
|
|
|
- Type: string
|
2022-03-18 12:29:54 +00:00
|
|
|
- Required: false
|
2020-09-02 15:59:04 +00:00
|
|
|
|
2018-10-01 19:48:54 +00:00
|
|
|
#### --hubic-chunk-size
|
|
|
|
|
|
|
|
Above this size files will be chunked into a _segments container.
|
|
|
|
|
|
|
|
Above this size files will be chunked into a _segments container. The
|
2021-03-02 19:11:57 +00:00
|
|
|
default for this is 5 GiB which is its maximum value.
|
2018-10-01 19:48:54 +00:00
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2018-10-01 19:48:54 +00:00
|
|
|
- Config: chunk_size
|
|
|
|
- Env Var: RCLONE_HUBIC_CHUNK_SIZE
|
|
|
|
- Type: SizeSuffix
|
2021-07-20 18:45:41 +00:00
|
|
|
- Default: 5Gi
|
2018-10-01 19:48:54 +00:00
|
|
|
|
2019-02-09 10:42:57 +00:00
|
|
|
#### --hubic-no-chunk
|
|
|
|
|
|
|
|
Don't chunk files during streaming upload.
|
|
|
|
|
2020-10-13 21:49:58 +00:00
|
|
|
When doing streaming uploads (e.g. using rcat or mount) setting this
|
2019-02-09 10:42:57 +00:00
|
|
|
flag will cause the swift backend to not upload chunked files.
|
|
|
|
|
2021-03-02 19:11:57 +00:00
|
|
|
This will limit the maximum upload size to 5 GiB. However non chunked
|
2019-02-09 10:42:57 +00:00
|
|
|
files are easier to deal with and have an MD5SUM.
|
|
|
|
|
|
|
|
Rclone will still chunk files bigger than chunk_size when doing normal
|
|
|
|
copy operations.
|
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2019-02-09 10:42:57 +00:00
|
|
|
- Config: no_chunk
|
|
|
|
- Env Var: RCLONE_HUBIC_NO_CHUNK
|
|
|
|
- Type: bool
|
|
|
|
- Default: false
|
|
|
|
|
2020-02-01 10:31:42 +00:00
|
|
|
#### --hubic-encoding
|
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
The encoding for the backend.
|
2020-02-01 10:31:42 +00:00
|
|
|
|
2021-11-01 15:42:05 +00:00
|
|
|
See the [encoding section in the overview](/overview/#encoding) for more info.
|
2020-02-01 10:31:42 +00:00
|
|
|
|
2022-03-18 12:29:54 +00:00
|
|
|
Properties:
|
|
|
|
|
2020-02-01 10:31:42 +00:00
|
|
|
- Config: encoding
|
|
|
|
- Env Var: RCLONE_HUBIC_ENCODING
|
|
|
|
- Type: MultiEncoder
|
|
|
|
- Default: Slash,InvalidUtf8
|
|
|
|
|
2020-05-22 11:22:52 +00:00
|
|
|
{{< rem autogenerated options stop >}}
|
2018-10-01 17:36:15 +00:00
|
|
|
|
2021-10-14 13:40:18 +00:00
|
|
|
## Limitations
|
2015-11-08 15:29:58 +00:00
|
|
|
|
2016-03-16 17:39:44 +00:00
|
|
|
This uses the normal OpenStack Swift mechanism to refresh the Swift
|
|
|
|
API credentials and ignores the expires field returned by the Hubic
|
|
|
|
API.
|
|
|
|
|
|
|
|
The Swift API doesn't return a correct MD5SUM for segmented files
|
|
|
|
(Dynamic or Static Large Objects) so rclone won't check or use the
|
|
|
|
MD5SUM for these.
|