We are in the process of migrating this forum. A new space will be available soon. We are sorry for the inconvenience.

File segments and swift browsing


Rey
03-06-2014, 01:02 PM
Cyberduck authorize 0 byte file download, and I get a 0 byte file on my hard drive.
But it works great with small files, regardless which software I used to upload them.

0 byte files are from windows sync upload.

There is another issue with cyberduck: when I upload then download a big files, I just get a json file.
An example:
I upload with cyberduck the file "default/Partage 4/Construction de la terrasse.avi", 3,87Go.
Then I download it (with cyberduck or windows sync, the result is the same) and I get a 128Ko file. It contains the following json descriptor :
[{"size_bytes":5242880,"etag":"276ae352d467942ce178 f15f0a141208","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000001"},{"size_bytes":5242880,"etag":"83c3b3d0e ccbe4aec3697c770efc4b88","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000002"},{"size_bytes":5242880,"etag":"76dcd1679 b08bbc694eb42efa3807e25","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000003"},{"size_bytes":5242880,"etag":"076d56045 4338e8d520e5a5f4c3da0c7","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000004"},{"size_bytes":5242880,"etag":"199ef8c50 9c96ef2cf46b82545f7ad7e","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000005"},{"size_bytes":5242880,"etag":"9e4d3f053 76b4c60e0e77b8f06021568","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000006"},{"size_bytes":5242880,"etag":"ebea26020 011e777cd2023890b53b236","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000007"},{"size_bytes":5242880,"etag":"351ff3d6f 1314fe4fa1f6738dbb5df44","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000008"},{"size_bytes":5242880,"etag":"051c26178 7a55866c4ca7d6050216f5b","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000009"},{"size_bytes":5242880,"etag":"05d472851 d3af1651052d5e913ea2089","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000010"},{"size_bytes":5242880,"etag":"689990ad6 d58ea2c5afc97239b30e89c","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000011"},{"size_bytes":5242880,"etag":"3846947e7 40c05b99b43b25daaaf9288","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000012"},{"size_bytes":5242880,"etag":"17bb192d2 b2dd273aada623c86970dfc","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000013"},{"size_bytes":5242880,"etag":"21ed63761 259916ae8adaf8bbbba23bf","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000014"},{"size_bytes":5242880,"etag":"5824ae6d0 53d523250bd138eedbf0b68","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000015"},{"size_bytes":5242880,"etag":"45d05b19b bc6debb668cc1d4874f1fab","path":"\/default\/.file-segments\/Partage 4\/Construction de la terrasse.avi\/4165321894\/00000016"}, etc etc
In the "/default/.file-segments/" directory (created after cyberduck use), I have the 5Mo chucks, downloadable separatly. But I cant reassemble them automaticaly.

I'm using cyberduck v4.4.3 (last version). Default config (I haven't find any chunks config anyway).

vcasse
03-06-2014, 12:36 PM
Hey Rey,

With big files, Openstack propose to cut it in segments. We store segments inside default_segments container and create a file inside default container to represent this big file.

It's appears that cyberduck don't manage download of your big file using segments. That's strange because only a GET request to openstack permit that. Cyberduck unauthorize 0 byte file download ?

Regards,
Vincent

Rey
03-06-2014, 12:24 PM
I'm browsing my hubic account with cyberduck (swift) and that's what I see :

http://i.imgur.com/LGoIs8P.jpg

Default_segments root directory stores 100Mb chunks, probably from >100Mb files. But how does it work ??

I can upload big files with cyberduck, but I can't download them. Neither with cyberduck, web app nor windows sync.

With cyberduck, I can't download big files uploaded with windows sync (0 Byte in cyberduck browser).

Is it supposed to work like that ?