We are in the process of migrating this forum. A new space will be available soon. We are sorry for the inconvenience.

Massive error while synchronizing /home/user


flotho
04-30-2014, 05:00 PM
Thanks, I can now have hubic status with success

jdesgats
04-30-2014, 04:16 PM
You need to export the same dbus environment variables in all shells that use hubic. See `SERVER USAGE` section in man page.

flotho
04-30-2014, 03:03 PM
Quote Originally Posted by jdesgats
Hello,

The login command registers the account so you only need to use it once. After that, the synchronization process should start automatically at session startup (on desktop environments) otherwise just use `hubic start`.
I'm not able to make hubic start anymore. as precised in the previous post. yet the main-loop is doing stuff and synchronizing datas.

Quote Originally Posted by jdesgats
About yous issues, do you have any recursive link in your folders (i.e. a link to a parent folder, making an infinite file tree) ? hubiC blindly follows the symlinks so it will keep indexing and uploading files !
I'm not supposed to but as teamviewer making some specific symlinks I think this had cause troubles.
Moreover, I would like to exclude forlders with the
Code:
hubic exclude .../..
command but I still have this error :
Cannot contact daemon, are you sure it is running
I precise that main-loop is running.
Any idea?

jdesgats
04-30-2014, 01:32 PM
Hello,

The login command registers the account so you only need to use it once. After that, the synchronization process should start automatically at session startup (on desktop environments) otherwise just use `hubic start`.

About yous issues, do you have any recursive link in your folders (i.e. a link to a parent folder, making an infinite file tree) ? hubiC blindly follows the symlinks so it will keep indexing and uploading files !

flotho
04-30-2014, 08:10 AM
Hy,

Thanks for your answer.
Here is my environment and procedure :
Code:
Mono JIT compiler version 3.0.6 (tarball Sat Sep 28 04:42:52 UTC 2013)
Copyright (C) 2002-2012 Novell, Inc, Xamarin Inc and Contributors. www.mono-project.com
        TLS:           __thread
        SIGSEGV:       altstack
        Notifications: epoll
        Architecture:  amd64
        Disabled:      none
        Misc:          softdebug 
        LLVM:          supported, not enabled.
        GC:            Included Boehm (with typed GC and Parallel Mark)
I followed this procedure :
  1. launch dbus-launch --sh-syntax and export the DBUS session in console
  2. Launch the main-loop with debug or verbose : hubic main-loop --debug or --verbose
  3. Wait few seconds and minutes and observe that mono is consuming 100% on one of my cores and memory usage is slowly increasing
  4. I observe that part of the trash were not correctly handled with encoding issue : '/home/user/.local/share/Trash/../d�tail.jpg' & Consider using MONO_EXTERNAL_ENCODINGS (This part seems to come from teamviewer way of encoding local files in their c:\ symlink)
  5. Empty the trash and relaunch main-loop
  6. Relaunch the main-loop and observe that scanning is really fast, little encoding issues but no more perf issues on mono nor memory expensive usage => Teamviewer was certainly generating multiple symlink that causes troubles for mono?
  7. Before main-loop has finished, I try to launch the login with
    Code:
    hubic login mail@mail.com /mnt/hubic
    but I have this message : Cannot contact daemon, are you sure it is running. What is amazing is that hubic seems to synchronize some datas

Well I don't understand anymore. Didin't I need to login for seeing hubic synchronizing datas?
Anyway, the first issue seems to come from multiple symlinks redirections

jdesgats
04-29-2014, 02:56 PM
Hello,

Thank you for your report, in order to help us to diagnose your issue, can you add some details:

Do you have this error right after login or does it takes some time (some minutes, hours) ?
Did you noticed any abnormal memory usage from the hubiC process (several GB of memory) ?
Which version of Mono do you use (mono -V) ?

flotho
04-29-2014, 08:32 AM
Hy,

I succeed in working with hubic on little number of files.
From now I would like to backup/synchronize my /home/user directory so I put a symbolic link in the /mnt/hubic folder.
I've launched the main-loop and authenticate myself with some exclude directories.
After a few moment, I have this kind of messgaes :

Code:
Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS
Stacktrace:

  at  <0xffffffff>
  at (wrapper managed-to-native) System.IO.MonoIO.GetFileSystemEntries (string,string,int,int,System.IO.MonoIOError&) <0xffffffff>
  at System.IO.Directory.GetFileSystemEntries (string,string,System.IO.FileAttributes,System.IO.FileAttributes) <0x000c6>
  at System.IO.Directory.GetDirectories (string,string) <0x0001b>
  at System.IO.Directory.GetDirectories (string) <0x00017>
  at System.IO.InotifyWatcher.StartMonitoringDirectory (System.IO.InotifyData,bool) <0x0036f>
.../...
at System.IO.InotifyWatcher.StartDispatching (System.IO.FileSystemWatcher) <0x002c7>
  at System.IO.FileSystemWatcher.Start () <0x0002b>
  at System.IO.FileSystemWatcher.set_EnableRaisingEvents (bool) <0x00033>
  at (wrapper remoting-invoke-with-check) System.IO.FileSystemWatcher.set_EnableRaisingEvents (bool) <0xffffffff>
  at Ovh.Hubic.Sync.FileSystem.NativeFSWatcher.CreateWatcher () <0x002b7>
  at Ovh.Hubic.Sync.FileSystem.NativeFSWatcher..ctor (string) <0x0002b>
  at Ovh.Hubic.Sync.Linux.LinuxPlatformManager.MakeFSWatcher (string) <0x0002b>
  at Ovh.Hubic.Sync.FileSystem.FSHandler.AddWatcher (Ovh.Hubic.Sync.SynchronizedDir) <0x00054>
  at Ovh.Hubic.Sync.FileSystem.FSHandler..ctor () <0x0011f>
  at Ovh.Hubic.Sync.Model.OnLogin () <0x0011b>
  at Ovh.Hubic.Sync.Model.StateManager_StateChangedEvent (object,Ovh.Hubic.Sync.StateChangedEventArgs) <0x0002f>
  at (wrapper delegate-invoke) System.EventHandler`1.invoke_void__this___object_TEventArgs (object,TEventArgs) <0x000a0>
  at (wrapper delegate-invoke) System.EventHandler`1.invoke_void__this___object_TEventArgs (object,TEventArgs) <0x000a0>
  at (wrapper delegate-invoke) System.EventHandler`1.invoke_void__this___object_TEventArgs (object,TEventArgs) <0xffffffff>
  at Ovh.Hubic.Sync.StateManager.set_CurrentState (Ovh.Hubic.Sync.StateManager/State) <0x00087>
  at Ovh.Hubic.Sync.StateManager.SetCurrentIdleState (bool) <0x00077>
  at Ovh.Hubic.Sync.StateManager.SetLoginState (Ovh.Hubic.Sync.StateManager/State) <0x0003b>
  at Ovh.Hubic.Sync.Model.Login () <0x0011b>
  at Ovh.Hubic.Sync.Linux.CLI.Server.m__30 (object) <0x00017>
  at (wrapper runtime-invoke) .runtime_invoke_void__this___object (object,intptr,intptr,intptr) <0xffffffff>

Native stacktrace:

        mono() [0x4ae931]
        /lib64/libpthread.so.0(+0xf9f0) [0x7f3e179159f0]
        /lib64/libc.so.6(gsignal+0x39) [0x7f3e1758c849]
        /lib64/libc.so.6(abort+0x148) [0x7f3e1758dcd8]
        mono() [0x602139]
        mono() [0x5fa2ea]
        mono() [0x5fa4f4]
        mono() [0x5fa74a]
        mono() [0x5fd992]
        mono() [0x5fdc4d]
        mono() [0x5fddcb]
        mono(mono_string_new_size+0x4b) [0x5a9c6b]
        mono(mono_string_new_utf16+0x10) [0x5a9d20]
        mono(mono_string_new+0x4c) [0x5aa1ec]
        mono() [0x5cd3fa]
        [0x41f2d7b6]
and

Code:
Debug info from gdb:

Missing separate debuginfo for /usr/bin/mono
Try: zypper install -C "debuginfo(build-id)=06d314a6c1c7b8377191cfd80023d175859ed79d"
Missing separate debuginfo for /lib64/libm.so.6
Try: zypper install -C "debuginfo(build-id)=35d35d9ce781be3a140a34242d998498615b021f"
Missing separate debuginfo for /lib64/librt.so.1
Try: zypper install -C "debuginfo(build-id)=0913d5ea4659cfa3ffad451acc84a6ed62772141"
Missing separate debuginfo for /lib64/libdl.so.2
Try: zypper install -C "debuginfo(build-id)=666913ec064c25fde1720db77b1f57bdeb5d9b3a"
Missing separate debuginfo for /lib64/libpthread.so.0
Try: zypper install -C "debuginfo(build-id)=522229c2dde70aaa8e4295ecb7b6643c810f758f"
[New LWP 16083]
Any idea?