Bug 32 - Missing mail folders and bad hierarchy
Summary: Missing mail folders and bad hierarchy
Status: RESOLVED INVALID
Alias: None
Product: ZeXtras
Classification: Unclassified
Component: ZxMobile (show other bugs)
Version: 1.2.2
Hardware: -- CentOS 5 - 64bit
: Normal normal
Assignee: ZeXtras Bugzilla Admin
QA Contact:
URL:
Depends on:
Blocks:
 
Reported: 2012-02-17 00:38 CET by Marc Bessière
Modified: 2012-10-09 08:57 CEST (History)
1 user (show)

See Also:
Browser: ---
Zimlet Chat version: ---
Zimbra Version: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Marc Bessière 2012-02-17 00:38:45 CET
Zimbra : ZCS OSE 7.1.4
OS     : Scientific Linux 5.7 (same as RHEL 5.7)

Phone  : Samsung Galaxy SII
OS     : Android 4.0.3
==================================================================================
In the mail client, some folders are missing and some others have a bad hierarchy.

Missing Folders
===============

I've noticed that missing folders have the View Type "unkn" instead of "mess" that might be the reason why they're not listed.
How can I fix that ?

14351  unkn           0        1138  /pop-test
38555  unkn           0         690  /Q-Junk
11223  unkn           0         885  /Q-Watchdog

Bad Hierarchy
=============

On the zimbra server
--------------------

/RSS

/RSS/RSS Criminalités numériques (http://blog.crimenumerique.fr/feed/)
/RSS/RSS DPreview (http://www.dpreview.com/feeds/news.xml)
/RSS/RSS Fedora-Fr (http://forums.fedora-fr.org/extern.php?action=feed&type=rss)
/RSS/RSS Gantry (http://www.gantry-framework.org/news?format=feed&type=rss)
/RSS/RSS GIMP News (http://www.gimp.org/news.rdf)
/RSS/RSS Joomla (http://www.joomla.org/announcements.feed?type=rss)
/RSS/RSS Nowatch (http://www.nowatch.net/feed/)
/RSS/RSS Phoronix (http://feeds.feedburner.com/Phoronix)
/RSS/RSS Planet Fedo (http://planet.fedora-fr.org/rss2/feed)
/RSS/RSS RdV Tech (http://feeds2.feedburner.com/lerendezvoustech)
/RSS/RSS RocketTheme (http://www.rockettheme.com/blog?format=feed&type=rss)
/RSS/RSS VirtualBox Buzz (http://blogs.sun.com/VirtualBoxBuzz/feed/entries/rss)
/RSS/RSS Zimbra Blog (http://feeds2.feedburner.com/zimbra)
/RSS/RSS ZimbraFr (http://www.zimbrafr.org/forum/rss/downloads/)
/RSS/RSS ZimbraFr C (http://www.zimbrafr.org/forum/rss/forums/2-communaute-zimbra/)
/RSS/RSS ZimbraFr Inf (http://www.zimbrafr.org/forum/rss/forums/1-infos/)
/RSS/RSS-Lisa Bettany (http://api.flickr.com/services/feeds/photos_public.gne?id=40414712@N00&lang=fr-fr&format=rss_200)

On the Phone
------------

/RSS

/RSS/RSS Criminalités numériques
/RSS/RSS DPreview
/RSS/RSS Gantry
/RSS/RSS GIMP News
/RSS/RSS Joomla
/RSS/RSS Phoronix
/RSS/RSS Planet Fedo
/RSS/RSS RdV Tech
/RSS/RSS RocketTheme
/RSS/RSS VirtualBox
/RSS/RSS Zimbra Blog
/RSS/RSS ZimbraFr
/RSS/RSS ZimbraFr C
/RSS/RSS ZimbraFr Inf
/RSS/RSS-Lisa Bettany

/RSS Fedora-Fr
/RSS Nowatch
Comment 1 Marc Bessière 2012-02-17 09:38:12 CET
The folders which has bad hierarchy are not always the same.

Now it's the following which are at the top level and should be under RSS folder:

RSS Fedora-Fr
RSS Nowatch
RSS Phoronix
RSS ZimbraFr C
Comment 2 Cine 2012-02-17 10:59:43 CET
Hello Marc, 
thanks for the report.

A couple of tests you can do:

- Folder Hierarchy
on your Zimbra server run:
zmmailbox -z -m user@domain.com gf "/RSS Nowatch" | less
and check the content of the "parendId" and "path" fields.
Running
zmmailbox -z -m user@domain.com gaf
does the /RSS folder have the same Id as the "parentId" field of /RSS Nowatch?

- Missing Folders
That 'unkn' type is strange indeed... Have been those folders created by some sort of client/external program (or imported from another server with one of Zimbra's own migration wizards)?
Can you please try to create a new folder in your Zimbra account, check if the View Type is correct and then move/copy all emails in one of the missing folder to this new folder?

Have a nice day,
Cine
Comment 3 Marc Bessière 2012-02-17 11:14:12 CET
(In reply to comment #2)
>> Hello Marc, 
>> thanks for the report.

Hello Cine,

>> A couple of tests you can do:
>>
>> - Folder Hierarchy
>> on your Zimbra server run:
>> zmmailbox -z -m user@domain.com gf "/RSS Nowatch" | less

The "/RSS Nowatch" doesn't exist:

ERROR: zclient.CLIENT_ERROR (unknown folder: /RSS Nowatch)

>> and check the content of the "parendId" and "path" fields.

The "/RSS/RSS Nowatch" does. Here are the interresting fields :

"id": "439037"
"name": "RSS Nowatch"
"parentId": "359010"
"path": "/RSS/RSS Nowatch"
"pathURLEncoded": "/RSS/RSS%20Nowatch"

>> Running
>> zmmailbox -z -m user@domain.com gaf
>> does the /RSS folder have the same Id as the "parentId" field of /RSS Nowatch?

The ID is the same :

359010  mess           0           0  /RSS
Comment 4 Marc Bessière 2012-02-17 11:23:09 CET
(In reply to comment #2)
>> - Missing Folders
>> That 'unkn' type is strange indeed... Have been those folders created by some
>> sort of client/external program (or imported from another server with one of
>> Zimbra's own migration wizards)?
No, all those folders have been created by Zimbra Web Client.

>> Can you please try to create a new folder in your Zimbra account, check if the
>> View Type is correct

The type of the new folder is a good valid "mess" :-)

>> and then move/copy all emails in one of the missing folder
>> to this new folder?

That's working !!!! Thanks

I don't know what created the bad folder type, I will make some search on Zimbra's Bugzilla.
I'll check all the types of other folders.

Have a nice day too.
--
Marcet
Comment 5 Cine 2012-02-17 11:36:20 CET
Glad the Missing Folders problem is solved!

I'd have an additional test to suggest, but it requires deleting and re-synchronizing the whole account on your device, so feel free to say no :)


The test is:

- Delete the account from your Mobile Phone
- Set the LogLevel of ZeXtras Suite to "Debug" (in the ZeXtras Administration Zimlet -> "Core" pane)
- Reconfigure your device and perform the first sync
- Search the /opt/zimbra/log/sync.log for the "ParentId" string. You should fine a line starting with 

<?xml version="1.0" standalone="no"?><FolderSync>

and ending with 

</FolderSync>

matching the search string multiple times.

Please paste here such line and the output of the `zmmailbox -z -m user@domain.com gaf` command (or email it to me: community@zextras.com)


Have a nice day,
Cine
Comment 6 Marc Bessière 2012-02-17 12:33:29 CET
(In reply to comment #5)
> Glad the Missing Folders problem is solved!
> 
> I'd have an additional test to suggest, but it requires deleting and
> re-synchronizing the whole account on your device, so feel free to say no :)

No !!!! Problems :-D

I send you the two files in a minute.

Best regards
--
Marcet
Comment 7 Marc Bessière 2012-02-17 12:52:53 CET
I still have those folders with "unkn" type :

         1  unkn           0           0  /
    374467  unkn           0           0  /@gmail.com
    374470  unkn           0           0  /@gmail.com/[Gmail]
    303974  unkn           0           0  /cerberus@technofil.fr
       265  unkn           0           7  /Notes
         3  unkn           0           0  /Trash
    303621  unkn           0           0  /Flagged (is:flagged)

I've seen from other accounts that it's normal for :

         1  unkn           0           0  /
         3  unkn           0           0  /Trash

But is it normal for my IMAP gmail account ? :

    374467  unkn           0           0  /@gmail.com
    374470  unkn           0           0  /@gmail.com/[Gmail]

Cerberus which is another external IMAP account ? :

    303974  unkn           0           0  /cerberus@technofil.fr

The Notes folder, which by the way is shown on my iPad syncing with ZxMobile ? :

       265  unkn           0           7  /Notes

The Flagged folder is a saved search, it appears also on my iPad, but the folder is empty.

So here came a question : Should you trust the folder type or should you check what's inside (just the first item). I think Apple is doing that to be able to show the Android side missing folders.
Comment 8 Cine 2012-02-17 12:58:03 CET
Got the files, checking them with the devs right now
Comment 9 Cine 2012-02-17 14:14:27 CET
From a first analysis appears that:

- Root folders in general have "unkn" type, which actually makes sense since a root folder is a container, not an actual mail folder.

- The FolderSync data contains all folders with the correct ParentId, this means that we need to perform additional tests in order to understand how the Android client processes such data and why the data ZxMobile sends to the device is not shown as it should.


I'll give you an update as soon as new informations are available..

Have a nice day,
Cine
Comment 10 Marc Bessière 2012-02-17 14:37:27 CET
(In reply to comment #9)
> From a first analysis appears that:
> 
> - Root folders in general have "unkn" type, which actually makes sense since a
> root folder is a container, not an actual mail folder.

Ok and for the others ? External IMAP and Notes ?

> - The FolderSync data contains all folders with the correct ParentId, this
> means that we need to perform additional tests in order to understand how the
> Android client processes such data and why the data ZxMobile sends to the
> device is not shown as it should.

I've made some extra tests. It get it right at the first sync.
But after a while, some misplaced folders appears.
Comment 11 Cine 2012-02-17 14:47:07 CET
(In reply to comment #10)
> (In reply to comment #9)
> > From a first analysis appears that:
> > 
> > - Root folders in general have "unkn" type, which actually makes sense since a
> > root folder is a container, not an actual mail folder.
> 
> Ok and for the others ? External IMAP and Notes ?

Same thing goes for the External IMAP accounts, as the actual mail is stored in  subfolders of the root (e.g. /@gmail.com/[Gmail]/Inbox). 
As for the /Notes folder, that's a custom folder made by iOS when configuring an IMAP account with the Notes synchronization enabled... I'd have to check with the devs why it is synchronized...  

> > - The FolderSync data contains all folders with the correct ParentId, this
> > means that we need to perform additional tests in order to understand how the
> > Android client processes such data and why the data ZxMobile sends to the
> > device is not shown as it should.
> 
> I've made some extra tests. It get it right at the first sync.
> But after a while, some misplaced folders appears.

Thanks for the update, we are investigating this behaviours and I'll report back as soon as I have any news
Comment 12 Marc Bessière 2012-04-04 12:36:09 CEST
Update for 1.2.5 :
==================

The subfolders problem is still present (RSS sub-folder out of main RSS folder).

But, I now can see the folders from external accounts :-D
Comment 13 Cine 2012-10-09 08:57:20 CEST
In order to resolve this and many more issue, please update your phone to Android 4.0.4.