|
FastMail Forum All posts relating to FastMail.FM should go here: suggestions, comments, requests for help, complaints, technical issues etc. |
|
Thread Tools |
6 Jan 2017, 07:35 AM | #1 |
Junior Member
Join Date: Jan 2017
Posts: 4
|
Imported Gmail messages take much less space?
Hi all,
I am new to fastmail and I just finished migrating my Gmail messages to fastmail - about 11000 messages (since 2004) that take over 2 GB, if I believe Google stats. I removed all labels and made visible in IMAP only "All", "Sent" and "Inbox" (which is normally empty). It took few experiments to come to this, but all went well and surprisingly fast, only that all this mail takes a bit over 600 MB in Fastmail, and this is suspicious. The number of messages match more or less (different, but around 11000 - a bit more actually), and reviewing the oldest and the newest they seems to be there, although I can not be REALLY sure for the oldest. As I tried this few times until I make the import to my liking, it wasevery time about this size. I wonder why Gmail may be showing bigger size - I often clean my mail from old semi-spam, and big attachments, but it seemed to be reflected on the spot. Difference that big seems off, although I can not identify something missing. So to state the question - does anyone has explanation for this - do Gmail inflate used storage somehow (for example count messages twice in some cases), or Fastmail compresses messages by default? |
6 Jan 2017, 08:17 AM | #2 |
The "e" in e-mail
Join Date: May 2003
Location: mostly in Thailand
Posts: 3,090
|
What an interesting post! While it has never occurred to me before, it suggests that efficiency of storage use must be taken into account, as well as storage quotas.It may suggest that Fastmail's pricing is more competitive than is sometimes claimed.
I believe Fastmail does compress email but, as you say, the discrepancy seems rather large to be explained simply by that. I am wondering if the following might be true:
|
6 Jan 2017, 09:31 AM | #3 |
Intergalactic Postmaster
Join Date: May 2004
Location: Irving, Texas
Posts: 8,926
|
Sending large messages to Gmail then deleting them recovers all space
I also find this a fascinating thread! It's hard to imagine what would cause a 3X difference. Binary files are usually sent using base64 encoding, but that only expands the file by a factor of 4/3, and I doubt that FastMail saves attachments as binary files. Maybe Gmail saves several hash tables or other metadata to make it easier to perform searches. But a 3X ratio is huge!
I just sent 5 identical messages with 14.7 MB attachments each from FastMail to Gmail. In FastMail each message size was about 20.25 MB (after base64 encoding), so the total size should be about 101 MB. In Gmail my used space (at the bottom of the page) changed from 1.72 GB to 1.82 GB, so that matches the expected size. I then deleted the 5 messages and permanently deleted them from Trash. My used space went back up to 1.72 GB. So my tests so far don't show anything unusual. Hmmm ... I think I will try moving messages back and forth using an IMAP email client and see what happens. Bill |
6 Jan 2017, 01:24 PM | #4 |
Intergalactic Postmaster
Join Date: May 2004
Location: Irving, Texas
Posts: 8,926
|
Messages moved to Gmail and Fastmail via IMAP client affect memory use identically
I moved about 100 MB of messages to/from Gmail using an IMAP client (Thunderbird), then did the same thing with an IMAP connection to Fastmail.
Bill |
6 Jan 2017, 01:40 PM | #5 |
The "e" in e-mail
Join Date: Jul 2002
Location: VK4
Posts: 3,013
|
Fastmail may delete duplicates....
|
6 Jan 2017, 02:04 PM | #6 |
Intergalactic Postmaster
Join Date: May 2004
Location: Irving, Texas
Posts: 8,926
|
That's a good idea, Terry. Gmail and Fastmail both suppress duplicates which arrive at the account in the normal fashion, but (at least for Fastmail) this suppression does not affect IMAP transfer:
http://www.emaildiscussions.com/show...16&postcount=7 Bill |
6 Jan 2017, 08:52 PM | #7 |
Junior Member
Join Date: Jan 2017
Posts: 4
|
That's what I suspected - that Google duplicates many messages for some reason. The thing is that I have removed all custom labels before importing. Basically I had one label - All (which is visible as Archive in IMAP) that has all the mail, Sent and empty Inbox. I have checked the option to eliminate duplicates on import.
The only explanation is that gmail keeps many duplicates for some reason - probably they were in some label and then moved or something like this - otherwise the total number of messages in "All mail" that I can see in Gmail web interface and the imported messages almost match - around 11000. They are not equal, but since the imported ones are more, I hope nothing is lost At the end this is just curiosity. Keeping old mail is somewhat weird for me, I think important info should be kept elsewhere and mail should be transactional, but for many years I relied on the Google mentality "don't delete anything" and I am still a bit nervous that I may lose something. I have not needed an old mail for quite a while, however. |
6 Jan 2017, 10:40 PM | #8 |
The "e" in e-mail
Join Date: May 2003
Location: mostly in Thailand
Posts: 3,090
|
At this point, I would be inclined to use the IMAPSize program to see if the "folder" sizes match up with total used space.
|
6 Jan 2017, 11:13 PM | #9 |
Junior Member
Join Date: Jan 2017
Posts: 4
|
Good suggestion, I will.
Edit: This program is only for Window, but I looked in Trash and here we go - it seems that it is cleaned a lot less often than I thought. After I cleaned it, everything matches. No mystery anymore. Kind of petty Last edited by petar : 6 Jan 2017 at 11:31 PM. |
7 Jan 2017, 04:07 AM | #10 |
The "e" in e-mail
Join Date: May 2003
Location: mostly in Thailand
Posts: 3,090
|
I think I ran IMAPsize in the past under Wine. Anyway, good in a way that the mystery is solved, but kind of disappointing that the explanation is so mundane!
|
Thread Tools | |
|
|