Search in sources :

Example 61 with LocalStore

use of com.fsck.k9.mailstore.LocalStore in project k-9 by k9mail.

the class MessagingController method loadSearchResults.

public void loadSearchResults(final Account account, final String folderName, final List<Message> messages, final MessagingListener listener) {
    threadPool.execute(new Runnable() {

        @Override
        public void run() {
            if (listener != null) {
                listener.enableProgressIndicator(true);
            }
            try {
                Store remoteStore = account.getRemoteStore();
                LocalStore localStore = account.getLocalStore();
                if (remoteStore == null || localStore == null) {
                    throw new MessagingException("Could not get store");
                }
                Folder remoteFolder = remoteStore.getFolder(folderName);
                LocalFolder localFolder = localStore.getFolder(folderName);
                if (remoteFolder == null || localFolder == null) {
                    throw new MessagingException("Folder not found");
                }
                loadSearchResultsSynchronous(messages, localFolder, remoteFolder, listener);
            } catch (MessagingException e) {
                Timber.e(e, "Exception in loadSearchResults");
                addErrorMessage(account, null, e);
            } finally {
                if (listener != null) {
                    listener.enableProgressIndicator(false);
                }
            }
        }
    });
}
Also used : LocalFolder(com.fsck.k9.mailstore.LocalFolder) MessagingException(com.fsck.k9.mail.MessagingException) LocalStore(com.fsck.k9.mailstore.LocalStore) Store(com.fsck.k9.mail.Store) Pop3Store(com.fsck.k9.mail.store.pop3.Pop3Store) LocalStore(com.fsck.k9.mailstore.LocalStore) Folder(com.fsck.k9.mail.Folder) LocalFolder(com.fsck.k9.mailstore.LocalFolder)

Example 62 with LocalStore

use of com.fsck.k9.mailstore.LocalStore in project k-9 by k9mail.

the class MessagingController method synchronizeMailboxSynchronous.

/**
     * Start foreground synchronization of the specified folder. This is generally only called
     * by synchronizeMailbox.
     * <p>
     * TODO Break this method up into smaller chunks.
     */
@VisibleForTesting
void synchronizeMailboxSynchronous(final Account account, final String folder, final MessagingListener listener, Folder providedRemoteFolder) {
    Folder remoteFolder = null;
    LocalFolder tLocalFolder = null;
    Timber.i("Synchronizing folder %s:%s", account.getDescription(), folder);
    for (MessagingListener l : getListeners(listener)) {
        l.synchronizeMailboxStarted(account, folder);
    }
    /*
         * We don't ever sync the Outbox or errors folder
         */
    if (folder.equals(account.getOutboxFolderName()) || folder.equals(account.getErrorFolderName())) {
        for (MessagingListener l : getListeners(listener)) {
            l.synchronizeMailboxFinished(account, folder, 0, 0);
        }
        return;
    }
    Exception commandException = null;
    try {
        Timber.d("SYNC: About to process pending commands for account %s", account.getDescription());
        try {
            processPendingCommandsSynchronous(account);
        } catch (Exception e) {
            addErrorMessage(account, null, e);
            Timber.e(e, "Failure processing command, but allow message sync attempt");
            commandException = e;
        }
        /*
             * Get the message list from the local store and create an index of
             * the uids within the list.
             */
        Timber.v("SYNC: About to get local folder %s", folder);
        final LocalStore localStore = account.getLocalStore();
        tLocalFolder = localStore.getFolder(folder);
        final LocalFolder localFolder = tLocalFolder;
        localFolder.open(Folder.OPEN_MODE_RW);
        localFolder.updateLastUid();
        Map<String, Long> localUidMap = localFolder.getAllMessagesAndEffectiveDates();
        if (providedRemoteFolder != null) {
            Timber.v("SYNC: using providedRemoteFolder %s", folder);
            remoteFolder = providedRemoteFolder;
        } else {
            Store remoteStore = account.getRemoteStore();
            Timber.v("SYNC: About to get remote folder %s", folder);
            remoteFolder = remoteStore.getFolder(folder);
            if (!verifyOrCreateRemoteSpecialFolder(account, folder, remoteFolder, listener)) {
                return;
            }
            /*
                 * Synchronization process:
                 *
                Open the folder
                Upload any local messages that are marked as PENDING_UPLOAD (Drafts, Sent, Trash)
                Get the message count
                Get the list of the newest K9.DEFAULT_VISIBLE_LIMIT messages
                getMessages(messageCount - K9.DEFAULT_VISIBLE_LIMIT, messageCount)
                See if we have each message locally, if not fetch it's flags and envelope
                Get and update the unread count for the folder
                Update the remote flags of any messages we have locally with an internal date newer than the remote message.
                Get the current flags for any messages we have locally but did not just download
                Update local flags
                For any message we have locally but not remotely, delete the local message to keep cache clean.
                Download larger parts of any new messages.
                (Optional) Download small attachments in the background.
                 */
            /*
                 * Open the remote folder. This pre-loads certain metadata like message count.
                 */
            Timber.v("SYNC: About to open remote folder %s", folder);
            remoteFolder.open(Folder.OPEN_MODE_RW);
            if (Expunge.EXPUNGE_ON_POLL == account.getExpungePolicy()) {
                Timber.d("SYNC: Expunging folder %s:%s", account.getDescription(), folder);
                remoteFolder.expunge();
            }
        }
        notificationController.clearAuthenticationErrorNotification(account, true);
        /*
             * Get the remote message count.
             */
        int remoteMessageCount = remoteFolder.getMessageCount();
        int visibleLimit = localFolder.getVisibleLimit();
        if (visibleLimit < 0) {
            visibleLimit = K9.DEFAULT_VISIBLE_LIMIT;
        }
        final List<Message> remoteMessages = new ArrayList<>();
        Map<String, Message> remoteUidMap = new HashMap<>();
        Timber.v("SYNC: Remote message count for folder %s is %d", folder, remoteMessageCount);
        final Date earliestDate = account.getEarliestPollDate();
        long earliestTimestamp = earliestDate != null ? earliestDate.getTime() : 0L;
        int remoteStart = 1;
        if (remoteMessageCount > 0) {
            /* Message numbers start at 1.  */
            if (visibleLimit > 0) {
                remoteStart = Math.max(0, remoteMessageCount - visibleLimit) + 1;
            } else {
                remoteStart = 1;
            }
            Timber.v("SYNC: About to get messages %d through %d for folder %s", remoteStart, remoteMessageCount, folder);
            final AtomicInteger headerProgress = new AtomicInteger(0);
            for (MessagingListener l : getListeners(listener)) {
                l.synchronizeMailboxHeadersStarted(account, folder);
            }
            List<? extends Message> remoteMessageArray = remoteFolder.getMessages(remoteStart, remoteMessageCount, earliestDate, null);
            int messageCount = remoteMessageArray.size();
            for (Message thisMess : remoteMessageArray) {
                headerProgress.incrementAndGet();
                for (MessagingListener l : getListeners(listener)) {
                    l.synchronizeMailboxHeadersProgress(account, folder, headerProgress.get(), messageCount);
                }
                Long localMessageTimestamp = localUidMap.get(thisMess.getUid());
                if (localMessageTimestamp == null || localMessageTimestamp >= earliestTimestamp) {
                    remoteMessages.add(thisMess);
                    remoteUidMap.put(thisMess.getUid(), thisMess);
                }
            }
            Timber.v("SYNC: Got %d messages for folder %s", remoteUidMap.size(), folder);
            for (MessagingListener l : getListeners(listener)) {
                l.synchronizeMailboxHeadersFinished(account, folder, headerProgress.get(), remoteUidMap.size());
            }
        } else if (remoteMessageCount < 0) {
            throw new Exception("Message count " + remoteMessageCount + " for folder " + folder);
        }
        /*
             * Remove any messages that are in the local store but no longer on the remote store or are too old
             */
        MoreMessages moreMessages = localFolder.getMoreMessages();
        if (account.syncRemoteDeletions()) {
            List<String> destroyMessageUids = new ArrayList<>();
            for (String localMessageUid : localUidMap.keySet()) {
                if (remoteUidMap.get(localMessageUid) == null) {
                    destroyMessageUids.add(localMessageUid);
                }
            }
            List<LocalMessage> destroyMessages = localFolder.getMessagesByUids(destroyMessageUids);
            if (!destroyMessageUids.isEmpty()) {
                moreMessages = MoreMessages.UNKNOWN;
                localFolder.destroyMessages(destroyMessages);
                for (Message destroyMessage : destroyMessages) {
                    for (MessagingListener l : getListeners(listener)) {
                        l.synchronizeMailboxRemovedMessage(account, folder, destroyMessage);
                    }
                }
            }
        }
        // noinspection UnusedAssignment, free memory early? (better break up the method!)
        localUidMap = null;
        if (moreMessages == MoreMessages.UNKNOWN) {
            updateMoreMessages(remoteFolder, localFolder, earliestDate, remoteStart);
        }
        /*
             * Now we download the actual content of messages.
             */
        int newMessages = downloadMessages(account, remoteFolder, localFolder, remoteMessages, false, true);
        int unreadMessageCount = localFolder.getUnreadMessageCount();
        for (MessagingListener l : getListeners()) {
            l.folderStatusChanged(account, folder, unreadMessageCount);
        }
        /* Notify listeners that we're finally done. */
        localFolder.setLastChecked(System.currentTimeMillis());
        localFolder.setStatus(null);
        Timber.d("Done synchronizing folder %s:%s @ %tc with %d new messages", account.getDescription(), folder, System.currentTimeMillis(), newMessages);
        for (MessagingListener l : getListeners(listener)) {
            l.synchronizeMailboxFinished(account, folder, remoteMessageCount, newMessages);
        }
        if (commandException != null) {
            String rootMessage = getRootCauseMessage(commandException);
            Timber.e("Root cause failure in %s:%s was '%s'", account.getDescription(), tLocalFolder.getName(), rootMessage);
            localFolder.setStatus(rootMessage);
            for (MessagingListener l : getListeners(listener)) {
                l.synchronizeMailboxFailed(account, folder, rootMessage);
            }
        }
        Timber.i("Done synchronizing folder %s:%s", account.getDescription(), folder);
    } catch (AuthenticationFailedException e) {
        handleAuthenticationFailure(account, true);
        for (MessagingListener l : getListeners(listener)) {
            l.synchronizeMailboxFailed(account, folder, "Authentication failure");
        }
    } catch (Exception e) {
        Timber.e(e, "synchronizeMailbox");
        // If we don't set the last checked, it can try too often during
        // failure conditions
        String rootMessage = getRootCauseMessage(e);
        if (tLocalFolder != null) {
            try {
                tLocalFolder.setStatus(rootMessage);
                tLocalFolder.setLastChecked(System.currentTimeMillis());
            } catch (MessagingException me) {
                Timber.e(e, "Could not set last checked on folder %s:%s", account.getDescription(), tLocalFolder.getName());
            }
        }
        for (MessagingListener l : getListeners(listener)) {
            l.synchronizeMailboxFailed(account, folder, rootMessage);
        }
        notifyUserIfCertificateProblem(account, e, true);
        addErrorMessage(account, null, e);
        Timber.e("Failed synchronizing folder %s:%s @ %tc", account.getDescription(), folder, System.currentTimeMillis());
    } finally {
        if (providedRemoteFolder == null) {
            closeFolder(remoteFolder);
        }
        closeFolder(tLocalFolder);
    }
}
Also used : LocalMessage(com.fsck.k9.mailstore.LocalMessage) MimeMessage(com.fsck.k9.mail.internet.MimeMessage) Message(com.fsck.k9.mail.Message) ConcurrentHashMap(java.util.concurrent.ConcurrentHashMap) HashMap(java.util.HashMap) AuthenticationFailedException(com.fsck.k9.mail.AuthenticationFailedException) ArrayList(java.util.ArrayList) LocalStore(com.fsck.k9.mailstore.LocalStore) Store(com.fsck.k9.mail.Store) Pop3Store(com.fsck.k9.mail.store.pop3.Pop3Store) LocalStore(com.fsck.k9.mailstore.LocalStore) Folder(com.fsck.k9.mail.Folder) LocalFolder(com.fsck.k9.mailstore.LocalFolder) LocalMessage(com.fsck.k9.mailstore.LocalMessage) MessagingException(com.fsck.k9.mail.MessagingException) CertificateValidationException(com.fsck.k9.mail.CertificateValidationException) UnavailableStorageException(com.fsck.k9.mailstore.UnavailableStorageException) IOException(java.io.IOException) MessagingException(com.fsck.k9.mail.MessagingException) AuthenticationFailedException(com.fsck.k9.mail.AuthenticationFailedException) SuppressLint(android.annotation.SuppressLint) Date(java.util.Date) LocalFolder(com.fsck.k9.mailstore.LocalFolder) AtomicInteger(java.util.concurrent.atomic.AtomicInteger) MoreMessages(com.fsck.k9.mailstore.LocalFolder.MoreMessages) VisibleForTesting(android.support.annotation.VisibleForTesting)

Example 63 with LocalStore

use of com.fsck.k9.mailstore.LocalStore in project k-9 by k9mail.

the class MessagingController method moveOrCopyMessageSynchronous.

private void moveOrCopyMessageSynchronous(final Account account, final String srcFolder, final List<? extends Message> inMessages, final String destFolder, final boolean isCopy) {
    try {
        LocalStore localStore = account.getLocalStore();
        Store remoteStore = account.getRemoteStore();
        if (!isCopy && (!remoteStore.isMoveCapable() || !localStore.isMoveCapable())) {
            return;
        }
        if (isCopy && (!remoteStore.isCopyCapable() || !localStore.isCopyCapable())) {
            return;
        }
        LocalFolder localSrcFolder = localStore.getFolder(srcFolder);
        Folder localDestFolder = localStore.getFolder(destFolder);
        boolean unreadCountAffected = false;
        List<String> uids = new LinkedList<>();
        for (Message message : inMessages) {
            String uid = message.getUid();
            if (!uid.startsWith(K9.LOCAL_UID_PREFIX)) {
                uids.add(uid);
            }
            if (!unreadCountAffected && !message.isSet(Flag.SEEN)) {
                unreadCountAffected = true;
            }
        }
        List<LocalMessage> messages = localSrcFolder.getMessagesByUids(uids);
        if (messages.size() > 0) {
            Map<String, Message> origUidMap = new HashMap<>();
            for (Message message : messages) {
                origUidMap.put(message.getUid(), message);
            }
            Timber.i("moveOrCopyMessageSynchronous: source folder = %s, %d messages, destination folder = %s, " + "isCopy = %s", srcFolder, messages.size(), destFolder, isCopy);
            Map<String, String> uidMap;
            if (isCopy) {
                FetchProfile fp = new FetchProfile();
                fp.add(Item.ENVELOPE);
                fp.add(Item.BODY);
                localSrcFolder.fetch(messages, fp, null);
                uidMap = localSrcFolder.copyMessages(messages, localDestFolder);
                if (unreadCountAffected) {
                    // If this copy operation changes the unread count in the destination
                    // folder, notify the listeners.
                    int unreadMessageCount = localDestFolder.getUnreadMessageCount();
                    for (MessagingListener l : getListeners()) {
                        l.folderStatusChanged(account, destFolder, unreadMessageCount);
                    }
                }
            } else {
                uidMap = localSrcFolder.moveMessages(messages, localDestFolder);
                for (Entry<String, Message> entry : origUidMap.entrySet()) {
                    String origUid = entry.getKey();
                    Message message = entry.getValue();
                    for (MessagingListener l : getListeners()) {
                        l.messageUidChanged(account, srcFolder, origUid, message.getUid());
                    }
                }
                unsuppressMessages(account, messages);
                if (unreadCountAffected) {
                    // If this move operation changes the unread count, notify the listeners
                    // that the unread count changed in both the source and destination folder.
                    int unreadMessageCountSrc = localSrcFolder.getUnreadMessageCount();
                    int unreadMessageCountDest = localDestFolder.getUnreadMessageCount();
                    for (MessagingListener l : getListeners()) {
                        l.folderStatusChanged(account, srcFolder, unreadMessageCountSrc);
                        l.folderStatusChanged(account, destFolder, unreadMessageCountDest);
                    }
                }
            }
            List<String> origUidKeys = new ArrayList<>(origUidMap.keySet());
            queueMoveOrCopy(account, srcFolder, destFolder, isCopy, origUidKeys, uidMap);
        }
        processPendingCommands(account);
    } catch (UnavailableStorageException e) {
        Timber.i("Failed to move/copy message because storage is not available - trying again later.");
        throw new UnavailableAccountException(e);
    } catch (MessagingException me) {
        addErrorMessage(account, null, me);
        throw new RuntimeException("Error moving message", me);
    }
}
Also used : LocalMessage(com.fsck.k9.mailstore.LocalMessage) FetchProfile(com.fsck.k9.mail.FetchProfile) LocalMessage(com.fsck.k9.mailstore.LocalMessage) MimeMessage(com.fsck.k9.mail.internet.MimeMessage) Message(com.fsck.k9.mail.Message) ConcurrentHashMap(java.util.concurrent.ConcurrentHashMap) HashMap(java.util.HashMap) MessagingException(com.fsck.k9.mail.MessagingException) UnavailableStorageException(com.fsck.k9.mailstore.UnavailableStorageException) ArrayList(java.util.ArrayList) LocalStore(com.fsck.k9.mailstore.LocalStore) Store(com.fsck.k9.mail.Store) Pop3Store(com.fsck.k9.mail.store.pop3.Pop3Store) LocalStore(com.fsck.k9.mailstore.LocalStore) Folder(com.fsck.k9.mail.Folder) LocalFolder(com.fsck.k9.mailstore.LocalFolder) LinkedList(java.util.LinkedList) SuppressLint(android.annotation.SuppressLint) LocalFolder(com.fsck.k9.mailstore.LocalFolder)

Example 64 with LocalStore

use of com.fsck.k9.mailstore.LocalStore in project k-9 by k9mail.

the class MessagingController method setFlag.

/**
     * Set or remove a flag for a message referenced by message UID.
     *
     * @param account
     *         The account the folder containing the message belongs to.
     * @param folderName
     *         The name of the folder.
     * @param uid
     *         The UID of the message to change the flag for.
     * @param flag
     *         The flag to change.
     * @param newState
     *         {@code true}, if the flag should be set. {@code false} if it should be removed.
     */
public void setFlag(Account account, String folderName, String uid, Flag flag, boolean newState) {
    Folder localFolder = null;
    try {
        LocalStore localStore = account.getLocalStore();
        localFolder = localStore.getFolder(folderName);
        localFolder.open(Folder.OPEN_MODE_RW);
        Message message = localFolder.getMessage(uid);
        if (message != null) {
            setFlag(account, folderName, Collections.singletonList(message), flag, newState);
        }
    } catch (MessagingException me) {
        addErrorMessage(account, null, me);
        throw new RuntimeException(me);
    } finally {
        closeFolder(localFolder);
    }
}
Also used : LocalMessage(com.fsck.k9.mailstore.LocalMessage) MimeMessage(com.fsck.k9.mail.internet.MimeMessage) Message(com.fsck.k9.mail.Message) MessagingException(com.fsck.k9.mail.MessagingException) LocalStore(com.fsck.k9.mailstore.LocalStore) Folder(com.fsck.k9.mail.Folder) LocalFolder(com.fsck.k9.mailstore.LocalFolder)

Example 65 with LocalStore

use of com.fsck.k9.mailstore.LocalStore in project k-9 by k9mail.

the class MessagingController method collectMessagesInThreads.

private static List<Message> collectMessagesInThreads(Account account, List<? extends Message> messages) throws MessagingException {
    LocalStore localStore = account.getLocalStore();
    List<Message> messagesInThreads = new ArrayList<>();
    for (Message message : messages) {
        LocalMessage localMessage = (LocalMessage) message;
        long rootId = localMessage.getRootId();
        long threadId = (rootId == -1) ? localMessage.getThreadId() : rootId;
        List<? extends Message> messagesInThread = localStore.getMessagesInThread(threadId);
        messagesInThreads.addAll(messagesInThread);
    }
    return messagesInThreads;
}
Also used : LocalMessage(com.fsck.k9.mailstore.LocalMessage) LocalMessage(com.fsck.k9.mailstore.LocalMessage) MimeMessage(com.fsck.k9.mail.internet.MimeMessage) Message(com.fsck.k9.mail.Message) ArrayList(java.util.ArrayList) LocalStore(com.fsck.k9.mailstore.LocalStore)

Aggregations

LocalStore (com.fsck.k9.mailstore.LocalStore)63 LocalFolder (com.fsck.k9.mailstore.LocalFolder)53 MessagingException (com.fsck.k9.mail.MessagingException)46 LocalMessage (com.fsck.k9.mailstore.LocalMessage)27 FetchProfile (com.fsck.k9.mail.FetchProfile)17 AuthenticationFailedException (com.fsck.k9.mail.AuthenticationFailedException)16 CertificateValidationException (com.fsck.k9.mail.CertificateValidationException)16 Store (com.fsck.k9.mail.Store)16 Folder (com.fsck.k9.mail.Folder)15 Pop3Store (com.fsck.k9.mail.store.pop3.Pop3Store)15 Account (com.fsck.k9.Account)13 Message (com.fsck.k9.mail.Message)13 MimeMessage (com.fsck.k9.mail.internet.MimeMessage)13 ArrayList (java.util.ArrayList)13 UnavailableStorageException (com.fsck.k9.mailstore.UnavailableStorageException)10 Test (org.junit.Test)10 Backend (com.fsck.k9.backend.api.Backend)9 IOException (java.io.IOException)9 SQLiteDatabase (android.database.sqlite.SQLiteDatabase)8 SuppressLint (android.annotation.SuppressLint)7