Re: improving concurrency/performance (fwd)

From: Andrew McNamara (no email)
Date: Wed Nov 09 2005 - 21:45:40 EST

  • Next message: Joshua Schmidlkofer: "Re: improving concurrency/performance (fwd)"

    >>> This guy is having a problem with cyrus-imap and ext3 - when multiple
    >>> processes are attempting to write to the one filesystem (but not the one
    >>> file), performance drops to next to nothing when only five processes are
    >>> writing. An strace shows most of the time is being spent in fdatasync
    >>> and fsync.
    >
    >Actually, the thread just got off topic quickly -- I'm running this on
    >reiserfs, not ext3. ...And I've got it mounted with data=writeback, too.
    >But thanks for the info, Andrew.

    Sorry, my confusion. But it might be worth asking the reiserfs guys.

    My experience has been that if you are fsync'ing files, then even modern
    disks only get around 10 fsync's per second (because not only does the
    file data get writen out, but typically the inode, the directory entry,
    the free block table and maybe even all the directory entries up to root).

    Journalling can help, because the commited data is writen sequentially
    to the journal, rather than being scattered all over the disk, but the
    journalled operations still need to be applied to the filesystem sooner
    or later.

    -- 
    Andrew McNamara, Senior Developer, Object Craft
    http://www.object-craft.com.au/
    ----
    Cyrus Home Page: http://asg.web.cmu.edu/cyrus
    Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
    List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
    

  • Next message: Joshua Schmidlkofer: "Re: improving concurrency/performance (fwd)"





    Hosted Email Solutions

    Invaluement Anti-Spam DNSBLs



    Powered By FreeBSD   Powered By FreeBSD