/[Apache-SVN]
ViewVC logotype

Revision 1149412


Jump to revision: Previous Next
Author: fdmanana
Date: Fri Jul 22 00:04:30 2011 UTC (12 years, 9 months ago)
Changed paths: 6
Log Message:
Refactor/simplify replicator

For each worker (doc copier) process there used to be
a rev finder process. A rev finder dequeues from the
_changes rows queue, finds which document IDs and revisions
are missing in the target and queues the IDs and revisions
of those that are missing into a second queue. Finally
worker processes dequeue up to N elements from this queue.

This model was reduced to have the workers dequeing directly
from the _changes rows queue and find which document IDs and
revisions are missing in the target. This makes the model
simpler without suffering any performance penalty - there's
still enough parallelism to continue to be as efficient as
before.



Changed paths

Path Details
Directorycouchdb/trunk/src/couchdb/Makefile.am modified , text changed
Directorycouchdb/trunk/src/couchdb/couch_replicator.erl modified , text changed
Directorycouchdb/trunk/src/couchdb/couch_replicator_doc_copier.erl deleted
Directorycouchdb/trunk/src/couchdb/couch_replicator_rev_finder.erl deleted
Directorycouchdb/trunk/src/couchdb/couch_replicator_worker.erl added
Directorycouchdb/trunk/test/etap/001-load.t modified , text changed

infrastructure at apache.org
ViewVC Help
Powered by ViewVC 1.1.26