Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: library
    • Security Level: Public
    • Labels:
    • Environment:
      OSX 10.8.2
      Couchbase: 2.0.0 community edition (build-1976)
      Nodejs: v0.8.18 (install via homebrew)
      libcouchbase: 2.0.2 (installed via homebrew)
      couchbase node module: 0.0.11 (install via npm)

      Description

      I have been running some tests around performance and ran across a problem attempting to create a large amount of documents. I have broken this down to the simplest example I can think of (see below) and been unable to insert more then 300 documents at a time. I have been able to rewrite the below as a recursive call but this is not ideal. I accept that this might not be a realistic example but do think that this is something which should be able to be done.

      var driver = require('couchbase');

      var config =

      { hosts : [ "localhost:8091" ], bucket : "default" }

      ;

      driver.connect(config, function(err, couchbase) {
      console.log("connected");
      for(var i=0; i < 300; ++i){
      couchbase.set("new_"+i, "something", function(err, meta)

      { console.log(err); console.log("inserted"); }

      );
      }
      });

      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        mladen.markov Mladen Markov added a comment -
        Show
        mladen.markov Mladen Markov added a comment - For completeness, a couple of real examples http://www.couchbase.com/forums/thread/how-many-simultaneous-sets-can-libcouchbase-handle http://www.couchbase.com/forums/thread/nodejs-sdk-performance-issue For me it doesn't work with recursive calls
        Hide
        trond Trond Norbye added a comment -

        Seems to be working with the refactored io plugin http://review.couchbase.org/25739 (needs clean shutdown but that's a todo on the refactor)

        Show
        trond Trond Norbye added a comment - Seems to be working with the refactored io plugin http://review.couchbase.org/25739 (needs clean shutdown but that's a todo on the refactor)
        Hide
        trond Trond Norbye added a comment -

        Marking it as resolved. It works with the new driver (which still isn't merged)

        Show
        trond Trond Norbye added a comment - Marking it as resolved. It works with the new driver (which still isn't merged)
        Hide
        balance.it David Mitchell added a comment -

        just tested on 0.0.12 and looks like it works a dream. will do some more testing, but thanks for sorting.

        Show
        balance.it David Mitchell added a comment - just tested on 0.0.12 and looks like it works a dream. will do some more testing, but thanks for sorting.
        Hide
        mladen.markov Mladen Markov added a comment -

        I can confirm that this works fine now. Thanks a ton guys, this has tremendously improved my flow.
        I used a Java proxy process to talk to Couchbase as a workaround, as it was able to handle the load.

        Show
        mladen.markov Mladen Markov added a comment - I can confirm that this works fine now. Thanks a ton guys, this has tremendously improved my flow. I used a Java proxy process to talk to Couchbase as a workaround, as it was able to handle the load.

          People

          • Assignee:
            trond Trond Norbye
            Reporter:
            balance.it David Mitchell
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes