Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-14797

GoXDCR [Windows]: Replication stuck (errMsg":"Failed to get starting seqno for pipeline )

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • 4.0.0
    • 4.0.0
    • XDCR
    • Security Level: Public
    • Windows 2012 R2 std 64 bit

    Description

      Build


      4.0.0-1977

      Testcase
      --------
      ./testrunner -i INI.FILE get-cbcollect-info=True,get-logs=False,stop-on-failure=False,enable_goxdcr=True,demand_encryption=1 -t xdcr.uniXDCR.unidirectional.load_with_async_ops_with_warmup_master,items=100000,rdirection=unidirection,ctopology=chain,sasl_buckets=2,update=C1,delete=C1,warm=C2

      test_9 in http://qa.sc.couchbase.com/view/BY%20COMPONENT/job/w012R2-p0-xxdcr-vset02-00-goxdcr-unixdcr-ssl/29/consoleFull

      1. C1 [.30,.32] --> C2[.225,.7], 3 buckets
      2. Load 100K keys on C1.
      3. Warmup C2's master .225
      4. perform updates and deletes on C1.
      5. key count on all buckets in C1 = 7000, all buckets on C2 have only 3500 keys.

      [2015-04-30 17:25:30,460] - [xdcrnewbasetests:2007] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C1, default bucket
      [2015-04-30 17:25:31,333] - [xdcrnewbasetests:2007] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C1, sasl_bucket_1 bucket
      [2015-04-30 17:25:31,722] - [xdcrnewbasetests:2007] INFO - Saw: vb_active_curr_items 70000 == 70000 expected on C1, sasl_bucket_2 bucket
      [2015-04-30 17:25:32,125] - [xdcrnewbasetests:2041] INFO - Saw: vb_replica_curr_items 70000 == 70000 expected on C1, default bucket
      [2015-04-30 17:25:32,459] - [xdcrnewbasetests:2041] INFO - Saw: vb_replica_curr_items 70000 == 70000 expected on C1, sasl_bucket_1 bucket
      [2015-04-30 17:25:32,968] - [xdcrnewbasetests:2041] INFO - Saw: vb_replica_curr_items 70000 == 70000 expected on C1, sasl_bucket_2 bucket
      [2015-04-30 17:25:33,196] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:25:38,343] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:25:43,470] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:25:48,625] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:25:53,727] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:25:58,854] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:03,969] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:10,632] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:15,787] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:20,928] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:26,017] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:31,209] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:36,360] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:41,623] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:46,836] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:51,958] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:26:57,108] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:02,221] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:07,368] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:12,505] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:17,635] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:22,757] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:28,017] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:33,148] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:38,326] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:43,620] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:48,776] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:53,898] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:27:59,074] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:04,207] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:09,334] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:14,483] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:19,602] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:24,687] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:29,820] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:34,825] - [xdcrnewbasetests:2000] ERROR - ERROR: Timed-out waiting for active item count to match
      [2015-04-30 17:28:34,979] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, sasl_bucket_1 bucket
      [2015-04-30 17:28:39,985] - [xdcrnewbasetests:2000] ERROR - ERROR: Timed-out waiting for active item count to match
      [2015-04-30 17:28:40,153] - [xdcrnewbasetests:1996] WARNING - Not Ready: vb_active_curr_items 35000 == 70000 expected on C2, sasl_bucket_2 bucket
      [2015-04-30 17:28:45,159] - [xdcrnewbasetests:2000] ERROR - ERROR: Timed-out waiting for active item count to match
      [2015-04-30 17:28:45,376] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:48,510] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:51,634] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:54,746] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:28:58,073] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:01,209] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:04,428] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:07,578] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:10,716] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:13,887] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:17,182] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:20,536] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:23,682] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:26,789] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:29,907] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:33,056] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:36,209] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:39,323] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:42,598] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:45,745] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:48,859] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:51,991] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:55,198] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:29:58,371] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:01,483] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:04,683] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:07,806] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:10,939] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:14,076] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:17,171] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:20,311] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:23,417] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:26,531] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:29,669] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:32,790] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:35,897] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:39,019] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:42,189] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:45,309] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:48,435] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:51,519] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:54,635] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:30:57,920] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:01,222] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:04,652] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:07,741] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:10,863] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:14,051] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:17,246] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:20,345] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:23,517] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:26,642] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:29,787] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:32,898] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:36,087] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:39,200] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:42,324] - [xdcrnewbasetests:2029] WARNING - Not Ready: vb_replica_curr_items 35000 == 70000 expected on C2, default bucket
      [2015-04-30 17:31:45,327] - [xdcrnewbasetests:2033] ERROR - ERROR: Timed-out waiting for replica item count to match
      

      A loooong list of errors on goxdcr.log on .30 -

      PipelineManager 2015-04-30T18:06:03.158-07:00 [INFO] addPipelineToMap. pipelines=map[9e4eb72db14222e3bf36bea35372ea66/default/default:name={9e4eb72db14222e3bf36bea35372ea66/default/default}, status={Pending}, errors={[{"time":"2015-04-30T18:05:58.6287556-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-404796600"},{"time":"2015-04-30T18:05:15.4558115-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-826814900"},{"time":"2015-04-30T18:04:55.7318096-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-216806000"},{"time":"2015-04-30T18:04:35.0168057-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-608817100"},{"time":"2015-04-30T18:04:12.676808-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-472807800"},{"time":"2015-04-30T18:03:49.6448426-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-683775000"},{"time":"2015-04-30T18:03:03.0827944-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-401808800"},{"time":"2015-04-30T18:02:27.64677-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-510811500"},{"time":"2015-04-30T18:02:12.7367691-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-609809800"},{"time":"2015-04-30T18:01:57.893807-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-406809900"},{"time":"2015-04-30T18:01:43.6498164-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-874814600"},{"time":"2015-04-30T18:01:28.9738075-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-550809400"},{"time":"2015-04-30T18:01:12.8487947-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-678805400"},{"time":"2015-04-30T18:00:38.9308374-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-797805100"},{"time":"2015-04-30T18:00:20.6278101-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-284833900"},{"time":"2015-04-30T18:00:03.4728059-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-79809200"},{"time":"2015-04-30T17:59:47.40478-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-956806600"},{"time":"2015-04-30T17:59:33.2658104-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-818807500"},{"time":"2015-04-30T17:59:11.3837944-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-236806600"},{"time":"2015-04-30T17:58:50.5868041-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-522817000"},{"time":"2015-04-30T17:58:18.8208105-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-776811700"},{"time":"2015-04-30T17:58:03.9128092-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-334806200"},{"time":"2015-04-30T17:57:47.700811-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-241806300"},{"time":"2015-04-30T17:57:29.0367678-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-102759800"},{"time":"2015-04-30T17:57:14.0537874-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-890784700"},{"time":"2015-04-30T17:56:38.7438086-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-73804100"},{"time":"2015-04-30T17:56:17.0418095-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-122806200"},{"time":"2015-04-30T17:55:46.3788011-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-18820500"},{"time":"2015-04-30T17:55:30.3328104-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-537806400"},{"time":"2015-04-30T17:55:15.8998077-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-453770800"},{"time":"2015-04-30T17:55:00.2688164-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-528808000"},{"time":"2015-04-30T17:54:24.3347754-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-639816600"},{"time":"2015-04-30T17:54:09.7328058-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-343804500"},{"time":"2015-04-30T17:53:52.5078924-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-519803800"},{"time":"2015-04-30T17:53:37.901763-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-215808400"},{"time":"2015-04-30T17:53:03.458806-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-301805100"},{"time":"2015-04-30T17:52:44.99081-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-976814600"},{"time":"2015-04-30T17:52:27.2478074-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-730809700"},{"time":"2015-04-30T17:52:07.9537879-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-150805400"},{"time":"2015-04-30T17:51:32.4508002-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-435809800"},{"time":"2015-04-30T17:51:17.2777891-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-698813400"},{"time":"2015-04-30T17:51:01.9718096-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-315766900"},{"time":"2015-04-30T17:50:44.0488109-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-828810700"},{"time":"2015-04-30T17:50:27.1727596-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-876771000"},{"time":"2015-04-30T17:50:13.1898063-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-876797000"},{"time":"2015-04-30T17:49:57.1597851-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-342806200"},{"time":"2015-04-30T17:49:42.3347766-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-724764000"},{"time":"2015-04-30T17:49:25.0208092-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-198804800"},{"time":"2015-04-30T17:49:08.4288075-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-720807600"},{"time":"2015-04-30T17:48:53.9988078-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-696760200"},{"time":"2015-04-30T17:48:39.5767842-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/d
      efault-140762900"},{"time":"2015-04-30T17:48:22.4668069-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-754805700"},{"time":"2015-04-30T17:47:48.041809-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-267807200"},{"time":"2015-04-30T17:47:33.4558081-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-718805800"},{"time":"2015-04-30T17:46:57.9038207-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-562804200"},{"time":"2015-04-30T17:46:42.5528073-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-697798200"},{"time":"2015-04-30T17:46:07.9248074-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-385808900"},{"time":"2015-04-30T17:45:53.3198064-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-136774700"},{"time":"2015-04-30T17:45:37.4548111-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-529765700"},{"time":"2015-04-30T17:45:21.8658053-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-222776600"},{"time":"2015-04-30T17:45:06.5348118-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-720810000"},{"time":"2015-04-30T17:44:32.0238059-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-578786800"},{"time":"2015-04-30T17:44:14.9308144-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-188806200"},{"time":"2015-04-30T17:43:29.4758293-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-366805300"},{"time":"2015-04-30T17:43:13.6538063-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-315807000"},{"time":"2015-04-30T17:42:59.6367846-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-312804300"},{"time":"2015-04-30T17:42:43.6127527-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-486806600"},{"time":"2015-04-30T17:42:25.4028093-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-492808400"},{"time":"2015-04-30T17:42:05.7978116-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-392777700"},{"time":"2015-04-30T17:41:50.7047549-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-502812300"},{"time":"2015-04-30T17:41:35.8617747-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-319807600"},{"time":"2015-04-30T17:41:20.5798067-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-584809200"},{"time":"2015-04-30T17:41:04.9448053-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-985807100"},{"time":"2015-04-30T17:40:49.3488091-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-593780400"},{"time":"2015-04-30T17:40:32.9048081-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-667810800"},{"time":"2015-04-30T17:40:16.9858043-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-264805900"},{"time":"2015-04-30T17:40:03.580809-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-349808700"},{"time":"2015-04-30T17:39:47.7458093-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-53809400"},{"time":"2015-04-30T17:39:32.3868093-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-526787100"},{"time":"2015-04-30T17:39:16.8718105-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-31808100"},{"time":"2015-04-30T17:39:03.2807584-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-56821000"},{"time":"2015-04-30T17:38:29.3768518-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-701789800"},{"time":"2015-04-30T17:38:15.0177617-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-792804000"},{"time":"2015-04-30T17:37:55.3217927-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-582805300"},{"time":"2015-04-30T17:37:38.2738042-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-605792600"},{"time":"2015-04-30T17:37:04.7347586-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-728810200"},{"time":"2015-04-30T17:36:48.8298108-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-25777000"},{"time":"2015-04-30T17:36:32.1927867-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-342809800"},{"time":"2015-04-30T17:36:16.3767771-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-913819100"},{"time":"2015-04-30T17:35:54.2058123-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-481765000"},{"time":"2015-04-30T17:35:27.8878101-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-432810200"},{"time":"2015-04-30T17:34:44.0098039-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-370792900"},{"time":"2015-04-30T17:34:23.1857707-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-611804700"},{"time":"2015-04-30T17:33:56.9828111-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-878808600"},{"time":"2015-04-30T17:33:38.6248104-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-598756100"},{"time":"2015-04-30T17:33:13.9328215-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-430757800"},{"time":"2015-04-30T17:32:48.7237603-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-611758200"},{"time":"2015-04-30T17:32:28.8878114-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-845812100"},{"time":"2015-04-30T17:32:15.2178246-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-199807300"},{"time":"2015-04-30T17:31:40.5697597-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-730811800"},{"time":"2015-04-30T17:31:21.083799-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-711809800"},{"time":"2015-04-30T17:31:07.0768031-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-951805300"},{"time":"2015-04-30T17:30:51.2387556-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-879804700"},{"time":"2015-04
      -30T17:30:33.1038141-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-912805600"},{"time":"2015-04-30T17:30:17.2608075-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-119808800"},{"time":"2015-04-30T17:29:43.867798-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-456765400"},{"time":"2015-04-30T17:29:28.5317985-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-267775000"},{"time":"2015-04-30T17:29:11.2588082-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-230786000"},{"time":"2015-04-30T17:28:55.3488068-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-511807700"},{"time":"2015-04-30T17:28:40.8948078-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-187808800"},{"time":"2015-04-30T17:28:25.1908079-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-822810100"},{"time":"2015-04-30T17:28:07.6238061-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-251811900"},{"time":"2015-04-30T17:27:51.9448093-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-780806800"},{"time":"2015-04-30T17:27:19.1118094-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-48814000"},{"time":"2015-04-30T17:27:03.3867681-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-957809300"},{"time":"2015-04-30T17:26:43.2318243-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-592805000"},{"time":"2015-04-30T17:26:26.9878031-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-339804700"},{"time":"2015-04-30T17:26:10.6688078-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-102812500"},{"time":"2015-04-30T17:25:54.5307584-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-343807500"},{"time":"2015-04-30T17:25:19.5988049-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-297820300"},{"time":"2015-04-30T17:25:03.6658087-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-598805800"},{"time":"2015-04-30T17:24:29.9208071-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-748775300"},{"time":"2015-04-30T17:24:10.7618129-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-682754700"},{"time":"2015-04-30T17:23:44.9678064-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-596802400"},{"time":"2015-04-30T17:23:23.0997982-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-232809400"},{"time":"2015-04-30T17:23:01.7357823-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-157761800"},{"time":"2015-04-30T17:22:35.9368087-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-749769300"},{"time":"2015-04-30T17:21:45.0748056-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-54769000"},{"time":"2015-04-30T17:21:21.3357829-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-127811800"},{"time":"2015-04-30T17:20:56.5407608-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-124805800"},{"time":"2015-04-30T17:20:11.8007587-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-727807000"},{"time":"2015-04-30T17:19:47.9958162-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-50878500"},{"time":"2015-04-30T17:19:25.6508061-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-351810200"},{"time":"2015-04-30T17:19:02.6447922-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-334775200"},{"time":"2015-04-30T17:18:40.5987653-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-673811900"},{"time":"2015-04-30T17:18:19.1838106-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-938810800"},{"time":"2015-04-30T17:17:59.3957713-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-654771700"},{"time":"2015-04-30T17:17:38.5218079-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-811797900"},{"time":"2015-04-30T17:17:15.4968373-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-37783600"},{"time":"2015-04-30T17:16:54.6248096-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-492778100"},{"time":"2015-04-30T17:16:32.4358059-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-26790400"},{"time":"2015-04-30T17:16:08.1657777-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-403766800"},{"time":"2015-04-30T17:15:46.8648111-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-137804500"},{"time":"2015-04-30T17:15:25.7028087-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-300807700"},{"time":"2015-04-30T17:15:03.7888069-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-436769300"},{"time":"2015-04-30T17:14:16.2178122-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-950807200"},{"time":"2015-04-30T17:13:52.5718077-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-969806200"},{"time":"2015-04-30T17:13:29.3708104-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-632764900"},{"time":"2015-04-30T17:13:06.1658152-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-287799600"},{"time":"2015-04-30T17:12:45.0138101-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-305775500"},{"time":"2015-04-30T17:12:21.9448402-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-815810200"},{"time":"2015-04-30T17:12:00.1887884-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-75755900"},{"time":"2015-04-30T17:11:36.3668086-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-458809800"},{"time":"2015-04-30T17:11:14.0648128-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-328805700"},{"time":"2015-04-30T17:10:54.7178114-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-487808800"},{"time":"2015-04-30T17:10:37.6848056-07:00","errMsg
      ":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-401770300"},{"time":"2015-04-30T17:10:23.7527587-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-569806600"},{"time":"2015-04-30T17:09:46.6178259-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-501806200"},{"time":"2015-04-30T17:09:27.7368067-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-335804900"},{"time":"2015-04-30T17:09:11.1418094-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-492773300"},{"time":"2015-04-30T17:08:49.025807-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-762812600"},{"time":"2015-04-30T17:08:24.4658078-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-246771400"},{"time":"2015-04-30T17:07:59.6848108-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-447810800"},{"time":"2015-04-30T17:07:33.934837-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-786777300"},{"time":"2015-04-30T17:06:44.4758118-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-136807700"},{"time":"2015-04-30T17:06:18.2098073-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-487765500"},{"time":"2015-04-30T17:05:56.8308093-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-923810800"},{"time":"2015-04-30T17:05:34.5247977-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-24807500"},{"time":"2015-04-30T17:04:49.5908074-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-734758400"},{"time":"2015-04-30T17:04:25.4558056-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-939827700"},{"time":"2015-04-30T17:04:02.5342747-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-96783100"},{"time":"2015-04-30T17:03:39.7597594-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-544810700"},{"time":"2015-04-30T17:03:15.7917881-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-703807900"},{"time":"2015-04-30T17:02:27.3908095-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-557781100"},{"time":"2015-04-30T17:01:37.4087981-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-767807500"},{"time":"2015-04-30T17:01:16.3527647-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-854806600"},{"time":"2015-04-30T17:00:55.124812-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-705804500"},{"time":"2015-04-30T17:00:31.2358007-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-31812300"},{"time":"2015-04-30T17:00:09.862814-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-447809600"},{"time":"2015-04-30T16:59:44.8108116-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-587811900"},{"time":"2015-04-30T16:59:20.0448051-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-470806500"},{"time":"2015-04-30T16:58:57.1128119-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-486811800"},{"time":"2015-04-30T16:58:35.2257932-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-922804300"},{"time":"2015-04-30T16:57:48.9437865-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-388770300"},{"time":"2015-04-30T16:57:21.8557924-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-831807200"},{"time":"2015-04-30T16:56:58.3238098-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-111804700"},{"time":"2015-04-30T16:56:34.7368191-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-125783800"},{"time":"2015-04-30T16:56:09.4507638-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-67812500"},{"time":"2015-04-30T16:55:47.8398086-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-999267700"},{"time":"2015-04-30T16:55:22.7367964-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-934804700"},{"time":"2015-04-30T16:54:55.567807-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-305794000"},{"time":"2015-04-30T16:54:32.4168308-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-9810700"},{"time":"2015-04-30T16:54:06.7328087-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-660816700"},{"time":"2015-04-30T16:53:44.1018062-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-392806200"},{"time":"2015-04-30T16:53:18.502809-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-127809500"},{"time":"2015-04-30T16:52:51.7207668-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-192808200"},{"time":"2015-04-30T16:52:31.1748113-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-333808500"},{"time":"2015-04-30T16:52:07.4118105-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-52810300"},{"time":"2015-04-30T16:51:18.3208072-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-845764700"},{"time":"2015-04-30T16:50:55.3528107-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-805806500"},{"time":"2015-04-30T16:50:31.1968129-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-489777100"},{"time":"2015-04-30T16:50:07.99682-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-491809100"},{"time":"2015-04-30T16:49:45.3967604-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-3811900"},{"time":"2015-04-30T16:49:24.4107621-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-673808900"},{"time":"2015-04-30T16:49:01.4047992-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-533807500"},{"time":"2015-04-30T16:48:38.6968078-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-54810400"},{"time":"2015-04-30T16:47:47.5638056-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-426757100"},{"time":"2015-04-30T16:47:20.9077723-07:00","errMsg":"Failed to get starting seqno for pipeline 9
      e4eb72db14222e3bf36bea35372ea66/default/default-813808700"},{"time":"2015-04-30T16:46:57.3638108-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-514804100"},{"time":"2015-04-30T16:46:26.3167691-07:00","errMsg":"Failed to get starting seqno for pipeline 9e4eb72db14222e3bf36bea35372ea66/default/default-701811100"}]}, progress={Pipeline is constructed
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty