Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-39071

[XDCR] Possible checkpoint encoding error

    XMLWordPrintable

Details

    Description

      Regression seen in checkpointing tests on 7.0.0-1902. Tests were passing in 7.0.0-1834.

      Running into "UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8d in position 72: invalid start byte" error while decoding json checkpoint record. This usually occurs when trying to decode something that is not UTF-8 encoded.

      Checkpoint record in 1834:

       2020-04-29 21:18:32 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 172.23.105.133:8091: True content: {"/ckpt/c2a6aa909f9b0d955b78b6ff02466bee/default/default/0":"{\"checkpoints\":[{\"failover_uuid\":87544922736699,\"seqno\":3,\"dcp_snapshot_seqno\":3,\"dcp_snapshot_end_seqno\":3,\"target_vb_opaque\":{\"target_vb_uuid\":60171791944193},\"target_seqno\":3,\"filtered_items_cnt\":0,\"filtered_failed_cnt\":0,\"source_manifest\":0,\"target_manifest\":0},{\"failover_uuid\":87544922736699,\"seqno\":2,\"dcp_snapshot_seqno\":2,\"dcp_snapshot_end_seqno\":2,\"target_vb_opaque\":{\"target_vb_uuid\":60171791944193},\"target_seqno\":2,\"filtered_items_cnt\":0,\"filtered_failed_cnt\":0,\"source_manifest\":0,\"target_manifest\":0},{\"failover_uuid\":87544922736699,\"seqno\":1,\"dcp_snapshot_seqno\":0,\"dcp_snapshot_end_seqno\":1,\"target_vb_opaque\":{\"target_vb_uuid\":60171791944193},\"target_seqno\":1,\"filtered_items_cnt\":0,\"filtered_failed_cnt\":0,\"source_manifest\":0,\"target_manifest\":0},null,null],\"xattrSeqno\":0,\"targetClusterVersion\":458752,\"specInternalId\":\"PFzk9PlgxDOugyDxxujfSQ==\",\"Revision\":null}"} command: ns_server_testrunner_api:grab_all_goxdcr_checkpoints().
      

      Successfully decoded as:

       2020-04-29 21:18:32 | INFO | MainProcess | test_thread | [checkpointXDCR.get_and_validate_latest_checkpoint] Checkpoint record : {'failover_uuid': 87544922736699, 'seqno': 3, 'dcp_snapshot_seqno': 3, 'dcp_snapshot_end_seqno': 3, 'target_vb_opaque': {'target_vb_uuid': 60171791944193}, 'target_seqno': 3, 'filtered_items_cnt': 0, 'filtered_failed_cnt': 0, 'source_manifest': 0, 'target_manifest': 0}
      

      Checkpoint record in 1902:

       2020-04-29 21:51:49 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 172.23.105.133:8091: True content: b'{"/ckpt/manifest/18f6ed8bdb91482e0529f7e4971cb49c/default/default/src":"\x8d\\u0001\xa8{\\"collection_manifests\\":[{\\"uid\\":\\"0\\",\\"scopes\\u0005\\u0015\\u0000c\\u0015.\\t\\u0010@name\\":\\"_default\\",\\u00157\\f}],\\"n\\u001E\\u0000\\u0001 8Revision\\":null}","/ckpt/18f6ed8bdb91482e0529f7e4971cb49c/default/default/brokenMappings":"{\\"NsMappingRecords\\":[{\\"CompressedMapping\\":\\"McB7IlNvdXJjZUNvbGxlY3Rpb25zIjpudWxsLCJJbmRpcmVjdFRhcmdldE1hcCI6e319\\",\\"Sha256Digest\\":\\"208bd79a2a7925f694f07c65771490b90142a7ac58ac7d84f636c0b1a7aaad01\\"}],\\"specInternalId\\":\\"BbW56bpqUsuLaUYpyLHfYw==\\",\\"Revision\\":null}","/ckpt/manifest/18f6ed8bdb91482e0529f7e4971cb49c/default/default/tgt":"\x8d\\u0001\xa8{\\"collection_manifests\\":[{\\"uid\\":\\"0\\",\\"scopes\\u0005\\u0015\\u0000c\\u0015.\\t\\u0010@name\\":\\"_default\\",\\u00157\\f}],\\"n\\u001E\\u0000\\u0001 8Revision\\":null}","/ckpt/18f6ed8bdb91482e0529f7e4971cb49c/default/default/0":"{\\"checkpoints\\":[{\\"failover_uuid\\":164035069018179,\\"seqno\\":2,\\"dcp_snapshot_seqno\\":2,\\"dcp_snapshot_end_seqno\\":2,\\"target_vb_opaque\\":{\\"target_vb_uuid\\":172187907264268},\\"target_seqno\\":2,\\"filtered_items_cnt\\":0,\\"filtered_failed_cnt\\":0,\\"source_manifest\\":0,\\"target_manifest\\":0,\\"brokenCollectionsMapSha256\\":\\"\\"},{\\"failover_uuid\\":164035069018179,\\"seqno\\":1,\\"dcp_snapshot_seqno\\":0,\\"dcp_snapshot_end_seqno\\":1,\\"target_vb_opaque\\":{\\"target_vb_uuid\\":172187907264268},\\"target_seqno\\":1,\\"filtered_items_cnt\\":0,\\"filtered_failed_cnt\\":0,\\"source_manifest\\":0,\\"target_manifest\\":0,\\"brokenCollectionsMapSha256\\":\\"\\"},null,null,null],\\"xattrSeqno\\":0,\\"targetClusterVersion\\":458752,\\"specInternalId\\":\\"BbW56bpqUsuLaUYpyLHfYw==\\",\\"Revision\\":null}"}' command: ns_server_testrunner_api:grab_all_goxdcr_checkpoints().
      

      Unable to decode due to "UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8d in position 72: invalid start byte" error.

      Attachments

        1. fail_1902.txt
          167 kB
        2. pass_1834.txt
          173 kB

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              neil.huang Neil Huang
              pavithra.mahamani Pavithra Mahamani (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty