filename: conf/fts/mk.conf
prefix: fts.stable_topology_fts.StableTopFTS
Global Test input params:
{'cluster_name': 'fts',
 'conf_file': 'conf/fts/mk.conf',
 'ini': 'resources/jenkins/fts.ini',
 'num_nodes': 1,
 'spec': 'mk'}
Logs will be stored at /Users/mihirkamdar/PycharmProjects/testrunner_0908/testrunner/logs/testrunner-16-Sep-15_12-11-44/test_1

./testrunner -i resources/jenkins/fts.ini  -t fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping,items=1000,custom_map=True,num_custom_analyzers=1,compare_es=True,cm_id=56,num_queries=100,GROUP=P0,cluster=D+F

Test Input params:
{'num_custom_analyzers': '1', 'GROUP': 'P0', 'compare_es': 'True', 'cluster': 'D+F', 'items': '1000', 'num_queries': '100', 'conf_file': 'conf/fts/mk.conf', 'num_nodes': 1, 'cluster_name': 'fts', 'cm_id': '56', 'ini': 'resources/jenkins/fts.ini', 'case_number': 1, 'logs_folder': '/Users/mihirkamdar/PycharmProjects/testrunner_0908/testrunner/logs/testrunner-16-Sep-15_12-11-44/test_1', 'custom_map': 'True', 'spec': 'mk'}
Run before suite setup for fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping
2016-09-15 12:11:44 | WARNING | MainProcess | MainThread | [data_helper.<module>] Can not import concurrent module. Data for each server will be loaded/retrieved sequentially
2016-09-15 12:11:45 | INFO | MainProcess | test_thread | [fts_base.setUp] ==== FTSbasetests setup is started for test #1 index_query_custom_mapping ====
2016-09-15 12:11:46 | INFO | MainProcess | test_thread | [fts_base.cleanup_cluster] removing nodes from cluster ...
2016-09-15 12:11:47 | INFO | MainProcess | test_thread | [fts_base.cleanup_cluster] cleanup [ip:172.23.108.141 port:8091 ssh_username:root]
2016-09-15 12:11:48 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [u'default'] on 172.23.108.141
2016-09-15 12:11:48 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] remove bucket default ...
2016-09-15 12:11:50 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 172.23.108.141
2016-09-15 12:11:50 | INFO | MainProcess | test_thread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete....
2016-09-15 12:11:50 | INFO | MainProcess | test_thread | [rest_client.bucket_exists] node 172.23.108.141 existing buckets : []
2016-09-15 12:11:53 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 172.23.108.141:8091
2016-09-15 12:11:54 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 172.23.108.141:8091 is running
2016-09-15 12:11:55 | INFO | MainProcess | test_thread | [fts_base.create_index_es] Created empty index es_index on Elastic Search node with custom standard analyzer(default)
2016-09-15 12:11:55 | INFO | MainProcess | test_thread | [fts_base.init_cluster] Initializing Cluster ...
2016-09-15 12:11:56 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=2014
2016-09-15 12:11:57 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=forestdb
2016-09-15 12:11:57 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 172.23.108.141:8091:username=Administrator&password=password&port=8091
2016-09-15 12:12:02 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://172.23.108.141:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=1514&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None
2016-09-15 12:12:02 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.52 seconds to create bucket default
2016-09-15 12:12:02 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 172.23.108.141 to accept set ops
2016-09-15 12:12:07 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 172.23.108.141:11210 default
2016-09-15 12:12:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 172.23.108.141:11210 default
2016-09-15 12:16:53 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'default' was created with per node RAM quota: 1514
2016-09-15 12:16:54 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 172.23.108.141:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2016-09-15 12:16:54 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 172.23.108.141 with username : root password : couchbase ssh_key: 
2016-09-15 12:16:58 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 172.23.108.141
2016-09-15 12:17:03 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] It could be other operating systyem.  Go to check at other location
2016-09-15 12:17:11 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 172.23.108.141: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
2016-09-15 12:17:12 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2016-09-15 12:17:12 | INFO | MainProcess | test_thread | [fts_base.check_error_count_in_fts_log] 0
2016-09-15 12:17:12 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 172.23.108.141: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
2016-09-15 12:17:12 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2016-09-15 12:17:12 | INFO | MainProcess | test_thread | [fts_base.check_error_count_in_fts_log] 0
2016-09-15 12:17:12 | INFO | MainProcess | test_thread | [fts_base.__initialize_error_count_dict] {'172.23.108.141': {'crash in forestdb': 0, 'panic:': 0}}
2016-09-15 12:17:12 | INFO | MainProcess | test_thread | [fts_base.setUp] ==== FTSbasetests setup is finished for test #1 index_query_custom_mapping ====
{'text': ['manages_reports', 'name', 'languages_known'], 'number': ['mutated', 'salary', 'manages_team_size'], 'datetime': ['join_date']}
2016-09-15 12:17:15 | INFO | MainProcess | test_thread | [fts_base.generate_new_custom_map] {
   "mapping": {
      "default_analyzer": "customAnalyzer1", 
      "default_datetime_parser": "dateTimeOptional", 
      "type_field": "type", 
      "default_mapping": {
         "default_analyzer": "", 
         "dynamic": true, 
         "enabled": false
      }, 
      "default_type": "_default", 
      "analysis": {
         "analyzers": {
            "customAnalyzer1": {
               "type": "custom", 
               "char_filters": [
                  "mapping"
               ], 
               "tokenizer": "unicode", 
               "token_filters": [
                  "shingle"
               ]
            }
         }, 
         "token_maps": {
            "stopwords": {
               "tokens": [
                  "i", 
                  "me", 
                  "my", 
                  "myself", 
                  "we", 
                  "our", 
                  "ours", 
                  "ourselves", 
                  "you", 
                  "your", 
                  "yours", 
                  "yourself", 
                  "yourselves", 
                  "he", 
                  "him", 
                  "his", 
                  "himself", 
                  "she", 
                  "her", 
                  "hers", 
                  "herself", 
                  "it", 
                  "its", 
                  "itself", 
                  "they", 
                  "them", 
                  "their", 
                  "theirs", 
                  "themselves", 
                  "what", 
                  "which", 
                  "who", 
                  "whom", 
                  "this", 
                  "that", 
                  "these", 
                  "those", 
                  "am", 
                  "is", 
                  "are", 
                  "was", 
                  "were", 
                  "be", 
                  "been", 
                  "being", 
                  "have", 
                  "has", 
                  "had", 
                  "having", 
                  "do", 
                  "does", 
                  "did", 
                  "doing", 
                  "would", 
                  "should", 
                  "could", 
                  "ought", 
                  "i'm", 
                  "you're", 
                  "he's", 
                  "she's", 
                  "it's", 
                  "we're", 
                  "they're", 
                  "i've", 
                  "you've", 
                  "we've", 
                  "they've", 
                  "i'd", 
                  "you'd", 
                  "he'd", 
                  "she'd", 
                  "we'd", 
                  "they'd", 
                  "i'll", 
                  "you'll", 
                  "he'll", 
                  "she'll", 
                  "we'll", 
                  "they'll", 
                  "isn't", 
                  "aren't", 
                  "wasn't", 
                  "weren't", 
                  "hasn't", 
                  "haven't", 
                  "hadn't", 
                  "doesn't", 
                  "don't", 
                  "didn't", 
                  "won't", 
                  "wouldn't", 
                  "shan't", 
                  "shouldn't", 
                  "can't", 
                  "cannot", 
                  "couldn't", 
                  "mustn't", 
                  "let's", 
                  "that's", 
                  "who's", 
                  "what's", 
                  "here's", 
                  "there's", 
                  "when's", 
                  "where's", 
                  "why's", 
                  "how's", 
                  "a", 
                  "an", 
                  "the", 
                  "and", 
                  "but", 
                  "if", 
                  "or", 
                  "because", 
                  "as", 
                  "until", 
                  "while", 
                  "of", 
                  "at", 
                  "by", 
                  "for", 
                  "with", 
                  "about", 
                  "against", 
                  "between", 
                  "into", 
                  "through", 
                  "during", 
                  "before", 
                  "after", 
                  "above", 
                  "below", 
                  "to", 
                  "from", 
                  "up", 
                  "down", 
                  "in", 
                  "out", 
                  "on", 
                  "off", 
                  "over", 
                  "under", 
                  "again", 
                  "further", 
                  "then", 
                  "once", 
                  "here", 
                  "there", 
                  "when", 
                  "where", 
                  "why", 
                  "how", 
                  "all", 
                  "any", 
                  "both", 
                  "each", 
                  "few", 
                  "more", 
                  "most", 
                  "other", 
                  "some", 
                  "such", 
                  "no", 
                  "nor", 
                  "not", 
                  "only", 
                  "own", 
                  "same", 
                  "so", 
                  "than", 
                  "too", 
                  "very"
               ], 
               "type": "custom"
            }
         }, 
         "tokenizers": {
            "alphanumeric": {
               "regexp": "[0-9a-zA-Z_]*", 
               "type": "regexp"
            }
         }, 
         "char_filters": {
            "mapping": {
               "regexp": "[f]", 
               "type": "regexp", 
               "replace": "ph"
            }
         }, 
         "token_filters": {
            "dict_compound_en": {
               "dict_token_map": "stop_en", 
               "type": "dict_compound"
            }, 
            "keyword_marker": {
               "type": "keyword_marker", 
               "keywords_token_map": "stopwords"
            }, 
            "truncate": {
               "length": 10, 
               "type": "truncate_token"
            }, 
            "dict_compound_fr": {
               "dict_token_map": "articles_fr", 
               "type": "dict_compound"
            }, 
            "ngram": {
               "max": 5, 
               "type": "ngram", 
               "min": 3
            }, 
            "front_edge_ngram": {
               "max": 5, 
               "type": "edge_ngram", 
               "back": false, 
               "min": 3
            }, 
            "back_edge_ngram": {
               "max": 5, 
               "type": "edge_ngram", 
               "back": true, 
               "min": 3
            }, 
            "shingle": {
               "output_original": "false", 
               "min": 2, 
               "filler": "", 
               "max": 5, 
               "separator": "", 
               "type": "shingle"
            }, 
            "length": {
               "max": 5, 
               "type": "length", 
               "min": 3
            }, 
            "stopwords": {
               "stop_token_map": "stopwords", 
               "type": "stop_tokens"
            }
         }
      }, 
      "default_field": "_all", 
      "types": {
         "emp": {
            "enabled": true, 
            "dynamic": false, 
            "properties": {
               "salary": {
                  "enabled": true, 
                  "dynamic": false, 
                  "properties": {}, 
                  "fields": [
                     {
                        "index": true, 
                        "name": "salary", 
                        "include_in_all": true, 
                        "type": "number", 
                        "analyzer": "", 
                        "include_term_vectors": true, 
                        "store": false
                     }
                  ]
               }, 
               "name": {
                  "enabled": true, 
                  "dynamic": false, 
                  "properties": {}, 
                  "fields": [
                     {
                        "index": true, 
                        "name": "name", 
                        "include_in_all": true, 
                        "type": "text", 
                        "analyzer": "customAnalyzer1", 
                        "include_term_vectors": true, 
                        "store": false
                     }
                  ]
               }, 
               "mutated": {
                  "enabled": true, 
                  "dynamic": false, 
                  "properties": {}, 
                  "fields": [
                     {
                        "index": true, 
                        "name": "mutated", 
                        "include_in_all": true, 
                        "type": "number", 
                        "analyzer": "", 
                        "include_term_vectors": true, 
                        "store": false
                     }
                  ]
               }, 
               "join_date": {
                  "enabled": true, 
                  "dynamic": false, 
                  "properties": {}, 
                  "fields": [
                     {
                        "index": true, 
                        "name": "join_date", 
                        "include_in_all": true, 
                        "type": "datetime", 
                        "analyzer": "", 
                        "include_term_vectors": true, 
                        "store": false
                     }
                  ]
               }, 
               "manages": {
                  "enabled": true, 
                  "dynamic": false, 
                  "properties": {
                     "reports": {
                        "enabled": true, 
                        "dynamic": false, 
                        "properties": {}, 
                        "fields": [
                           {
                              "index": true, 
                              "name": "reports", 
                              "include_in_all": true, 
                              "type": "text", 
                              "analyzer": "customAnalyzer1", 
                              "include_term_vectors": true, 
                              "store": false
                           }
                        ]
                     }
                  }, 
                  "fields": []
               }, 
               "languages_known": {
                  "enabled": true, 
                  "dynamic": false, 
                  "properties": {}, 
                  "fields": [
                     {
                        "index": true, 
                        "name": "languages_known", 
                        "include_in_all": true, 
                        "type": "text", 
                        "analyzer": "customAnalyzer1", 
                        "include_term_vectors": true, 
                        "store": false
                     }
                  ]
               }
            }, 
            "fields": []
         }
      }
   }
}
2016-09-15 12:17:15 | INFO | MainProcess | test_thread | [fts_base.create] Checking if index already exists ...
2016-09-15 12:17:17 | ERROR | MainProcess | test_thread | [rest_client._http_request] http://172.23.108.141:8094/api/index/custom_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found 
 rest_auth: preparePerm, err: index not found 
2016-09-15 12:17:18 | ERROR | MainProcess | test_thread | [rest_client._http_request] http://172.23.108.141:8094/api/index/custom_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found 
 rest_auth: preparePerm, err: index not found 
2016-09-15 12:17:18 | INFO | MainProcess | test_thread | [fts_base.create] Creating fulltext-index custom_index on 172.23.108.141
2016-09-15 12:17:18 | INFO | MainProcess | test_thread | [rest_client.create_fts_index] {"params": {"mapping": {"default_analyzer": "customAnalyzer1", "default_datetime_parser": "dateTimeOptional", "type_field": "type", "default_mapping": {"default_analyzer": "", "dynamic": true, "enabled": false}, "default_type": "_default", "analysis": {"analyzers": {"customAnalyzer1": {"type": "custom", "char_filters": ["mapping"], "tokenizer": "unicode", "token_filters": ["shingle"]}}, "token_maps": {"stopwords": {"tokens": ["i", "me", "my", "myself", "we", "our", "ours", "ourselves", "you", "your", "yours", "yourself", "yourselves", "he", "him", "his", "himself", "she", "her", "hers", "herself", "it", "its", "itself", "they", "them", "their", "theirs", "themselves", "what", "which", "who", "whom", "this", "that", "these", "those", "am", "is", "are", "was", "were", "be", "been", "being", "have", "has", "had", "having", "do", "does", "did", "doing", "would", "should", "could", "ought", "i'm", "you're", "he's", "she's", "it's", "we're", "they're", "i've", "you've", "we've", "they've", "i'd", "you'd", "he'd", "she'd", "we'd", "they'd", "i'll", "you'll", "he'll", "she'll", "we'll", "they'll", "isn't", "aren't", "wasn't", "weren't", "hasn't", "haven't", "hadn't", "doesn't", "don't", "didn't", "won't", "wouldn't", "shan't", "shouldn't", "can't", "cannot", "couldn't", "mustn't", "let's", "that's", "who's", "what's", "here's", "there's", "when's", "where's", "why's", "how's", "a", "an", "the", "and", "but", "if", "or", "because", "as", "until", "while", "of", "at", "by", "for", "with", "about", "against", "between", "into", "through", "during", "before", "after", "above", "below", "to", "from", "up", "down", "in", "out", "on", "off", "over", "under", "again", "further", "then", "once", "here", "there", "when", "where", "why", "how", "all", "any", "both", "each", "few", "more", "most", "other", "some", "such", "no", "nor", "not", "only", "own", "same", "so", "than", "too", "very"], "type": "custom"}}, "tokenizers": {"alphanumeric": {"regexp": "[0-9a-zA-Z_]*", "type": "regexp"}}, "char_filters": {"mapping": {"regexp": "[f]", "type": "regexp", "replace": "ph"}}, "token_filters": {"dict_compound_en": {"dict_token_map": "stop_en", "type": "dict_compound"}, "keyword_marker": {"type": "keyword_marker", "keywords_token_map": "stopwords"}, "truncate": {"length": 10, "type": "truncate_token"}, "dict_compound_fr": {"dict_token_map": "articles_fr", "type": "dict_compound"}, "ngram": {"max": 5, "type": "ngram", "min": 3}, "front_edge_ngram": {"max": 5, "type": "edge_ngram", "back": false, "min": 3}, "back_edge_ngram": {"max": 5, "type": "edge_ngram", "back": true, "min": 3}, "shingle": {"output_original": "false", "min": 2, "filler": "", "max": 5, "separator": "", "type": "shingle"}, "length": {"max": 5, "type": "length", "min": 3}, "stopwords": {"stop_token_map": "stopwords", "type": "stop_tokens"}}}, "default_field": "_all", "types": {"emp": {"enabled": true, "dynamic": false, "properties": {"salary": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "salary", "include_in_all": true, "type": "number", "analyzer": "", "include_term_vectors": true, "store": false}]}, "name": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "name", "include_in_all": true, "type": "text", "analyzer": "customAnalyzer1", "include_term_vectors": true, "store": false}]}, "mutated": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "mutated", "include_in_all": true, "type": "number", "analyzer": "", "include_term_vectors": true, "store": false}]}, "join_date": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "join_date", "include_in_all": true, "type": "datetime", "analyzer": "", "include_term_vectors": true, "store": false}]}, "manages": {"enabled": true, "dynamic": false, "properties": {"reports": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "reports", "include_in_all": true, "type": "text", "analyzer": "customAnalyzer1", "include_term_vectors": true, "store": false}]}}, "fields": []}, "languages_known": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "languages_known", "include_in_all": true, "type": "text", "analyzer": "customAnalyzer1", "include_term_vectors": true, "store": false}]}}, "fields": []}}}}, "name": "custom_index", "planParams": {"hierarchyRules": null, "nodePlanParams": null, "numReplicas": 0, "planFrozen": false, "maxPartitionsPerPIndex": 32}, "sourceName": "default", "sourceUUID": "", "sourceType": "couchbase", "type": "fulltext-index", "sourceParams": {"authUser": "default", "dataManagerSleepMaxMS": 20000, "authSaslUser": "", "clusterManagerSleepMaxMS": 20000, "authSaslPassword": "", "clusterManagerSleepInitMS": 0, "dataManagerBackoffFactor": 0, "authPassword": "", "dataManagerSleepInitMS": 0, "feedBufferAckThreshold": 0, "feedBufferSizeBytes": 0, "clusterManagerBackoffFactor": 0}, "uuid": ""}
2016-09-15 12:17:19 | INFO | MainProcess | test_thread | [rest_client.create_fts_index] Index custom_index created
2016-09-15 12:17:19 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validating index distribution for custom_index ...
2016-09-15 12:17:28 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: Number of PIndexes = 32
2016-09-15 12:17:29 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: Every pIndex serves 32 partitions or lesser
2016-09-15 12:17:29 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: pIndexes are distributed across [u'57d9d024c0ea2335a88ac2ad91344376'] 
2016-09-15 12:17:29 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Expecting num of partitions in each node in range 992-1024
2016-09-15 12:17:29 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: Node 57d9d024c0ea2335a88ac2ad91344376 houses 32 pindexes which serve 1024 partitions
2016-09-15 12:17:30 | INFO | MainProcess | test_thread | [es_base.create_index_mapping] Creating es_index with mapping {
   "mappings": {
      "emp": {
         "dynamic": false, 
         "properties": {
            "salary": {
               "index": "analyzed", 
               "type": "float", 
               "store": false
            }, 
            "name": {
               "index": "analyzed", 
               "type": "string", 
               "analyzer": "customAnalyzer1", 
               "store": false, 
               "term_vector": "yes"
            }, 
            "mutated": {
               "index": "analyzed", 
               "type": "float", 
               "store": false
            }, 
            "join_date": {
               "index": "analyzed", 
               "type": "date", 
               "store": false
            }, 
            "manages": {
               "enabled": true, 
               "dynamic": false, 
               "properties": {
                  "reports": {
                     "index": "analyzed", 
                     "type": "string", 
                     "analyzer": "customAnalyzer1", 
                     "store": false, 
                     "term_vector": "yes"
                  }
               }, 
               "type": "object"
            }, 
            "languages_known": {
               "index": "analyzed", 
               "type": "string", 
               "analyzer": "customAnalyzer1", 
               "store": false, 
               "term_vector": "yes"
            }
         }
      }
   }, 
   "settings": {
      "analysis": {
         "filter": {
            "stemmer_fr_light": {
               "type": "stemmer", 
               "name": "light_french"
            }, 
            "stemmer_pt_light": {
               "type": "stemmer", 
               "name": "light_portuguese"
            }, 
            "truncate": {
               "length": 10, 
               "type": "truncate"
            }, 
            "ngram": {
               "max_gram": 5, 
               "type": "nGram", 
               "side": "front", 
               "min_gram": 3
            }, 
            "front_edge_ngram": {
               "max_gram": 5, 
               "type": "edgeNGram", 
               "side": "front", 
               "min_gram": 3
            }, 
            "cjk_bigram": {
               "type": "cjk_bigram"
            }, 
            "keyword_marker": {
               "keywords": [
                  "i", 
                  "me", 
                  "my", 
                  "myself", 
                  "we", 
                  "our", 
                  "ours", 
                  "ourselves", 
                  "you", 
                  "your", 
                  "yours", 
                  "yourself", 
                  "yourselves", 
                  "he", 
                  "him", 
                  "his", 
                  "himself", 
                  "she", 
                  "her", 
                  "hers", 
                  "herself", 
                  "it", 
                  "its", 
                  "itself", 
                  "they", 
                  "them", 
                  "their", 
                  "theirs", 
                  "themselves", 
                  "what", 
                  "which", 
                  "who", 
                  "whom", 
                  "this", 
                  "that", 
                  "these", 
                  "those", 
                  "am", 
                  "is", 
                  "are", 
                  "was", 
                  "were", 
                  "be", 
                  "been", 
                  "being", 
                  "have", 
                  "has", 
                  "had", 
                  "having", 
                  "do", 
                  "does", 
                  "did", 
                  "doing", 
                  "would", 
                  "should", 
                  "could", 
                  "ought", 
                  "i'm", 
                  "you're", 
                  "he's", 
                  "she's", 
                  "it's", 
                  "we're", 
                  "they're", 
                  "i've", 
                  "you've", 
                  "we've", 
                  "they've", 
                  "i'd", 
                  "you'd", 
                  "he'd", 
                  "she'd", 
                  "we'd", 
                  "they'd", 
                  "i'll", 
                  "you'll", 
                  "he'll", 
                  "she'll", 
                  "we'll", 
                  "they'll", 
                  "isn't", 
                  "aren't", 
                  "wasn't", 
                  "weren't", 
                  "hasn't", 
                  "haven't", 
                  "hadn't", 
                  "doesn't", 
                  "don't", 
                  "didn't", 
                  "won't", 
                  "wouldn't", 
                  "shan't", 
                  "shouldn't", 
                  "can't", 
                  "cannot", 
                  "couldn't", 
                  "mustn't", 
                  "let's", 
                  "that's", 
                  "who's", 
                  "what's", 
                  "here's", 
                  "there's", 
                  "when's", 
                  "where's", 
                  "why's", 
                  "how's", 
                  "a", 
                  "an", 
                  "the", 
                  "and", 
                  "but", 
                  "if", 
                  "or", 
                  "because", 
                  "as", 
                  "until", 
                  "while", 
                  "of", 
                  "at", 
                  "by", 
                  "for", 
                  "with", 
                  "about", 
                  "against", 
                  "between", 
                  "into", 
                  "through", 
                  "during", 
                  "before", 
                  "after", 
                  "above", 
                  "below", 
                  "to", 
                  "from", 
                  "up", 
                  "down", 
                  "in", 
                  "out", 
                  "on", 
                  "off", 
                  "over", 
                  "under", 
                  "again", 
                  "further", 
                  "then", 
                  "once", 
                  "here", 
                  "there", 
                  "when", 
                  "where", 
                  "why", 
                  "how", 
                  "all", 
                  "any", 
                  "both", 
                  "each", 
                  "few", 
                  "more", 
                  "most", 
                  "other", 
                  "some", 
                  "such", 
                  "no", 
                  "nor", 
                  "not", 
                  "only", 
                  "own", 
                  "same", 
                  "so", 
                  "than", 
                  "too", 
                  "very"
               ], 
               "type": "keyword_marker"
            }, 
            "shingle": {
               "token_separator": "", 
               "output_unigrams": "false", 
               "filler_token": "", 
               "output_unigrams_if_no_shingles": "false", 
               "min_shingle_size": 2, 
               "type": "shingle", 
               "max_shingle_size": 5
            }, 
            "stemmer_it_light": {
               "type": "stemmer", 
               "name": "light_italian"
            }, 
            "stemmer_fr_min": {
               "type": "stemmer", 
               "name": "minimal_french"
            }, 
            "length": {
               "max": 5, 
               "type": "length", 
               "min": 3
            }, 
            "back_edge_ngram": {
               "max_gram": 5, 
               "type": "edgeNGram", 
               "side": "back", 
               "min_gram": 3
            }, 
            "stopwords": {
               "stopwords": [
                  "i", 
                  "me", 
                  "my", 
                  "myself", 
                  "we", 
                  "our", 
                  "ours", 
                  "ourselves", 
                  "you", 
                  "your", 
                  "yours", 
                  "yourself", 
                  "yourselves", 
                  "he", 
                  "him", 
                  "his", 
                  "himself", 
                  "she", 
                  "her", 
                  "hers", 
                  "herself", 
                  "it", 
                  "its", 
                  "itself", 
                  "they", 
                  "them", 
                  "their", 
                  "theirs", 
                  "themselves", 
                  "what", 
                  "which", 
                  "who", 
                  "whom", 
                  "this", 
                  "that", 
                  "these", 
                  "those", 
                  "am", 
                  "is", 
                  "are", 
                  "was", 
                  "were", 
                  "be", 
                  "been", 
                  "being", 
                  "have", 
                  "has", 
                  "had", 
                  "having", 
                  "do", 
                  "does", 
                  "did", 
                  "doing", 
                  "would", 
                  "should", 
                  "could", 
                  "ought", 
                  "i'm", 
                  "you're", 
                  "he's", 
                  "she's", 
                  "it's", 
                  "we're", 
                  "they're", 
                  "i've", 
                  "you've", 
                  "we've", 
                  "they've", 
                  "i'd", 
                  "you'd", 
                  "he'd", 
                  "she'd", 
                  "we'd", 
                  "they'd", 
                  "i'll", 
                  "you'll", 
                  "he'll", 
                  "she'll", 
                  "we'll", 
                  "they'll", 
                  "isn't", 
                  "aren't", 
                  "wasn't", 
                  "weren't", 
                  "hasn't", 
                  "haven't", 
                  "hadn't", 
                  "doesn't", 
                  "don't", 
                  "didn't", 
                  "won't", 
                  "wouldn't", 
                  "shan't", 
                  "shouldn't", 
                  "can't", 
                  "cannot", 
                  "couldn't", 
                  "mustn't", 
                  "let's", 
                  "that's", 
                  "who's", 
                  "what's", 
                  "here's", 
                  "there's", 
                  "when's", 
                  "where's", 
                  "why's", 
                  "how's", 
                  "a", 
                  "an", 
                  "the", 
                  "and", 
                  "but", 
                  "if", 
                  "or", 
                  "because", 
                  "as", 
                  "until", 
                  "while", 
                  "of", 
                  "at", 
                  "by", 
                  "for", 
                  "with", 
                  "about", 
                  "against", 
                  "between", 
                  "into", 
                  "through", 
                  "during", 
                  "before", 
                  "after", 
                  "above", 
                  "below", 
                  "to", 
                  "from", 
                  "up", 
                  "down", 
                  "in", 
                  "out", 
                  "on", 
                  "off", 
                  "over", 
                  "under", 
                  "again", 
                  "further", 
                  "then", 
                  "once", 
                  "here", 
                  "there", 
                  "when", 
                  "where", 
                  "why", 
                  "how", 
                  "all", 
                  "any", 
                  "both", 
                  "each", 
                  "few", 
                  "more", 
                  "most", 
                  "other", 
                  "some", 
                  "such", 
                  "no", 
                  "nor", 
                  "not", 
                  "only", 
                  "own", 
                  "same", 
                  "so", 
                  "than", 
                  "too", 
                  "very"
               ], 
               "type": "stop"
            }
         }, 
         "char_filter": {
            "mapping": {
               "type": "mapping", 
               "mappings": [
                  "f => ph"
               ]
            }
         }, 
         "tokenizer": {
            "alphanumeric": {
               "pattern": "[^a-zA-Z0-9_]", 
               "type": "pattern"
            }
         }, 
         "analyzer": {
            "customAnalyzer1": {
               "filter": [
                  "shingle"
               ], 
               "char_filter": [
                  "mapping"
               ], 
               "tokenizer": "standard"
            }
         }
      }
   }
}
2016-09-15 12:17:31 | INFO | MainProcess | test_thread | [es_base.create_index_mapping] SUCCESS: ES index created with above mapping
2016-09-15 12:17:31 | INFO | MainProcess | test_thread | [task.__init__] Starting operation 'create' on Elastic Search ...
2016-09-15 12:17:34 | INFO | MainProcess | test_thread | [data_helper.direct_client] creating direct client 172.23.108.141:11210 default
2016-09-15 12:17:35 | INFO | MainProcess | ES_Thread  | [task.execute] 1000 documents bulk loaded into ES
2016-09-15 12:17:36 | INFO | MainProcess | ES_Thread  | [task.execute] ES index count for 'es_index': 1000
2016-09-15 12:17:39 | INFO | MainProcess | test_thread | [fts_base.load_data] Loading phase complete!
2016-09-15 12:17:45 | INFO | MainProcess | test_thread | [fts_base.wait_for_indexing_complete] Docs in bucket = 1000, docs in FTS index 'custom_index': 755, docs in ES index: 1000 
2016-09-15 12:17:56 | INFO | MainProcess | test_thread | [fts_base.wait_for_indexing_complete] Docs in bucket = 1000, docs in FTS index 'custom_index': 1000, docs in ES index: 1000 
2016-09-15 12:17:56 | INFO | MainProcess | test_thread | [fts_base.wait_for_indexing_complete] FTS indexed 1000 docs in 0.29 mins
Smart queries will be generated on fields: {'date': ['join_date'], 'text': ['manages_reports', 'name', 'languages_known'], 'num': ['mutated', 'salary', 'manages_team_size'], 'str': ['manages_reports', 'name', 'languages_known']}
2016-09-15 12:17:57 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 1 -----------------------------------------------------------------
2016-09-15 12:17:58 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "name", "match": "Trista Stewart"}, {"field": "manages.reports", "prefix": "Kag"}, {"inclusive_max": true, "field": "mutated", "max": 9877, "inclusive_min": true, "min": 4}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:17:59 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:17:59 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"conjuncts": [{"field": "name", "match": "Trista Stewart"}, {"field": "manages.reports", "prefix": "Kag"}, {"inclusive_max": true, "field": "mutated", "max": 9877, "inclusive_min": true, "min": 4}]} is 0 (took 13.98068ms)
2016-09-15 12:18:00 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must": [{"match": {"name": "Trista Stewart"}}, {"prefix": {"manages.reports": "Kag"}}, {"filtered": {"filter": {"range": {"mutated": {"gte": 4, "lte": 9877}}}}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:18:00 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:00 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 2 -----------------------------------------------------------------
2016-09-15 12:18:01 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Africans"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:02 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:02 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match": "Africans"} is 1 (took 5.114222ms)
2016-09-15 12:18:03 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"languages_known": "Africans"}} on es_index is 0 (took 1ms)
2016-09-15 12:18:03 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 1, while ES hits: 0
2016-09-15 12:18:03 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000154']
2016-09-15 12:18:03 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
2016-09-15 12:18:04 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Chinese"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:05 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:05 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match_phrase": "Chinese"} is 0 (took 23.08566ms)
2016-09-15 12:18:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"languages_known": "Chinese"}} on es_index is 0 (took 1ms)
2016-09-15 12:18:06 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 4 -----------------------------------------------------------------
2016-09-15 12:18:07 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Trista Robinson Sr."}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:08 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:08 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Trista Robinson Sr."}]}} is 20 (took 17.42654ms)
2016-09-15 12:18:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": {"match": {"name": "Trista Robinson Sr."}}}} on es_index is 18 (took 2ms)
2016-09-15 12:18:09 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 20, while ES hits: 18
2016-09-15 12:18:09 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 2 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000733', u'emp10000141']
2016-09-15 12:18:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 5 -----------------------------------------------------------------
2016-09-15 12:18:10 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.683608", "start": "1997-10-18T14:49:00"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:11 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:11 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.683608", "start": "1997-10-18T14:49:00"}]} is 2 (took 44.157022ms)
2016-09-15 12:18:12 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Dutch"}}, {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.683608", "gt": "1997-10-18T14:49:00"}}}}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:18:12 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 2, while ES hits: 0
2016-09-15 12:18:12 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 2 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000989', u'emp10000072']
2016-09-15 12:18:12 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 6 -----------------------------------------------------------------
2016-09-15 12:18:13 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Spanish"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:14 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:14 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match_phrase": "Spanish"} is 0 (took 14.955707ms)
2016-09-15 12:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"languages_known": "Spanish"}} on es_index is 0 (took 1ms)
2016-09-15 12:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 7 -----------------------------------------------------------------
2016-09-15 12:18:16 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:18 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:18 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match": "German"} is 3 (took 10.521948ms)
2016-09-15 12:18:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"languages_known": "German"}} on es_index is 0 (took 1ms)
2016-09-15 12:18:18 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 3, while ES hits: 0
2016-09-15 12:18:18 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 3 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000771', u'emp10000277', u'emp10000489']
2016-09-15 12:18:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 8 -----------------------------------------------------------------
2016-09-15 12:18:19 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "wildcard": "Sidoni? Wint? G?lli? D?bri?"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:21 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:21 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "wildcard": "Sidoni? Wint? G?lli? D?bri?"} is 0 (took 6.02806ms)
2016-09-15 12:18:22 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"manages.reports": "Sidoni? Wint? G?lli? D?bri?"}} on es_index is 0 (took 2ms)
2016-09-15 12:18:22 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:22 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 9 -----------------------------------------------------------------
2016-09-15 12:18:23 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "wildcard": "Druc*"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:24 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:24 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "name", "wildcard": "Druc*"} is 16 (took 4.77484ms)
2016-09-15 12:18:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"name": "Druc*"}} on es_index is 10 (took 1ms)
2016-09-15 12:18:25 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 16, while ES hits: 10
2016-09-15 12:18:25 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 6 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000968', u'emp10000484', u'emp10000507', u'emp10000345', u'emp10000340', u'emp10000387']
2016-09-15 12:18:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 10 -----------------------------------------------------------------
2016-09-15 12:18:26 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "Qu?chua"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:27 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:27 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "wildcard": "Qu?chua"} is 0 (took 12.33121ms)
2016-09-15 12:18:27 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"languages_known": "Qu?chua"}} on es_index is 0 (took 1ms)
2016-09-15 12:18:27 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:27 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 11 -----------------------------------------------------------------
2016-09-15 12:18:28 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.684212", "start": "2005-01-28T06:04:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:30 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:30 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.684212", "start": "2005-01-28T06:04:00"} is 171 (took 38.097821ms)
2016-09-15 12:18:32 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "2005-01-28T06:04:00", "lte": "2016-09-15T12:17:56.684212"}}}}} on es_index is 171 (took 6ms)
2016-09-15 12:18:32 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:32 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 12 -----------------------------------------------------------------
2016-09-15 12:18:33 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Portuguese"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:34 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:34 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match_phrase": "Portuguese"} is 0 (took 10.538808ms)
2016-09-15 12:18:34 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"languages_known": "Portuguese"}} on es_index is 0 (took 1ms)
2016-09-15 12:18:34 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:34 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 13 -----------------------------------------------------------------
2016-09-15 12:18:35 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"field": "languages_known", "match_phrase": "Arabic"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.684470", "start": "1964-09-24T10:16:00"}, {"inclusive_max": false, "field": "salary", "max": 129825.0, "inclusive_min": false, "min": 120000.0}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:37 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:37 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"field": "languages_known", "match_phrase": "Arabic"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.684470", "start": "1964-09-24T10:16:00"}, {"inclusive_max": false, "field": "salary", "max": 129825.0, "inclusive_min": false, "min": 120000.0}]} is 0 (took 62.403933ms)
2016-09-15 12:18:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Dutch"}}, {"match_phrase": {"languages_known": "Arabic"}}, {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.684470", "gt": "1964-09-24T10:16:00"}}}}}, {"filtered": {"filter": {"range": {"salary": {"lt": 129825.0, "gt": 120000.0}}}}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:18:37 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 14 -----------------------------------------------------------------
2016-09-15 12:18:38 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Kerry-Ann"}, {"field": "manages.reports", "match": "Cynara"}, {"field": "languages_known", "match": "Hindi"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:39 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:39 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "name", "match": "Kerry-Ann"}, {"field": "manages.reports", "match": "Cynara"}, {"field": "languages_known", "match": "Hindi"}]} is 18 (took 15.66004ms)
2016-09-15 12:18:40 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"name": "Kerry-Ann"}}, {"match": {"manages.reports": "Cynara"}}, {"match": {"languages_known": "Hindi"}}]}} on es_index is 18 (took 2ms)
2016-09-15 12:18:40 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:40 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 15 -----------------------------------------------------------------
2016-09-15 12:18:41 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "salary", "max": 63832.0, "inclusive_min": true, "min": 56000.0}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:44 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:44 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": true, "field": "salary", "max": 63832.0, "inclusive_min": true, "min": 56000.0} is 90 (took 11.723857ms)
2016-09-15 12:18:46 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"salary": {"gte": 56000.0, "lte": 63832.0}}}}} on es_index is 90 (took 4ms)
2016-09-15 12:18:46 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:46 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 16 -----------------------------------------------------------------
2016-09-15 12:18:47 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "-manages.team_size:<8"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:49 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:49 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "-manages.team_size:<8"} is 1000 (took 69.81144ms)
2016-09-15 12:18:52 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "-manages.team_size:<8"}} on es_index is 1000 (took 27ms)
2016-09-15 12:18:52 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:52 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 17 -----------------------------------------------------------------
2016-09-15 12:18:54 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "mutated", "max": 1202, "inclusive_min": false, "min": 4}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:18:55 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:18:55 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "mutated", "max": 1202, "inclusive_min": false, "min": 4} is 0 (took 44.16248ms)
2016-09-15 12:18:55 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"lt": 1202, "gt": 4}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:18:55 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:18:55 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 18 -----------------------------------------------------------------
2016-09-15 12:18:56 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "T"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:00 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:00 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "prefix": "T"} is 360 (took 44.500253ms)
2016-09-15 12:19:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"manages.reports": "T"}} on es_index is 189 (took 6ms)
2016-09-15 12:19:02 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 360, while ES hits: 189
2016-09-15 12:19:02 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 173 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000730', u'emp10000279', u'emp10000733', u'emp10000734', u'emp10000041', u'emp10000899', u'emp10000534', u'emp10000533', u'emp10000239', u'emp10000123', u'emp10000237', u'emp10000978', u'emp10000979', u'emp10000974', u'emp10000609', u'emp10000605', u'emp10000607', u'emp10000325', u'emp10000878', u'emp10000705', u'emp10000704', u'emp10000701', u'emp10000339', u'emp10000703', u'emp10000746', u'emp10000708', u'emp10000424', u'emp10000426', u'emp10000548', u'emp10000788', u'emp10000748', u'emp10000039', u'emp10000038', u'emp10000782', u'emp10000983', u'emp10000982', u'emp10000981', u'emp10000984', u'emp10001000', u'emp10000909', u'emp10000637', u'emp10000902', u'emp10000907', u'emp10000869', u'emp10000904', u'emp10000653', u'emp10000305', u'emp10000574', u'emp10000147', u'emp10000146']
2016-09-15 12:19:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 19 -----------------------------------------------------------------
2016-09-15 12:19:04 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "mutated", "max": 9374, "inclusive_min": false, "min": 4}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:05 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:05 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "mutated", "max": 9374, "inclusive_min": false, "min": 4} is 0 (took 39.569557ms)
2016-09-15 12:19:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"lt": 9374, "gt": 4}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:19:06 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 20 -----------------------------------------------------------------
2016-09-15 12:19:07 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "wildcard": "Amara Amara ?abria Ebony"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:09 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:09 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "wildcard": "Amara Amara ?abria Ebony"} is 0 (took 15.423717ms)
2016-09-15 12:19:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"manages.reports": "Amara Amara ?abria Ebony"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:09 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 21 -----------------------------------------------------------------
2016-09-15 12:19:11 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "match": "Thea"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:12 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:12 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "match": "Thea"}]} is 4 (took 15.747754ms)
2016-09-15 12:19:13 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Italian"}}, {"match": {"name": "Thea"}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:19:13 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 4, while ES hits: 0
2016-09-15 12:19:13 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 4 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000676', u'emp10000789', u'emp10000384', u'emp10000318']
2016-09-15 12:19:13 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 22 -----------------------------------------------------------------
2016-09-15 12:19:13 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "French"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:15 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:15 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match": "French"} is 0 (took 3.944512ms)
2016-09-15 12:19:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"languages_known": "French"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:15 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 23 -----------------------------------------------------------------
2016-09-15 12:19:16 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Italian"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:18 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:18 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match_phrase": "Italian"} is 0 (took 16.769193ms)
2016-09-15 12:19:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"languages_known": "Italian"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:18 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 24 -----------------------------------------------------------------
2016-09-15 12:19:19 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "salary", "max": 71215.0, "inclusive_min": true, "min": 62000.0}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:21 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:21 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": true, "field": "salary", "max": 71215.0, "inclusive_min": true, "min": 62000.0} is 92 (took 20.859913ms)
2016-09-15 12:19:22 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"salary": {"gte": 62000.0, "lte": 71215.0}}}}} on es_index is 92 (took 6ms)
2016-09-15 12:19:22 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:22 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 25 -----------------------------------------------------------------
2016-09-15 12:19:23 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "salary", "max": 96692.0, "inclusive_min": true, "min": 91000.0}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:25 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:25 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": true, "field": "salary", "max": 96692.0, "inclusive_min": true, "min": 91000.0} is 65 (took 22.544721ms)
2016-09-15 12:19:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"salary": {"gte": 91000.0, "lte": 96692.0}}}}} on es_index is 65 (took 3ms)
2016-09-15 12:19:25 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 26 -----------------------------------------------------------------
2016-09-15 12:19:27 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Gallia"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:28 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:28 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "name", "match": "Gallia"} is 1 (took 5.24635ms)
2016-09-15 12:19:28 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"name": "Gallia"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:28 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 1, while ES hits: 0
2016-09-15 12:19:28 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000788']
2016-09-15 12:19:28 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 27 -----------------------------------------------------------------
2016-09-15 12:19:29 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "wildcard": "Deirdre Alarice Cy?heria"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:30 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:30 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "wildcard": "Deirdre Alarice Cy?heria"} is 0 (took 6.948068ms)
2016-09-15 12:19:31 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"manages.reports": "Deirdre Alarice Cy?heria"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:31 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:31 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 28 -----------------------------------------------------------------
2016-09-15 12:19:32 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Casondrah Campbell"}, {"field": "languages_known", "match": "Chinese"}]}, "must_not": {"disjuncts": [{"field": "name", "match": "Riona Davis"}]}, "must": {"conjuncts": [{"field": "name", "match": "Wright"}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:33 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:33 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Casondrah Campbell"}, {"field": "languages_known", "match": "Chinese"}]}, "must_not": {"disjuncts": [{"field": "name", "match": "Riona Davis"}]}, "must": {"conjuncts": [{"field": "name", "match": "Wright"}]}} is 0 (took 14.349365ms)
2016-09-15 12:19:34 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"name": "Casondrah Campbell"}}, {"match": {"languages_known": "Chinese"}}], "must_not": {"match": {"name": "Riona Davis"}}, "must": {"match": {"name": "Wright"}}}} on es_index is 0 (took 1ms)
2016-09-15 12:19:34 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:34 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 29 -----------------------------------------------------------------
2016-09-15 12:19:35 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Quechua"}, {"field": "manages.reports", "prefix": "Cia"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.686052", "start": "2000-11-14T07:28:00"}, {"inclusive_max": true, "field": "manages.team_size", "max": 1890, "inclusive_min": true, "min": 9}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:36 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:36 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Quechua"}, {"field": "manages.reports", "prefix": "Cia"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.686052", "start": "2000-11-14T07:28:00"}, {"inclusive_max": true, "field": "manages.team_size", "max": 1890, "inclusive_min": true, "min": 9}]} is 0 (took 41.111268ms)
2016-09-15 12:19:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Quechua"}}, {"prefix": {"manages.reports": "Cia"}}, {"filtered": {"filter": {"range": {"join_date": {"gte": "2000-11-14T07:28:00", "lte": "2016-09-15T12:17:56.686052"}}}}}, {"filtered": {"filter": {"range": {"manages.team_size": {"gte": 9, "lte": 1890}}}}}]}} on es_index is 0 (took 2ms)
2016-09-15 12:19:37 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 30 -----------------------------------------------------------------
2016-09-15 12:19:38 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:39 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:39 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match": "German"} is 6 (took 7.358345ms)
2016-09-15 12:19:40 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"languages_known": "German"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:40 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 6, while ES hits: 0
2016-09-15 12:19:40 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 6 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000098', u'emp10000020', u'emp10000578', u'emp10000553', u'emp10000248', u'emp10000938']
2016-09-15 12:19:40 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 31 -----------------------------------------------------------------
2016-09-15 12:19:41 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Cassandra Russell"}, {"field": "manages.reports", "match": "Jerica Antonia Araceli Kerry"}, {"field": "languages_known", "match": "Arabic"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:42 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:42 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "name", "match": "Cassandra Russell"}, {"field": "manages.reports", "match": "Jerica Antonia Araceli Kerry"}, {"field": "languages_known", "match": "Arabic"}]} is 2 (took 11.842992ms)
2016-09-15 12:19:42 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"name": "Cassandra Russell"}}, {"match": {"manages.reports": "Jerica Antonia Araceli Kerry"}}, {"match": {"languages_known": "Arabic"}}]}} on es_index is 1 (took 2ms)
2016-09-15 12:19:42 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 2, while ES hits: 1
2016-09-15 12:19:42 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000985']
2016-09-15 12:19:42 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 32 -----------------------------------------------------------------
2016-09-15 12:19:45 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Hindi"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:46 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:46 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match": "Hindi"} is 4 (took 7.680705ms)
2016-09-15 12:19:47 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"languages_known": "Hindi"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:47 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 4, while ES hits: 0
2016-09-15 12:19:47 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 4 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000677', u'emp10000658', u'emp10000510', u'emp10000986']
2016-09-15 12:19:47 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 33 -----------------------------------------------------------------
2016-09-15 12:19:48 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Casondrah"}, {"field": "manages.reports", "match": "Quella Kerry Araceli"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:49 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:49 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "name", "match": "Casondrah"}, {"field": "manages.reports", "match": "Quella Kerry Araceli"}]} is 0 (took 17.03738ms)
2016-09-15 12:19:49 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"name": "Casondrah"}}, {"match": {"manages.reports": "Quella Kerry Araceli"}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:19:49 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:49 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 34 -----------------------------------------------------------------
2016-09-15 12:19:51 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "manages.team_size", "max": 2064, "inclusive_min": false, "min": 5}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:52 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:52 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "manages.team_size", "max": 2064, "inclusive_min": false, "min": 5} is 0 (took 48.485336ms)
2016-09-15 12:19:52 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"lt": 2064, "gt": 5}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:19:52 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:52 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 35 -----------------------------------------------------------------
2016-09-15 12:19:54 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "Portugue*"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:56 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:56 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "wildcard": "Portugue*"} is 125 (took 21.866984ms)
2016-09-15 12:19:56 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"languages_known": "Portugue*"}} on es_index is 0 (took 1ms)
2016-09-15 12:19:56 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 125, while ES hits: 0
2016-09-15 12:19:56 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 125 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000536', u'emp10000530', u'emp10000437', u'emp10000124', u'emp10000434', u'emp10000121', u'emp10000236', u'emp10000230', u'emp10000438', u'emp10000600', u'emp10000705', u'emp10000272', u'emp10000339', u'emp10000006', u'emp10000336', u'emp10000708', u'emp10000332', u'emp10000032', u'emp10000420', u'emp10000788', u'emp10000542', u'emp10000039', u'emp10000229', u'emp10000983', u'emp10001000', u'emp10000631', u'emp10000636', u'emp10000905', u'emp10000305', u'emp10000417', u'emp10000254', u'emp10000797', u'emp10000551', u'emp10000259', u'emp10000557', u'emp10000994', u'emp10000999', u'emp10000647', u'emp10000626', u'emp10000910', u'emp10000404', u'emp10000917', u'emp10000640', u'emp10000317', u'emp10000314', u'emp10000312', u'emp10000311', u'emp10000406', u'emp10000156', u'emp10000400']
2016-09-15 12:19:56 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 36 -----------------------------------------------------------------
2016-09-15 12:19:57 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "name", "match": "Lilith Gerónimo"}, {"field": "languages_known", "prefix": "It"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:19:58 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:19:58 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"conjuncts": [{"field": "name", "match": "Lilith Gerónimo"}, {"field": "languages_known", "prefix": "It"}]} is 0 (took 15.92022ms)
2016-09-15 12:19:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must": [{"match": {"name": "Lilith Gerónimo"}}, {"prefix": {"languages_known": "It"}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:19:59 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:19:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 37 -----------------------------------------------------------------
2016-09-15 12:20:00 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "salary", "max": 136186.0, "inclusive_min": false, "min": 129000.0}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:01 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:01 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "salary", "max": 136186.0, "inclusive_min": false, "min": 129000.0} is 76 (took 43.738244ms)
2016-09-15 12:20:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"salary": {"lt": 136186.0, "gt": 129000.0}}}}} on es_index is 76 (took 4ms)
2016-09-15 12:20:02 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 38 -----------------------------------------------------------------
2016-09-15 12:20:04 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match_phrase": "Basha Kagami"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:05 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:05 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match_phrase": "Basha Kagami"} is 0 (took 13.889402ms)
2016-09-15 12:20:05 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"manages.reports": "Basha Kagami"}} on es_index is 0 (took 1ms)
2016-09-15 12:20:05 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:05 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 39 -----------------------------------------------------------------
2016-09-15 12:20:06 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Lucr"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:08 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:08 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "prefix": "Lucr"} is 58 (took 17.948566ms)
2016-09-15 12:20:08 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"manages.reports": "Lucr"}} on es_index is 57 (took 2ms)
2016-09-15 12:20:08 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 58, while ES hits: 57
2016-09-15 12:20:08 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000727']
2016-09-15 12:20:08 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 40 -----------------------------------------------------------------
2016-09-15 12:20:10 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "prefix": "Afri"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:11 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:11 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "prefix": "Afri"} is 0 (took 5.101038ms)
2016-09-15 12:20:11 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"languages_known": "Afri"}} on es_index is 0 (took 1ms)
2016-09-15 12:20:11 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:11 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 41 -----------------------------------------------------------------
2016-09-15 12:20:12 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.687265", "start": "1987-06-10T19:48:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:15 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:15 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.687265", "start": "1987-06-10T19:48:00"} is 434 (took 44.090348ms)
2016-09-15 12:20:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.687265", "gt": "1987-06-10T19:48:00"}}}}} on es_index is 434 (took 13ms)
2016-09-15 12:20:18 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 42 -----------------------------------------------------------------
2016-09-15 12:20:19 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Quella Martin"}, {"field": "manages.reports", "match": "Antonia Joby"}, {"field": "manages.reports", "match": "Maura Lilith Cassandra Ambika"}]}, "must": {"conjuncts": [{"field": "manages.reports", "match": "Sirena Tempest Keelia"}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:20 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:20 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Quella Martin"}, {"field": "manages.reports", "match": "Antonia Joby"}, {"field": "manages.reports", "match": "Maura Lilith Cassandra Ambika"}]}, "must": {"conjuncts": [{"field": "manages.reports", "match": "Sirena Tempest Keelia"}]}} is 0 (took 9.932578ms)
2016-09-15 12:20:20 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"name": "Quella Martin"}}, {"match": {"manages.reports": "Antonia Joby"}}, {"match": {"manages.reports": "Maura Lilith Cassandra Ambika"}}], "must": {"match": {"manages.reports": "Sirena Tempest Keelia"}}}} on es_index is 0 (took 1ms)
2016-09-15 12:20:20 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:20 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 43 -----------------------------------------------------------------
2016-09-15 12:20:22 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.687607", "start": "1989-02-06T02:49:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:24 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:24 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.687607", "start": "1989-02-06T02:49:00"} is 411 (took 37.994439ms)
2016-09-15 12:20:26 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1989-02-06T02:49:00", "lte": "2016-09-15T12:17:56.687607"}}}}} on es_index is 411 (took 17ms)
2016-09-15 12:20:26 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:26 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 44 -----------------------------------------------------------------
2016-09-15 12:20:27 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Urdu"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:28 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:28 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "match_phrase": "Urdu"} is 0 (took 5.83175ms)
2016-09-15 12:20:29 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"languages_known": "Urdu"}} on es_index is 0 (took 1ms)
2016-09-15 12:20:29 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:29 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 45 -----------------------------------------------------------------
2016-09-15 12:20:30 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "-salary:>76000.0"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:32 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:32 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "-salary:>76000.0"} is 270 (took 123.818362ms)
2016-09-15 12:20:34 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "-salary:>76000.0"}} on es_index is 270 (took 8ms)
2016-09-15 12:20:34 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:34 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 46 -----------------------------------------------------------------
2016-09-15 12:20:35 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "mutated:<=2 -languages_known:\"Quechua\" -manages.reports:\"Sidonia Safiya Winta\""}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:39 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:39 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "mutated:<=2 -languages_known:\"Quechua\" -manages.reports:\"Sidonia Safiya Winta\""} is 1000 (took 30.88885ms)
2016-09-15 12:20:46 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "mutated:<=2 -languages_known:\"Quechua\" -manages.reports:\"Sidonia Safiya Winta\""}} on es_index is 1000 (took 40ms)
2016-09-15 12:20:46 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:46 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 47 -----------------------------------------------------------------
2016-09-15 12:20:47 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.688060", "start": "1964-05-27T21:49:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:20:51 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:20:51 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.688060", "start": "1964-05-27T21:49:00"} is 784 (took 45.548809ms)
2016-09-15 12:20:58 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.688060", "gt": "1964-05-27T21:49:00"}}}}} on es_index is 784 (took 20ms)
2016-09-15 12:20:58 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:20:58 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 48 -----------------------------------------------------------------
2016-09-15 12:21:00 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "Japane?e"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:01 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:01 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "wildcard": "Japane?e"} is 0 (took 14.915431ms)
2016-09-15 12:21:01 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"languages_known": "Japane?e"}} on es_index is 0 (took 1ms)
2016-09-15 12:21:01 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:21:01 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 49 -----------------------------------------------------------------
2016-09-15 12:21:03 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "wildcard": "*"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:20 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:20 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "name", "wildcard": "*"} is 1000 (took 141.419546ms)
2016-09-15 12:21:30 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"name": "*"}} on es_index is 1000 (took 22ms)
2016-09-15 12:21:30 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:21:30 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 50 -----------------------------------------------------------------
2016-09-15 12:21:31 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "manages.reports", "match": "Adena"}, {"field": "languages_known", "prefix": "Mala"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.688412", "start": "1975-07-01T02:47:00"}, {"inclusive_max": true, "field": "salary", "max": 62265.0, "inclusive_min": true, "min": 58000.0}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:32 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:32 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"conjuncts": [{"field": "manages.reports", "match": "Adena"}, {"field": "languages_known", "prefix": "Mala"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.688412", "start": "1975-07-01T02:47:00"}, {"inclusive_max": true, "field": "salary", "max": 62265.0, "inclusive_min": true, "min": 58000.0}]} is 0 (took 43.406333ms)
2016-09-15 12:21:33 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must": [{"match": {"manages.reports": "Adena"}}, {"prefix": {"languages_known": "Mala"}}, {"filtered": {"filter": {"range": {"join_date": {"gte": "1975-07-01T02:47:00", "lte": "2016-09-15T12:17:56.688412"}}}}}, {"filtered": {"filter": {"range": {"salary": {"gte": 58000.0, "lte": 62265.0}}}}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:21:33 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:21:33 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 51 -----------------------------------------------------------------
2016-09-15 12:21:34 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.688636", "start": "1990-10-14T18:23:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:37 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:37 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.688636", "start": "1990-10-14T18:23:00"} is 387 (took 39.065266ms)
2016-09-15 12:21:40 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1990-10-14T18:23:00", "lte": "2016-09-15T12:17:56.688636"}}}}} on es_index is 387 (took 16ms)
2016-09-15 12:21:40 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:21:40 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 52 -----------------------------------------------------------------
2016-09-15 12:21:41 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.688782", "start": "1951-11-21T07:34:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:45 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:45 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.688782", "start": "1951-11-21T07:34:00"} is 963 (took 51.518802ms)
2016-09-15 12:21:51 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.688782", "gt": "1951-11-21T07:34:00"}}}}} on es_index is 963 (took 26ms)
2016-09-15 12:21:51 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:21:51 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 53 -----------------------------------------------------------------
2016-09-15 12:21:52 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Africans"}, {"field": "name", "match": "Mercedes"}, {"field": "manages.reports", "match": "Chatha Lucretia Deirdre Thea"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:53 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:53 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Africans"}, {"field": "name", "match": "Mercedes"}, {"field": "manages.reports", "match": "Chatha Lucretia Deirdre Thea"}]} is 3 (took 12.208315ms)
2016-09-15 12:21:54 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Africans"}}, {"match": {"name": "Mercedes"}}, {"match": {"manages.reports": "Chatha Lucretia Deirdre Thea"}}]}} on es_index is 0 (took 2ms)
2016-09-15 12:21:54 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 3, while ES hits: 0
2016-09-15 12:21:54 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 3 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000469', u'emp10000331', u'emp10000924']
2016-09-15 12:21:54 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 54 -----------------------------------------------------------------
2016-09-15 12:21:55 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "languages_known", "match": "Chinese"}, {"field": "manages.reports", "match": "Drucilla Kallie Devi Alarice"}, {"field": "name", "match": "Adena Ward"}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:56 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:56 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"should": {"disjuncts": [{"field": "languages_known", "match": "Chinese"}, {"field": "manages.reports", "match": "Drucilla Kallie Devi Alarice"}, {"field": "name", "match": "Adena Ward"}]}} is 0 (took 7.331845ms)
2016-09-15 12:21:57 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Chinese"}}, {"match": {"manages.reports": "Drucilla Kallie Devi Alarice"}}, {"match": {"name": "Adena Ward"}}]}} on es_index is 0 (took 2ms)
2016-09-15 12:21:57 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:21:57 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 55 -----------------------------------------------------------------
2016-09-15 12:21:58 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "mutated", "max": 6495, "inclusive_min": false, "min": 4}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:21:59 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:21:59 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "mutated", "max": 6495, "inclusive_min": false, "min": 4} is 0 (took 29.407283ms)
2016-09-15 12:21:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"lt": 6495, "gt": 4}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:21:59 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:21:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 56 -----------------------------------------------------------------
2016-09-15 12:22:00 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "prefix": "Ara"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:02 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:02 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "name", "prefix": "Ara"} is 129 (took 8.304331ms)
2016-09-15 12:22:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"name": "Ara"}} on es_index is 15 (took 2ms)
2016-09-15 12:22:02 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 129, while ES hits: 15
2016-09-15 12:22:02 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 114 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000733', u'emp10000328', u'emp10000327', u'emp10000323', u'emp10000322', u'emp10000437', u'emp10000124', u'emp10000120', u'emp10000974', u'emp10000874', u'emp10000604', u'emp10000878', u'emp10000138', u'emp10000139', u'emp10000130', u'emp10000549', u'emp10000030', u'emp10000037', u'emp10000421', u'emp10000034', u'emp10000787', u'emp10000428', u'emp10000780', u'emp10000782', u'emp10000981', u'emp10000986', u'emp10000636', u'emp10000869', u'emp10000432', u'emp10000308', u'emp10000413', u'emp10000255', u'emp10000794', u'emp10000028', u'emp10000383', u'emp10000854', u'emp10000856', u'emp10000627', u'emp10000310', u'emp10000404', u'emp10000403', u'emp10000318', u'emp10000319', u'emp10000396', u'emp10000560', u'emp10000842', u'emp10000090', u'emp10000490', u'emp10000711', u'emp10000160']
2016-09-15 12:22:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 57 -----------------------------------------------------------------
2016-09-15 12:22:04 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "-languages_known:\"German\""}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:07 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:07 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "-languages_known:\"German\""} is 1000 (took 69.916001ms)
2016-09-15 12:22:07 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "-languages_known:\"German\""}} on es_index is 0 (took 1ms)
2016-09-15 12:22:07 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 1000, while ES hits: 0
2016-09-15 12:22:07 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1000 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000538', u'emp10000539', u'emp10000536', u'emp10000537', u'emp10000534', u'emp10000535', u'emp10000532', u'emp10000533', u'emp10000530', u'emp10000531', u'emp10000125', u'emp10000124', u'emp10000127', u'emp10000126', u'emp10000121', u'emp10000120', u'emp10000123', u'emp10000122', u'emp10000129', u'emp10000128', u'emp10000439', u'emp10000438', u'emp10000472', u'emp10000509', u'emp10000508', u'emp10000620', u'emp10000471', u'emp10000222', u'emp10000223', u'emp10000220', u'emp10000221', u'emp10000226', u'emp10000227', u'emp10000224', u'emp10000225', u'emp10000543', u'emp10000542', u'emp10000228', u'emp10000540', u'emp10000547', u'emp10000546', u'emp10000545', u'emp10000544', u'emp10000983', u'emp10000982', u'emp10000981', u'emp10000980', u'emp10000987', u'emp10000986', u'emp10000985']
2016-09-15 12:22:07 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 58 -----------------------------------------------------------------
2016-09-15 12:22:09 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match_phrase": "Perdita Tempest Severin Killian"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:10 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:10 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match_phrase": "Perdita Tempest Severin Killian"} is 0 (took 7.557801ms)
2016-09-15 12:22:10 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"manages.reports": "Perdita Tempest Severin Killian"}} on es_index is 0 (took 1ms)
2016-09-15 12:22:10 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:10 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 59 -----------------------------------------------------------------
2016-09-15 12:22:11 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "prefix": "F"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.689594", "start": "1982-11-27T15:34:00"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:12 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:12 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "prefix": "F"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.689594", "start": "1982-11-27T15:34:00"}]} is 0 (took 53.856398ms)
2016-09-15 12:22:13 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Italian"}}, {"prefix": {"name": "F"}}, {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.689594", "gt": "1982-11-27T15:34:00"}}}}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:22:13 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:13 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 60 -----------------------------------------------------------------
2016-09-15 12:22:14 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Thai"}, {"field": "languages_known", "match": "Vietnamese"}, {"field": "manages.reports", "match": "Duvessa"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:15 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:15 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Thai"}, {"field": "languages_known", "match": "Vietnamese"}, {"field": "manages.reports", "match": "Duvessa"}]} is 12 (took 8.94018ms)
2016-09-15 12:22:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Thai"}}, {"match": {"languages_known": "Vietnamese"}}, {"match": {"manages.reports": "Duvessa"}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:22:15 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 12, while ES hits: 0
2016-09-15 12:22:15 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 12 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000087', u'emp10000888', u'emp10000294', u'emp10000899', u'emp10000186', u'emp10000071', u'emp10000802', u'emp10000209', u'emp10000435', u'emp10000876', u'emp10000567', u'emp10000905']
2016-09-15 12:22:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 61 -----------------------------------------------------------------
2016-09-15 12:22:17 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "?ortuguese"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:18 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:18 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "languages_known", "wildcard": "?ortuguese"} is 0 (took 33.053281ms)
2016-09-15 12:22:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"wildcard": {"languages_known": "?ortuguese"}} on es_index is 0 (took 1ms)
2016-09-15 12:22:18 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 62 -----------------------------------------------------------------
2016-09-15 12:22:19 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"must_not": {"disjuncts": [{"field": "name", "match": "Riona"}, {"field": "name", "match": "Juan José"}]}, "should": {"disjuncts": [{"field": "name", "match": "Delores Johnson"}, {"field": "name", "match": "Riona Adams"}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:21 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:21 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"must_not": {"disjuncts": [{"field": "name", "match": "Riona"}, {"field": "name", "match": "Juan José"}]}, "should": {"disjuncts": [{"field": "name", "match": "Delores Johnson"}, {"field": "name", "match": "Riona Adams"}]}} is 3 (took 12.247498ms)
2016-09-15 12:22:21 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must_not": [{"match": {"name": "Riona"}}, {"match": {"name": "Juan José"}}], "should": [{"match": {"name": "Delores Johnson"}}, {"match": {"name": "Riona Adams"}}]}} on es_index is 2 (took 1ms)
2016-09-15 12:22:21 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 3, while ES hits: 2
2016-09-15 12:22:21 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000181']
2016-09-15 12:22:21 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 63 -----------------------------------------------------------------
2016-09-15 12:22:22 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Ker"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:24 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:24 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "prefix": "Ker"} is 106 (took 8.934011ms)
2016-09-15 12:22:26 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"manages.reports": "Ker"}} on es_index is 96 (took 5ms)
2016-09-15 12:22:26 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 106, while ES hits: 96
2016-09-15 12:22:26 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 10 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000081', u'emp10000328', u'emp10000410', u'emp10000898', u'emp10000152', u'emp10000261', u'emp10000442', u'emp10000367', u'emp10000237', u'emp10000554']
2016-09-15 12:22:26 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 64 -----------------------------------------------------------------
2016-09-15 12:22:27 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Thea Casondrah Basha"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:28 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:28 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match": "Thea Casondrah Basha"} is 0 (took 4.84822ms)
2016-09-15 12:22:29 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"manages.reports": "Thea Casondrah Basha"}} on es_index is 0 (took 1ms)
2016-09-15 12:22:29 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:29 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 65 -----------------------------------------------------------------
2016-09-15 12:22:30 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "manages.reports", "match": "Desdomna Gabi Dabria Thea"}, {"field": "languages_known", "match": "Japanese"}, {"field": "manages.reports", "match": "Antonia Kacila Beryl Sirena"}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:31 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:31 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"should": {"disjuncts": [{"field": "manages.reports", "match": "Desdomna Gabi Dabria Thea"}, {"field": "languages_known", "match": "Japanese"}, {"field": "manages.reports", "match": "Antonia Kacila Beryl Sirena"}]}} is 0 (took 17.690393ms)
2016-09-15 12:22:32 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"manages.reports": "Desdomna Gabi Dabria Thea"}}, {"match": {"languages_known": "Japanese"}}, {"match": {"manages.reports": "Antonia Kacila Beryl Sirena"}}]}} on es_index is 0 (took 2ms)
2016-09-15 12:22:32 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:32 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 66 -----------------------------------------------------------------
2016-09-15 12:22:35 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Mercedes"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:36 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:36 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match": "Mercedes"} is 0 (took 5.477383ms)
2016-09-15 12:22:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"manages.reports": "Mercedes"}} on es_index is 0 (took 1ms)
2016-09-15 12:22:37 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 67 -----------------------------------------------------------------
2016-09-15 12:22:38 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.690533", "start": "1953-02-01T01:04:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:42 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:42 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.690533", "start": "1953-02-01T01:04:00"} is 939 (took 42.893893ms)
2016-09-15 12:22:47 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.690533", "gt": "1953-02-01T01:04:00"}}}}} on es_index is 939 (took 23ms)
2016-09-15 12:22:47 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:47 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 68 -----------------------------------------------------------------
2016-09-15 12:22:48 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.690684", "start": "2012-08-09T08:14:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:49 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:49 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.690684", "start": "2012-08-09T08:14:00"} is 59 (took 28.911246ms)
2016-09-15 12:22:52 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "2012-08-09T08:14:00", "lte": "2016-09-15T12:17:56.690684"}}}}} on es_index is 59 (took 4ms)
2016-09-15 12:22:52 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:22:52 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 69 -----------------------------------------------------------------
2016-09-15 12:22:53 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Du"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:22:55 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:22:55 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "prefix": "Du"} is 87 (took 8.394125ms)
2016-09-15 12:22:56 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"manages.reports": "Du"}} on es_index is 44 (took 3ms)
2016-09-15 12:22:56 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 87, while ES hits: 44
2016-09-15 12:22:56 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 43 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000653', u'emp10000163', u'emp10000009', u'emp10000297', u'emp10000307', u'emp10000325', u'emp10000535', u'emp10000276', u'emp10000257', u'emp10000360', u'emp10000512', u'emp10000382', u'emp10000214', u'emp10000896', u'emp10000891', u'emp10000852', u'emp10000626', u'emp10000936', u'emp10000951', u'emp10000910', u'emp10000837', u'emp10000534', u'emp10000316', u'emp10000281', u'emp10000282', u'emp10000067', u'emp10000057', u'emp10000199', u'emp10000132', u'emp10000076', u'emp10000157', u'emp10000114', u'emp10000682', u'emp10000359', u'emp10000558', u'emp10000985', u'emp10000847', u'emp10000490', u'emp10000694', u'emp10000599', u'emp10000805', u'emp10000666', u'emp10000868']
2016-09-15 12:22:56 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 70 -----------------------------------------------------------------
2016-09-15 12:22:57 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.690897", "start": "1981-12-23T06:33:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:00 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:00 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.690897", "start": "1981-12-23T06:33:00"} is 501 (took 44.206515ms)
2016-09-15 12:23:03 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1981-12-23T06:33:00", "lte": "2016-09-15T12:17:56.690897"}}}}} on es_index is 501 (took 16ms)
2016-09-15 12:23:03 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:03 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 71 -----------------------------------------------------------------
2016-09-15 12:23:04 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "manages.team_size", "max": 1865, "inclusive_min": false, "min": 10}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:06 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:06 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "manages.team_size", "max": 1865, "inclusive_min": false, "min": 10} is 0 (took 41.406368ms)
2016-09-15 12:23:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"lt": 1865, "gt": 10}}}}} on es_index is 0 (took 5ms)
2016-09-15 12:23:06 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 72 -----------------------------------------------------------------
2016-09-15 12:23:07 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"must_not": {"disjuncts": [{"field": "name", "match": "Fuscienne Howard Jr."}]}, "should": {"disjuncts": [{"field": "manages.reports", "match": "Fantine Fuscienne Cassandra Araceli"}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:08 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:08 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"must_not": {"disjuncts": [{"field": "name", "match": "Fuscienne Howard Jr."}]}, "should": {"disjuncts": [{"field": "manages.reports", "match": "Fantine Fuscienne Cassandra Araceli"}]}} is 1 (took 9.105752ms)
2016-09-15 12:23:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"must_not": {"match": {"name": "Fuscienne Howard Jr."}}, "should": {"match": {"manages.reports": "Fantine Fuscienne Cassandra Araceli"}}}} on es_index is 0 (took 1ms)
2016-09-15 12:23:09 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 1, while ES hits: 0
2016-09-15 12:23:09 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000568']
2016-09-15 12:23:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 73 -----------------------------------------------------------------
2016-09-15 12:23:10 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Kory Robinson Sr."}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:12 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:12 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "name", "match": "Kory Robinson Sr."} is 18 (took 7.948853ms)
2016-09-15 12:23:12 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"name": "Kory Robinson Sr."}} on es_index is 18 (took 2ms)
2016-09-15 12:23:12 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:12 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 74 -----------------------------------------------------------------
2016-09-15 12:23:13 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "languages_known:\"Dutch\" -mutated:>5 +mutated:<=9 mutated:>1 +mutated:<8715"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:17 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:17 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "languages_known:\"Dutch\" -mutated:>5 +mutated:<=9 mutated:>1 +mutated:<8715"} is 1000 (took 99.762891ms)
2016-09-15 12:23:22 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "languages_known:\"Dutch\" -mutated:>5 +mutated:<=9 mutated:>1 +mutated:<8715"}} on es_index is 1000 (took 22ms)
2016-09-15 12:23:22 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:22 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 75 -----------------------------------------------------------------
2016-09-15 12:23:23 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Jerica Thomas"}, {"field": "languages_known", "match": "Italian"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:24 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:24 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "name", "match": "Jerica Thomas"}, {"field": "languages_known", "match": "Italian"}]} is 1 (took 9.996294ms)
2016-09-15 12:23:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"name": "Jerica Thomas"}}, {"match": {"languages_known": "Italian"}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:23:25 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 1, while ES hits: 0
2016-09-15 12:23:25 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000554']
2016-09-15 12:23:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 76 -----------------------------------------------------------------
2016-09-15 12:23:27 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Jerica Wood"}, {"field": "name", "match": "Lysha Gerónimo"}]}}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:28 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:28 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Jerica Wood"}, {"field": "name", "match": "Lysha Gerónimo"}]}} is 0 (took 10.491364ms)
2016-09-15 12:23:28 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"name": "Jerica Wood"}}, {"match": {"name": "Lysha Gerónimo"}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:23:28 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:28 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 77 -----------------------------------------------------------------
2016-09-15 12:23:29 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.692223", "start": "1988-02-04T02:24:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:32 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:32 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.692223", "start": "1988-02-04T02:24:00"} is 425 (took 52.129912ms)
2016-09-15 12:23:35 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.692223", "gt": "1988-02-04T02:24:00"}}}}} on es_index is 425 (took 12ms)
2016-09-15 12:23:35 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:35 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 78 -----------------------------------------------------------------
2016-09-15 12:23:36 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "manages.team_size", "max": 4735, "inclusive_min": false, "min": 7}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:37 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:37 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "manages.team_size", "max": 4735, "inclusive_min": false, "min": 7} is 0 (took 23.650076ms)
2016-09-15 12:23:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"lt": 4735, "gt": 7}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:23:37 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:37 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 79 -----------------------------------------------------------------
2016-09-15 12:23:39 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.692471", "start": "1983-06-27T10:08:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:42 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:42 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.692471", "start": "1983-06-27T10:08:00"} is 482 (took 46.836371ms)
2016-09-15 12:23:44 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.692471", "gt": "1983-06-27T10:08:00"}}}}} on es_index is 482 (took 14ms)
2016-09-15 12:23:44 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:23:44 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 80 -----------------------------------------------------------------
2016-09-15 12:23:45 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "manages.reports", "match": "Sidonia Adara"}, {"field": "name", "match": "Killian Davis"}, {"field": "languages_known", "match": "Portuguese"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:46 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:46 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "manages.reports", "match": "Sidonia Adara"}, {"field": "name", "match": "Killian Davis"}, {"field": "languages_known", "match": "Portuguese"}]} is 3 (took 6.461654ms)
2016-09-15 12:23:47 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"manages.reports": "Sidonia Adara"}}, {"match": {"name": "Killian Davis"}}, {"match": {"languages_known": "Portuguese"}}]}} on es_index is 1 (took 2ms)
2016-09-15 12:23:47 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 3, while ES hits: 1
2016-09-15 12:23:47 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 2 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000723', u'emp10000748']
2016-09-15 12:23:47 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 81 -----------------------------------------------------------------
2016-09-15 12:23:48 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Cyn"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:49 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:49 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "prefix": "Cyn"} is 43 (took 20.789607ms)
2016-09-15 12:23:50 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"manages.reports": "Cyn"}} on es_index is 38 (took 3ms)
2016-09-15 12:23:50 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 43, while ES hits: 38
2016-09-15 12:23:50 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 5 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000529', u'emp10000187', u'emp10000145', u'emp10000210', u'emp10000456']
2016-09-15 12:23:50 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 82 -----------------------------------------------------------------
2016-09-15 12:23:51 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.692859", "start": "1959-07-06T10:42:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:23:56 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:23:56 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.692859", "start": "1959-07-06T10:42:00"} is 855 (took 44.154262ms)
2016-09-15 12:24:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.692859", "gt": "1959-07-06T10:42:00"}}}}} on es_index is 855 (took 26ms)
2016-09-15 12:24:02 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 83 -----------------------------------------------------------------
2016-09-15 12:24:04 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "salary", "max": 144354.0, "inclusive_min": false, "min": 140000.0}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:05 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:05 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "salary", "max": 144354.0, "inclusive_min": false, "min": 140000.0} is 50 (took 33.19402ms)
2016-09-15 12:24:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"salary": {"lt": 144354.0, "gt": 140000.0}}}}} on es_index is 50 (took 3ms)
2016-09-15 12:24:06 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:06 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 84 -----------------------------------------------------------------
2016-09-15 12:24:07 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Callia"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:08 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:08 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match": "Callia"} is 0 (took 15.263783ms)
2016-09-15 12:24:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"manages.reports": "Callia"}} on es_index is 0 (took 1ms)
2016-09-15 12:24:09 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 85 -----------------------------------------------------------------
2016-09-15 12:24:10 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "prefix": "D"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:12 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:12 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "name", "prefix": "D"} is 315 (took 15.004585ms)
2016-09-15 12:24:14 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"name": "D"}} on es_index is 147 (took 5ms)
2016-09-15 12:24:14 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 315, while ES hits: 147
2016-09-15 12:24:14 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 169 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000047', u'emp10000733', u'emp10000734', u'emp10000043', u'emp10000738', u'emp10000535', u'emp10000533', u'emp10000436', u'emp10000238', u'emp10000236', u'emp10000626', u'emp10000972', u'emp10000973', u'emp10000970', u'emp10000608', u'emp10000600', u'emp10000601', u'emp10000707', u'emp10000132', u'emp10000131', u'emp10000330', u'emp10000332', u'emp10000322', u'emp10000221', u'emp10000420', u'emp10000422', u'emp10000540', u'emp10000780', u'emp10000783', u'emp10000661', u'emp10000862', u'emp10000863', u'emp10000902', u'emp10000907', u'emp10000905', u'emp10000120', u'emp10000301', u'emp10000652', u'emp10000651', u'emp10000304', u'emp10000307', u'emp10000411', u'emp10000659', u'emp10000658', u'emp10000282', u'emp10000793', u'emp10000022', u'emp10000283', u'emp10000024', u'emp10000252']
2016-09-15 12:24:14 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 86 -----------------------------------------------------------------
2016-09-15 12:24:15 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Casondrah Ambika"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:16 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:16 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match": "Casondrah Ambika"} is 0 (took 6.044285ms)
2016-09-15 12:24:17 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"manages.reports": "Casondrah Ambika"}} on es_index is 0 (took 1ms)
2016-09-15 12:24:17 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:17 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 87 -----------------------------------------------------------------
2016-09-15 12:24:18 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "mutated", "max": 1738, "inclusive_min": true, "min": 3}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:19 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:19 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": true, "field": "mutated", "max": 1738, "inclusive_min": true, "min": 3} is 0 (took 16.785084ms)
2016-09-15 12:24:20 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"gte": 3, "lte": 1738}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:24:20 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:20 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 88 -----------------------------------------------------------------
2016-09-15 12:24:21 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.693377", "start": "2008-10-22T21:24:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:22 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:22 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.693377", "start": "2008-10-22T21:24:00"} is 110 (took 42.164876ms)
2016-09-15 12:24:23 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.693377", "gt": "2008-10-22T21:24:00"}}}}} on es_index is 110 (took 5ms)
2016-09-15 12:24:23 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:23 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 89 -----------------------------------------------------------------
2016-09-15 12:24:25 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "+manages.reports:\"Jetta Lucretia Ebony\" mutated:>1 +mutated:<528 +manages.team_size:<9"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:26 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:26 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "+manages.reports:\"Jetta Lucretia Ebony\" mutated:>1 +mutated:<528 +manages.team_size:<9"} is 0 (took 47.024726ms)
2016-09-15 12:24:26 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "+manages.reports:\"Jetta Lucretia Ebony\" mutated:>1 +mutated:<528 +manages.team_size:<9"}} on es_index is 0 (took 2ms)
2016-09-15 12:24:26 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:26 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 90 -----------------------------------------------------------------
2016-09-15 12:24:27 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.693639", "start": "1990-08-03T07:32:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:31 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:31 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.693639", "start": "1990-08-03T07:32:00"} is 389 (took 59.865655ms)
2016-09-15 12:24:33 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1990-08-03T07:32:00", "lte": "2016-09-15T12:17:56.693639"}}}}} on es_index is 389 (took 11ms)
2016-09-15 12:24:33 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:33 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 91 -----------------------------------------------------------------
2016-09-15 12:24:34 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "C"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:41 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:41 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "prefix": "C"} is 410 (took 50.414582ms)
2016-09-15 12:24:44 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"prefix": {"manages.reports": "C"}} on es_index is 285 (took 10ms)
2016-09-15 12:24:44 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 410, while ES hits: 285
2016-09-15 12:24:44 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 125 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000735', u'emp10000534', u'emp10000438', u'emp10000998', u'emp10000608', u'emp10000270', u'emp10000878', u'emp10000132', u'emp10000335', u'emp10000130', u'emp10000330', u'emp10000137', u'emp10000873', u'emp10000423', u'emp10000038', u'emp10000547', u'emp10000544', u'emp10001000', u'emp10000864', u'emp10000860', u'emp10000634', u'emp10000862', u'emp10000863', u'emp10000300', u'emp10000146', u'emp10000022', u'emp10000359', u'emp10000024', u'emp10000026', u'emp10000028', u'emp10000382', u'emp10000384', u'emp10000858', u'emp10000996', u'emp10000851', u'emp10000852', u'emp10000729', u'emp10000916', u'emp10000644', u'emp10000647', u'emp10000648', u'emp10000649', u'emp10000157', u'emp10000151', u'emp10000152', u'emp10000399', u'emp10000397', u'emp10000393', u'emp10000095', u'emp10000847']
2016-09-15 12:24:44 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 92 -----------------------------------------------------------------
2016-09-15 12:24:45 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.693851", "start": "1999-04-25T06:20:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:47 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:47 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.693851", "start": "1999-04-25T06:20:00"} is 255 (took 44.644783ms)
2016-09-15 12:24:48 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1999-04-25T06:20:00", "lte": "2016-09-15T12:17:56.693851"}}}}} on es_index is 255 (took 8ms)
2016-09-15 12:24:48 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:48 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 93 -----------------------------------------------------------------
2016-09-15 12:24:49 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.693990", "start": "1986-01-14T10:55:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:53 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:53 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-09-15T12:17:56.693990", "start": "1986-01-14T10:55:00"} is 452 (took 43.186439ms)
2016-09-15 12:24:54 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-09-15T12:17:56.693990", "gt": "1986-01-14T10:55:00"}}}}} on es_index is 452 (took 23ms)
2016-09-15 12:24:54 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:54 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 94 -----------------------------------------------------------------
2016-09-15 12:24:55 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Antonia"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:56 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:56 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match": "Antonia"} is 0 (took 7.759367ms)
2016-09-15 12:24:57 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match": {"manages.reports": "Antonia"}} on es_index is 0 (took 1ms)
2016-09-15 12:24:57 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:57 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 95 -----------------------------------------------------------------
2016-09-15 12:24:58 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match_phrase": "Tempest Campbell"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:24:59 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:24:59 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "name", "match_phrase": "Tempest Campbell"} is 0 (took 4.802041ms)
2016-09-15 12:24:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"name": "Tempest Campbell"}} on es_index is 0 (took 1ms)
2016-09-15 12:24:59 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:24:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 96 -----------------------------------------------------------------
2016-09-15 12:25:00 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Malay"}, {"field": "manages.reports", "match": "Gallia"}]}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:25:02 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:25:02 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Malay"}, {"field": "manages.reports", "match": "Gallia"}]} is 0 (took 12.495793ms)
2016-09-15 12:25:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Malay"}}, {"match": {"manages.reports": "Gallia"}}]}} on es_index is 0 (took 1ms)
2016-09-15 12:25:02 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:25:02 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 97 -----------------------------------------------------------------
2016-09-15 12:25:03 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "manages.team_size", "max": 3207, "inclusive_min": false, "min": 10}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:25:04 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:25:04 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": false, "field": "manages.team_size", "max": 3207, "inclusive_min": false, "min": 10} is 0 (took 37.976847ms)
2016-09-15 12:25:05 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"lt": 3207, "gt": 10}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:25:05 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:25:05 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 98 -----------------------------------------------------------------
2016-09-15 12:25:07 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "manages.team_size", "max": 7899, "inclusive_min": true, "min": 8}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:25:08 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:25:08 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_max": true, "field": "manages.team_size", "max": 7899, "inclusive_min": true, "min": 8} is 0 (took 27.137665ms)
2016-09-15 12:25:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"gte": 8, "lte": 7899}}}}} on es_index is 0 (took 1ms)
2016-09-15 12:25:09 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:25:09 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 99 -----------------------------------------------------------------
2016-09-15 12:25:10 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.694550", "start": "1990-07-08T05:07:00"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:25:13 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:25:13 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-09-15T12:17:56.694550", "start": "1990-07-08T05:07:00"} is 389 (took 36.641638ms)
2016-09-15 12:25:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1990-07-08T05:07:00", "lte": "2016-09-15T12:17:56.694550"}}}}} on es_index is 389 (took 12ms)
2016-09-15 12:25:15 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:25:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 100 -----------------------------------------------------------------
2016-09-15 12:25:16 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match_phrase": "Cassandra Sidonia"}, "size": 10000000} on node: 172.23.108.141:
2016-09-15 12:25:17 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 32, u'failed': 0, u'total': 32}
2016-09-15 12:25:17 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "manages.reports", "match_phrase": "Cassandra Sidonia"} is 0 (took 4.948207ms)
2016-09-15 12:25:17 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"match_phrase": {"manages.reports": "Cassandra Sidonia"}} on es_index is 0 (took 1ms)
2016-09-15 12:25:17 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
2016-09-15 12:25:18 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 172.23.108.141:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2016-09-15 12:25:18 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 172.23.108.141 with username : root password : couchbase ssh_key: 
2016-09-15 12:25:22 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 172.23.108.141
2016-09-15 12:25:27 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] It could be other operating systyem.  Go to check at other location
2016-09-15 12:25:35 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 172.23.108.141: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
2016-09-15 12:25:36 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2016-09-15 12:25:36 | INFO | MainProcess | test_thread | [fts_base.check_error_count_in_fts_log] 0
2016-09-15 12:25:36 | INFO | MainProcess | test_thread | [fts_base.check_error_count_in_fts_log] Initial 'panic:' count on 172.23.108.141 :0, now :0
2016-09-15 12:25:36 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 172.23.108.141: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
2016-09-15 12:25:37 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2016-09-15 12:25:37 | INFO | MainProcess | test_thread | [fts_base.check_error_count_in_fts_log] 0
2016-09-15 12:25:37 | INFO | MainProcess | test_thread | [fts_base.check_error_count_in_fts_log] Initial 'crash in forestdb' count on 172.23.108.141 :0, now :0
2016-09-15 12:25:37 | INFO | MainProcess | test_thread | [fts_base.tearDown] ====  FTSbasetests cleanup is started for test #1 index_query_custom_mapping ====
2016-09-15 12:25:38 | INFO | MainProcess | test_thread | [fts_base.delete] Deleting fulltext-index custom_index on 172.23.108.141
2016-09-15 12:25:41 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 172.23.108.141 with username : root password : couchbase ssh_key: 
2016-09-15 12:25:45 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 172.23.108.141
2016-09-15 12:25:50 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] It could be other operating systyem.  Go to check at other location
2016-09-15 12:25:58 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 172.23.108.141: ls /opt/couchbase/var/lib/couchbase/data/@fts |grep custom_index*.pindex | wc -l
2016-09-15 12:25:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2016-09-15 12:25:59 | INFO | MainProcess | test_thread | [fts_base.are_index_files_deleted_from_disk] 0
2016-09-15 12:25:59 | INFO | MainProcess | test_thread | [fts_base.delete] Validated: all index files for custom_index deleted from disk
2016-09-15 12:25:59 | INFO | MainProcess | test_thread | [fts_base.cleanup_cluster] removing nodes from cluster ...
2016-09-15 12:26:00 | INFO | MainProcess | test_thread | [fts_base.cleanup_cluster] cleanup [ip:172.23.108.141 port:8091 ssh_username:root]
2016-09-15 12:26:01 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [u'default'] on 172.23.108.141
2016-09-15 12:26:01 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] remove bucket default ...
2016-09-15 12:26:03 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 172.23.108.141
2016-09-15 12:26:03 | INFO | MainProcess | test_thread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete....
2016-09-15 12:26:03 | INFO | MainProcess | test_thread | [rest_client.bucket_exists] node 172.23.108.141 existing buckets : []
2016-09-15 12:26:06 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 172.23.108.141:8091
2016-09-15 12:26:07 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 172.23.108.141:8091 is running
Cluster instance shutdown with force
2016-09-15 12:26:07 | INFO | MainProcess | test_thread | [es_base.delete_indices] ES index es_index deleted
2016-09-15 12:26:07 | INFO | MainProcess | test_thread | [fts_base.tearDown] ====  FTSbasetests cleanup is finished for test #1 index_query_custom_mapping ===
Cluster instance shutdown with force
summary so far suite fts.stable_topology_fts.StableTopFTS , pass 0 , fail 1
failures so far...
fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping
testrunner logs, diags and results are available under /Users/mihirkamdar/PycharmProjects/testrunner_0908/testrunner/logs/testrunner-16-Sep-15_12-11-44/test_1
Run after suite setup for fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping
Thread Cluster_Thread was not properly terminated, will be terminated now.
Thread ES_Thread was not properly terminated, will be terminated now.