Logs will be stored at /data/workspace/cen006-p0-fts-vset00-00-custom-map-rqg/logs/testrunner-16-Aug-15_11-29-36/test_58 ./testrunner -i INI_FILE.ini get-cbcollect-info=True,get-coredumps=True,get-logs=False,stop-on-failure=False,cluster=D+F,GROUP=ALL -t fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping,items=1000,custom_map=True,num_custom_analyzers=1,cm_id=19,num_queries=100,compare_es=True,GROUP=P0 Test Input params: {'get-coredumps': 'True', 'num_custom_analyzers': '1', 'logs_folder': '/data/workspace/cen006-p0-fts-vset00-00-custom-map-rqg/logs/testrunner-16-Aug-15_11-29-36/test_58', 'GROUP': 'ALL', 'compare_es': 'True', 'cluster': 'D+F', 'items': '1000', 'num_queries': '100', 'conf_file': 'conf/fts/py-fts-custmap-rqg-queries.conf', 'num_nodes': 1, 'cluster_name': 'INI_FILE', 'cm_id': '19', 'stop-on-failure': 'False', 'ini': 'INI_FILE.ini', 'case_number': 58, 'get-logs': 'False', 'get-cbcollect-info': 'True', 'custom_map': 'True', 'spec': 'py-fts-custmap-rqg-queries'} [2016-08-15 12:34:39,334] - [remote_util:172] INFO - connecting to 172.23.106.72 with username : root password : couchbase ssh_key: [2016-08-15 12:34:39,622] - [remote_util:206] INFO - Connected to 172.23.106.72 [2016-08-15 12:34:40,463] - [remote_util:481] INFO - 172.23.106.72 **** The version file /opt/couchbase/ VERSION.txt exists index_query_custom_mapping (fts.stable_topology_fts.StableTopFTS) ... looking for Erlang/Memcached crashes on 172.23.106.72 ... dump files not found on 172.23.106.72 [2016-08-15 12:34:40,760] - [fts_base:1995] INFO - ==== FTSbasetests setup is started for test #58 index_query_custom_mapping ==== [2016-08-15 12:34:40,783] - [fts_base:978] INFO - removing nodes from cluster ... [2016-08-15 12:34:40,800] - [fts_base:980] INFO - cleanup [ip:172.23.106.72 port:8091 ssh_username:root] [2016-08-15 12:34:40,811] - [bucket_helper:138] INFO - deleting existing buckets [] on 172.23.106.72 [2016-08-15 12:34:40,842] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.106.72:8091 [2016-08-15 12:34:40,849] - [cluster_helper:80] INFO - ns_server @ 172.23.106.72:8091 is running [2016-08-15 12:34:40,853] - [es_base:168] ERROR - http://172.23.107.55:9200/es_index error 404 reason: IndexMissingException[[es_index] missing] {"error":"IndexMissingException[[es_index] missing]","status":404} [2016-08-15 12:34:40,901] - [fts_base:2792] INFO - Created empty index es_index on Elastic Search node with custom standard analyzer(default) [2016-08-15 12:34:40,901] - [fts_base:923] INFO - Initializing Cluster ... [2016-08-15 12:34:41,777] - [rest_client:879] INFO - pools/default params : memoryQuota=2069 [2016-08-15 12:34:41,783] - [rest_client:907] INFO - settings/indexes params : storageMode=forestdb [2016-08-15 12:34:41,791] - [rest_client:795] INFO - settings/web params on 172.23.106.72:8091:username=Administrator&password=password&port=8091 [2016-08-15 12:34:42,835] - [rest_client:1908] INFO - http://172.23.106.72:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=1569&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-08-15 12:34:42,846] - [rest_client:1930] INFO - 0.01 seconds to create bucket default [2016-08-15 12:34:42,847] - [bucket_helper:322] INFO - waiting for memcached bucket : default in 172.23.106.72 to accept set ops [2016-08-15 12:34:44,103] - [data_helper:295] INFO - creating direct client 172.23.106.72:11210 default [2016-08-15 12:34:44,278] - [data_helper:295] INFO - creating direct client 172.23.106.72:11210 default [2016-08-15 12:34:46,814] - [task:289] INFO - bucket 'default' was created with per node RAM quota: 1569 [2016-08-15 12:34:46,874] - [rest_client:1299] INFO - /diag/eval status on 172.23.106.72:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))). [2016-08-15 12:34:46,876] - [remote_util:172] INFO - connecting to 172.23.106.72 with username : root password : couchbase ssh_key: [2016-08-15 12:34:47,164] - [remote_util:206] INFO - Connected to 172.23.106.72 [2016-08-15 12:34:47,867] - [remote_util:2383] INFO - running command.raw on 172.23.106.72: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l [2016-08-15 12:34:48,749] - [remote_util:2420] INFO - command executed successfully [2016-08-15 12:34:48,750] - [fts_base:2474] INFO - 0 [2016-08-15 12:34:48,751] - [remote_util:2383] INFO - running command.raw on 172.23.106.72: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l [2016-08-15 12:34:49,568] - [remote_util:2420] INFO - command executed successfully [2016-08-15 12:34:49,569] - [fts_base:2474] INFO - 0 [2016-08-15 12:34:49,683] - [fts_base:2205] INFO - {'172.23.106.72': {'crash in forestdb': 0, 'panic:': 0}} [2016-08-15 12:34:49,684] - [fts_base:2004] INFO - ==== FTSbasetests setup is finished for test #58 index_query_custom_mapping ==== Adding an extra non-indexed field 'languages_known' to list of queryable fields {'text': ['manages_reports', 'name', 'languages_known'], 'number': ['manages_team_size', 'salary', 'mutated'], 'datetime': ['join_date']} [2016-08-15 12:34:49,760] - [fts_base:611] INFO - { "mapping": { "default_analyzer": "customAnalyzer1", "default_datetime_parser": "dateTimeOptional", "type_field": "type", "default_mapping": { "default_analyzer": "", "dynamic": true, "enabled": false }, "default_type": "_default", "analysis": { "analyzers": { "customAnalyzer1": { "type": "custom", "char_filters": [ "html" ], "tokenizer": "web", "token_filters": [ "back_edge_ngram" ] } }, "token_filters": { "dict_compound_en": { "dict_token_map": "stop_en", "type": "dict_compound" }, "length": { "max": 5, "type": "length", "min": 3 }, "truncate": { "length": 10, "type": "truncate_token" }, "dict_compound_fr": { "dict_token_map": "articles_fr", "type": "dict_compound" }, "ngram": { "max": 5, "type": "ngram", "min": 3 }, "front_edge_ngram": { "max": 5, "type": "edge_ngram", "back": false, "min": 3 }, "back_edge_ngram": { "max": 5, "type": "edge_ngram", "back": true, "min": 3 }, "shingle": { "output_original": "false", "min": 2, "filler": "", "max": 5, "separator": "", "type": "shingle" }, "keyword_marker_en": { "type": "keyword_marker", "keywords_token_map": "stop_en" } } }, "default_field": "_all", "types": { "emp": { "enabled": true, "dynamic": false, "properties": { "salary": { "enabled": true, "dynamic": false, "properties": {}, "fields": [ { "index": true, "name": "salary", "include_in_all": true, "type": "number", "analyzer": "", "include_term_vectors": true, "store": false } ] }, "mutated": { "enabled": true, "dynamic": false, "properties": {}, "fields": [ { "index": true, "name": "mutated", "include_in_all": true, "type": "number", "analyzer": "", "include_term_vectors": true, "store": false } ] }, "join_date": { "enabled": true, "dynamic": false, "properties": {}, "fields": [ { "index": true, "name": "join_date", "include_in_all": true, "type": "datetime", "analyzer": "", "include_term_vectors": true, "store": false } ] }, "manages": { "enabled": true, "dynamic": false, "properties": { "reports": { "enabled": true, "dynamic": false, "properties": {}, "fields": [ { "index": true, "name": "reports", "include_in_all": true, "type": "text", "analyzer": "customAnalyzer1", "include_term_vectors": true, "store": false } ] } }, "fields": [] }, "name": { "enabled": true, "dynamic": false, "properties": {}, "fields": [ { "index": true, "name": "name", "include_in_all": true, "type": "text", "analyzer": "customAnalyzer1", "include_term_vectors": true, "store": false } ] } }, "fields": [] } } } } [2016-08-15 12:34:49,760] - [fts_base:639] INFO - Checking if index already exists ... [2016-08-15 12:34:49,790] - [rest_client:778] ERROR - http://172.23.106.72:8094/api/index/custom_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found rest_auth: preparePerm, err: index not found [2016-08-15 12:34:49,797] - [rest_client:778] ERROR - http://172.23.106.72:8094/api/index/custom_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found rest_auth: preparePerm, err: index not found [2016-08-15 12:34:49,798] - [fts_base:647] INFO - Creating fulltext-index custom_index on 172.23.106.72 [2016-08-15 12:34:49,798] - [rest_client:2217] INFO - {"params": {"mapping": {"default_analyzer": "customAnalyzer1", "default_datetime_parser": "dateTimeOptional", "type_field": "type", "default_mapping": {"default_analyzer": "", "dynamic": true, "enabled": false}, "default_type": "_default", "analysis": {"analyzers": {"customAnalyzer1": {"type": "custom", "char_filters": ["html"], "tokenizer": "web", "token_filters": ["back_edge_ngram"]}}, "token_filters": {"dict_compound_en": {"dict_token_map": "stop_en", "type": "dict_compound"}, "length": {"max": 5, "type": "length", "min": 3}, "truncate": {"length": 10, "type": "truncate_token"}, "dict_compound_fr": {"dict_token_map": "articles_fr", "type": "dict_compound"}, "ngram": {"max": 5, "type": "ngram", "min": 3}, "front_edge_ngram": {"max": 5, "type": "edge_ngram", "back": false, "min": 3}, "back_edge_ngram": {"max": 5, "type": "edge_ngram", "back": true, "min": 3}, "shingle": {"output_original": "false", "min": 2, "filler": "", "max": 5, "separator": "", "type": "shingle"}, "keyword_marker_en": {"type": "keyword_marker", "keywords_token_map": "stop_en"}}}, "default_field": "_all", "types": {"emp": {"enabled": true, "dynamic": false, "properties": {"salary": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "salary", "include_in_all": true, "type": "number", "analyzer": "", "include_term_vectors": true, "store": false}]}, "mutated": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "mutated", "include_in_all": true, "type": "number", "analyzer": "", "include_term_vectors": true, "store": false}]}, "join_date": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "join_date", "include_in_all": true, "type": "datetime", "analyzer": "", "include_term_vectors": true, "store": false}]}, "manages": {"enabled": true, "dynamic": false, "properties": {"reports": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "reports", "include_in_all": true, "type": "text", "analyzer": "customAnalyzer1", "include_term_vectors": true, "store": false}]}}, "fields": []}, "name": {"enabled": true, "dynamic": false, "properties": {}, "fields": [{"index": true, "name": "name", "include_in_all": true, "type": "text", "analyzer": "customAnalyzer1", "include_term_vectors": true, "store": false}]}}, "fields": []}}}}, "name": "custom_index", "planParams": {"hierarchyRules": null, "nodePlanParams": null, "numReplicas": 0, "planFrozen": false, "maxPartitionsPerPIndex": 32}, "sourceName": "default", "sourceUUID": "", "sourceType": "couchbase", "type": "fulltext-index", "sourceParams": {"authUser": "default", "dataManagerSleepMaxMS": 20000, "authSaslUser": "", "clusterManagerSleepMaxMS": 20000, "authSaslPassword": "", "clusterManagerSleepInitMS": 0, "dataManagerBackoffFactor": 0, "authPassword": "", "dataManagerSleepInitMS": 0, "feedBufferAckThreshold": 0, "feedBufferSizeBytes": 0, "clusterManagerBackoffFactor": 0}, "uuid": ""} [2016-08-15 12:34:49,878] - [rest_client:2226] INFO - Index custom_index created [2016-08-15 12:34:49,878] - [fts_base:2584] INFO - Validating index distribution for custom_index ... [2016-08-15 12:34:49,993] - [fts_base:2495] INFO - sleep for 5 secs. No pindexes found, waiting for index to get created ... [2016-08-15 12:34:55,144] - [fts_base:2602] INFO - Validated: Number of PIndexes = 32 [2016-08-15 12:34:55,163] - [fts_base:2614] INFO - Validated: Every pIndex serves 32 partitions or lesser [2016-08-15 12:34:55,163] - [fts_base:2630] INFO - Validated: pIndexes are distributed across [u'dcec109232afc5fdd72f56d81f17cc5c'] [2016-08-15 12:34:55,163] - [fts_base:2636] INFO - Expecting num of partitions in each node in range 992-1024 [2016-08-15 12:34:55,164] - [fts_base:2651] INFO - Validated: Node dcec109232afc5fdd72f56d81f17cc5c houses 32 pindexes which serve 1024 partitions [2016-08-15 12:34:55,192] - [es_base:260] INFO - Creating es_index with mapping { "mappings": { "emp": { "dynamic": false, "properties": { "salary": { "index": "analyzed", "type": "float", "store": false }, "mutated": { "index": "analyzed", "type": "float", "store": false }, "join_date": { "index": "analyzed", "type": "date", "store": false }, "manages": { "enabled": true, "dynamic": false, "properties": { "reports": { "index": "analyzed", "type": "string", "analyzer": "customAnalyzer1", "store": false, "term_vector": "yes" } }, "type": "object" }, "name": { "index": "analyzed", "type": "string", "analyzer": "customAnalyzer1", "store": false, "term_vector": "yes" } } } }, "settings": { "analysis": { "filter": { "truncate": { "length": 10, "type": "truncate" }, "shingle": { "token_separator": "", "output_unigrams": "false", "filler_token": "", "output_unigrams_if_no_shingles": "false", "min_shingle_size": 2, "type": "shingle", "max_shingle_size": 5 }, "ngram": { "max_gram": 5, "type": "nGram", "side": "front", "min_gram": 3 }, "keyword_marker_en": { "keywords": [ "i", "me", "my", "myself", "we", "our", "ours", "ourselves", "you", "your", "yours", "yourself", "yourselves", "he", "him", "his", "himself", "she", "her", "hers", "herself", "it", "its", "itself", "they", "them", "their", "theirs", "themselves", "what", "which", "who", "whom", "this", "that", "these", "those", "am", "is", "are", "was", "were", "be", "been", "being", "have", "has", "had", "having", "do", "does", "did", "doing", "would", "should", "could", "ought", "i'm", "you're", "he's", "she's", "it's", "we're", "they're", "i've", "you've", "we've", "they've", "i'd", "you'd", "he'd", "she'd", "we'd", "they'd", "i'll", "you'll", "he'll", "she'll", "we'll", "they'll", "isn't", "aren't", "wasn't", "weren't", "hasn't", "haven't", "hadn't", "doesn't", "don't", "didn't", "won't", "wouldn't", "shan't", "shouldn't", "can't", "cannot", "couldn't", "mustn't", "let's", "that's", "who's", "what's", "here's", "there's", "when's", "where's", "why's", "how's", "a", "an", "the", "and", "but", "if", "or", "because", "as", "until", "while", "of", "at", "by", "for", "with", "about", "against", "between", "into", "through", "during", "before", "after", "above", "below", "to", "from", "up", "down", "in", "out", "on", "off", "over", "under", "again", "further", "then", "once", "here", "there", "when", "where", "why", "how", "all", "any", "both", "each", "few", "more", "most", "other", "some", "such", "no", "nor", "not", "only", "own", "same", "so", "than", "too", "very" ], "type": "keyword_marker" }, "length": { "max": 5, "type": "length", "min": 3 }, "front_edge_ngram": { "max_gram": 5, "type": "edgeNGram", "side": "front", "min_gram": 3 }, "back_edge_ngram": { "max_gram": 5, "type": "edgeNGram", "side": "back", "min_gram": 3 } }, "analyzer": { "customAnalyzer1": { "filter": [ "back_edge_ngram" ], "char_filter": [ "html_strip" ], "tokenizer": "uax_url_email" } } } } } [2016-08-15 12:34:55,257] - [es_base:266] INFO - SUCCESS: ES index created with above mapping [2016-08-15 12:34:55,415] - [task:1044] INFO - Starting operation 'create' on Elastic Search ... [2016-08-15 12:34:55,740] - [data_helper:295] INFO - creating direct client 172.23.106.72:11210 default [2016-08-15 12:34:56,148] - [task:1078] INFO - 1000 documents bulk loaded into ES [2016-08-15 12:34:56,204] - [task:1083] INFO - ES index count for 'es_index': 1000 [2016-08-15 12:34:57,312] - [fts_base:2892] INFO - Loading phase complete! [2016-08-15 12:34:57,447] - [fts_base:2525] INFO - Docs in bucket = 160, docs in FTS index 'custom_index': 15, docs in ES index: 1000 [2016-08-15 12:35:03,558] - [fts_base:2525] INFO - Docs in bucket = 1000, docs in FTS index 'custom_index': 476, docs in ES index: 1000 [2016-08-15 12:35:09,651] - [fts_base:2525] INFO - Docs in bucket = 1000, docs in FTS index 'custom_index': 1000, docs in ES index: 1000 [2016-08-15 12:35:09,651] - [fts_base:2537] INFO - FTS indexed 1000 docs in 0.21 mins Smart queries will be generated on fields: {'date': ['join_date'], 'text': ['manages_reports', 'name', 'languages_known'], 'num': ['manages_team_size', 'salary', 'mutated'], 'str': ['manages_reports', 'name', 'languages_known']} [2016-08-15 12:35:09,865] - [task:1112] INFO - ------------------------------------------------------------------ Query # 1 ----------------------------------------------------------------- [2016-08-15 12:35:09,885] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "name", "match": "Trista Stewart"}, {"field": "manages.reports", "prefix": "Kag"}, {"inclusive_max": true, "field": "manages.team_size", "max": 9882, "inclusive_min": true, "min": 9}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:09,925] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:09,926] - [task:1140] INFO - FTS hits for query: {"conjuncts": [{"field": "name", "match": "Trista Stewart"}, {"field": "manages.reports", "prefix": "Kag"}, {"inclusive_max": true, "field": "manages.team_size", "max": 9882, "inclusive_min": true, "min": 9}]} is 0 (took 16.013803ms) [2016-08-15 12:35:09,931] - [task:1150] INFO - ES hits for query: {"bool": {"must": [{"match": {"name": "Trista Stewart"}}, {"prefix": {"manages.reports": "Kag"}}, {"filtered": {"filter": {"range": {"manages.team_size": {"gte": 9, "lte": 9882}}}}}]}} on es_index is 0 (took 1ms) [2016-08-15 12:35:09,931] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:09,931] - [task:1112] INFO - ------------------------------------------------------------------ Query # 2 ----------------------------------------------------------------- [2016-08-15 12:35:09,950] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Africans"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:09,983] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:09,984] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match": "Africans"} is 0 (took 3.596748ms) [2016-08-15 12:35:09,987] - [task:1150] INFO - ES hits for query: {"match": {"languages_known": "Africans"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:09,988] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:09,988] - [task:1112] INFO - ------------------------------------------------------------------ Query # 3 ----------------------------------------------------------------- [2016-08-15 12:35:10,000] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Chinese"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,023] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,023] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match_phrase": "Chinese"} is 0 (took 3.604424ms) [2016-08-15 12:35:10,027] - [task:1150] INFO - ES hits for query: {"match_phrase": {"languages_known": "Chinese"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,027] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,027] - [task:1112] INFO - ------------------------------------------------------------------ Query # 4 ----------------------------------------------------------------- [2016-08-15 12:35:10,043] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Trista Robinson Sr."}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,079] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,079] - [task:1140] INFO - FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Trista Robinson Sr."}]}} is 116 (took 8.65664ms) [2016-08-15 12:35:10,094] - [task:1150] INFO - ES hits for query: {"bool": {"should": {"match": {"name": "Trista Robinson Sr."}}}} on es_index is 116 (took 5ms) [2016-08-15 12:35:10,095] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,095] - [task:1112] INFO - ------------------------------------------------------------------ Query # 5 ----------------------------------------------------------------- [2016-08-15 12:35:10,119] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.653707", "start": "1997-10-18T14:49:00"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,226] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,227] - [task:1140] INFO - FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.653707", "start": "1997-10-18T14:49:00"}]} is 0 (took 81.385527ms) [2016-08-15 12:35:10,231] - [task:1150] INFO - ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Dutch"}}, {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.653707", "gt": "1997-10-18T14:49:00"}}}}}]}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,231] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,231] - [task:1112] INFO - ------------------------------------------------------------------ Query # 6 ----------------------------------------------------------------- [2016-08-15 12:35:10,251] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Spanish"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,279] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,280] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match_phrase": "Spanish"} is 0 (took 2.830112ms) [2016-08-15 12:35:10,283] - [task:1150] INFO - ES hits for query: {"match_phrase": {"languages_known": "Spanish"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,284] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,284] - [task:1112] INFO - ------------------------------------------------------------------ Query # 7 ----------------------------------------------------------------- [2016-08-15 12:35:10,299] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,319] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,320] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match": "German"} is 0 (took 2.490425ms) [2016-08-15 12:35:10,323] - [task:1150] INFO - ES hits for query: {"match": {"languages_known": "German"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,323] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,324] - [task:1112] INFO - ------------------------------------------------------------------ Query # 8 ----------------------------------------------------------------- [2016-08-15 12:35:10,338] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "wildcard": "Sidoni? Wint? G?lli? D?bri?"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,357] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,358] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "wildcard": "Sidoni? Wint? G?lli? D?bri?"} is 0 (took 1.377444ms) [2016-08-15 12:35:10,362] - [task:1150] INFO - ES hits for query: {"wildcard": {"manages.reports": "Sidoni? Wint? G?lli? D?bri?"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,362] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,362] - [task:1112] INFO - ------------------------------------------------------------------ Query # 9 ----------------------------------------------------------------- [2016-08-15 12:35:10,377] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "wildcard": "Druc*"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,393] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,393] - [task:1140] INFO - FTS hits for query: {"field": "name", "wildcard": "Druc*"} is 0 (took 2.105258ms) [2016-08-15 12:35:10,397] - [task:1150] INFO - ES hits for query: {"wildcard": {"name": "Druc*"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,397] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,398] - [task:1112] INFO - ------------------------------------------------------------------ Query # 10 ----------------------------------------------------------------- [2016-08-15 12:35:10,409] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "Qu?chua"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,422] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,423] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "wildcard": "Qu?chua"} is 0 (took 1.231683ms) [2016-08-15 12:35:10,431] - [task:1150] INFO - ES hits for query: {"wildcard": {"languages_known": "Qu?chua"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,431] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,432] - [task:1112] INFO - ------------------------------------------------------------------ Query # 11 ----------------------------------------------------------------- [2016-08-15 12:35:10,447] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.655392", "start": "2005-01-28T06:04:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,490] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,490] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.655392", "start": "2005-01-28T06:04:00"} is 169 (took 20.623039ms) [2016-08-15 12:35:10,516] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "2005-01-28T06:04:00", "lte": "2016-08-15T12:35:09.655392"}}}}} on es_index is 169 (took 3ms) [2016-08-15 12:35:10,517] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,517] - [task:1112] INFO - ------------------------------------------------------------------ Query # 12 ----------------------------------------------------------------- [2016-08-15 12:35:10,545] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Portuguese"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,580] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,581] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match_phrase": "Portuguese"} is 0 (took 2.771812ms) [2016-08-15 12:35:10,589] - [task:1150] INFO - ES hits for query: {"match_phrase": {"languages_known": "Portuguese"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,589] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,590] - [task:1112] INFO - ------------------------------------------------------------------ Query # 13 ----------------------------------------------------------------- [2016-08-15 12:35:10,615] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"field": "languages_known", "match_phrase": "Arabic"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.656043", "start": "1964-09-24T10:16:00"}, {"inclusive_max": false, "field": "salary", "max": 129825.0, "inclusive_min": false, "min": 120000.0}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,698] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,699] - [task:1140] INFO - FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Dutch"}, {"field": "languages_known", "match_phrase": "Arabic"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.656043", "start": "1964-09-24T10:16:00"}, {"inclusive_max": false, "field": "salary", "max": 129825.0, "inclusive_min": false, "min": 120000.0}]} is 0 (took 54.240951ms) [2016-08-15 12:35:10,713] - [task:1150] INFO - ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Dutch"}}, {"match_phrase": {"languages_known": "Arabic"}}, {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.656043", "gt": "1964-09-24T10:16:00"}}}}}, {"filtered": {"filter": {"range": {"salary": {"lt": 129825.0, "gt": 120000.0}}}}}]}} on es_index is 0 (took 1ms) [2016-08-15 12:35:10,714] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,714] - [task:1112] INFO - ------------------------------------------------------------------ Query # 14 ----------------------------------------------------------------- [2016-08-15 12:35:10,732] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Kerry-Ann"}, {"field": "manages.reports", "match": "Cynara"}, {"field": "languages_known", "match": "Hindi"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,778] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,778] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "name", "match": "Kerry-Ann"}, {"field": "manages.reports", "match": "Cynara"}, {"field": "languages_known", "match": "Hindi"}]} is 163 (took 5.389045ms) [2016-08-15 12:35:10,819] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"name": "Kerry-Ann"}}, {"match": {"manages.reports": "Cynara"}}, {"match": {"languages_known": "Hindi"}}]}} on es_index is 177 (took 5ms) [2016-08-15 12:35:10,819] - [task:1155] ERROR - FAIL: FTS hits: 163, while ES hits: 177 [2016-08-15 12:35:10,820] - [task:1170] ERROR - FAIL: Following 14 docs were not returned by FTS, but ES, printing 50: [u'emp10000480', u'emp10000164', u'emp10000056', u'emp10000299', u'emp10000840', u'emp10000244', u'emp10000630', u'emp10000945', u'emp10000492', u'emp10000568', u'emp10000422', u'emp10000935', u'emp10000200', u'emp10000762'] [2016-08-15 12:35:10,820] - [task:1112] INFO - ------------------------------------------------------------------ Query # 15 ----------------------------------------------------------------- [2016-08-15 12:35:10,841] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "salary", "max": 63832.0, "inclusive_min": true, "min": 56000.0}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:10,886] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:10,886] - [task:1140] INFO - FTS hits for query: {"inclusive_max": true, "field": "salary", "max": 63832.0, "inclusive_min": true, "min": 56000.0} is 90 (took 14.267625ms) [2016-08-15 12:35:10,912] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"salary": {"gte": 56000.0, "lte": 63832.0}}}}} on es_index is 90 (took 2ms) [2016-08-15 12:35:10,912] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:10,912] - [task:1112] INFO - ------------------------------------------------------------------ Query # 16 ----------------------------------------------------------------- [2016-08-15 12:35:10,926] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "-mutated:<3"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,061] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,062] - [task:1140] INFO - FTS hits for query: {"query": "-mutated:<3"} is 0 (took 110.21384ms) [2016-08-15 12:35:11,072] - [task:1150] INFO - ES hits for query: {"query_string": {"query": "-mutated:<3"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:11,072] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,073] - [task:1112] INFO - ------------------------------------------------------------------ Query # 17 ----------------------------------------------------------------- [2016-08-15 12:35:11,088] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "manages.team_size", "max": 1207, "inclusive_min": false, "min": 9}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,147] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,147] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "manages.team_size", "max": 1207, "inclusive_min": false, "min": 9} is 0 (took 36.470834ms) [2016-08-15 12:35:11,158] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"lt": 1207, "gt": 9}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:11,159] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,159] - [task:1112] INFO - ------------------------------------------------------------------ Query # 18 ----------------------------------------------------------------- [2016-08-15 12:35:11,176] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "T"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,202] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,203] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "prefix": "T"} is 0 (took 2.608831ms) [2016-08-15 12:35:11,228] - [task:1150] INFO - ES hits for query: {"prefix": {"manages.reports": "T"}} on es_index is 157 (took 4ms) [2016-08-15 12:35:11,229] - [task:1155] ERROR - FAIL: FTS hits: 0, while ES hits: 157 [2016-08-15 12:35:11,229] - [task:1170] ERROR - FAIL: Following 157 docs were not returned by FTS, but ES, printing 50: [u'emp10000046', u'emp10000328', u'emp10000435', u'emp10000122', u'emp10000237', u'emp10000231', u'emp10000232', u'emp10000976', u'emp10000975', u'emp10000601', u'emp10000705', u'emp10000700', u'emp10000372', u'emp10000335', u'emp10000788', u'emp10000983', u'emp10000692', u'emp10000988', u'emp10000909', u'emp10000867', u'emp10000860', u'emp10000907', u'emp10000904', u'emp10000653', u'emp10000305', u'emp10000656', u'emp10000307', u'emp10000281', u'emp10000146', u'emp10000145', u'emp10000144', u'emp10000417', u'emp10000416', u'emp10000021', u'emp10000022', u'emp10000023', u'emp10000024', u'emp10000026', u'emp10000550', u'emp10000553', u'emp10000313', u'emp10000995', u'emp10000996', u'emp10000997', u'emp10000419', u'emp10000624', u'emp10000625', u'emp10000620', u'emp10000912', u'emp10000350'] [2016-08-15 12:35:11,230] - [task:1112] INFO - ------------------------------------------------------------------ Query # 19 ----------------------------------------------------------------- [2016-08-15 12:35:11,244] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "manages.team_size", "max": 9379, "inclusive_min": false, "min": 9}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,316] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,316] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "manages.team_size", "max": 9379, "inclusive_min": false, "min": 9} is 0 (took 51.289343ms) [2016-08-15 12:35:11,320] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"lt": 9379, "gt": 9}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:11,321] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,322] - [task:1112] INFO - ------------------------------------------------------------------ Query # 20 ----------------------------------------------------------------- [2016-08-15 12:35:11,342] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "wildcard": "Amara Amara ?abria Ebony"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,373] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,373] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "wildcard": "Amara Amara ?abria Ebony"} is 0 (took 2.556721ms) [2016-08-15 12:35:11,377] - [task:1150] INFO - ES hits for query: {"wildcard": {"manages.reports": "Amara Amara ?abria Ebony"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:11,377] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,378] - [task:1112] INFO - ------------------------------------------------------------------ Query # 21 ----------------------------------------------------------------- [2016-08-15 12:35:11,391] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "match": "Thea"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,422] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,423] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "match": "Thea"}]} is 10 (took 4.955552ms) [2016-08-15 12:35:11,432] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Italian"}}, {"match": {"name": "Thea"}}]}} on es_index is 10 (took 5ms) [2016-08-15 12:35:11,433] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,433] - [task:1112] INFO - ------------------------------------------------------------------ Query # 22 ----------------------------------------------------------------- [2016-08-15 12:35:11,447] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "French"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,471] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,471] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match": "French"} is 0 (took 5.311333ms) [2016-08-15 12:35:11,474] - [task:1150] INFO - ES hits for query: {"match": {"languages_known": "French"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:11,475] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,475] - [task:1112] INFO - ------------------------------------------------------------------ Query # 23 ----------------------------------------------------------------- [2016-08-15 12:35:11,491] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Italian"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,517] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,517] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match_phrase": "Italian"} is 0 (took 2.594087ms) [2016-08-15 12:35:11,522] - [task:1150] INFO - ES hits for query: {"match_phrase": {"languages_known": "Italian"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:11,522] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,523] - [task:1112] INFO - ------------------------------------------------------------------ Query # 24 ----------------------------------------------------------------- [2016-08-15 12:35:11,545] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "salary", "max": 71215.0, "inclusive_min": true, "min": 62000.0}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,584] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,585] - [task:1140] INFO - FTS hits for query: {"inclusive_max": true, "field": "salary", "max": 71215.0, "inclusive_min": true, "min": 62000.0} is 92 (took 12.592383ms) [2016-08-15 12:35:11,599] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"salary": {"gte": 62000.0, "lte": 71215.0}}}}} on es_index is 92 (took 5ms) [2016-08-15 12:35:11,599] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,600] - [task:1112] INFO - ------------------------------------------------------------------ Query # 25 ----------------------------------------------------------------- [2016-08-15 12:35:11,620] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "salary", "max": 96692.0, "inclusive_min": true, "min": 91000.0}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,662] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,663] - [task:1140] INFO - FTS hits for query: {"inclusive_max": true, "field": "salary", "max": 96692.0, "inclusive_min": true, "min": 91000.0} is 65 (took 13.84088ms) [2016-08-15 12:35:11,674] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"salary": {"gte": 91000.0, "lte": 96692.0}}}}} on es_index is 65 (took 2ms) [2016-08-15 12:35:11,674] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,675] - [task:1112] INFO - ------------------------------------------------------------------ Query # 26 ----------------------------------------------------------------- [2016-08-15 12:35:11,690] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Gallia"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,730] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,731] - [task:1140] INFO - FTS hits for query: {"field": "name", "match": "Gallia"} is 34 (took 6.781863ms) [2016-08-15 12:35:11,739] - [task:1150] INFO - ES hits for query: {"match": {"name": "Gallia"}} on es_index is 34 (took 1ms) [2016-08-15 12:35:11,740] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,740] - [task:1112] INFO - ------------------------------------------------------------------ Query # 27 ----------------------------------------------------------------- [2016-08-15 12:35:11,758] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "wildcard": "Deirdre Alarice Cy?heria"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,791] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,791] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "wildcard": "Deirdre Alarice Cy?heria"} is 0 (took 3.836806ms) [2016-08-15 12:35:11,795] - [task:1150] INFO - ES hits for query: {"wildcard": {"manages.reports": "Deirdre Alarice Cy?heria"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:11,795] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,795] - [task:1112] INFO - ------------------------------------------------------------------ Query # 28 ----------------------------------------------------------------- [2016-08-15 12:35:11,810] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Casondrah Campbell"}, {"field": "languages_known", "match": "Chinese"}]}, "must_not": {"disjuncts": [{"field": "name", "match": "Riona Davis"}]}, "must": {"conjuncts": [{"field": "name", "match": "Wright"}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:11,850] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:11,850] - [task:1140] INFO - FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Casondrah Campbell"}, {"field": "languages_known", "match": "Chinese"}]}, "must_not": {"disjuncts": [{"field": "name", "match": "Riona Davis"}]}, "must": {"conjuncts": [{"field": "name", "match": "Wright"}]}} is 10 (took 17.352335ms) [2016-08-15 12:35:11,856] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"name": "Casondrah Campbell"}}, {"match": {"languages_known": "Chinese"}}], "must_not": {"match": {"name": "Riona Davis"}}, "must": {"match": {"name": "Wright"}}}} on es_index is 10 (took 1ms) [2016-08-15 12:35:11,856] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:11,857] - [task:1112] INFO - ------------------------------------------------------------------ Query # 29 ----------------------------------------------------------------- [2016-08-15 12:35:11,882] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Quechua"}, {"field": "manages.reports", "prefix": "Cia"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.660982", "start": "2000-11-14T07:28:00"}, {"inclusive_max": true, "field": "mutated", "max": 1885, "inclusive_min": true, "min": 4}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,008] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,009] - [task:1140] INFO - FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Quechua"}, {"field": "manages.reports", "prefix": "Cia"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.660982", "start": "2000-11-14T07:28:00"}, {"inclusive_max": true, "field": "mutated", "max": 1885, "inclusive_min": true, "min": 4}]} is 0 (took 80.736532ms) [2016-08-15 12:35:12,013] - [task:1150] INFO - ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Quechua"}}, {"prefix": {"manages.reports": "Cia"}}, {"filtered": {"filter": {"range": {"join_date": {"gte": "2000-11-14T07:28:00", "lte": "2016-08-15T12:35:09.660982"}}}}}, {"filtered": {"filter": {"range": {"mutated": {"gte": 4, "lte": 1885}}}}}]}} on es_index is 0 (took 1ms) [2016-08-15 12:35:12,014] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,014] - [task:1112] INFO - ------------------------------------------------------------------ Query # 30 ----------------------------------------------------------------- [2016-08-15 12:35:12,077] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,146] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,147] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match": "German"} is 0 (took 3.574386ms) [2016-08-15 12:35:12,151] - [task:1150] INFO - ES hits for query: {"match": {"languages_known": "German"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:12,152] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,152] - [task:1112] INFO - ------------------------------------------------------------------ Query # 31 ----------------------------------------------------------------- [2016-08-15 12:35:12,211] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Cassandra Russell"}, {"field": "manages.reports", "match": "Jerica Antonia Araceli Kerry"}, {"field": "languages_known", "match": "Arabic"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,323] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,324] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "name", "match": "Cassandra Russell"}, {"field": "manages.reports", "match": "Jerica Antonia Araceli Kerry"}, {"field": "languages_known", "match": "Arabic"}]} is 301 (took 24.47334ms) [2016-08-15 12:35:12,358] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"name": "Cassandra Russell"}}, {"match": {"manages.reports": "Jerica Antonia Araceli Kerry"}}, {"match": {"languages_known": "Arabic"}}]}} on es_index is 301 (took 9ms) [2016-08-15 12:35:12,358] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,359] - [task:1112] INFO - ------------------------------------------------------------------ Query # 32 ----------------------------------------------------------------- [2016-08-15 12:35:12,375] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Hindi"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,408] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,409] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match": "Hindi"} is 0 (took 4.286673ms) [2016-08-15 12:35:12,413] - [task:1150] INFO - ES hits for query: {"match": {"languages_known": "Hindi"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:12,414] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,414] - [task:1112] INFO - ------------------------------------------------------------------ Query # 33 ----------------------------------------------------------------- [2016-08-15 12:35:12,429] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Casondrah"}, {"field": "manages.reports", "match": "Quella Kerry Araceli"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,486] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,487] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "name", "match": "Casondrah"}, {"field": "manages.reports", "match": "Quella Kerry Araceli"}]} is 235 (took 15.131108ms) [2016-08-15 12:35:12,515] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"name": "Casondrah"}}, {"match": {"manages.reports": "Quella Kerry Araceli"}}]}} on es_index is 235 (took 7ms) [2016-08-15 12:35:12,516] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,516] - [task:1112] INFO - ------------------------------------------------------------------ Query # 34 ----------------------------------------------------------------- [2016-08-15 12:35:12,535] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "mutated", "max": 2059, "inclusive_min": false, "min": 0}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,619] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,620] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "mutated", "max": 2059, "inclusive_min": false, "min": 0} is 0 (took 62.312643ms) [2016-08-15 12:35:12,624] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"lt": 2059, "gt": 0}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:12,624] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,624] - [task:1112] INFO - ------------------------------------------------------------------ Query # 35 ----------------------------------------------------------------- [2016-08-15 12:35:12,640] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "Portugue*"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,666] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,666] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "wildcard": "Portugue*"} is 0 (took 2.740423ms) [2016-08-15 12:35:12,670] - [task:1150] INFO - ES hits for query: {"wildcard": {"languages_known": "Portugue*"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:12,670] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,670] - [task:1112] INFO - ------------------------------------------------------------------ Query # 36 ----------------------------------------------------------------- [2016-08-15 12:35:12,683] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "name", "match": "Lilith Gerónimo"}, {"field": "languages_known", "prefix": "It"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,712] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,713] - [task:1140] INFO - FTS hits for query: {"conjuncts": [{"field": "name", "match": "Lilith Gerónimo"}, {"field": "languages_known", "prefix": "It"}]} is 0 (took 6.354465ms) [2016-08-15 12:35:12,717] - [task:1150] INFO - ES hits for query: {"bool": {"must": [{"match": {"name": "Lilith Gerónimo"}}, {"prefix": {"languages_known": "It"}}]}} on es_index is 0 (took 1ms) [2016-08-15 12:35:12,717] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,718] - [task:1112] INFO - ------------------------------------------------------------------ Query # 37 ----------------------------------------------------------------- [2016-08-15 12:35:12,734] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "salary", "max": 136186.0, "inclusive_min": false, "min": 129000.0}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,857] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,857] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "salary", "max": 136186.0, "inclusive_min": false, "min": 129000.0} is 76 (took 98.500446ms) [2016-08-15 12:35:12,868] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"salary": {"lt": 136186.0, "gt": 129000.0}}}}} on es_index is 76 (took 2ms) [2016-08-15 12:35:12,868] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,869] - [task:1112] INFO - ------------------------------------------------------------------ Query # 38 ----------------------------------------------------------------- [2016-08-15 12:35:12,883] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match_phrase": "Basha Kagami"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,909] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,910] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match_phrase": "Basha Kagami"} is 0 (took 4.315499ms) [2016-08-15 12:35:12,917] - [task:1150] INFO - ES hits for query: {"match_phrase": {"manages.reports": "Basha Kagami"}} on es_index is 0 (took 3ms) [2016-08-15 12:35:12,917] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,918] - [task:1112] INFO - ------------------------------------------------------------------ Query # 39 ----------------------------------------------------------------- [2016-08-15 12:35:12,932] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Lucr"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:12,969] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:12,970] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "prefix": "Lucr"} is 0 (took 3.612603ms) [2016-08-15 12:35:12,977] - [task:1150] INFO - ES hits for query: {"prefix": {"manages.reports": "Lucr"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:12,978] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:12,978] - [task:1112] INFO - ------------------------------------------------------------------ Query # 40 ----------------------------------------------------------------- [2016-08-15 12:35:12,994] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "prefix": "Afri"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:13,018] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:13,019] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "prefix": "Afri"} is 0 (took 3.201123ms) [2016-08-15 12:35:13,022] - [task:1150] INFO - ES hits for query: {"prefix": {"languages_known": "Afri"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:13,023] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:13,023] - [task:1112] INFO - ------------------------------------------------------------------ Query # 41 ----------------------------------------------------------------- [2016-08-15 12:35:13,036] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.664609", "start": "1987-06-10T19:48:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:13,141] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:13,142] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.664609", "start": "1987-06-10T19:48:00"} is 432 (took 59.351384ms) [2016-08-15 12:35:13,182] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.664609", "gt": "1987-06-10T19:48:00"}}}}} on es_index is 432 (took 12ms) [2016-08-15 12:35:13,183] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:13,184] - [task:1112] INFO - ------------------------------------------------------------------ Query # 42 ----------------------------------------------------------------- [2016-08-15 12:35:13,204] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Quella Martin"}, {"field": "manages.reports", "match": "Antonia Joby"}, {"field": "manages.reports", "match": "Maura Lilith Cassandra Ambika"}]}, "must": {"conjuncts": [{"field": "manages.reports", "match": "Sirena Tempest Keelia"}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:13,328] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:13,329] - [task:1140] INFO - FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Quella Martin"}, {"field": "manages.reports", "match": "Antonia Joby"}, {"field": "manages.reports", "match": "Maura Lilith Cassandra Ambika"}]}, "must": {"conjuncts": [{"field": "manages.reports", "match": "Sirena Tempest Keelia"}]}} is 260 (took 76.87541ms) [2016-08-15 12:35:13,360] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"name": "Quella Martin"}}, {"match": {"manages.reports": "Antonia Joby"}}, {"match": {"manages.reports": "Maura Lilith Cassandra Ambika"}}], "must": {"match": {"manages.reports": "Sirena Tempest Keelia"}}}} on es_index is 260 (took 9ms) [2016-08-15 12:35:13,361] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:13,361] - [task:1112] INFO - ------------------------------------------------------------------ Query # 43 ----------------------------------------------------------------- [2016-08-15 12:35:13,376] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.665592", "start": "1989-02-06T02:49:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:13,465] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:13,466] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.665592", "start": "1989-02-06T02:49:00"} is 409 (took 45.102793ms) [2016-08-15 12:35:13,503] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1989-02-06T02:49:00", "lte": "2016-08-15T12:35:09.665592"}}}}} on es_index is 409 (took 9ms) [2016-08-15 12:35:13,504] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:13,505] - [task:1112] INFO - ------------------------------------------------------------------ Query # 44 ----------------------------------------------------------------- [2016-08-15 12:35:13,522] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match_phrase": "Urdu"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:13,546] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:13,546] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "match_phrase": "Urdu"} is 0 (took 4.339856ms) [2016-08-15 12:35:13,551] - [task:1150] INFO - ES hits for query: {"match_phrase": {"languages_known": "Urdu"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:13,552] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:13,552] - [task:1112] INFO - ------------------------------------------------------------------ Query # 45 ----------------------------------------------------------------- [2016-08-15 12:35:13,566] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "-salary:>76000.0"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:13,887] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:13,888] - [task:1140] INFO - FTS hits for query: {"query": "-salary:>76000.0"} is 270 (took 278.999844ms) [2016-08-15 12:35:13,910] - [task:1150] INFO - ES hits for query: {"query_string": {"query": "-salary:>76000.0"}} on es_index is 270 (took 6ms) [2016-08-15 12:35:13,911] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:13,912] - [task:1112] INFO - ------------------------------------------------------------------ Query # 46 ----------------------------------------------------------------- [2016-08-15 12:35:13,991] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "manages.team_size:<=7 -languages_known:\"Quechua\" -manages.reports:\"Sidonia Safiya Winta\""}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:14,120] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:14,121] - [task:1140] INFO - FTS hits for query: {"query": "manages.team_size:<=7 -languages_known:\"Quechua\" -manages.reports:\"Sidonia Safiya Winta\""} is 0 (took 19.82515ms) [2016-08-15 12:35:14,127] - [task:1150] INFO - ES hits for query: {"query_string": {"query": "manages.team_size:<=7 -languages_known:\"Quechua\" -manages.reports:\"Sidonia Safiya Winta\""}} on es_index is 0 (took 2ms) [2016-08-15 12:35:14,127] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:14,128] - [task:1112] INFO - ------------------------------------------------------------------ Query # 47 ----------------------------------------------------------------- [2016-08-15 12:35:14,212] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.666752", "start": "1964-05-27T21:49:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:14,342] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:14,343] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.666752", "start": "1964-05-27T21:49:00"} is 782 (took 46.45265ms) [2016-08-15 12:35:14,408] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.666752", "gt": "1964-05-27T21:49:00"}}}}} on es_index is 782 (took 19ms) [2016-08-15 12:35:14,409] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:14,410] - [task:1112] INFO - ------------------------------------------------------------------ Query # 48 ----------------------------------------------------------------- [2016-08-15 12:35:14,426] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "Japane?e"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:14,452] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:14,452] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "wildcard": "Japane?e"} is 0 (took 1.899864ms) [2016-08-15 12:35:14,457] - [task:1150] INFO - ES hits for query: {"wildcard": {"languages_known": "Japane?e"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:14,457] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:14,457] - [task:1112] INFO - ------------------------------------------------------------------ Query # 49 ----------------------------------------------------------------- [2016-08-15 12:35:14,472] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "wildcard": "*"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:14,736] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:14,738] - [task:1140] INFO - FTS hits for query: {"field": "name", "wildcard": "*"} is 999 (took 138.906933ms) [2016-08-15 12:35:14,825] - [task:1150] INFO - ES hits for query: {"wildcard": {"name": "*"}} on es_index is 1000 (took 32ms) [2016-08-15 12:35:14,826] - [task:1155] ERROR - FAIL: FTS hits: 999, while ES hits: 1000 [2016-08-15 12:35:14,828] - [task:1170] ERROR - FAIL: Following 1 docs were not returned by FTS, but ES, printing 50: [u'emp10000939'] [2016-08-15 12:35:14,828] - [task:1112] INFO - ------------------------------------------------------------------ Query # 50 ----------------------------------------------------------------- [2016-08-15 12:35:14,849] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "manages.reports", "match": "Adena"}, {"field": "languages_known", "prefix": "Mala"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.667834", "start": "1975-07-01T02:47:00"}, {"inclusive_max": true, "field": "salary", "max": 62265.0, "inclusive_min": true, "min": 58000.0}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:14,945] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:14,946] - [task:1140] INFO - FTS hits for query: {"conjuncts": [{"field": "manages.reports", "match": "Adena"}, {"field": "languages_known", "prefix": "Mala"}, {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.667834", "start": "1975-07-01T02:47:00"}, {"inclusive_max": true, "field": "salary", "max": 62265.0, "inclusive_min": true, "min": 58000.0}]} is 0 (took 70.720703ms) [2016-08-15 12:35:14,950] - [task:1150] INFO - ES hits for query: {"bool": {"must": [{"match": {"manages.reports": "Adena"}}, {"prefix": {"languages_known": "Mala"}}, {"filtered": {"filter": {"range": {"join_date": {"gte": "1975-07-01T02:47:00", "lte": "2016-08-15T12:35:09.667834"}}}}}, {"filtered": {"filter": {"range": {"salary": {"gte": 58000.0, "lte": 62265.0}}}}}]}} on es_index is 0 (took 1ms) [2016-08-15 12:35:14,950] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:14,951] - [task:1112] INFO - ------------------------------------------------------------------ Query # 51 ----------------------------------------------------------------- [2016-08-15 12:35:14,977] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.668466", "start": "1990-10-14T18:23:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,099] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,100] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.668466", "start": "1990-10-14T18:23:00"} is 385 (took 81.947042ms) [2016-08-15 12:35:15,130] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1990-10-14T18:23:00", "lte": "2016-08-15T12:35:09.668466"}}}}} on es_index is 385 (took 8ms) [2016-08-15 12:35:15,131] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,131] - [task:1112] INFO - ------------------------------------------------------------------ Query # 52 ----------------------------------------------------------------- [2016-08-15 12:35:15,145] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.668825", "start": "1951-11-21T07:34:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,294] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,295] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.668825", "start": "1951-11-21T07:34:00"} is 961 (took 72.523938ms) [2016-08-15 12:35:15,359] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.668825", "gt": "1951-11-21T07:34:00"}}}}} on es_index is 961 (took 15ms) [2016-08-15 12:35:15,361] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,361] - [task:1112] INFO - ------------------------------------------------------------------ Query # 53 ----------------------------------------------------------------- [2016-08-15 12:35:15,376] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Africans"}, {"field": "name", "match": "Mercedes"}, {"field": "manages.reports", "match": "Chatha Lucretia Deirdre Thea"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,433] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,433] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Africans"}, {"field": "name", "match": "Mercedes"}, {"field": "manages.reports", "match": "Chatha Lucretia Deirdre Thea"}]} is 211 (took 16.797519ms) [2016-08-15 12:35:15,469] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Africans"}}, {"match": {"name": "Mercedes"}}, {"match": {"manages.reports": "Chatha Lucretia Deirdre Thea"}}]}} on es_index is 211 (took 18ms) [2016-08-15 12:35:15,470] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,470] - [task:1112] INFO - ------------------------------------------------------------------ Query # 54 ----------------------------------------------------------------- [2016-08-15 12:35:15,487] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "languages_known", "match": "Chinese"}, {"field": "manages.reports", "match": "Drucilla Kallie Devi Alarice"}, {"field": "name", "match": "Adena Ward"}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,557] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,558] - [task:1140] INFO - FTS hits for query: {"should": {"disjuncts": [{"field": "languages_known", "match": "Chinese"}, {"field": "manages.reports", "match": "Drucilla Kallie Devi Alarice"}, {"field": "name", "match": "Adena Ward"}]}} is 259 (took 20.374242ms) [2016-08-15 12:35:15,588] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Chinese"}}, {"match": {"manages.reports": "Drucilla Kallie Devi Alarice"}}, {"match": {"name": "Adena Ward"}}]}} on es_index is 259 (took 10ms) [2016-08-15 12:35:15,588] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,589] - [task:1112] INFO - ------------------------------------------------------------------ Query # 55 ----------------------------------------------------------------- [2016-08-15 12:35:15,603] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "manages.team_size", "max": 6500, "inclusive_min": false, "min": 9}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,686] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,687] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "manages.team_size", "max": 6500, "inclusive_min": false, "min": 9} is 0 (took 62.388046ms) [2016-08-15 12:35:15,691] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"lt": 6500, "gt": 9}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:15,691] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,692] - [task:1112] INFO - ------------------------------------------------------------------ Query # 56 ----------------------------------------------------------------- [2016-08-15 12:35:15,706] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "prefix": "Ara"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,733] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,734] - [task:1140] INFO - FTS hits for query: {"field": "name", "prefix": "Ara"} is 0 (took 3.09453ms) [2016-08-15 12:35:15,737] - [task:1150] INFO - ES hits for query: {"prefix": {"name": "Ara"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:15,738] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,738] - [task:1112] INFO - ------------------------------------------------------------------ Query # 57 ----------------------------------------------------------------- [2016-08-15 12:35:15,752] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "-languages_known:\"German\""}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,829] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,829] - [task:1140] INFO - FTS hits for query: {"query": "-languages_known:\"German\""} is 1000 (took 43.077834ms) [2016-08-15 12:35:15,905] - [task:1150] INFO - ES hits for query: {"query_string": {"query": "-languages_known:\"German\""}} on es_index is 1000 (took 26ms) [2016-08-15 12:35:15,906] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,907] - [task:1112] INFO - ------------------------------------------------------------------ Query # 58 ----------------------------------------------------------------- [2016-08-15 12:35:15,922] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match_phrase": "Perdita Tempest Severin Killian"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:15,950] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:15,951] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match_phrase": "Perdita Tempest Severin Killian"} is 0 (took 6.016209ms) [2016-08-15 12:35:15,955] - [task:1150] INFO - ES hits for query: {"match_phrase": {"manages.reports": "Perdita Tempest Severin Killian"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:15,955] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:15,956] - [task:1112] INFO - ------------------------------------------------------------------ Query # 59 ----------------------------------------------------------------- [2016-08-15 12:35:15,988] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"conjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "prefix": "F"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.671162", "start": "1982-11-27T15:34:00"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:16,103] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:16,104] - [task:1140] INFO - FTS hits for query: {"conjuncts": [{"field": "languages_known", "match": "Italian"}, {"field": "name", "prefix": "F"}, {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.671162", "start": "1982-11-27T15:34:00"}]} is 0 (took 90.402033ms) [2016-08-15 12:35:16,108] - [task:1150] INFO - ES hits for query: {"bool": {"must": [{"match": {"languages_known": "Italian"}}, {"prefix": {"name": "F"}}, {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.671162", "gt": "1982-11-27T15:34:00"}}}}}]}} on es_index is 0 (took 1ms) [2016-08-15 12:35:16,108] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:16,109] - [task:1112] INFO - ------------------------------------------------------------------ Query # 60 ----------------------------------------------------------------- [2016-08-15 12:35:16,131] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Thai"}, {"field": "languages_known", "match": "Vietnamese"}, {"field": "manages.reports", "match": "Duvessa"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:16,201] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:16,202] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Thai"}, {"field": "languages_known", "match": "Vietnamese"}, {"field": "manages.reports", "match": "Duvessa"}]} is 94 (took 10.678974ms) [2016-08-15 12:35:16,215] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Thai"}}, {"match": {"languages_known": "Vietnamese"}}, {"match": {"manages.reports": "Duvessa"}}]}} on es_index is 94 (took 3ms) [2016-08-15 12:35:16,215] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:16,216] - [task:1112] INFO - ------------------------------------------------------------------ Query # 61 ----------------------------------------------------------------- [2016-08-15 12:35:16,325] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "wildcard": "?ortuguese"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:17,323] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:17,324] - [task:1140] INFO - FTS hits for query: {"field": "languages_known", "wildcard": "?ortuguese"} is 0 (took 2.798757ms) [2016-08-15 12:35:17,328] - [task:1150] INFO - ES hits for query: {"wildcard": {"languages_known": "?ortuguese"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:17,329] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:17,329] - [task:1112] INFO - ------------------------------------------------------------------ Query # 62 ----------------------------------------------------------------- [2016-08-15 12:35:17,415] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"must_not": {"disjuncts": [{"field": "name", "match": "Riona"}, {"field": "name", "match": "Juan José"}]}, "should": {"disjuncts": [{"field": "name", "match": "Delores Johnson"}, {"field": "name", "match": "Riona Adams"}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:17,480] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:17,481] - [task:1140] INFO - FTS hits for query: {"must_not": {"disjuncts": [{"field": "name", "match": "Riona"}, {"field": "name", "match": "Juan José"}]}, "should": {"disjuncts": [{"field": "name", "match": "Delores Johnson"}, {"field": "name", "match": "Riona Adams"}]}} is 133 (took 13.570017ms) [2016-08-15 12:35:17,496] - [task:1150] INFO - ES hits for query: {"bool": {"must_not": [{"match": {"name": "Riona"}}, {"match": {"name": "Juan José"}}], "should": [{"match": {"name": "Delores Johnson"}}, {"match": {"name": "Riona Adams"}}]}} on es_index is 133 (took 4ms) [2016-08-15 12:35:17,497] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:17,497] - [task:1112] INFO - ------------------------------------------------------------------ Query # 63 ----------------------------------------------------------------- [2016-08-15 12:35:17,515] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Ker"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:17,539] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:17,539] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "prefix": "Ker"} is 0 (took 2.388522ms) [2016-08-15 12:35:17,551] - [task:1150] INFO - ES hits for query: {"prefix": {"manages.reports": "Ker"}} on es_index is 96 (took 2ms) [2016-08-15 12:35:17,551] - [task:1155] ERROR - FAIL: FTS hits: 0, while ES hits: 96 [2016-08-15 12:35:17,551] - [task:1170] ERROR - FAIL: Following 96 docs were not returned by FTS, but ES, printing 50: [u'emp10000731', u'emp10000531', u'emp10000435', u'emp10000438', u'emp10000976', u'emp10000873', u'emp10000880', u'emp10000138', u'emp10000132', u'emp10000335', u'emp10000330', u'emp10000220', u'emp10000782', u'emp10000988', u'emp10000639', u'emp10000907', u'emp10000869', u'emp10000305', u'emp10000793', u'emp10000790', u'emp10000251', u'emp10000858', u'emp10000995', u'emp10000997', u'emp10000628', u'emp10000317', u'emp10000643', u'emp10000407', u'emp10000403', u'emp10000247', u'emp10000011', u'emp10000012', u'emp10000397', u'emp10000393', u'emp10000719', u'emp10000497', u'emp10000499', u'emp10000926', u'emp10000921', u'emp10000922', u'emp10000675', u'emp10000005', u'emp10000360', u'emp10000366', u'emp10000578', u'emp10000368', u'emp10000476', u'emp10000083', u'emp10000932', u'emp10000485'] [2016-08-15 12:35:17,552] - [task:1112] INFO - ------------------------------------------------------------------ Query # 64 ----------------------------------------------------------------- [2016-08-15 12:35:17,566] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Thea Casondrah Basha"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:17,614] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:17,615] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match": "Thea Casondrah Basha"} is 192 (took 10.192752ms) [2016-08-15 12:35:17,636] - [task:1150] INFO - ES hits for query: {"match": {"manages.reports": "Thea Casondrah Basha"}} on es_index is 192 (took 5ms) [2016-08-15 12:35:17,637] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:17,637] - [task:1112] INFO - ------------------------------------------------------------------ Query # 65 ----------------------------------------------------------------- [2016-08-15 12:35:17,652] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "manages.reports", "match": "Desdomna Gabi Dabria Thea"}, {"field": "languages_known", "match": "Japanese"}, {"field": "manages.reports", "match": "Antonia Kacila Beryl Sirena"}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:17,740] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:17,741] - [task:1140] INFO - FTS hits for query: {"should": {"disjuncts": [{"field": "manages.reports", "match": "Desdomna Gabi Dabria Thea"}, {"field": "languages_known", "match": "Japanese"}, {"field": "manages.reports", "match": "Antonia Kacila Beryl Sirena"}]}} is 387 (took 28.391475ms) [2016-08-15 12:35:17,780] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"manages.reports": "Desdomna Gabi Dabria Thea"}}, {"match": {"languages_known": "Japanese"}}, {"match": {"manages.reports": "Antonia Kacila Beryl Sirena"}}]}} on es_index is 387 (took 9ms) [2016-08-15 12:35:17,780] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:17,781] - [task:1112] INFO - ------------------------------------------------------------------ Query # 66 ----------------------------------------------------------------- [2016-08-15 12:35:17,796] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Mercedes"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:17,855] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:17,856] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match": "Mercedes"} is 52 (took 12.7303ms) [2016-08-15 12:35:17,864] - [task:1150] INFO - ES hits for query: {"match": {"manages.reports": "Mercedes"}} on es_index is 52 (took 2ms) [2016-08-15 12:35:17,865] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:17,865] - [task:1112] INFO - ------------------------------------------------------------------ Query # 67 ----------------------------------------------------------------- [2016-08-15 12:35:17,880] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.673943", "start": "1953-02-01T01:04:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,035] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,036] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.673943", "start": "1953-02-01T01:04:00"} is 937 (took 89.98335ms) [2016-08-15 12:35:18,102] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.673943", "gt": "1953-02-01T01:04:00"}}}}} on es_index is 937 (took 16ms) [2016-08-15 12:35:18,104] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,104] - [task:1112] INFO - ------------------------------------------------------------------ Query # 68 ----------------------------------------------------------------- [2016-08-15 12:35:18,120] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.674308", "start": "2012-08-09T08:14:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,220] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,221] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.674308", "start": "2012-08-09T08:14:00"} is 57 (took 72.951951ms) [2016-08-15 12:35:18,231] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "2012-08-09T08:14:00", "lte": "2016-08-15T12:35:09.674308"}}}}} on es_index is 57 (took 2ms) [2016-08-15 12:35:18,231] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,232] - [task:1112] INFO - ------------------------------------------------------------------ Query # 69 ----------------------------------------------------------------- [2016-08-15 12:35:18,246] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Du"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,274] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,274] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "prefix": "Du"} is 0 (took 3.854694ms) [2016-08-15 12:35:18,278] - [task:1150] INFO - ES hits for query: {"prefix": {"manages.reports": "Du"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:18,279] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,279] - [task:1112] INFO - ------------------------------------------------------------------ Query # 70 ----------------------------------------------------------------- [2016-08-15 12:35:18,297] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.674912", "start": "1981-12-23T06:33:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,410] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,411] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.674912", "start": "1981-12-23T06:33:00"} is 499 (took 58.271948ms) [2016-08-15 12:35:18,457] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1981-12-23T06:33:00", "lte": "2016-08-15T12:35:09.674912"}}}}} on es_index is 499 (took 10ms) [2016-08-15 12:35:18,459] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,459] - [task:1112] INFO - ------------------------------------------------------------------ Query # 71 ----------------------------------------------------------------- [2016-08-15 12:35:18,478] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "mutated", "max": 1860, "inclusive_min": false, "min": 5}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,566] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,566] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "mutated", "max": 1860, "inclusive_min": false, "min": 5} is 0 (took 63.453429ms) [2016-08-15 12:35:18,569] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"lt": 1860, "gt": 5}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:18,570] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,570] - [task:1112] INFO - ------------------------------------------------------------------ Query # 72 ----------------------------------------------------------------- [2016-08-15 12:35:18,588] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"must_not": {"disjuncts": [{"field": "name", "match": "Fuscienne Howard Jr."}]}, "should": {"disjuncts": [{"field": "manages.reports", "match": "Fantine Fuscienne Cassandra Araceli"}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,669] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,670] - [task:1140] INFO - FTS hits for query: {"must_not": {"disjuncts": [{"field": "name", "match": "Fuscienne Howard Jr."}]}, "should": {"disjuncts": [{"field": "manages.reports", "match": "Fantine Fuscienne Cassandra Araceli"}]}} is 226 (took 26.433084ms) [2016-08-15 12:35:18,694] - [task:1150] INFO - ES hits for query: {"bool": {"must_not": {"match": {"name": "Fuscienne Howard Jr."}}, "should": {"match": {"manages.reports": "Fantine Fuscienne Cassandra Araceli"}}}} on es_index is 226 (took 6ms) [2016-08-15 12:35:18,694] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,695] - [task:1112] INFO - ------------------------------------------------------------------ Query # 73 ----------------------------------------------------------------- [2016-08-15 12:35:18,713] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Kory Robinson Sr."}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,764] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,764] - [task:1140] INFO - FTS hits for query: {"field": "name", "match": "Kory Robinson Sr."} is 116 (took 6.894472ms) [2016-08-15 12:35:18,780] - [task:1150] INFO - ES hits for query: {"match": {"name": "Kory Robinson Sr."}} on es_index is 116 (took 4ms) [2016-08-15 12:35:18,780] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,781] - [task:1112] INFO - ------------------------------------------------------------------ Query # 74 ----------------------------------------------------------------- [2016-08-15 12:35:18,796] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "languages_known:\"Dutch\" -manages.team_size:>10 +manages.team_size:<=14 manages.team_size:>6 +manages.team_size:<8720"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:18,967] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:18,968] - [task:1140] INFO - FTS hits for query: {"query": "languages_known:\"Dutch\" -manages.team_size:>10 +manages.team_size:<=14 manages.team_size:>6 +manages.team_size:<8720"} is 0 (took 149.257182ms) [2016-08-15 12:35:18,972] - [task:1150] INFO - ES hits for query: {"query_string": {"query": "languages_known:\"Dutch\" -manages.team_size:>10 +manages.team_size:<=14 manages.team_size:>6 +manages.team_size:<8720"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:18,972] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:18,973] - [task:1112] INFO - ------------------------------------------------------------------ Query # 75 ----------------------------------------------------------------- [2016-08-15 12:35:18,986] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "name", "match": "Jerica Thomas"}, {"field": "languages_known", "match": "Italian"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,032] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,033] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "name", "match": "Jerica Thomas"}, {"field": "languages_known", "match": "Italian"}]} is 23 (took 8.9739ms) [2016-08-15 12:35:19,039] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"name": "Jerica Thomas"}}, {"match": {"languages_known": "Italian"}}]}} on es_index is 23 (took 1ms) [2016-08-15 12:35:19,039] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:19,040] - [task:1112] INFO - ------------------------------------------------------------------ Query # 76 ----------------------------------------------------------------- [2016-08-15 12:35:19,054] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"should": {"disjuncts": [{"field": "name", "match": "Jerica Wood"}, {"field": "name", "match": "Lysha Gerónimo"}]}}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,092] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,092] - [task:1140] INFO - FTS hits for query: {"should": {"disjuncts": [{"field": "name", "match": "Jerica Wood"}, {"field": "name", "match": "Lysha Gerónimo"}]}} is 64 (took 7.860768ms) [2016-08-15 12:35:19,101] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"name": "Jerica Wood"}}, {"match": {"name": "Lysha Gerónimo"}}]}} on es_index is 64 (took 2ms) [2016-08-15 12:35:19,102] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:19,102] - [task:1112] INFO - ------------------------------------------------------------------ Query # 77 ----------------------------------------------------------------- [2016-08-15 12:35:19,127] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.677515", "start": "1988-02-04T02:24:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,239] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,240] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.677515", "start": "1988-02-04T02:24:00"} is 423 (took 53.361975ms) [2016-08-15 12:35:19,278] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.677515", "gt": "1988-02-04T02:24:00"}}}}} on es_index is 423 (took 7ms) [2016-08-15 12:35:19,279] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:19,280] - [task:1112] INFO - ------------------------------------------------------------------ Query # 78 ----------------------------------------------------------------- [2016-08-15 12:35:19,298] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "mutated", "max": 4730, "inclusive_min": false, "min": 2}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,374] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,374] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "mutated", "max": 4730, "inclusive_min": false, "min": 2} is 0 (took 41.847557ms) [2016-08-15 12:35:19,378] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"lt": 4730, "gt": 2}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:19,378] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:19,379] - [task:1112] INFO - ------------------------------------------------------------------ Query # 79 ----------------------------------------------------------------- [2016-08-15 12:35:19,408] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.678157", "start": "1983-06-27T10:08:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,526] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,527] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.678157", "start": "1983-06-27T10:08:00"} is 480 (took 69.419662ms) [2016-08-15 12:35:19,569] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.678157", "gt": "1983-06-27T10:08:00"}}}}} on es_index is 480 (took 8ms) [2016-08-15 12:35:19,571] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:19,572] - [task:1112] INFO - ------------------------------------------------------------------ Query # 80 ----------------------------------------------------------------- [2016-08-15 12:35:19,598] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "manages.reports", "match": "Sidonia Adara"}, {"field": "name", "match": "Killian Davis"}, {"field": "languages_known", "match": "Portuguese"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,652] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,653] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "manages.reports", "match": "Sidonia Adara"}, {"field": "name", "match": "Killian Davis"}, {"field": "languages_known", "match": "Portuguese"}]} is 230 (took 18.648379ms) [2016-08-15 12:35:19,683] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"manages.reports": "Sidonia Adara"}}, {"match": {"name": "Killian Davis"}}, {"match": {"languages_known": "Portuguese"}}]}} on es_index is 230 (took 11ms) [2016-08-15 12:35:19,684] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:19,684] - [task:1112] INFO - ------------------------------------------------------------------ Query # 81 ----------------------------------------------------------------- [2016-08-15 12:35:19,705] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "Cyn"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,732] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,733] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "prefix": "Cyn"} is 0 (took 1.914463ms) [2016-08-15 12:35:19,742] - [task:1150] INFO - ES hits for query: {"prefix": {"manages.reports": "Cyn"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:19,742] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:19,743] - [task:1112] INFO - ------------------------------------------------------------------ Query # 82 ----------------------------------------------------------------- [2016-08-15 12:35:19,760] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.679241", "start": "1959-07-06T10:42:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:19,889] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:19,889] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.679241", "start": "1959-07-06T10:42:00"} is 853 (took 67.929651ms) [2016-08-15 12:35:20,052] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.679241", "gt": "1959-07-06T10:42:00"}}}}} on es_index is 853 (took 14ms) [2016-08-15 12:35:20,054] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,054] - [task:1112] INFO - ------------------------------------------------------------------ Query # 83 ----------------------------------------------------------------- [2016-08-15 12:35:20,071] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "salary", "max": 144354.0, "inclusive_min": false, "min": 140000.0}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,154] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,154] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "salary", "max": 144354.0, "inclusive_min": false, "min": 140000.0} is 50 (took 55.850307ms) [2016-08-15 12:35:20,169] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"salary": {"lt": 144354.0, "gt": 140000.0}}}}} on es_index is 50 (took 2ms) [2016-08-15 12:35:20,170] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,170] - [task:1112] INFO - ------------------------------------------------------------------ Query # 84 ----------------------------------------------------------------- [2016-08-15 12:35:20,185] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Callia"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,227] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,227] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match": "Callia"} is 149 (took 9.022396ms) [2016-08-15 12:35:20,263] - [task:1150] INFO - ES hits for query: {"match": {"manages.reports": "Callia"}} on es_index is 149 (took 4ms) [2016-08-15 12:35:20,264] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,264] - [task:1112] INFO - ------------------------------------------------------------------ Query # 85 ----------------------------------------------------------------- [2016-08-15 12:35:20,280] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "prefix": "D"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,308] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,308] - [task:1140] INFO - FTS hits for query: {"field": "name", "prefix": "D"} is 0 (took 4.612735ms) [2016-08-15 12:35:20,328] - [task:1150] INFO - ES hits for query: {"prefix": {"name": "D"}} on es_index is 37 (took 2ms) [2016-08-15 12:35:20,329] - [task:1155] ERROR - FAIL: FTS hits: 0, while ES hits: 37 [2016-08-15 12:35:20,329] - [task:1170] ERROR - FAIL: Following 37 docs were not returned by FTS, but ES, printing 50: [u'emp10000160', u'emp10000165', u'emp10000041', u'emp10000243', u'emp10000006', u'emp10000707', u'emp10000340', u'emp10000850', u'emp10000853', u'emp10000654', u'emp10000877', u'emp10000818', u'emp10000746', u'emp10000606', u'emp10000607', u'emp10000762', u'emp10000664', u'emp10000760', u'emp10000704', u'emp10000138', u'emp10000269', u'emp10000137', u'emp10000263', u'emp10000686', u'emp10000221', u'emp10000569', u'emp10000117', u'emp10000378', u'emp10000198', u'emp10000661', u'emp10000960', u'emp10000631', u'emp10000801', u'emp10000804', u'emp10000595', u'emp10000610', u'emp10000458'] [2016-08-15 12:35:20,329] - [task:1112] INFO - ------------------------------------------------------------------ Query # 86 ----------------------------------------------------------------- [2016-08-15 12:35:20,345] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Casondrah Ambika"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,399] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,400] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match": "Casondrah Ambika"} is 75 (took 24.571847ms) [2016-08-15 12:35:20,424] - [task:1150] INFO - ES hits for query: {"match": {"manages.reports": "Casondrah Ambika"}} on es_index is 75 (took 2ms) [2016-08-15 12:35:20,424] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,425] - [task:1112] INFO - ------------------------------------------------------------------ Query # 87 ----------------------------------------------------------------- [2016-08-15 12:35:20,441] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "manages.team_size", "max": 1743, "inclusive_min": true, "min": 8}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,474] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,475] - [task:1140] INFO - FTS hits for query: {"inclusive_max": true, "field": "manages.team_size", "max": 1743, "inclusive_min": true, "min": 8} is 0 (took 9.200535ms) [2016-08-15 12:35:20,486] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"manages.team_size": {"gte": 8, "lte": 1743}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:20,487] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,487] - [task:1112] INFO - ------------------------------------------------------------------ Query # 88 ----------------------------------------------------------------- [2016-08-15 12:35:20,507] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.680883", "start": "2008-10-22T21:24:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,573] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,574] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.680883", "start": "2008-10-22T21:24:00"} is 108 (took 37.59216ms) [2016-08-15 12:35:20,597] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.680883", "gt": "2008-10-22T21:24:00"}}}}} on es_index is 108 (took 3ms) [2016-08-15 12:35:20,598] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,598] - [task:1112] INFO - ------------------------------------------------------------------ Query # 89 ----------------------------------------------------------------- [2016-08-15 12:35:20,621] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "+manages.reports:\"Jetta Lucretia Ebony\" manages.team_size:>6 +manages.team_size:<533 +mutated:<4"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,719] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,719] - [task:1140] INFO - FTS hits for query: {"query": "+manages.reports:\"Jetta Lucretia Ebony\" manages.team_size:>6 +manages.team_size:<533 +mutated:<4"} is 0 (took 69.673669ms) [2016-08-15 12:35:20,733] - [task:1150] INFO - ES hits for query: {"query_string": {"query": "+manages.reports:\"Jetta Lucretia Ebony\" manages.team_size:>6 +manages.team_size:<533 +mutated:<4"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:20,733] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,733] - [task:1112] INFO - ------------------------------------------------------------------ Query # 90 ----------------------------------------------------------------- [2016-08-15 12:35:20,749] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.681678", "start": "1990-08-03T07:32:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:20,897] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:20,897] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.681678", "start": "1990-08-03T07:32:00"} is 387 (took 89.243027ms) [2016-08-15 12:35:20,970] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1990-08-03T07:32:00", "lte": "2016-08-15T12:35:09.681678"}}}}} on es_index is 387 (took 9ms) [2016-08-15 12:35:20,971] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:20,972] - [task:1112] INFO - ------------------------------------------------------------------ Query # 91 ----------------------------------------------------------------- [2016-08-15 12:35:20,994] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "prefix": "C"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,018] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,019] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "prefix": "C"} is 0 (took 3.044773ms) [2016-08-15 12:35:21,058] - [task:1150] INFO - ES hits for query: {"prefix": {"manages.reports": "C"}} on es_index is 168 (took 4ms) [2016-08-15 12:35:21,058] - [task:1155] ERROR - FAIL: FTS hits: 0, while ES hits: 168 [2016-08-15 12:35:21,058] - [task:1170] ERROR - FAIL: Following 168 docs were not returned by FTS, but ES, printing 50: [u'emp10000731', u'emp10000042', u'emp10000187', u'emp10000325', u'emp10000094', u'emp10000120', u'emp10000430', u'emp10000237', u'emp10000231', u'emp10000232', u'emp10000972', u'emp10000873', u'emp10000168', u'emp10000607', u'emp10000534', u'emp10000878', u'emp10000705', u'emp10000704', u'emp10000138', u'emp10000701', u'emp10000339', u'emp10000703', u'emp10000424', u'emp10000220', u'emp10000427', u'emp10000788', u'emp10000225', u'emp10000542', u'emp10000005', u'emp10000987', u'emp10000988', u'emp10001000', u'emp10000865', u'emp10000909', u'emp10000860', u'emp10000618', u'emp10000639', u'emp10000907', u'emp10000869', u'emp10000653', u'emp10000652', u'emp10000656', u'emp10000145', u'emp10000144', u'emp10000415', u'emp10000414', u'emp10000257', u'emp10000254', u'emp10000550', u'emp10000553'] [2016-08-15 12:35:21,059] - [task:1112] INFO - ------------------------------------------------------------------ Query # 92 ----------------------------------------------------------------- [2016-08-15 12:35:21,075] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.682370", "start": "1999-04-25T06:20:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,164] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,164] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.682370", "start": "1999-04-25T06:20:00"} is 253 (took 49.26628ms) [2016-08-15 12:35:21,205] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1999-04-25T06:20:00", "lte": "2016-08-15T12:35:09.682370"}}}}} on es_index is 253 (took 5ms) [2016-08-15 12:35:21,206] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:21,206] - [task:1112] INFO - ------------------------------------------------------------------ Query # 93 ----------------------------------------------------------------- [2016-08-15 12:35:21,223] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.682747", "start": "1986-01-14T10:55:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,308] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,309] - [task:1140] INFO - FTS hits for query: {"inclusive_start": false, "field": "join_date", "inclusive_end": false, "end": "2016-08-15T12:35:09.682747", "start": "1986-01-14T10:55:00"} is 450 (took 40.26861ms) [2016-08-15 12:35:21,371] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"lt": "2016-08-15T12:35:09.682747", "gt": "1986-01-14T10:55:00"}}}}} on es_index is 450 (took 7ms) [2016-08-15 12:35:21,372] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:21,373] - [task:1112] INFO - ------------------------------------------------------------------ Query # 94 ----------------------------------------------------------------- [2016-08-15 12:35:21,392] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Antonia"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,440] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,441] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match": "Antonia"} is 96 (took 7.911275ms) [2016-08-15 12:35:21,464] - [task:1150] INFO - ES hits for query: {"match": {"manages.reports": "Antonia"}} on es_index is 96 (took 2ms) [2016-08-15 12:35:21,464] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:21,465] - [task:1112] INFO - ------------------------------------------------------------------ Query # 95 ----------------------------------------------------------------- [2016-08-15 12:35:21,479] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match_phrase": "Tempest Campbell"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,506] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,506] - [task:1140] INFO - FTS hits for query: {"field": "name", "match_phrase": "Tempest Campbell"} is 0 (took 3.977184ms) [2016-08-15 12:35:21,516] - [task:1150] INFO - ES hits for query: {"match_phrase": {"name": "Tempest Campbell"}} on es_index is 2 (took 1ms) [2016-08-15 12:35:21,516] - [task:1155] ERROR - FAIL: FTS hits: 0, while ES hits: 2 [2016-08-15 12:35:21,517] - [task:1170] ERROR - FAIL: Following 2 docs were not returned by FTS, but ES, printing 50: [u'emp10000016', u'emp10000441'] [2016-08-15 12:35:21,517] - [task:1112] INFO - ------------------------------------------------------------------ Query # 96 ----------------------------------------------------------------- [2016-08-15 12:35:21,540] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"disjuncts": [{"field": "languages_known", "match": "Malay"}, {"field": "manages.reports", "match": "Gallia"}]}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,584] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,584] - [task:1140] INFO - FTS hits for query: {"disjuncts": [{"field": "languages_known", "match": "Malay"}, {"field": "manages.reports", "match": "Gallia"}]} is 149 (took 8.595089ms) [2016-08-15 12:35:21,616] - [task:1150] INFO - ES hits for query: {"bool": {"should": [{"match": {"languages_known": "Malay"}}, {"match": {"manages.reports": "Gallia"}}]}} on es_index is 149 (took 4ms) [2016-08-15 12:35:21,617] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:21,617] - [task:1112] INFO - ------------------------------------------------------------------ Query # 97 ----------------------------------------------------------------- [2016-08-15 12:35:21,634] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": false, "field": "mutated", "max": 3202, "inclusive_min": false, "min": 5}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,712] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,713] - [task:1140] INFO - FTS hits for query: {"inclusive_max": false, "field": "mutated", "max": 3202, "inclusive_min": false, "min": 5} is 0 (took 55.229551ms) [2016-08-15 12:35:21,722] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"lt": 3202, "gt": 5}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:21,723] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:21,723] - [task:1112] INFO - ------------------------------------------------------------------ Query # 98 ----------------------------------------------------------------- [2016-08-15 12:35:21,741] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_max": true, "field": "mutated", "max": 7894, "inclusive_min": true, "min": 3}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,779] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,779] - [task:1140] INFO - FTS hits for query: {"inclusive_max": true, "field": "mutated", "max": 7894, "inclusive_min": true, "min": 3} is 0 (took 14.803437ms) [2016-08-15 12:35:21,792] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"mutated": {"gte": 3, "lte": 7894}}}}} on es_index is 0 (took 1ms) [2016-08-15 12:35:21,792] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:21,793] - [task:1112] INFO - ------------------------------------------------------------------ Query # 99 ----------------------------------------------------------------- [2016-08-15 12:35:21,810] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.684599", "start": "1990-07-08T05:07:00"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:21,900] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:21,901] - [task:1140] INFO - FTS hits for query: {"inclusive_start": true, "field": "join_date", "inclusive_end": true, "end": "2016-08-15T12:35:09.684599", "start": "1990-07-08T05:07:00"} is 387 (took 51.735701ms) [2016-08-15 12:35:21,959] - [task:1150] INFO - ES hits for query: {"filtered": {"filter": {"range": {"join_date": {"gte": "1990-07-08T05:07:00", "lte": "2016-08-15T12:35:09.684599"}}}}} on es_index is 387 (took 7ms) [2016-08-15 12:35:21,960] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified [2016-08-15 12:35:21,961] - [task:1112] INFO - ------------------------------------------------------------------ Query # 100 ----------------------------------------------------------------- [2016-08-15 12:35:21,977] - [fts_base:1173] INFO - Running query {"from": 0, "indexName": "custom_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match_phrase": "Cassandra Sidonia"}, "size": 10000000} on node: 172.23.106.72: [2016-08-15 12:35:22,002] - [task:1116] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32} [2016-08-15 12:35:22,003] - [task:1140] INFO - FTS hits for query: {"field": "manages.reports", "match_phrase": "Cassandra Sidonia"} is 0 (took 6.159812ms) [2016-08-15 12:35:22,015] - [task:1150] INFO - ES hits for query: {"match_phrase": {"manages.reports": "Cassandra Sidonia"}} on es_index is 0 (took 1ms) [2016-08-15 12:35:22,015] - [task:1159] INFO - SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified FAIL [2016-08-15 12:35:22,039] - [rest_client:1299] INFO - /diag/eval status on 172.23.106.72:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))). [2016-08-15 12:35:22,041] - [remote_util:172] INFO - connecting to 172.23.106.72 with username : root password : couchbase ssh_key: [2016-08-15 12:35:22,329] - [remote_util:206] INFO - Connected to 172.23.106.72 [2016-08-15 12:35:22,991] - [remote_util:2383] INFO - running command.raw on 172.23.106.72: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l [2016-08-15 12:35:23,841] - [remote_util:2420] INFO - command executed successfully [2016-08-15 12:35:23,842] - [fts_base:2474] INFO - 0 [2016-08-15 12:35:23,842] - [fts_base:2482] INFO - Initial 'panic:' count on 172.23.106.72 :0, now :0 [2016-08-15 12:35:23,842] - [remote_util:2383] INFO - running command.raw on 172.23.106.72: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l [2016-08-15 12:35:24,682] - [remote_util:2420] INFO - command executed successfully [2016-08-15 12:35:24,683] - [fts_base:2474] INFO - 0 [2016-08-15 12:35:24,683] - [fts_base:2482] INFO - Initial 'crash in forestdb' count on 172.23.106.72 :0, now :0 [2016-08-15 12:35:24,798] - [fts_base:2047] INFO - Collecting logs @ 172.23.106.72 grabbing cbcollect from 172.23.106.72 [2016-08-15 12:35:24,800] - [remote_util:172] INFO - connecting to 172.23.106.72 with username : root password : couchbase ssh_key: [2016-08-15 12:35:25,010] - [remote_util:206] INFO - Connected to 172.23.106.72 Collecting logs from 172.23.106.72 [2016-08-15 12:35:25,507] - [remote_util:2383] INFO - running command.raw on 172.23.106.72: /opt/couchbase/bin/cbcollect_info 172.23.106.72-20160815-1235-diag.zip [2016-08-15 12:38:07,898] - [remote_util:2420] INFO - command executed successfully Downloading zipped logs from 172.23.106.72 [2016-08-15 12:38:09,162] - [remote_util:2383] INFO - running command.raw on 172.23.106.72: rm -f /root/172.23.106.72-20160815-1235-diag.zip [2016-08-15 12:38:09,280] - [remote_util:2420] INFO - command executed successfully [2016-08-15 12:38:09,282] - [fts_base:2056] INFO - ==== FTSbasetests cleanup is started for test #58 index_query_custom_mapping ==== [2016-08-15 12:38:09,385] - [fts_base:663] INFO - Deleting fulltext-index custom_index on 172.23.106.72 [2016-08-15 12:38:09,545] - [remote_util:172] INFO - connecting to 172.23.106.72 with username : root password : couchbase ssh_key: [2016-08-15 12:38:09,839] - [remote_util:206] INFO - Connected to 172.23.106.72 [2016-08-15 12:38:10,514] - [remote_util:2383] INFO - running command.raw on 172.23.106.72: ls /opt/couchbase/var/lib/couchbase/data/@fts |grep custom_index*.pindex | wc -l [2016-08-15 12:38:10,620] - [remote_util:2420] INFO - command executed successfully [2016-08-15 12:38:10,621] - [fts_base:886] INFO - 0 [2016-08-15 12:38:10,622] - [fts_base:670] INFO - Validated: all index files for custom_index deleted from disk [2016-08-15 12:38:10,622] - [fts_base:978] INFO - removing nodes from cluster ... [2016-08-15 12:38:10,654] - [fts_base:980] INFO - cleanup [ip:172.23.106.72 port:8091 ssh_username:root] [2016-08-15 12:38:10,691] - [bucket_helper:138] INFO - deleting existing buckets [u'default'] on 172.23.106.72 [2016-08-15 12:38:10,691] - [bucket_helper:140] INFO - remove bucket default ... [2016-08-15 12:38:12,203] - [bucket_helper:154] INFO - deleted bucket : default from 172.23.106.72 [2016-08-15 12:38:12,203] - [bucket_helper:230] INFO - waiting for bucket deletion to complete.... [2016-08-15 12:38:12,208] - [rest_client:133] INFO - node 172.23.106.72 existing buckets : [] [2016-08-15 12:38:12,246] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.106.72:8091 [2016-08-15 12:38:12,254] - [cluster_helper:80] INFO - ns_server @ 172.23.106.72:8091 is running Cluster instance shutdown with force [2016-08-15 12:38:12,280] - [es_base:208] INFO - ES index es_index deleted [2016-08-15 12:38:12,280] - [fts_base:2062] INFO - ==== FTSbasetests cleanup is finished for test #58 index_query_custom_mapping === ====================================================================== FAIL: index_query_custom_mapping (fts.stable_topology_fts.StableTopFTS) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/fts/stable_topology_fts.py", line 339, in index_query_custom_mapping self.run_query_and_compare(index) File "pytests/fts/fts_base.py", line 2941, in run_query_and_compare failed_queries)) AssertionError: 7 out of 100 queries failed! - [14, 18, 49, 63, 85, 91, 95] ---------------------------------------------------------------------- Ran 1 test in 211.529s FAILED (failures=1) Cluster instance shutdown with force grabbing core dumps files from 172.23.106.72 [2016-08-15 12:38:12,283] - [remote_util:172] INFO - connecting to 172.23.106.72 with username : root password : couchbase ssh_key: [2016-08-15 12:38:12,573] - [remote_util:206] INFO - Connected to 172.23.106.72 [2016-08-15 12:38:13,293] - [remote_util:481] INFO - 172.23.106.72 **** The version file /opt/couchbase/ VERSION.txt exists downloading 172.23.106.72 ...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................looking for crashes on 172.23.106.72 ... erl_crash files under /opt/couchbase/var/lib/couchbase/ core* files under /opt/couchbase/var/lib/couchbase/ core* files under /tmp/ breakpad *dmp files under /opt/couchbase/var/lib/couchbase/ crashes not found on 172.23.106.72 grabbing diags from http://172.23.106.72:8091/diag downloaded and zipped diags @ : /data/workspace/cen006-p0-fts-vset00-00-custom-map-rqg/logs/testrunner-16-Aug-15_11-29-36/test_58/172.23.106.72-diag.txt.gz summary so far suite fts.stable_topology_fts.StableTopFTS , pass 51 , fail 7 failures so far... fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping testrunner logs, diags and results are available under /data/workspace/cen006-p0-fts-vset00-00-custom-map-rqg/logs/testrunner-16-Aug-15_11-29-36/test_58