Details
-
Bug
-
Resolution: User Error
-
Major
-
None
-
4.5.0
-
None
-
Couchbase 4.5.0-2203 Enterprise Edition
Mac OSX 10.10.5
Single Node cluster
Only primary index was created for the table with data inserted.
-
Untriaged
-
MacOSX 64-bit
-
Unknown
Description
Simba is trying to insert 140K rows in batches of different sizes, and seeing perf issue (with 4.5 build#2203)
---------------------------------------
Here’s some information around the insertion delays we’re seeing. There are two lines showing insertions of 140k documents, with a batch size of 72 and 10000. The times for each are:
· Batch size 72: 30967.09 seconds (~8.6 hours)
· Batch size 10000: 710.062 seconds (~11.8 minutes)
The chart shows the delay we’re seeing for each INSERT statement and the increase in delay from the Couchbase server as the totally insertion of 140k documents progresses. The reason that the batch size of 10000 shows that it’s taking much longer per insert is because it’s inserting many more documents at a time, but since there any many fewer INSERTs the delay incurred from the Couchbase server is much less.
Couchbase Server Info:
Couchbase 4.5.0-2203 Enterprise Edition
Mac OSX 10.10.5
Single Node cluster
Only primary index was created for the table with data inserted.
It appears that N1QL doesn’t support parameters, so we translate a batch set of parameters with a single insert query. Here’s the query that we end up sending to Informatica for the first batch of parameters we get from Informatica:
INSERT INTO `DBF` (KEY, VALUE) VALUES ('1', {"Agency":"San Francisco","BasePay":167411.18,"Benefits":null,"EmployeeName":"NATHANIEL FORD","Id":"1","JobTitle":"GENERAL MANAGER-METROPOLITAN TRANSIT AUTHORITY","Notes":null,"OtherPay":400184.25,"OvertimePay":0.0,"Status":null,"TotalPay":567595.43,"TotalPayBenefits":567595.43,"Year":2011,"type":"DBFInformatica"}), VALUES ('2', {"Agency":"San Francisco","BasePay":155966.02,"Benefits":null,"EmployeeName":"GARY JIMENEZ","Id":"2","JobTitle":"CAPTAIN III (POLICE DEPARTMENT)","Notes":null,"OtherPay":137811.38,"OvertimePay":245131.88,"Status":null,"TotalPay":538909.28,"TotalPayBenefits":538909.28,"Year":2011,"type":"DBFInformatica"}), VALUES ('3', {"Agency":"San Francisco","BasePay":212739.13,"Benefits":null,"EmployeeName":"ALBERT PARDINI","Id":"3","JobTitle":"CAPTAIN III (POLICE DEPARTMENT)","Notes":null,"OtherPay":16452.6,"OvertimePay":106088.18,"Status":null,"TotalPay":335279.91,"TotalPayBenefits":335279.91,"Year":2011,"type":"DBFInformatica"}), VALUES ('4', {"Agency":"San Francisco","BasePay":77916.0,"Benefits":null,"EmployeeName":"CHRISTOPHER CHONG","Id":"4","JobTitle":"WIRE ROPE CABLE MAINTENANCE MECHANIC","Notes":null,"OtherPay":198306.9,"OvertimePay":56120.71,"Status":null,"TotalPay":332343.61,"TotalPayBenefits":332343.61,"Year":2011,"type":"DBFInformatica"}), VALUES ('5', {"Agency":"San Francisco","BasePay":134401.6,"Benefits":null,"EmployeeName":"PATRICK GARDNER","Id":"5","JobTitle":"DEPUTY CHIEF OF DEPARTMENT,(FIRE DEPARTMENT)","Notes":null,"OtherPay":182234.59,"OvertimePay":9737.0,"Status":null,"TotalPay":326373.19,"TotalPayBenefits":326373.19,"Year":2011,"type":"DBFInformatica"}), VALUES ('6', {"Agency":"San Francisco","BasePay":118602.0,"Benefits":null,"EmployeeName":"DAVID SULLIVAN","Id":"6","JobTitle":"ASSISTANT DEPUTY CHIEF II","Notes":null,"OtherPay":189082.74,"OvertimePay":8601.0,"Status":null,"TotalPay":316285.74,"TotalPayBenefits":316285.74,"Year":2011,"type":"DBFInformatica"}), VALUES ('7', {"Agency":"San Francisco","BasePay":92492.01,"Benefits":null,"EmployeeName":"ALSON LEE","Id":"7","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":134426.14,"OvertimePay":89062.9,"Status":null,"TotalPay":315981.05,"TotalPayBenefits":315981.05,"Year":2011,"type":"DBFInformatica"}), VALUES ('8', {"Agency":"San Francisco","BasePay":256576.96,"Benefits":null,"EmployeeName":"DAVID KUSHNER","Id":"8","JobTitle":"DEPUTY DIRECTOR OF INVESTMENTS","Notes":null,"OtherPay":51322.5,"OvertimePay":0.0,"Status":null,"TotalPay":307899.46,"TotalPayBenefits":307899.46,"Year":2011,"type":"DBFInformatica"}), VALUES ('9', {"Agency":"San Francisco","BasePay":176932.64,"Benefits":null,"EmployeeName":"MICHAEL MORRIS","Id":"9","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":40132.23,"OvertimePay":86362.68,"Status":null,"TotalPay":303427.55,"TotalPayBenefits":303427.55,"Year":2011,"type":"DBFInformatica"}), VALUES ('10', {"Agency":"San Francisco","BasePay":285262.0,"Benefits":null,"EmployeeName":"JOANNE HAYES-WHITE","Id":"10","JobTitle":"CHIEF OF DEPARTMENT, (FIRE DEPARTMENT)","Notes":null,"OtherPay":17115.73,"OvertimePay":0.0,"Status":null,"TotalPay":302377.73,"TotalPayBenefits":302377.73,"Year":2011,"type":"DBFInformatica"}), VALUES ('11', {"Agency":"San Francisco","BasePay":194999.39,"Benefits":null,"EmployeeName":"ARTHUR KENNEY","Id":"11","JobTitle":"ASSISTANT CHIEF OF DEPARTMENT, (FIRE DEPARTMENT)","Notes":null,"OtherPay":33149.9,"OvertimePay":71344.88,"Status":null,"TotalPay":299494.17,"TotalPayBenefits":299494.17,"Year":2011,"type":"DBFInformatica"}), VALUES ('12', {"Agency":"San Francisco","BasePay":99722.0,"Benefits":null,"EmployeeName":"PATRICIA JACKSON","Id":"12","JobTitle":"CAPTAIN III (POLICE DEPARTMENT)","Notes":null,"OtherPay":110804.3,"OvertimePay":87082.62,"Status":null,"TotalPay":297608.92,"TotalPayBenefits":297608.92,"Year":2011,"type":"DBFInformatica"}), VALUES ('13', {"Agency":"San Francisco","BasePay":294580.02,"Benefits":null,"EmployeeName":"EDWARD HARRINGTON","Id":"13","JobTitle":"EXECUTIVE CONTRACT EMPLOYEE","Notes":null,"OtherPay":0.0,"OvertimePay":0.0,"Status":null,"TotalPay":294580.02,"TotalPayBenefits":294580.02,"Year":2011,"type":"DBFInformatica"}), VALUES ('14', {"Agency":"San Francisco","BasePay":271329.03,"Benefits":null,"EmployeeName":"JOHN MARTIN","Id":"14","JobTitle":"DEPARTMENT HEAD V","Notes":null,"OtherPay":21342.59,"OvertimePay":0.0,"Status":null,"TotalPay":292671.62,"TotalPayBenefits":292671.62,"Year":2011,"type":"DBFInformatica"}), VALUES ('15', {"Agency":"San Francisco","BasePay":174872.64,"Benefits":null,"EmployeeName":"DAVID FRANKLIN","Id":"15","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":37424.11,"OvertimePay":74050.3,"Status":null,"TotalPay":286347.05,"TotalPayBenefits":286347.05,"Year":2011,"type":"DBFInformatica"}), VALUES ('16', {"Agency":"San Francisco","BasePay":198778.01,"Benefits":null,"EmployeeName":"RICHARD CORRIEA","Id":"16","JobTitle":"COMMANDER III, (POLICE DEPARTMENT)","Notes":null,"OtherPay":13957.65,"OvertimePay":73478.2,"Status":null,"TotalPay":286213.86,"TotalPayBenefits":286213.86,"Year":2011,"type":"DBFInformatica"}), VALUES ('17', {"Agency":"San Francisco","BasePay":268604.57,"Benefits":null,"EmployeeName":"AMY HART","Id":"17","JobTitle":"DEPARTMENT HEAD V","Notes":null,"OtherPay":16115.86,"OvertimePay":0.0,"Status":null,"TotalPay":284720.43,"TotalPayBenefits":284720.43,"Year":2011,"type":"DBFInformatica"}), VALUES ('18', {"Agency":"San Francisco","BasePay":140546.87,"Benefits":null,"EmployeeName":"SEBASTIAN WONG","Id":"18","JobTitle":"CAPTAIN, EMERGENCYCY MEDICAL SERVICES","Notes":null,"OtherPay":18625.08,"OvertimePay":119397.26,"Status":null,"TotalPay":278569.21,"TotalPayBenefits":278569.21,"Year":2011,"type":"DBFInformatica"}), VALUES ('19', {"Agency":"San Francisco","BasePay":168692.63,"Benefits":null,"EmployeeName":"MARTY ROSS","Id":"19","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":38115.47,"OvertimePay":69626.12,"Status":null,"TotalPay":276434.22,"TotalPayBenefits":276434.22,"Year":2011,"type":"DBFInformatica"}), VALUES ('20', {"Agency":"San Francisco","BasePay":257510.59,"Benefits":null,"EmployeeName":"ELLEN MOFFATT","Id":"20","JobTitle":"ASSISTANT MEDICAL EXAMINER","Notes":null,"OtherPay":16159.5,"OvertimePay":880.16,"Status":null,"TotalPay":274550.25,"TotalPayBenefits":274550.25,"Year":2011,"type":"DBFInformatica"}), VALUES ('21', {"Agency":"San Francisco","BasePay":257510.48,"Benefits":null,"EmployeeName":"VENUS AZAR","Id":"21","JobTitle":"ASSISTANT MEDICAL EXAMINER","Notes":null,"OtherPay":16679.79,"OvertimePay":0.0,"Status":null,"TotalPay":274190.27,"TotalPayBenefits":274190.27,"Year":2011,"type":"DBFInformatica"}), VALUES ('22', {"Agency":"San Francisco","BasePay":257510.44,"Benefits":null,"EmployeeName":"JUDY MELINEK","Id":"22","JobTitle":"ASSISTANT MEDICAL EXAMINER","Notes":null,"OtherPay":15883.56,"OvertimePay":377.21,"Status":null,"TotalPay":273771.21,"TotalPayBenefits":273771.21,"Year":2011,"type":"DBFInformatica"}), VALUES ('23', {"Agency":"San Francisco","BasePay":140546.88,"Benefits":null,"EmployeeName":"GEORGE GARCIA","Id":"23","JobTitle":"CAPTAIN, FIRE SUPPRESSION","Notes":null,"OtherPay":39955.25,"OvertimePay":93200.58,"Status":null,"TotalPay":273702.71,"TotalPayBenefits":273702.71,"Year":2011,"type":"DBFInformatica"}), VALUES ('24', {"Agency":"San Francisco","BasePay":168692.63,"Benefits":null,"EmployeeName":"VICTOR WYRSCH","Id":"24","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":24083.86,"OvertimePay":77896.14,"Status":null,"TotalPay":270672.63,"TotalPayBenefits":270672.63,"Year":2011,"type":"DBFInformatica"}), VALUES ('25', {"Agency":"San Francisco","BasePay":140546.86,"Benefits":null,"EmployeeName":"JOSEPH DRISCOLL","Id":"25","JobTitle":"CAPTAIN, FIRE SUPPRESSION","Notes":null,"OtherPay":31909.28,"OvertimePay":97868.77,"Status":null,"TotalPay":270324.91,"TotalPayBenefits":270324.91,"Year":2011,"type":"DBFInformatica"}), VALUES ('26', {"Agency":"San Francisco","BasePay":256470.41,"Benefits":null,"EmployeeName":"GREGORY SUHR","Id":"26","JobTitle":"CHIEF OF POLICE","Notes":null,"OtherPay":11522.18,"OvertimePay":0.0,"Status":null,"TotalPay":267992.59,"TotalPayBenefits":267992.59,"Year":2011,"type":"DBFInformatica"}), VALUES ('27', {"Agency":"San Francisco","BasePay":92080.8,"Benefits":null,"EmployeeName":"JOHN HANLEY","Id":"27","JobTitle":"CAPTAIN, FIRE SUPPRESSION","Notes":null,"OtherPay":133695.76,"OvertimePay":40008.0,"Status":null,"TotalPay":265784.56,"TotalPayBenefits":265784.56,"Year":2011,"type":"DBFInformatica"}), VALUES ('28', {"Agency":"San Francisco","BasePay":168692.59,"Benefits":null,"EmployeeName":"RAYMOND GUZMAN","Id":"28","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":16063.99,"OvertimePay":80706.88,"Status":null,"TotalPay":265463.46,"TotalPayBenefits":265463.46,"Year":2011,"type":"DBFInformatica"}), VALUES ('29', {"Agency":"San Francisco","BasePay":261717.6,"Benefits":null,"EmployeeName":"DENISE SCHMITT","Id":"29","JobTitle":"DEPUTY CHIEF III (POLICE DEPARTMENT)","Notes":null,"OtherPay":2357.0,"OvertimePay":0.0,"Status":null,"TotalPay":264074.6,"TotalPayBenefits":264074.6,"Year":2011,"type":"DBFInformatica"}), VALUES ('30', {"Agency":"San Francisco","BasePay":246225.6,"Benefits":null,"EmployeeName":"MONICA FIELDS","Id":"30","JobTitle":"DEPUTY CHIEF OF DEPARTMENT,(FIRE DEPARTMENT)","Notes":null,"OtherPay":15140.54,"OvertimePay":0.0,"Status":null,"TotalPay":261366.14,"TotalPayBenefits":261366.14,"Year":2011,"type":"DBFInformatica"}), VALUES ('31', {"Agency":"San Francisco","BasePay":234325.02,"Benefits":null,"EmployeeName":"HARLAN KELLY-JR","Id":"31","JobTitle":"EXECUTIVE CONTRACT EMPLOYEE","Notes":null,"OtherPay":25972.64,"OvertimePay":0.0,"Status":null,"TotalPay":260297.66,"TotalPayBenefits":260297.66,"Year":2011,"type":"DBFInformatica"}), VALUES ('32', {"Agency":"San Francisco","BasePay":254027.63,"Benefits":null,"EmployeeName":"DAVID SHINN","Id":"32","JobTitle":"DEPUTY CHIEF III (POLICE DEPARTMENT)","Notes":null,"OtherPay":5899.48,"OvertimePay":0.0,"Status":null,"TotalPay":259927.11,"TotalPayBenefits":259927.11,"Year":2011,"type":"DBFInformatica"}), VALUES ('33', {"Agency":"San Francisco","BasePay":248895.7,"Benefits":null,"EmployeeName":"GARY AMELIO","Id":"33","JobTitle":"DEPARTMENT HEAD V","Notes":null,"OtherPay":10789.18,"OvertimePay":0.0,"Status":null,"TotalPay":259684.88,"TotalPayBenefits":259684.88,"Year":2011,"type":"DBFInformatica"}), VALUES ('34', {"Agency":"San Francisco","BasePay":104861.39,"Benefits":null,"EmployeeName":"JOHN TURSI","Id":"34","JobTitle":"INSPECTOR III, (POLICE DEPARTMENT)","Notes":null,"OtherPay":103499.39,"OvertimePay":50227.61,"Status":null,"TotalPay":258588.39,"TotalPayBenefits":258588.39,"Year":2011,"type":"DBFInformatica"}), VALUES ('35', {"Agency":"San Francisco","BasePay":177781.25,"Benefits":null,"EmployeeName":"JOSE VELO","Id":"35","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":20658.0,"OvertimePay":59924.97,"Status":null,"TotalPay":258364.22,"TotalPayBenefits":258364.22,"Year":2011,"type":"DBFInformatica"}), VALUES ('36', {"Agency":"San Francisco","BasePay":101953.2,"Benefits":null,"EmployeeName":"KHOA TRINH","Id":"36","JobTitle":"ELECTRONIC MAINTENANCE TECHNICIAN","Notes":null,"OtherPay":16483.94,"OvertimePay":139102.95,"Status":null,"TotalPay":257540.09,"TotalPayBenefits":257540.09,"Year":2011,"type":"DBFInformatica"}), VALUES ('37', {"Agency":"San Francisco","BasePay":245124.44,"Benefits":null,"EmployeeName":"SUSAN CURRIN","Id":"37","JobTitle":"ADMINISTRATOR, SFGH MEDICAL CENTER","Notes":null,"OtherPay":12000.0,"OvertimePay":0.0,"Status":null,"TotalPay":257124.44,"TotalPayBenefits":257124.44,"Year":2011,"type":"DBFInformatica"}), VALUES ('38', {"Agency":"San Francisco","BasePay":110661.2,"Benefits":null,"EmployeeName":"JAMES BOSCH","Id":"38","JobTitle":"INSPECTOR III, (POLICE DEPARTMENT)","Notes":null,"OtherPay":111446.2,"OvertimePay":31162.04,"Status":null,"TotalPay":253269.44,"TotalPayBenefits":253269.44,"Year":2011,"type":"DBFInformatica"}), VALUES ('39', {"Agency":"San Francisco","BasePay":132202.26,"Benefits":null,"EmployeeName":"JONES WONG","Id":"39","JobTitle":"LIEUTENANT III (POLICE DEPARTMENT)","Notes":null,"OtherPay":67083.83,"OvertimePay":52648.92,"Status":null,"TotalPay":251935.01,"TotalPayBenefits":251935.01,"Year":2011,"type":"DBFInformatica"}), VALUES ('40', {"Agency":"San Francisco","BasePay":147158.85,"Benefits":null,"EmployeeName":"BRENDAN WARD","Id":"40","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":39540.46,"OvertimePay":64985.85,"Status":null,"TotalPay":251685.16,"TotalPayBenefits":251685.16,"Year":2011,"type":"DBFInformatica"}), VALUES ('41', {"Agency":"San Francisco","BasePay":168692.66,"Benefits":null,"EmployeeName":"MICHAEL THOMPSON","Id":"41","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":21055.17,"OvertimePay":60847.56,"Status":null,"TotalPay":250595.39,"TotalPayBenefits":250595.39,"Year":2011,"type":"DBFInformatica"}), VALUES ('42', {"Agency":"San Francisco","BasePay":168692.63,"Benefits":null,"EmployeeName":"THOMAS ABBOTT","Id":"42","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":21954.96,"OvertimePay":59760.9,"Status":null,"TotalPay":250408.49,"TotalPayBenefits":250408.49,"Year":2011,"type":"DBFInformatica"}), VALUES ('43', {"Agency":"San Francisco","BasePay":218930.76,"Benefits":null,"EmployeeName":"THOMAS SIRAGUSA","Id":"43","JobTitle":"DEPUTY CHIEF OF DEPARTMENT,(FIRE DEPARTMENT)","Notes":null,"OtherPay":27330.59,"OvertimePay":4078.0,"Status":null,"TotalPay":250339.35,"TotalPayBenefits":250339.35,"Year":2011,"type":"DBFInformatica"}), VALUES ('44', {"Agency":"San Francisco","BasePay":123013.02,"Benefits":null,"EmployeeName":"MICHAEL THOMPSON","Id":"44","JobTitle":"FIREFIGHTER","Notes":null,"OtherPay":15575.26,"OvertimePay":111729.65,"Status":null,"TotalPay":250317.93,"TotalPayBenefits":250317.93,"Year":2011,"type":"DBFInformatica"}), VALUES ('45', {"Agency":"San Francisco","BasePay":196081.86,"Benefits":null,"EmployeeName":"SHARON MCCOLE WICHER","Id":"45","JobTitle":"NURSING SUPERVISOR PSYCHIATRIC","Notes":null,"OtherPay":54040.18,"OvertimePay":0.0,"Status":null,"TotalPay":250122.04,"TotalPayBenefits":250122.04,"Year":2011,"type":"DBFInformatica"}), VALUES ('46', {"Agency":"San Francisco","BasePay":249375.02,"Benefits":null,"EmployeeName":"EDWIN LEE","Id":"46","JobTitle":"MAYOR","Notes":null,"OtherPay":0.0,"OvertimePay":0.0,"Status":null,"TotalPay":249375.02,"TotalPayBenefits":249375.02,"Year":2011,"type":"DBFInformatica"}), VALUES ('47', {"Agency":"San Francisco","BasePay":168692.64,"Benefits":null,"EmployeeName":"BRYAN RUBENSTEIN","Id":"47","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":14401.43,"OvertimePay":66199.23,"Status":null,"TotalPay":249293.3,"TotalPayBenefits":249293.3,"Year":2011,"type":"DBFInformatica"}), VALUES ('48', {"Agency":"San Francisco","BasePay":248895.77,"Benefits":null,"EmployeeName":"TRENT RHORER","Id":"48","JobTitle":"DEPARTMENT HEAD V","Notes":null,"OtherPay":0.0,"OvertimePay":0.0,"Status":null,"TotalPay":248895.77,"TotalPayBenefits":248895.77,"Year":2011,"type":"DBFInformatica"}), VALUES ('49', {"Agency":"San Francisco","BasePay":233867.6,"Benefits":null,"EmployeeName":"JAMES DUDLEY","Id":"49","JobTitle":"DEPUTY CHIEF III (POLICE DEPARTMENT)","Notes":null,"OtherPay":14851.04,"OvertimePay":0.0,"Status":null,"TotalPay":248718.64,"TotalPayBenefits":248718.64,"Year":2011,"type":"DBFInformatica"}), VALUES ('50', {"Agency":"San Francisco","BasePay":137729.92,"Benefits":null,"EmployeeName":"KEN YEE","Id":"50","JobTitle":"LIEUTENANT, FIRE DEPARTMENT","Notes":null,"OtherPay":20848.46,"OvertimePay":89856.01,"Status":null,"TotalPay":248434.39,"TotalPayBenefits":248434.39,"Year":2011,"type":"DBFInformatica"}), VALUES ('51', {"Agency":"San Francisco","BasePay":168692.59,"Benefits":null,"EmployeeName":"KIRK RICHARDSON","Id":"51","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":20477.16,"OvertimePay":58084.86,"Status":null,"TotalPay":247254.61,"TotalPayBenefits":247254.61,"Year":2011,"type":"DBFInformatica"}), VALUES ('52', {"Agency":"San Francisco","BasePay":246305.62,"Benefits":null,"EmployeeName":"BARBARA GARCIA","Id":"52","JobTitle":"DEPARTMENT HEAD V","Notes":null,"OtherPay":0.0,"OvertimePay":0.0,"Status":null,"TotalPay":246305.62,"TotalPayBenefits":246305.62,"Year":2011,"type":"DBFInformatica"}), VALUES ('53', {"Agency":"San Francisco","BasePay":140546.87,"Benefits":null,"EmployeeName":"MICHAEL ROLOVICH","Id":"53","JobTitle":"CAPTAIN, FIRE SUPPRESSION","Notes":null,"OtherPay":26203.69,"OvertimePay":77937.25,"Status":null,"TotalPay":244687.81,"TotalPayBenefits":244687.81,"Year":2011,"type":"DBFInformatica"}), VALUES ('54', {"Agency":"San Francisco","BasePay":140546.88,"Benefits":null,"EmployeeName":"DARRYL HUNTER","Id":"54","JobTitle":"CAPTAIN, FIRE SUPPRESSION","Notes":null,"OtherPay":28988.36,"OvertimePay":73207.61,"Status":null,"TotalPay":242742.85,"TotalPayBenefits":242742.85,"Year":2011,"type":"DBFInformatica"}), VALUES ('55', {"Agency":"San Francisco","BasePay":140546.89,"Benefits":null,"EmployeeName":"RAY CRAWFORD","Id":"55","JobTitle":"CAPTAIN, EMERGENCYCY MEDICAL SERVICES","Notes":null,"OtherPay":18310.77,"OvertimePay":82428.76,"Status":null,"TotalPay":241286.42,"TotalPayBenefits":241286.42,"Year":2011,"type":"DBFInformatica"}), VALUES ('56', {"Agency":"San Francisco","BasePay":226206.8,"Benefits":null,"EmployeeName":"KEVIN CASHMAN","Id":"56","JobTitle":"DEPUTY CHIEF III (POLICE DEPARTMENT)","Notes":null,"OtherPay":15004.37,"OvertimePay":0.0,"Status":null,"TotalPay":241211.17,"TotalPayBenefits":241211.17,"Year":2011,"type":"DBFInformatica"}), VALUES ('57', {"Agency":"San Francisco","BasePay":240731.93,"Benefits":null,"EmployeeName":"BENJAMIN ROSENFIELD","Id":"57","JobTitle":"DEPARTMENT HEAD V","Notes":null,"OtherPay":114.37,"OvertimePay":0.0,"Status":null,"TotalPay":240846.3,"TotalPayBenefits":240846.3,"Year":2011,"type":"DBFInformatica"}), VALUES ('58', {"Agency":"San Francisco","BasePay":217410.8,"Benefits":null,"EmployeeName":"MARK KEARNEY","Id":"58","JobTitle":"ASSISTANT DEPUTY CHIEF II","Notes":null,"OtherPay":22608.3,"OvertimePay":0.0,"Status":null,"TotalPay":240019.1,"TotalPayBenefits":240019.1,"Year":2011,"type":"DBFInformatica"}), VALUES ('59', {"Agency":"San Francisco","BasePay":115381.02,"Benefits":null,"EmployeeName":"DOUGLAS RIBA","Id":"59","JobTitle":"INCIDENT SUPPORT SPECIALIST","Notes":null,"OtherPay":19016.4,"OvertimePay":105028.94,"Status":null,"TotalPay":239426.36,"TotalPayBenefits":239426.36,"Year":2011,"type":"DBFInformatica"}), VALUES ('60', {"Agency":"San Francisco","BasePay":214745.44,"Benefits":null,"EmployeeName":"AI-KYUNG CHUNG","Id":"60","JobTitle":"ANESTHETIST","Notes":null,"OtherPay":14972.45,"OvertimePay":9161.31,"Status":null,"TotalPay":238879.2,"TotalPayBenefits":238879.2,"Year":2011,"type":"DBFInformatica"}), VALUES ('61', {"Agency":"San Francisco","BasePay":123105.0,"Benefits":null,"EmployeeName":"KENNETH SMITH","Id":"61","JobTitle":"LIEUTENANT, FIRE DEPARTMENT","Notes":null,"OtherPay":16113.62,"OvertimePay":99584.94,"Status":null,"TotalPay":238803.56,"TotalPayBenefits":238803.56,"Year":2011,"type":"DBFInformatica"}), VALUES ('62', {"Agency":"San Francisco","BasePay":102571.24,"Benefits":null,"EmployeeName":"ANNA BROWN","Id":"62","JobTitle":"CAPTAIN III (POLICE DEPARTMENT)","Notes":null,"OtherPay":128543.64,"OvertimePay":7437.0,"Status":null,"TotalPay":238551.88,"TotalPayBenefits":238551.88,"Year":2011,"type":"DBFInformatica"}), VALUES ('63', {"Agency":"San Francisco","BasePay":140546.86,"Benefits":null,"EmployeeName":"JAMES FAZACKERLEY","Id":"63","JobTitle":"CAPTAIN, EMERGENCYCY MEDICAL SERVICES","Notes":null,"OtherPay":17542.29,"OvertimePay":80411.9,"Status":null,"TotalPay":238501.05,"TotalPayBenefits":238501.05,"Year":2011,"type":"DBFInformatica"}), VALUES ('64', {"Agency":"San Francisco","BasePay":168692.62,"Benefits":null,"EmployeeName":"CHARLES CRANE","Id":"64","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":15444.38,"OvertimePay":54342.28,"Status":null,"TotalPay":238479.28,"TotalPayBenefits":238479.28,"Year":2011,"type":"DBFInformatica"}), VALUES ('65', {"Agency":"San Francisco","BasePay":148970.43,"Benefits":null,"EmployeeName":"GREGORY MAR","Id":"65","JobTitle":"LIEUTENANT III (POLICE DEPARTMENT)","Notes":null,"OtherPay":21889.67,"OvertimePay":66977.63,"Status":null,"TotalPay":237837.73,"TotalPayBenefits":237837.73,"Year":2011,"type":"DBFInformatica"}), VALUES ('66', {"Agency":"San Francisco","BasePay":185369.69,"Benefits":null,"EmployeeName":"RICHARD PARRY","Id":"66","JobTitle":"CAPTAIN III (POLICE DEPARTMENT)","Notes":null,"OtherPay":14465.53,"OvertimePay":37873.61,"Status":null,"TotalPay":237708.83,"TotalPayBenefits":237708.83,"Year":2011,"type":"DBFInformatica"}), VALUES ('67', {"Agency":"San Francisco","BasePay":177914.76,"Benefits":null,"EmployeeName":"ROBERT POSTEL","Id":"67","JobTitle":"ASSISTANT CHIEF OF DEPARTMENT, (FIRE DEPARTMENT)","Notes":null,"OtherPay":22785.08,"OvertimePay":36644.57,"Status":null,"TotalPay":237344.41,"TotalPayBenefits":237344.41,"Year":2011,"type":"DBFInformatica"}), VALUES ('68', {"Agency":"San Francisco","BasePay":139167.39,"Benefits":null,"EmployeeName":"EDWARD ROLAND","Id":"68","JobTitle":"CAPTAIN, FIRE SUPPRESSION","Notes":null,"OtherPay":31070.15,"OvertimePay":66596.28,"Status":null,"TotalPay":236833.82,"TotalPayBenefits":236833.82,"Year":2011,"type":"DBFInformatica"}), VALUES ('69', {"Agency":"San Francisco","BasePay":122974.0,"Benefits":null,"EmployeeName":"THOMAS SHAWYER","Id":"69","JobTitle":"DEPUTY CHIEF III (POLICE DEPARTMENT)","Notes":null,"OtherPay":113226.92,"OvertimePay":0.0,"Status":null,"TotalPay":236200.92,"TotalPayBenefits":236200.92,"Year":2011,"type":"DBFInformatica"}), VALUES ('70', {"Agency":"San Francisco","BasePay":115455.44,"Benefits":null,"EmployeeName":"WING CHAN","Id":"70","JobTitle":"INCIDENT SUPPORT SPECIALIST","Notes":null,"OtherPay":14776.81,"OvertimePay":104632.95,"Status":null,"TotalPay":234865.2,"TotalPayBenefits":234865.2,"Year":2011,"type":"DBFInformatica"}), VALUES ('71', {"Agency":"San Francisco","BasePay":220983.12,"Benefits":null,"EmployeeName":"GEORGE GASCON","Id":"71","JobTitle":"DISTRICT ATTORNEY","Notes":null,"OtherPay":13864.99,"OvertimePay":0.0,"Status":null,"TotalPay":234848.11,"TotalPayBenefits":234848.11,"Year":2011,"type":"DBFInformatica"}), VALUES ('72', {"Agency":"San Francisco","BasePay":92782.61,"Benefits":null,"EmployeeName":"RICHARD BUSALACCHI","Id":"72","JobTitle":"BATTALION CHIEF, (FIRE DEPARTMENT)","Notes":null,"OtherPay":135684.25,"OvertimePay":5477.62,"Status":null,"TotalPay":233944.48,"TotalPayBenefits":233944.48,"Year":2011,"type":"DBFInformatica"})RETURNING META(`DBF`).id AS PK
|
It appears from what we can see that the insertions begin to slow down as we insert more values because Couchbase is doing a scan of the primary keys to ensure there are no duplicates, so each insert takes incrementally longer. Perhaps this is a configuration problem on our end?
Cheers,
Kyle
Kyle Porter
Senior Sales Engineer | Simba Technologies Inc.
Direct: +1.604.441.7318 | Office: +1.604.633.0008 x112 | kylep@simba.com
