Uploaded image for project: 'Couchbase Hadoop Plugin'
  1. Couchbase Hadoop Plugin
  2. CBHADOOP-28

couchbase hadoop connector shows class method not found exceptions on export

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • None
    • None
    • None
    • Security Level: Public
    • None

    Description

      Couchbase Server : 3.5.0 enterprise version (build-1415)
      3.0.2 enterprise version (build-1641)
      Hadoop version: cdh5.3.2
      Sqoop version: 1.4.5
      Couchbase-hadoop-plugin cversion: 1.2.0

      Running export cmd shows classmethod not found excetions.
      sqoop export --connect http://10.3.5.95:8091/pools --table

      java.lang.Exception: java.lang.NoSuchMethodError: net.spy.memcached.util.StringUtils.validateKey(Ljava/lang/String;)V
      at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
      at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
      Caused by: java.lang.NoSuchMethodError: net.spy.memcached.util.StringUtils.validateKey(Ljava/lang/String;)V
      at com.couchbase.sqoop.mapreduce.db.CouchbaseOutputFormat$CouchbaseRecordWriter.write(CouchbaseOutputFormat.java:199)

      spymemcached-2.11.4.jar contains that class method and is placed at SQOOP_HOME. sqoop export cmd seems not pick it up here.

      The entire logoutput
      ======================
      [root@master cdh5]# sqoop export --connect http://10.3.5.95:8091/pools --table garbage_value --export-dir /user/root/student/part-m-00000
      Warning: /usr/lib/sqoop/../hbase does not exist! HBase imports will fail.
      Please set $HBASE_HOME to the root of your HBase installation.
      Warning: /usr/lib/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
      Please set $HCAT_HOME to the root of your HCatalog installation.
      Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
      Please set $ACCUMULO_HOME to the root of your Accumulo installation.
      15/03/12 13:34:09 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5-cdh5.3.2
      15/03/12 13:34:10 INFO tool.CodeGenTool: Beginning code generation
      15/03/12 13:34:10 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-mapreduce
      Note: /tmp/sqoop-root/compile/48eb3d0c1d82bcb129d0e8c30e33202f/garbage_value.java uses or overrides a deprecated API.
      Note: Recompile with -Xlint:deprecation for details.
      15/03/12 13:34:12 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/48eb3d0c1d82bcb129d0e8c30e33202f/garbage_value.jar
      15/03/12 13:34:12 INFO mapreduce.ExportJobBase: Beginning export of garbage_value
      15/03/12 13:34:12 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
      SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
      SLF4J: Defaulting to no-operation (NOP) logger implementation
      SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
      15/03/12 13:34:13 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
      15/03/12 13:34:14 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
      15/03/12 13:34:14 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
      15/03/12 13:34:14 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
      15/03/12 13:34:14 WARN util.Jars: No such class couchbase doesn't use a jdbc driver available.
      15/03/12 13:34:15 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
      15/03/12 13:34:15 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
      15/03/12 13:34:15 INFO input.FileInputFormat: Total input paths to process : 1
      15/03/12 13:34:15 INFO input.FileInputFormat: Total input paths to process : 1
      15/03/12 13:34:15 INFO mapreduce.JobSubmitter: number of splits:4
      15/03/12 13:34:15 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
      15/03/12 13:34:15 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local900732163_0001
      15/03/12 13:34:15 WARN conf.Configuration: file:/tmp/hadoop-root/mapred/staging/root900732163/.staging/job_local900732163_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
      15/03/12 13:34:15 WARN conf.Configuration: file:/tmp/hadoop-root/mapred/staging/root900732163/.staging/job_local900732163_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
      15/03/12 13:34:16 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455915/ant-eclipse-1.0-jvm1.2.jar <- /root/cdh5/ant-eclipse-1.0-jvm1.2.jar
      15/03/12 13:34:16 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar as file:/tmp/hadoop-root/mapred/local/1426192455915/ant-eclipse-1.0-jvm1.2.jar
      15/03/12 13:34:27 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455916/jackson-core-asl-1.8.8.jar <- /root/cdh5/jackson-core-asl-1.8.8.jar
      15/03/12 13:34:29 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/jackson-core-asl-1.8.8.jar as file:/tmp/hadoop-root/mapred/local/1426192455916/jackson-core-asl-1.8.8.jar
      15/03/12 13:34:29 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455917/xz-1.0.jar <- /root/cdh5/xz-1.0.jar
      15/03/12 13:34:29 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/xz-1.0.jar as file:/tmp/hadoop-root/mapred/local/1426192455917/xz-1.0.jar
      15/03/12 13:34:29 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455918/slf4j-api-1.7.5.jar <- /root/cdh5/slf4j-api-1.7.5.jar
      15/03/12 13:34:30 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/slf4j-api-1.7.5.jar as file:/tmp/hadoop-root/mapred/local/1426192455918/slf4j-api-1.7.5.jar
      15/03/12 13:34:30 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455919/paranamer-2.3.jar <- /root/cdh5/paranamer-2.3.jar
      15/03/12 13:34:30 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/paranamer-2.3.jar as file:/tmp/hadoop-root/mapred/local/1426192455919/paranamer-2.3.jar
      15/03/12 13:34:30 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455920/couchbase-client-1.4.4.bundled.jar <- /root/cdh5/couchbase-client-1.4.4.bundled.jar
      15/03/12 13:34:30 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/couchbase-client-1.4.4.bundled.jar as file:/tmp/hadoop-root/mapred/local/1426192455920/couchbase-client-1.4.4.bundled.jar
      15/03/12 13:34:30 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455921/commons-codec-1.4.jar <- /root/cdh5/commons-codec-1.4.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/commons-codec-1.4.jar as file:/tmp/hadoop-root/mapred/local/1426192455921/commons-codec-1.4.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455922/couchbase-hadoop-plugin-1.2.0.jar <- /root/cdh5/couchbase-hadoop-plugin-1.2.0.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/couchbase-hadoop-plugin-1.2.0.jar as file:/tmp/hadoop-root/mapred/local/1426192455922/couchbase-hadoop-plugin-1.2.0.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455923/netty-3.5.5.Final.jar <- /root/cdh5/netty-3.5.5.Final.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/netty-3.5.5.Final.jar as file:/tmp/hadoop-root/mapred/local/1426192455923/netty-3.5.5.Final.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455924/jsr305-2.0.1.jar <- /root/cdh5/jsr305-2.0.1.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/jsr305-2.0.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455924/jsr305-2.0.1.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455925/jackson-annotations-2.3.0.jar <- /root/cdh5/jackson-annotations-2.3.0.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/jackson-annotations-2.3.0.jar as file:/tmp/hadoop-root/mapred/local/1426192455925/jackson-annotations-2.3.0.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455926/snappy-java-1.0.4.1.jar <- /root/cdh5/snappy-java-1.0.4.1.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/snappy-java-1.0.4.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455926/snappy-java-1.0.4.1.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455927/couchbase-hadoop-plugin-1.1-dp3.jar <- /root/cdh5/couchbase-hadoop-plugin-1.1-dp3.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/couchbase-hadoop-plugin-1.1-dp3.jar as file:/tmp/hadoop-root/mapred/local/1426192455927/couchbase-hadoop-plugin-1.1-dp3.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455928/commons-io-1.4.jar <- /root/cdh5/commons-io-1.4.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/commons-io-1.4.jar as file:/tmp/hadoop-root/mapred/local/1426192455928/commons-io-1.4.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455929/opencsv-2.3.jar <- /root/cdh5/opencsv-2.3.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/opencsv-2.3.jar as file:/tmp/hadoop-root/mapred/local/1426192455929/opencsv-2.3.jar
      15/03/12 13:34:31 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455930/netty-3.2.0.Final.jar <- /root/cdh5/netty-3.2.0.Final.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/netty-3.2.0.Final.jar as file:/tmp/hadoop-root/mapred/local/1426192455930/netty-3.2.0.Final.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455931/sqoop-1.4.5-cdh5.3.2.jar <- /root/cdh5/sqoop-1.4.5-cdh5.3.2.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/sqoop-1.4.5-cdh5.3.2.jar as file:/tmp/hadoop-root/mapred/local/1426192455931/sqoop-1.4.5-cdh5.3.2.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455932/spymemcached-2.11.4.jar <- /root/cdh5/spymemcached-2.11.4.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/spymemcached-2.11.4.jar as file:/tmp/hadoop-root/mapred/local/1426192455932/spymemcached-2.11.4.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455933/jackson-core-2.3.1.jar <- /root/cdh5/jackson-core-2.3.1.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/jackson-core-2.3.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455933/jackson-core-2.3.1.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455934/kite-data-core.jar <- /root/cdh5/kite-data-core.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/kite-data-core.jar as file:/tmp/hadoop-root/mapred/local/1426192455934/kite-data-core.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455935/kite-hadoop-compatibility.jar <- /root/cdh5/kite-hadoop-compatibility.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/kite-hadoop-compatibility.jar as file:/tmp/hadoop-root/mapred/local/1426192455935/kite-hadoop-compatibility.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455936/ant-contrib-1.0b3.jar <- /root/cdh5/ant-contrib-1.0b3.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar as file:/tmp/hadoop-root/mapred/local/1426192455936/ant-contrib-1.0b3.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455937/commons-jexl-2.1.1.jar <- /root/cdh5/commons-jexl-2.1.1.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/commons-jexl-2.1.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455937/commons-jexl-2.1.1.jar
      15/03/12 13:34:32 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455938/guava-11.0.2.jar <- /root/cdh5/guava-11.0.2.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/guava-11.0.2.jar as file:/tmp/hadoop-root/mapred/local/1426192455938/guava-11.0.2.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455939/kite-data-hive.jar <- /root/cdh5/kite-data-hive.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/kite-data-hive.jar as file:/tmp/hadoop-root/mapred/local/1426192455939/kite-data-hive.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455940/avro.jar <- /root/cdh5/avro.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/avro.jar as file:/tmp/hadoop-root/mapred/local/1426192455940/avro.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455941/hsqldb-1.8.0.10.jar <- /root/cdh5/hsqldb-1.8.0.10.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/hsqldb-1.8.0.10.jar as file:/tmp/hadoop-root/mapred/local/1426192455941/hsqldb-1.8.0.10.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455942/kite-data-mapreduce.jar <- /root/cdh5/kite-data-mapreduce.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/kite-data-mapreduce.jar as file:/tmp/hadoop-root/mapred/local/1426192455942/kite-data-mapreduce.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455943/jettison-1.1.jar <- /root/cdh5/jettison-1.1.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/jettison-1.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455943/jettison-1.1.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455944/commons-logging-1.1.1.jar <- /root/cdh5/commons-logging-1.1.1.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/commons-logging-1.1.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455944/commons-logging-1.1.1.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455945/jackson-mapper-asl-1.8.8.jar <- /root/cdh5/jackson-mapper-asl-1.8.8.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/jackson-mapper-asl-1.8.8.jar as file:/tmp/hadoop-root/mapred/local/1426192455945/jackson-mapper-asl-1.8.8.jar
      15/03/12 13:34:33 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455946/commons-compress-1.4.1.jar <- /root/cdh5/commons-compress-1.4.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/commons-compress-1.4.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455946/commons-compress-1.4.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455947/mysql-connector-java-5.1.22-bin.jar <- /root/cdh5/mysql-connector-java-5.1.22-bin.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/mysql-connector-java-5.1.22-bin.jar as file:/tmp/hadoop-root/mapred/local/1426192455947/mysql-connector-java-5.1.22-bin.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455948/couchbase-client-1.0.3.jar <- /root/cdh5/couchbase-client-1.0.3.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/couchbase-client-1.0.3.jar as file:/tmp/hadoop-root/mapred/local/1426192455948/couchbase-client-1.0.3.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455949/jackson-databind-2.3.1.jar <- /root/cdh5/jackson-databind-2.3.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/jackson-databind-2.3.1.jar as file:/tmp/hadoop-root/mapred/local/1426192455949/jackson-databind-2.3.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1426192455950/avro-mapred-hadoop2.jar <- /root/cdh5/avro-mapred-hadoop2.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: Localized hdfs://master/usr/lib/sqoop/lib/avro-mapred-hadoop2.jar as file:/tmp/hadoop-root/mapred/local/1426192455950/avro-mapred-hadoop2.jar
      15/03/12 13:34:34 WARN conf.Configuration: file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local900732163_0001/job_local900732163_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
      15/03/12 13:34:34 WARN conf.Configuration: file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local900732163_0001/job_local900732163_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455915/ant-eclipse-1.0-jvm1.2.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455916/jackson-core-asl-1.8.8.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455917/xz-1.0.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455918/slf4j-api-1.7.5.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455919/paranamer-2.3.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455920/couchbase-client-1.4.4.bundled.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455921/commons-codec-1.4.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455922/couchbase-hadoop-plugin-1.2.0.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455923/netty-3.5.5.Final.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455924/jsr305-2.0.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455925/jackson-annotations-2.3.0.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455926/snappy-java-1.0.4.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455927/couchbase-hadoop-plugin-1.1-dp3.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455928/commons-io-1.4.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455929/opencsv-2.3.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455930/netty-3.2.0.Final.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455931/sqoop-1.4.5-cdh5.3.2.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455932/spymemcached-2.11.4.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455933/jackson-core-2.3.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455934/kite-data-core.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455935/kite-hadoop-compatibility.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455936/ant-contrib-1.0b3.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455937/commons-jexl-2.1.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455938/guava-11.0.2.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455939/kite-data-hive.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455940/avro.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455941/hsqldb-1.8.0.10.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455942/kite-data-mapreduce.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455943/jettison-1.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455944/commons-logging-1.1.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455945/jackson-mapper-asl-1.8.8.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455946/commons-compress-1.4.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455947/mysql-connector-java-5.1.22-bin.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455948/couchbase-client-1.0.3.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455949/jackson-databind-2.3.1.jar
      15/03/12 13:34:34 INFO mapred.LocalDistributedCacheManager: file:/tmp/hadoop-root/mapred/local/1426192455950/avro-mapred-hadoop2.jar
      15/03/12 13:34:34 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
      15/03/12 13:34:34 INFO mapreduce.Job: Running job: job_local900732163_0001
      15/03/12 13:34:34 INFO mapred.LocalJobRunner: OutputCommitter set in config null
      15/03/12 13:34:34 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
      15/03/12 13:34:34 WARN output.FileOutputCommitter: Output Path is null in setupJob()
      15/03/12 13:34:34 INFO mapred.LocalJobRunner: Waiting for map tasks
      15/03/12 13:34:34 INFO mapred.LocalJobRunner: Starting task: attempt_local900732163_0001_m_000000_0
      15/03/12 13:34:35 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
      15/03/12 13:34:35 INFO mapred.MapTask: Processing split: Paths:/user/root/student/part-m-00000:0+4
      15/03/12 13:34:35 INFO Configuration.deprecation: map.input.file is deprecated. Instead, use mapreduce.map.input.file
      15/03/12 13:34:35 INFO Configuration.deprecation: map.input.start is deprecated. Instead, use mapreduce.map.input.start
      15/03/12 13:34:35 INFO Configuration.deprecation: map.input.length is deprecated. Instead, use mapreduce.map.input.length
      15/03/12 13:34:35 INFO mapreduce.Job: Job job_local900732163_0001 running in uber mode : false
      15/03/12 13:34:35 INFO mapreduce.Job: map 0% reduce 0%
      15/03/12 13:34:35 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.238:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:35 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.241:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:35 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.5.95:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:36 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
      15/03/12 13:34:36 INFO client.CouchbaseConnection: Shut down Couchbase client
      15/03/12 13:34:36 INFO mapred.LocalJobRunner: Starting task: attempt_local900732163_0001_m_000001_0
      15/03/12 13:34:36 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
      15/03/12 13:34:36 INFO mapred.MapTask: Processing split: Paths:/user/root/student/part-m-00000:4+4
      15/03/12 13:34:36 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.238:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:36 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.241:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:36 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.5.95:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:37 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
      15/03/12 13:34:37 INFO mapred.LocalJobRunner:
      15/03/12 13:34:37 INFO client.CouchbaseConnection: Shut down Couchbase client
      15/03/12 13:34:37 INFO mapred.Task: Task:attempt_local900732163_0001_m_000001_0 is done. And is in the process of committing
      15/03/12 13:34:37 INFO mapred.LocalJobRunner: map
      15/03/12 13:34:37 INFO mapred.Task: Task 'attempt_local900732163_0001_m_000001_0' done.
      15/03/12 13:34:37 INFO mapred.LocalJobRunner: Finishing task: attempt_local900732163_0001_m_000001_0
      15/03/12 13:34:37 INFO mapred.LocalJobRunner: Starting task: attempt_local900732163_0001_m_000002_0
      15/03/12 13:34:37 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
      15/03/12 13:34:37 INFO mapred.MapTask: Processing split: Paths:/user/root/student/part-m-00000:8+4
      15/03/12 13:34:37 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.238:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:37 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.241:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:37 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.5.95:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:37 INFO mapreduce.Job: map 100% reduce 0%
      15/03/12 13:34:37 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
      15/03/12 13:34:37 INFO client.CouchbaseConnection: Shut down Couchbase client
      15/03/12 13:34:37 INFO mapred.LocalJobRunner: Starting task: attempt_local900732163_0001_m_000003_0
      15/03/12 13:34:37 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
      15/03/12 13:34:37 INFO mapred.MapTask: Processing split: Paths:/user/root/student/part-m-00000:12+4
      15/03/12 13:34:38 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.238:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:38 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.3.241:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:38 INFO client.CouchbaseConnection: Added

      {QA sa=/10.3.5.95:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}

      to connect queue
      15/03/12 13:34:38 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
      15/03/12 13:34:38 INFO mapred.LocalJobRunner:
      15/03/12 13:34:38 INFO client.CouchbaseConnection: Shut down Couchbase client
      15/03/12 13:34:38 INFO mapred.Task: Task:attempt_local900732163_0001_m_000003_0 is done. And is in the process of committing
      15/03/12 13:34:38 INFO mapred.LocalJobRunner: map
      15/03/12 13:34:38 INFO mapred.Task: Task 'attempt_local900732163_0001_m_000003_0' done.
      15/03/12 13:34:38 INFO mapred.LocalJobRunner: Finishing task: attempt_local900732163_0001_m_000003_0
      15/03/12 13:34:38 INFO mapred.LocalJobRunner: map task executor complete.
      15/03/12 13:34:38 WARN output.FileOutputCommitter: Output Path is null in cleanupJob()
      15/03/12 13:34:38 WARN mapred.LocalJobRunner: job_local900732163_0001
      java.lang.Exception: java.lang.NoSuchMethodError: net.spy.memcached.util.StringUtils.validateKey(Ljava/lang/String;)V
      at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
      at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
      Caused by: java.lang.NoSuchMethodError: net.spy.memcached.util.StringUtils.validateKey(Ljava/lang/String;)V
      at com.couchbase.sqoop.mapreduce.db.CouchbaseOutputFormat$CouchbaseRecordWriter.write(CouchbaseOutputFormat.java:199)
      at com.couchbase.sqoop.mapreduce.db.CouchbaseOutputFormat$CouchbaseRecordWriter.write(CouchbaseOutputFormat.java:96)
      at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:655)
      at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
      at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
      at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:84)
      at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
      at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
      at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:701)
      15/03/12 13:34:38 INFO mapreduce.Job: Job job_local900732163_0001 failed with state FAILED due to: NA
      15/03/12 13:34:38 INFO mapreduce.Job: Counters: 23
      File System Counters
      FILE: Number of bytes read=10132
      FILE: Number of bytes written=27163230
      FILE: Number of read operations=0
      FILE: Number of large read operations=0
      FILE: Number of write operations=0
      HDFS: Number of bytes read=26386168
      HDFS: Number of bytes written=0
      HDFS: Number of read operations=830
      HDFS: Number of large read operations=0
      HDFS: Number of write operations=0
      Map-Reduce Framework
      Map input records=0
      Map output records=0
      Input split bytes=250
      Spilled Records=0
      Failed Shuffles=0
      Merged Map outputs=0
      GC time elapsed (ms)=0
      CPU time spent (ms)=0
      Physical memory (bytes) snapshot=0
      Virtual memory (bytes) snapshot=0
      Total committed heap usage (bytes)=407830528
      File Input Format Counters
      Bytes Read=0
      File Output Format Counters
      Bytes Written=0
      15/03/12 13:34:38 INFO mapreduce.ExportJobBase: Transferred 25.1638 MB in 23.7732 seconds (1.0585 MB/sec)
      15/03/12 13:34:38 INFO mapreduce.ExportJobBase: Exported 0 records.
      15/03/12 13:34:38 ERROR tool.ExportTool: Error during export: Export job failed!

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ingenthr Matt Ingenthron
              wei-li Wei-Li Liu (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty