Details
-
Task
-
Resolution: Won't Do
-
Major
-
None
-
None
-
None
-
None
Description
See https://forums.couchbase.com/t/spark-connector-returns-different-result-than-cbq-query/9048/8
For Hive, normally I provide hive-site.xml and core-site.xml, then my spark app is able to access hive tables. However, to use Couchbase bucket, I have to add this line of code as stated in Couchbase documentation:
|
|
|
val cfg = new SparkConf()
|
.setAppName("couchbaseQuickstart") // give your app a name
|
.setMaster("local[*]") // set the master to local for easy experimenting
|
.set("com.couchbase.bucket.travel-sample", "") // open the travel-sample bucket
|
|
|
As soon as this line was added, my spark app won't be able to find hive tables anymore. Error message is (cannot find table "table name"). I believe it's trying to find the table from the couchbase bucket.
|