Details
-
Bug
-
Resolution: Fixed
-
Major
-
3.0.0, 3.1.0
-
None
-
None
-
Databricks
-
1
-
SDK46: Limit Err, CB++, Spark
Description
running the code below on Databricks environment thows an exception
sc is the sparkContext thats available to you upon configuration. Other operations works perfectly fine.
Environment : Scala 2.12 and Spark 3.1.1 or 3.1.2**
import com.couchbase.client.scala.kv.LookupInSpec |
import com.couchbase.spark.kv.LookupIn |
import com.couchbase.spark._ |
import com.couchbase.client.scala.json.JsonObject |
|
|
sc
|
.couchbaseLookupIn(Seq(LookupIn("airline_10642", Seq(LookupInSpec.get("icao"))))) |
.collect()
|
.foreach(println)
|
Job aborted due to stage failure: task 0.0 in stage 33.0 (TID 65) had a not serializable result: com.couchbase.client.core.msg.kv.SubDocumentField
Serialization stack:
object not serializable (class: com.couchbase.client.core.msg.kv.SubDocumentField, value: SubdocField{status=SUCCESS, value="JRB", path='icao'}) element of array (index: 0) array (class [Lcom.couchbase.client.core.msg.kv.SubDocumentField;, size 1) field (class: scala.collection.mutable.WrappedArray$ofRef, name: array, type: class [Ljava.lang.Object object (class scala.collection.mutable.WrappedArray$ofRef, WrappedArray(SubdocField{status=SUCCESS, value="JRB", path='icao'})) field (class: com.couchbase.client.scala.kv.LookupInResult, name: content, type: interface scala.collection.Seq) object (class com.couchbase.client.scala.kv.LookupInResult, LookupInResult(airline_10642,WrappedArray(SubdocField{status=SUCCESS, value="JRB", path='icao'}),33554432,1629927942956580864,None,com.couchbase.client.scala.codec.JsonTranscoder@6397a538)) element of array (index: 0) array (class [Lcom.couchbase.client.scala.kv.LookupInResult;, size 1) |
Attachments
Issue Links
- depends on
-
JVMCBC-1035 Make SubDocumentField Serializable
-
- Resolved
-