RDD常用方法之subtract&intersection&cartesian

subtract

Return an RDD with the elements from `this` that are not in `other` .    

def subtract(other: RDD[T]): RDD[T]
def subtract(other: RDD[T], numPartitions: Int): RDD[T]
def subtract(other: RDD[T], p: Partitioner): RDD[T]

val a = sc.parallelize( to )
val b = sc.parallelize( to )
val c = a.subtract(b)
c.collect
 Array[Int] = Array(, )

 

intersection

Return the intersection of this RDD and another one.  The output will not contain any duplicate elements, even if the input RDDs did.   交集

def intersection(other: RDD[T], numPartitions: Int): RDD[T]
def intersection(other: RDD[T], partitioner: Partitioner)(implicit ord: Ordering[T] = null): RDD[T]
def intersection(other: RDD[T]): RDD[T]

val x = sc.parallelize( to )
val y = sc.parallelize( to )
val z = x.intersection(y)
z.collect
 Array[Int] = Array(, , , , , , )

cartesian

Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of elements (a, b) where a is in `this` and b is in `other` .   笛卡尔积

def cartesian[U: ClassTag](other: RDD[U]): RDD[(T, U)] 

val x = sc.parallelize(List(,,))
val y = sc.parallelize(List(,,))
x.cartesian(y).collect
 Array[(Int, Int)] = Array((,), (,), (,), (,), (,), (,), (,), (,), (,))