sparkSpark’s primary abstraction is a distributed collection of items called a Dataset. Datasets can be created from Hadoop InputFormats (such as HDFS files) or by transforming other Datasets.. Spark Spark 3.5.5 Spark Hadoop HDFS YARN Hadoop