pyspark.SparkFiles

class pyspark.SparkFiles

Resolves paths to files added through SparkContext.addFile().

SparkFiles contains only classmethods; users should not create SparkFiles instances.

Methods

get(filename)	Get the absolute path of a file added through SparkContext.addFile() or SparkContext.addPyFile().
getRootDirectory()	Get the root directory that contains files added through SparkContext.addFile() or SparkContext.addPyFile().