Getting Started
User Guide
API Reference
Development
Migration Guide
Spark SQL
Pandas API on Spark
Structured Streaming
MLlib (DataFrame-based)
Spark Streaming
MLlib (RDD-based)
Spark Core
Resource Management
pyspark.SparkContext.dump_profiles
¶
SparkContext.
dump_profiles
(
path
:
str
)
→ None
[source]
¶
Dump the profile stats into directory
path
pyspark.SparkContext.defaultParallelism
pyspark.SparkContext.emptyRDD