擅长:python、mysql、java
<p>在写入之前,可以将空列强制转换为字符串类型:</p>
<pre><code>from pyspark.sql.types import NullType
import pyspark.sql.functions as F
# Check each column type. If it's nulltype, cast to string type,
# else keep the original column.
df2 = df.select([
F.lit(None).cast('string').alias(i.name)
if isinstance(i.dataType, NullType)
else i.name
for i in df.schema
])
df2.repartition(1).write.format('com.databricks.spark.csv').mode('overwrite').save(output_path, quote='', escape='\"', sep='|', header='True', nullValue=None)
</code></pre>