擅长:python、mysql、java
<p>在Pyspark中,语法应为:</p>
<pre><code>import pyspark.sql.functions as F
schema = F.schema_of_json(df.select('params').head()[0])
df2 = df.withColumn(
"params", F.from_json("params", schema)
).select(
'id1', 'id2', 'Col2', 'params.*'
)
df2.show()
+ -+ -+ + + +
|id1|id2|Col2|param1|param2|
+ -+ -+ + + +
| 1| 2| 1| val1| val2|
| 1| 3| 3| val4| val5|
+ -+ -+ + + +
</code></pre>