擅长:python、mysql、java
<p>您正在执行dataframe和dynamicframe之间的并集操作。你知道吗</p>
<p>这将创建名为<strong>newData</strong>的动态帧和名为<strong>newDF</strong>的数据帧:</p>
<pre><code>newData = glueContext.create_dynamic_frame.from_options(connection_type = "dynamodb", connection_options = {"tableName": source_table})
newValues = newData.select_fields(params)
newDF = newValues.toDF()
</code></pre>
<p>这将创建名为<strong>oldData</strong>的动态帧和名为<strong>oldDF</strong>的数据帧:</p>
<pre><code>oldData = glueContext.create_dynamic_frame.from_options(connection_type="s3", connection_options={"paths": [source_s3]}, format="orc", format_options={}, transformation_ctx="dynamic_frame")
oldDataValues = oldData.drop_fields(params)
oldDF = oldDataValues.toDF()
</code></pre>
<p>您正在对上述两个实体执行联合操作,如下所示:</p>
<pre><code>rebuildData = oldDF.union(newData)
</code></pre>
<p>应该是:</p>
<pre><code>rebuildData = oldDF.union(newDF)
</code></pre>