擅长:python、mysql、java
<p>你可以用雪管。您需要不断创建较小的文件,并使用snowpipe继续上载它们。您可以使用Amazon Kinesis Firehose来管理批次。
请参阅<a href="https://docs.snowflake.com/en/user-guide/data-load-considerations-prepare.html#continuous-data-loads-i-e-snowpipe-and-file-sizing" rel="nofollow noreferrer">https://docs.snowflake.com/en/user-guide/data-load-considerations-prepare.html#continuous-data-loads-i-e-snowpipe-and-file-sizing</a>和<a href="https://docs.aws.amazon.com/firehose/latest/dev/create-configure.html" rel="nofollow noreferrer">https://docs.aws.amazon.com/firehose/latest/dev/create-configure.html</a>上的文档</p>