<p>下面是从ADLS读取csv文件的示例代码。在</p>
<pre><code># -*- coding: utf-8 -*-
"""
Created on Wed Mar 20 11:37:19 2019
@author: Mohit Verma
"""
from azure.datalake.store import core, lib, multithread
token = lib.auth(tenant_id, username, password)
adl = core.AzureDLFileSystem(token, store_name=store_name)
# typical operations
adl.ls('')
adl.ls('tmp/', detail=True)
adl.ls('tmp/', detail=True, invalidate_cache=True)
adl.cat('littlefile')
adl.head('gdelt20150827.csv')
# file-like object
with adl.open('gdelt20150827.csv', blocksize=2**20) as f:
print(f.readline())
print(f.readline())
print(f.readline())
# could have passed f to any function requiring a file object:
# pandas.read_csv(f)
with adl.open('anewfile', 'wb') as f:
# data is written on flush/close, or when buffer is bigger than
# blocksize
f.write(b'important data')
adl.du('anewfile')
# recursively download the whole directory tree with 5 threads and
# 16MB chunks
multithread.ADLDownloader(adl, "", 'my_temp_dir', 5, 2**24)
</code></pre>
<p>请尝试这个代码,看看它是否帮助。为了其他与Azure Data Lake相关的示例请参阅以下github回购。在</p>
<p><a href="https://github.com/Azure/azure-data-lake-store-python/tree/master/azure" rel="nofollow noreferrer">https://github.com/Azure/azure-data-lake-store-python/tree/master/azure</a></p>
<p>另外,如果您想了解ADLS中不同类型的身份验证,请检查下面的代码库。在</p>
<p><a href="https://github.com/Azure-Samples/data-lake-analytics-python-auth-options/blob/master/sample.py" rel="nofollow noreferrer">https://github.com/Azure-Samples/data-lake-analytics-python-auth-options/blob/master/sample.py</a></p>