用于验证utf-8文本的python库和cli
validate-utf8的Python项目详细描述
validate-utf8
用于验证utf-8文本的python库和cli。
按如下方式安装:
pip3 install validate-utf8
命令行工具的工作方式如下:
$ validate-utf8 20081104__wv__general__mason__precinct.csv
invalid continuation byte
Mason,28 COURTHOUSE-GROUND FLOORá,,,REP,Straight Ticket,15
^
invalid continuation byte
Mason,28 COURTHOUSE-GROUND FLOORá,,,DEM,Straight Ticket,21
^
像这样将其用作库:
from validate_utf8 import find_utf8_errors
errrors = find_utf8_errors(bytestring):
if not errors:
print("It is valid")
else:
print(errors)