解析列表作为另一个函数的参数 - Python

Question

我有一个.log文件，我想在其中检查是否有错误/警告：

    2018-03-05 10:55:54,636 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M740.aswc.arxml is well-formed
    2018-03-05 10:55:55,193 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M740.aswc.arxml is valid with the AUTOSAR4.2.2-STRICT schema
    2018-03-05 10:55:55,227 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M741.aswc.arxml is well-formed
    2018-03-05 10:55:55,795 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M741.aswc.arxml is valid with the AUTOSAR4.2.2-STRICT schema
    2018-03-05 10:55:55,831 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M742.aswc.arxml is well-formed
    2018-03-05 10:55:56,403 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M742.aswc.arxml is valid with the AUTOSAR4.2.2-STRICT schema
    2018-03-05 10:55:56,438 WARNING ASWC_M740_MSI is without connector
2018-03-05 10:55:56,438 ERROR ASWC_M741_MSI is without connector
    2018-03-05 10:55:56,438 WARNING PRP_CS_VehicleSPeed is without connector

到目前为止，我已经成功地编写了下一个函数，但没有成功：

def checkLog(path, level, message):
    """
    path = used for defining the file to be checked
    level = criticity level :INFO, WARNING, ERROR
    message = string to be matched
    """
    datafile = open(path)
    line_file = datafile.readline()
    while line_file != "":
        for text in message:
            if level + " " + text in line_file:
                return True
            line_file = datafile.readline()
    return False

checkLog("C:\\test\Abu\TRS.ABU.GEN.003_1\output\\result.log", "WARNING", ["PRP_CS_VehicleSPeed", "ASWC_M740_MSI", "ASWC_M741_MSI"])

我错在哪里？你知道吗

Answer 1

我想你需要取消这行line_file = datafile.readline()。您当前所做的是检查第一行是否包含第一条消息，如果没有，则跳到第二行并检查它是否包含第二条消息。因此，它并不检查每一行是否都包含这三条消息中的一条。你知道吗

Answer 2

我建议您为此使用pandas。这是一个说明性的例子。你知道吗

设置

import pandas as pd, numpy as np
from io import StringIO

mystr = StringIO("""2018-03-05 10:55:54,636 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M740.aswc.arxml is well-formed
2018-03-05 10:55:55,193 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M740.aswc.arxml is valid with the AUTOSAR4.2.2-STRICT schema
2018-03-05 10:55:55,227 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M741.aswc.arxml is well-formed
2018-03-05 10:55:55,795 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M741.aswc.arxml is valid with the AUTOSAR4.2.2-STRICT schema
2018-03-05 10:55:55,831 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M742.aswc.arxml is well-formed
2018-03-05 10:55:56,403 INFO The file: C:/test/Abu/TRS.ABU.GEN.003_1/input\ASWC_M742.aswc.arxml is valid with the AUTOSAR4.2.2-STRICT schema
2018-03-05 10:55:56,438 WARNING ASWC_M740_MSI is without connector
2018-03-05 10:55:56,438 ERROR ASWC_M741_MSI is without connector
2018-03-05 10:55:56,438 WARNING PRP_CS_VehicleSPeed is without connector
""")

df = pd.read_csv(mystr, sep=',', header=None, names=['Timestamp', 'Message'])

解决方案

df['Message_Error'] = df.loc[df['Message'].str.contains('WARNING|ERROR'), 'Message'].apply(lambda x: x.split(' ')[:3])
df['Message_Error'] = df['Message_Error'].apply(lambda x: x if isinstance(x, list) else [])
df = df.join(pd.DataFrame(df['Message_Error'].values.tolist()))

#              Timestamp                                            Message  \
# 0  2018-03-05 10:55:54  636 INFO The file: C:/test/Abu/TRS.ABU.GEN.003...   
# 1  2018-03-05 10:55:55  193 INFO The file: C:/test/Abu/TRS.ABU.GEN.003...   
# 2  2018-03-05 10:55:55  227 INFO The file: C:/test/Abu/TRS.ABU.GEN.003...   
# 3  2018-03-05 10:55:55  795 INFO The file: C:/test/Abu/TRS.ABU.GEN.003...   
# 4  2018-03-05 10:55:55  831 INFO The file: C:/test/Abu/TRS.ABU.GEN.003...   
# 5  2018-03-05 10:55:56  403 INFO The file: C:/test/Abu/TRS.ABU.GEN.003...   
# 6  2018-03-05 10:55:56     438 WARNING ASWC_M740_MSI is without connector   
# 7  2018-03-05 10:55:56       438 ERROR ASWC_M741_MSI is without connector   
# 8  2018-03-05 10:55:56  438 WARNING PRP_CS_VehicleSPeed is without con...   

#                          Message_Error     0        1                    2  
# 0                                   []  None     None                 None  
# 1                                   []  None     None                 None  
# 2                                   []  None     None                 None  
# 3                                   []  None     None                 None  
# 4                                   []  None     None                 None  
# 5                                   []  None     None                 None  
# 6        [438, WARNING, ASWC_M740_MSI]   438  WARNING        ASWC_M740_MSI  
# 7          [438, ERROR, ASWC_M741_MSI]   438    ERROR        ASWC_M741_MSI  
# 8  [438, WARNING, PRP_CS_VehicleSPeed]   438  WARNING  PRP_CS_VehicleSPeed 

示例查询

q= {'PRP_CS_VehicleSPeed', 'ASWC_M740_MSI', 'ASWC_M741_MSI'}))
mask = (df[1] == 'WARNING') & df[2].isin(q)

df_mask = df[mask]

#              Timestamp                                            Message  \
# 6  2018-03-05 10:55:56     438 WARNING ASWC_M740_MSI is without connector   
# 8  2018-03-05 10:55:56  438 WARNING PRP_CS_VehicleSPeed is without con...   

#                          Message_Error    0        1                    2  
# 6        [438, WARNING, ASWC_M740_MSI]  438  WARNING        ASWC_M740_MSI  
# 8  [438, WARNING, PRP_CS_VehicleSPeed]  438  WARNING  PRP_CS_VehicleSPeed 

Answer 3

第二个readline()在for循环中，该循环对可能要匹配的消息进行迭代，因此在检查所有消息之前，代码将移到下一行。你知道吗

尝试将其移到外部范围：

def checkLog(path, level, message):
    datafile = open(path)
    line_file = datafile.readline()
    while line_file != "":
        for text in message:
            if level + " " + text in line_file:
                return True
        line_file = datafile.readline()
    return False

您的代码可以这样编写：

def checkLog(path, level, message):
    with open(path) as datafile:
        for line in datafile:
            for text in message:
                if (level + " " + text) in line:
                    return True
    return False

这避免了对readline()的调用，而不是对file对象进行迭代，从而简化了代码。此外，它还使用上下文管理器（with语句）打开文件，这将确保文件正确关闭。你知道吗