解析包含多个子级和子级的XML文件

Question

我对python很陌生。我有一个非常大的xml文件，我想从中提取一些数据。以下是摘录：

<program>
    <id>38e072a7-8fc9-4f9a-8eac-3957905c0002</id>
    <programID>3853</programID>
    <orchestra>New York Philharmonic</orchestra>
    <season>1842-43</season>
    <concertInfo>
        <eventType>Subscription Season</eventType>
        <Location>Manhattan, NY</Location>
        <Venue>Apollo Rooms</Venue>
        <Date>1842-12-07T05:00:00Z</Date>
        <Time>8:00PM</Time>
    </concertInfo>
    <worksInfo>
        <work ID="52446*">
            <composerName>Beethoven,  Ludwig  van</composerName>
            <workTitle>SYMPHONY NO. 5 IN C MINOR, OP.67</workTitle>
            <conductorName>Hill, Ureli Corelli</conductorName>
        </work>
        <work ID="8834*4">
            <composerName>Weber,  Carl  Maria Von</composerName>
            <workTitle>OBERON</workTitle>
            <movement>"Ozean, du Ungeheuer" (Ocean, thou mighty monster), Reiza (Scene and Aria), Act II</movement>
            <conductorName>Timm, Henry C.</conductorName>
            <soloists>
                <soloist>
                    <soloistName>Otto, Antoinette</soloistName>
                    <soloistInstrument>Soprano</soloistInstrument>
                    <soloistRoles>S</soloistRoles>
                </soloist>
            </soloists>
        </work>
        <work ID="3642*">
            <composerName>Hummel,  Johann</composerName>
            <workTitle>QUINTET, PIANO, D MINOR, OP. 74</workTitle>
            <soloists>
                <soloist>
                    <soloistName>Scharfenberg, William</soloistName>
                    <soloistInstrument>Piano</soloistInstrument>
                    <soloistRoles>A</soloistRoles>
                </soloist>
                <soloist>
                    <soloistName>Hill, Ureli Corelli</soloistName>
                    <soloistInstrument>Violin</soloistInstrument>
                    <soloistRoles>A</soloistRoles>
                </soloist>
                <soloist>
                    <soloistName>Derwort, G. H.</soloistName>
                    <soloistInstrument>Viola</soloistInstrument>
                    <soloistRoles>A</soloistRoles>
                </soloist>
                <soloist>
                    <soloistName>Boucher, Alfred</soloistName>
                    <soloistInstrument>Cello</soloistInstrument>
                    <soloistRoles>A</soloistRoles>
                </soloist>
                <soloist>
                    <soloistName>Rosier, F. W.</soloistName>
                    <soloistInstrument>Contrabass</soloistInstrument>
                    <soloistRoles>A</soloistRoles>
                </soloist>
            </soloists>
        </work>
        <work ID="0*">
            <interval>Intermission</interval>
        </work>
        <work ID="8834*3">
            <composerName>Weber,  Carl  Maria Von</composerName>
            <workTitle>OBERON</workTitle>
            <movement>Overture</movement>
            <conductorName>Etienne, Denis G.</conductorName>
        </work>
        <work ID="8835*1">
            <composerName>Rossini,  Gioachino</composerName>
            <workTitle>ARMIDA</workTitle>
            <movement>Duet</movement>
            <conductorName>Timm, Henry C.</conductorName>
            <soloists>
                <soloist>
                    <soloistName>Otto, Antoinette</soloistName>
                    <soloistInstrument>Soprano</soloistInstrument>
                    <soloistRoles>S</soloistRoles>
                </soloist>
                <soloist>
                    <soloistName>Horn, Charles Edward</soloistName>
                    <soloistInstrument>Tenor</soloistInstrument>
                    <soloistRoles>S</soloistRoles>
                </soloist>
            </soloists>
        </work>
        <work ID="8837*6">
            <composerName>Beethoven,  Ludwig  van</composerName>
            <workTitle>FIDELIO, OP. 72</workTitle>
            <movement>"In Des Lebens Fruhlingstagen...O spur ich nicht linde," Florestan (aria)</movement>
            <conductorName>Timm, Henry C.</conductorName>
            <soloists>
                <soloist>
                    <soloistName>Horn, Charles Edward</soloistName>
                    <soloistInstrument>Tenor</soloistInstrument>
                    <soloistRoles>S</soloistRoles>
                </soloist>
            </soloists>
        </work>
        <work ID="8336*4">
            <composerName>Mozart,  Wolfgang  Amadeus</composerName>
            <workTitle>ABDUCTION FROM THE SERAGLIO,THE, K.384</workTitle>
            <movement>"Ach Ich liebte," Konstanze (aria)</movement>
            <conductorName>Timm, Henry C.</conductorName>
            <soloists>
                <soloist>
                    <soloistName>Otto, Antoinette</soloistName>
                    <soloistInstrument>Soprano</soloistInstrument>
                    <soloistRoles>S</soloistRoles>
                </soloist>
            </soloists>
        </work>
        <work ID="5543*">
            <composerName>Kalliwoda,  Johann  W.</composerName>
            <workTitle>OVERTURE NO. 1, D MINOR, OP. 38</workTitle>
            <conductorName>Timm, Henry C.</conductorName>
        </work>
    </worksInfo>
</program>
<program>

我想做的是提取以下信息：programmid，orchestration，season，eventType，work ID，soloistName，solositInstrument，soloistRole

以下是我使用的代码：

^{pr2}$

当我运行这段代码时，我只得到最后一个soloistName和soloistInstrumet。我想到的结果有点像是对每个程序的重复观察。所以我会有一些类似的东西：

13918年，纽约爱乐乐团，1842-1843年，订阅季，52446*，奥托，安托瓦内特，女高音，南卡罗莱纳

13918，…，3642*，沙芬伯格，威廉，钢琴，A

13918，…，3642*，希尔，乌雷利·科雷利，小提琴，A

以此类推直到最后一个工作ID：

13918，…，8336*4，奥托，安托瓦内特，女高音，S

我得到的只是最后的工作：

13918年，纽约爱乐乐团，1842-1843年，订阅季，8336*，奥托，安托瓦内特，女高音，南斯

在这个文件中有超过15000个程序像我发布的例子。我想解析所有这些代码并提取我上面提到的信息。我不太清楚该怎么做，我已经在互联网上搜索过一种方法，但是我尝试的一切都不管用！！在

Answer 1

13918没有出现在您的数据中。撇开这些不谈，我写的是，它似乎成功地处理了你的数据。在

from lxml import etree

tree = etree.parse('test.xml')
programs = tree.xpath('.//program')

for program in programs:
    programID, orchestra, season = [program.xpath(_)[0].text for _ in ['programID', 'orchestra', 'season']]
    print (programID, orchestra, season)
    works = program.xpath('worksInfo/work')
    for work in works:
        workID = work.attrib['ID']
        soloistItems = work.xpath('soloists/soloist')
        for soloistItem in soloistItems:
            print (workID, soloistItem.find('soloistName').text, soloistItem.find('soloistInstrument').text, soloistItem.find('soloistRoles').text)

脚本生成以下输出。在

^{pr2}$

还有一件事需要注意：我在XML的开头放了一个标记，在末尾放了一个标记，因为实际数据将包含多个元素。在

Answer 2

你的问题是你误解了循环的工作方式。具体地说，这些值仅在循环中发生变化：

for x in range(10):
    pass

print(x) # prints 9

与

^{pr2}$

这是两回事。你做的是前者。你需要做的是：

with open('nyphil.txt', 'w') as f:
    nyphilwriter = csv.writer(f)        
    for program in root.iter('program'):
        id_ = program.findtext('id')
        program_id = program.findtext('programID')
        orchestra = program.findtext('orchestra')
        season = program.findtext('season')
        for concert in program.findall('concertInfo'):
            event = concert.findtext('eventType')
        for info in program.findall('worksInfo'):
            for work in info.iter('work'):
                work_id = work.get('ID')
                for soloists in work.iter('soloists'):
                    for soloist in soloists.iter('soloist'):
                        # Change this line to whatever you want to write out
                        nyphilwriter.writerow([id, program_id, orchestra, season, event, work_id, soloist.findtext('soloistName')])