在python3中合并多个csv文件

2024-05-18 19:23:50 发布

您现在位置:Python中文网/ 问答频道 /正文

我是python新手,正在分析涉及合并csv文件的大型数据集,它们都包含相同的标记行,但列的数量不同。我没有太多,但这是我目前的代码,任何帮助是非常感谢。在

import csv
import pandas as pd
file1 = 'C:\\Users\\User\\Documents\\Ubiome csv Kit #\\107-078-414.csv'
file2 = 'C:\\Users\\User\\Documents\\Ubiome csv Kit #\\109-080-426.csv'

reader1 = csv.reader(open(file1))
reader2 = csv.reader(open(file2))

reader1 = csv.reader(open(file1))
reader2 = csv.reader(open(file2))

Tags: 文件csvimportopenusersfile1kitdocuments
2条回答

来自熊猫文档:https://pandas.pydata.org/pandas-docs/stable/merging.html

import pandas as pd
df1 = pd.read_csv(file1)
df2 = pd.read_csv(file2)
merged_df = pd.concat([df1, df2], axis = 1, join = 'outer')
import pymysql.cursors
import re
import csv
import collections
import glob

# Variables

total_record = []
headerCount = 0

for file in glob.glob("*.csv"):
    print(file)

    with open(file, 'r') as f:
        reader = csv.reader(f)
        list_record = list(reader)
        if headerCount == 0:
            headerCount = 1
            total_record.extend(list_record)
        else:
            list_record.pop(0)
            total_record.extend(list_record)

with open('combine.csv', 'w') as csvFile:
    writer = csv.writer(csvFile)
    writer.writerows(total_record)

相关问题 更多 >

    热门问题