为什么fit_transform不断抛出错误？

Question

我一直在努力理解为什么fit_transform不断抛出错误。调试并没有多大帮助，因为它只会将我发送到数组的定义，我不确定我缺少了什么。有什么想法吗

import numpy as np
from sklearn.preprocessing import MinMaxScaler
import pickle

def split_data(inputs, outputs, p_train=0.9, p_test=0.1):
    train_size = int(len(inputs) * p_train)
    test_size = int(len(inputs) * p_test)
    inputs_train, inputs_test = inputs[0:train_size, :], inputs[train_size:, :]
    outputs_train, outputs_test = outputs[0:train_size, :], outputs[train_size:, :]
    return inputs_train, inputs_test, outputs_train, outputs_test

rawinputs = pickle.load(open('rawinputs.pck', 'rb'))  
rawoutputs = pickle.load(open('rawoutputs.pck', 'rb'))  

#split
inputs_train, inputs_test, outputs_train, outputs_test = split_data(rawinputs, rawoutputs, p_train=0.90, p_test=0.10)

#normalize
scaler_inputs = MinMaxScaler()
inputs_train_scaled = scaler_inputs.fit_transform(inputs_train)
inputs_test_scaled = scaler_inputs.transform(inputs_test)
outputs_train = np.asmatrix(outputs_train)

在使用fit_transform的第一行抛出错误get：

inputs_train_scaled = scaler_inputs.fit_transform(inputs_train)

例如，输入数据的一行：

['28,7170876207375' '339,050018316624' '0,173448071160097' '158,211319524893']

抛出错误：

File "C:\****\venv\lib\site-packages\sklearn\base.py", line 690, in fit_transform return self.fit(X, **fit_params).transform(X)

Answer 1

关键点是inputs_train变量必须是二维数组

下面是一个简单的例子：

from sklearn.datasets import fetch_olivetti_faces

我们将MinMaxScaler应用于人脸数据集

from sklearn.datasets import fetch_olivetti_faces

olivetti = fetch_olivetti_faces()

X = olivetti.images
y = olivetti.target

X是人脸图像，其中y是每个人脸的标签

接下来，我们将数据集划分为训练集和测试集

类似于split_data方法

from sklearn.datasets import fetch_olivetti_faces
from sklearn.model_selection import train_test_split

olivetti = fetch_olivetti_faces()

X = olivetti.images
y = olivetti.target

x_train, x_test, y_train, y_test = train_test_split(X, y,
                                                    test_size=0.2,
                                                    random_state=42)

每次运行代码时，random_state变量将帮助我们生成相同的序列和测试集

现在，如果我们看一下x_train变量：

print(x_train.shape)

共有320个列车图像，每个图像为64 x 64像素。我们必须重塑以使用MinMaxScaler

x_train = x_train.reshape(x_train.shape[0], x_train.shape[1] * x_train.shape[2])

现在，新的图像大小：

最终代码：

from sklearn.datasets import fetch_olivetti_faces
from sklearn.model_selection import train_test_split
from sklearn.preprocessing import MinMaxScaler

olivetti = fetch_olivetti_faces()

X = olivetti.images
y = olivetti.target

x_train, x_test, y_train, y_test = train_test_split(X,
                                                    y,
                                                    test_size=0.2,
                                                    random_state=42)

x_train = x_train.reshape(x_train.shape[0], x_train.shape[1] * x_train.shape[2])
x_test = x_test.reshape(x_test.shape[0], x_test.shape[1] * x_test.shape[2])

min_max_obj = MinMaxScaler()

inputs_train_scaled = min_max_obj.fit_transform(X=x_train)
inputs_test_scaled = min_max_obj.transform(X=x_test)