使用此模块根据地址预测国家名称:
import re
import numpy as np
import pandas as pd
from sklearn.naive_bayes import MultinomialNB
from sklearn.model_selection import train_test_split
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.preprocessing import LabelEncoder
from sklearn.metrics import accuracy_score
def normalize_text(s):
s = s.lower()
s = re.sub('\s\W',' ',s)
s = re.sub('\W\s',' ',s)
s = re.sub('\s+',' ',s)
return(s)
df['TEXT'] = [normalize_text(s) for s in df['Full_Address']]
vectorizer = CountVectorizer()
x = vectorizer.fit_transform(df['TEXT'])
encoder = LabelEncoder()
y = encoder.fit_transform(df['CountryName'])
x_train, x_test, y_train, y_test = train_test_split(x, y, test_size=0.2)
nb = MultinomialNB()
nb.fit(x_train, y_train)
y_predicted = nb.predict(x_test)
accuracy_score(y_test, y_predicted)
我想使用我构建的模块来预测单个字符串地址,我该怎么做? 我试过:
nb.predict('1100 112th Ave NE #400, Bellevue, WA 98004, United States')
ValueError: Expected 2D array, got scalar array instead:
array=1100 112th Ave NE #400, Bellevue, WA 98004, United States.
Reshape your data either using array.reshape(-1, 1) if your data has a single feature or array.reshape(1, -1) if it contains a single sample.
更新:
正如在一份答复中所建议的那样:
nb.predict([['1100 112th Ave NE #400, Bellevue, WA 98004, United States']])
ValueError: matmul: Input operand 1 has a mismatch in its core dimension 0, with gufunc signature (n?,k),(k,m?)->(n?,m?) (size 82043 is different from 1)
使用:
predict方法需要一个数组
要进行预测,您需要通过所有预处理步骤传递数据,以训练模型:
注意:改进代码的两种方法:
normalize_text
步骤实际上并不必要,因为它所做的一切都将被CountVectorizer的标记器regextoken_pattern='(?u)\\b\\w\\w+\\b'
和lowercase=True
捕获将所有预处理保持在sklearn
Pipeline
中。这样,您的代码将更干净,更不容易出错(而且您肯定会避免像以前那样的错误)工作[canonical?]模板如何实现:
拥有
Pipeline
的额外好处是,您可以通过GridSearchCV
传递它,以便通过交叉验证选择最佳参数相关问题 更多 >
编程相关推荐