去停用词

标签：txt   strip   readlines   python   and   word   return   coding   ext   

import pandas as pd
stop_words = []
with open('data/stop_words.txt','r',encoding='utf-8') as f:
    lines = f.readlines()
    for i in lines:
        word = i.strip()
        stop_words.append(word)
print(stop_words[:10])


def clean_stopwords(text,stop_words):
    data = []
    for sentence in text:
        data.append([ word for word in sentence if word not in stop_words])
    return data

去停用词

标签：txt   strip   readlines   python   and   word   return   coding   ext   

原文地址：https://www.cnblogs.com/rise0111/p/11563355.html