AuDoLab.subclasses.preprocessing

class AuDoLab.subclasses.preprocessing.Preprocessor

Bases: object

basic_preprocessing(df, column, ngram_type=2)

The data will be lemmatized, tokenized and the stopwords will be deleted.

Args:

df (pd.DataFrame): Dataframe where the documents to be preprocessed

are stored.

column (str): Column name of the column where docs are stored.

ngram_type (int, optional): Number of ngrams used. Defaults to 2.

Returns:

pd.DataFrame: DataFrame where the original docus and the

preprocessed documents are stored.