Often in statistics, when we combine two methods, the resulting hybrid outperforms the two pure methods. For example, consider a naïve Bayes approach that incorporates the derived variables into the probability calculation. For simplicity, you might try a few variables that result from the important splits in the recursive partitioning tree from Figure 3.8, e.g., whether or not the percentage of capitals in the message body exceeds 13%. These variables have only 2 values as the splits are based on yes-no questions. Develop a hybrid classifier that uses both the word vectors and these additional features.
