Using cart algorithm perform binary classification


Assignment Part I: Latent Space

Problem 1: A scatter plot of the r = 2-dimensional representation of the faces in the r = 2-dimensional latent space, together with the faces which represent the two dimensions/features of the two-dimensional representation.

Problem 2: A visualization of the faces which define the features of the latent space for r = 5.

Problem 3: The reconstruction of the faces with indices i ∈ {0, 10, 20} when using a rank of r ∈ {5, 25, 50, 100} For example, the reconstruction of a picture when using 25, 50 and 100 (centered) principal components should look like those in Fig. 1.

Problem 4: Point out differences and similarities of the three methods and describe how the differences in the matrix factorization objective functions are expressed in the latent space.

Assignment Part II: Classification methods and metrics

Problem 1: Using the Naive Bayes method (you are free to use an implementation at your choice) perform binary classification on the HW3 dataset. Try to maximize the accuracy obtained on the validation set, while training the model on the training set. Report the results of the worst and best performing models using: confusion matrix and accuracy in percentages. Draw the decision boundaries of the worst and best models obtained. Perform a qualitative discussion on the process followed and the results obtained.

Problem 2: Using the CART algorithm (you are free to use an implementation at your choice) perform binary classification on the HW3 dataset. Try to maximize the accuracy obtained on the validation set, while training the model on the training set. Report the results of the worst and best performing models using: confusion matrix and accuracy in percentages. Draw the decision boundaries of the worst and best models obtained. Draw the best and the worst CART models obtained. Perform a qualitative discussion on the process followed and the results obtained.

Problem 3: Using Support Vector Machine - SVM (you are free to use an implementation at your choice) perform binary classification on the HW3 dataset. Use two kernels for SVM: (a) linear and (b) radial basis function. For both kernels, try to maximize the accuracy obtained on the validation set, while training the model on the training set. For both kernels, report the results of the worst and best performing models using: confusion matrix and accuracy in percentages. For both kernels, draw the decision boundaries of the worst and best models obtained. Perform a qualitative discussion on the process followed and the results obtained.

Problem 4: Add to the Neural Networks code that you implemented yourself from scratch for HW3 Part I

f (x) = x, ∀x ∈ 0

f (x) = x, ∀x ≥ 0

f (x) = { 0.3x, ∀x < 0

Please perform and report the following using the HW3 dataset:

Present in the report the derivations of the two above mentioned activation functions to use them for the optimization process of the MLP

For each of the above mentioned activation functions, create one MLP model where the hidden neurons activation is set to chosen activation function, while the remaining configuration is exactly the same as the one defined in the "Problem" section of HW3.

For both MLP models, try to maximize the accuracy obtained on the validation set, while training the model on the training set.

For both MLP models, draw the decision boundaries of the worst and best models obtained.

Perform a qualitative discussion on the process followed and the results obtained.

Problem 5: Discuss on the advantages and disadvantages of using all of the methods from part II (Classification methods and metrics) of this resit exam. Which one do you believe that is the best method to use on the HW3 dataset? Why?

Is complex Data Mining and Machine Learning assignments and homework act as an obstacle in your academic success? Then, without any delay, you must avail our Data Mining and Machine Learning Assignment Help service for better academic grades!

Tags: Data Mining and Machine Learning Assignment Help, Data Mining and Machine Learning Homework Help, Data Mining and Machine Learning Coursework, Data Mining and Machine Learning Solved Assignments, Latent Space Assignment Help, Latent Space Homework Help, Naive Bayes Method Assignment Help, Naive Bayes Method Homework Help, CART Algorithm Assignment Help, CART Algorithm Homework Help, Support Vector Machine Assignment Help, Support Vector Machine Homework Help, Neural Networks Code Assignment Help, Neural Networks Code Homework Help

Attachment:- Data Mining and Machine Learning.rar

Request for Solution File

Ask an Expert for Answer!!
Python Programming: Using cart algorithm perform binary classification
Reference No:- TGS03051983

Expected delivery within 24 Hours