Python Project Assignment: Data Science
Overview
This project consists of two tasks. The goal is to apply what we have learned to solve real problems in Data Science. Glance at "What to Submit" when you start working on a task so that you know what information to provide from each task.
What to Submit
o One doc file "csci333-project-XX.doc" including the text source code and screenshots of the outputs of all programs. Please replace XX with your first name and last name. You can copy/paste the text source code from Pycharm or other IDEs into the doc file. Hopefully, based on the screen snapshots of the output, you can show that your programs passed tests and were well.
o Python files for all programs. In well-defined programs, proper comments are required. For programs without comments, they will be deducted greatly in grade.
o Note that if any program or code does not work, you can explain the status of the program or code and then attach your explanation and description in a file "README.txt".
o Optional. Anything you want to attract the attention.
Task I: (Intro to Data Science: Survey Response Statistics) Twenty students were asked to rate on a scale of 1 to 5 the quality of the food in the student cafeteria, with 1 being "awful" and 5 being "excellent". Place the 20 responses in a list.
1, 2, 5, 4, 3, 5, 2, 1, 3, 3, 1, 4, 3, 3, 3, 2, 3, 3, 2, 5
Write a program that does the following:
o Determine and display the frequency of each rating.
o Use the built-in functions, statistics module functions and NumPy or Panda functions covered in the course materials to display the following response statistics: minimum, maximum, range, mean, median, variance and standard deviation.
o Display a bar chart showing the response frequencies and their percentages of the total responses.
Task II: (Classification with k-Nearest Neighbors and the Digits Dataset) Read the file "09-02-MachineLearning.pdf" and the python program "CaseStudy1.py" to learn the algorithm of k-Nearest Neighbors with the Digits dataset for recognizing handwritten digits.
Re-write the python program by doing the following subtasks:
o Write code to display the two-dimensional array representing the sample image at index 24 and numeric value of the digit the image represents.
o Write code to display the image for the sample image at index 24 of the Digits dataset.
o For the Digits dataset, what numbers of samples would the following statement reserve for training and testing purposes?
o Write code to get and display these numbers.
o Rewrite the list comprehension in snippet [50] using a for loop. Hint: create an empty list and then use the built-in function "append".
Format your assignment according to the following formatting requirements:
o The answer should be typed, using Times New Roman font (size 12), double spaced, with one-inch margins on all sides.
o The response also includes a cover page containing the title of the assignment, the student's name, the course title, and the date. The cover page is not included in the required page length.
o Also include a reference page. The Citations and references must follow APA format. The reference page is not included in the required page length.