Assignment: Data Mining
1. Discuss why a document-term matrix is an example of a data set that hasasymmetric discrete or asymmetric continuous features.
2. Many sciences rely on observation instead of (or in addition to) designed experiments.Compare the data quality issues involved in observational sciencewith those of experimental science and data mining.
3. Discuss the difference between the precision of a measurement and the termssingle and double precision, as they are used in computer science, typicallyto represent floating-point numbers that require 32 and 64 bits, respectively.
4. This exercise compares and contrasts some similarity and distance measures.
(a) For binary data, the L1 distance corresponds to the Hamming distance;that is, the number of bits that are different between two binary vectors.The Jaccard similarity is a measure of the similarity between twobinary vectors. Compute the Hamming distance and the Jaccard similaritybetween the following two binary vectors.x = 0101010001y = 0100011000
(b) Which approach, Jaccard or Hamming distance, is more similar to theSimple Matching Coefficient, and which approach is more similar to thecosine measure? Explain. (Note: The Hamming measure is a distance,while the other three measures are similarities, but don't let this confuseyou.)
(c) Suppose that you are comparing how similar two organisms of differentspecies are in terms of the number of genes they share. Describe whichmeasure, Hamming or Jaccard, you think would be more appropriate forcomparing the genetic makeup of two organisms. Explain. (Assume thateach animal is represented as a binary vector, where each attribute is 1 ifa particular gene is present in the organism and 0 otherwise.)
(d) If you wanted to compare the genetic makeup of two organisms of the samespecies, e.g., two human beings, would you use the Hamming distance,the Jaccard coefficient, or a different measure of similarity or distance?Explain. (Note that two human beings share > 99.9% of the same genes.)
5. Discuss how you might map correlation values from the interval [-1,1] to theinterval [0,1]. Note that the type of transformation that you use might dependon the application that you have in mind. Thus, consider two applications:clustering time series and predicting the behavior of one time series given another.
6. Show that the distance measure defined as the angle between two data vectors,x and y, satisfies the metric axioms given on page 70. Specifically, d(x, y) :arccos(cos(x,y)).
Chapter 3 Exercises:
7. Describe how you would create visualizations to display information that describesthe following types of systems.
(a) Computer networks. Be sure to include both the static aspects of thenetwork, such as connectivity, and the dynamic aspects, such as traffic.
(b) The distribution of specific plant and animal species around the world fora specific moment in time.
(c) The use of computer resources, such as processor time, main memory, anddisk, for a set of benchmark database programs.
(d) The change in occupation of workers in a particular country over the lastthirty years. Assume that you have yearly information about each personthat also includes gender and level of education.
Be sure to address the following issues:
* Representation. How will you map objects, attributes, and relationshipsto visual elements?
* Arrangement. Are there any special considerations that need to betaken into account with respect to how visual elements are displayed? Specificexamples might be the choice of viewpoint, the use of transparency,or the separation of certain groups of objects.
* Selection. How will you handle a larqe number of attributes and dataobjects?
8. Discuss the differences between dimensionality reduction based on aggregationand dimensionality reduction based on techniques such as PCA andSVD.
Format your assignment according to the following formatting requirements:
1. The answer should be typed, double spaced, using Times New Roman font (size 12), with one-inch margins on all sides.
2. The response also includes a cover page containing the title of the assignment, the student's name, the course title, and the date. The cover page is not included in the required page length.
3. Also include a reference page. The Citations and references should follow APA format. The reference page is not included in the required page length.