User:Kithira/Course Pages/CSCI 12/Assignment 2/Group 4/Homework 4

Method of Filtering
To identify spikes in the data, we choose to look at the standard deviation of data points in ranges of 1 minute. We identify outliers in the standard deviation measurements (by again using standard deviation) and mark these minutes as times to look for spikes in. Then, we take the standard deviation of all the second-long measurements in the previously identified minute ranges. This gives us a measure of what points are outliers which we then filter out. This is step one. We repeat the process, switching the time interval by thirty seconds. This is accomplished by checking that the first thirty measurements have indeed not been marked as possible outliers in step one, then eliminating them temporarily from our data. Then, we repeat step one on this new data set. This gives us two lists of possible outliers which we augment and analyze to determine the spikes in the data.

Filtering Code
The code is explained in the comments.

Augmentation Code
Code used to augment the spikes.txt with the spikes2.txt