Template Credit: Adapted from a template made available by Dr. Jason Brownlee of Machine Learning Mastery.
SUMMARY: The purpose of this project is to construct a prediction model using various machine learning algorithms and to document the end-to-end steps using a template. The Ames Iowa Housing Prices dataset is a regression situation where we are trying to predict the value of a continuous variable.
INTRODUCTION: Many factors can influence a home’s purchase price. This Ames Housing dataset contains 79 explanatory variables describing every aspect of residential homes in Ames, Iowa. The goal is to predict the final price of each home.
In this iteration, we plan to establish the baseline mean squared error for further takes of modeling.
ANALYSIS: The baseline performance of the machine learning algorithms achieved an average RMSE of 31,429. Two algorithms (Ridge Regression and Gradient Boosting) achieved the top RMSE metrics after the first round of modeling. After a series of tuning trials, Gradient Boosting turned in the best overall result and achieved an RMSE metric of 23,906. By using the optimized parameters, the Gradient Boosting algorithm processed the testing dataset with an RMSE of 21,522, which was even better than the prediction from the training data.
CONCLUSION: For this iteration, the Gradient Boosting algorithm achieved the best overall results using the training and testing datasets. For this dataset, Gradient Boosting should be considered for further modeling.
Dataset Used: Kaggle Competition – House Prices: Advanced Regression Techniques
Dataset ML Model: Regression with numerical and categorical attributes
Dataset Reference: https://www.kaggle.com/c/house-prices-advanced-regression-techniques
One potential source of performance benchmarks: https://www.kaggle.com/c/house-prices-advanced-regression-techniques
The HTML formatted report can be found here on GitHub.