Data Mining – Classification, Model Optimisation and Evaluation
This individual Data Mining assignment requires students to apply the techniques covered in the module using the WEKA data mining platform. The assessment is worth 40% and focuses on practical application of machine learning and data mining methods, requiring students to configure algorithms, analyse datasets, optimise model parameters, evaluate classification performance and explain their technical choices and results. The assignment also assesses the ability to critically evaluate different algorithms and models of data mining. The assignment includes several tasks covering different stages of the data mining process. Students are required to work with supplied datasets and use appropriate preprocessing and classification techniques. The datasets include a balanced screenshot dataset containing processed screenshots classified into categories such as "Okay" and "Bad", where the objective is to train a model capable of identifying inappropriate content. The data has been processed using PCA to provide a smaller four-dimensional representation while protecting privacy and reducing the size of the data. Another supplied dataset concerns furniture reviews, containing positive ("pos") and negative ("neg") written feedback, with the objective of building a model that can determine whether a furniture review belongs to either class. The assessment evaluates students' ability to understand and describe the datasets, including the number of instances, number of columns, data types and relevant statistical information. For text-based data, students must apply appropriate vectorisation and describe the resulting dataset characteristics. Students must also consider class imbalance and apply an appropriate method where necessary, explaining how the chosen approach affects the distribution of instances between the classes. A significant component of the assignment involves classification algorithms and parameter optimisation. The assessment requires students to work with algorithms including Naive Bayes, LibSVM and J48. Students must investigate appropriate parameters and perform parameter searches or fine grid searches to identify suitable configurations. They must explain the selected parameters, their impact on the model and the reasoning behind the chosen values. Model performance must be evaluated using appropriate validation techniques, including cross-validation. Students are required to compare the algorithms using results such as overall accuracy and confusion matrices. The assignment expects students to identify an appropriate or best-performing algorithm in the context of the dataset and to provide a clear explanation of the comparison rather than simply reporting numerical results. The rubric places emphasis on accurate configuration, clear explanation of parameter choices, dataset analysis, class-balance treatment, parameter optimisation, cross-validation and critical comparison of algorithm strengths and weaknesses. High-quality work should explain both the technical process and the implications of the results, with results presented clearly through appropriate tables, confusion matrices and graphical outputs where required. The submission must be a single PDF document containing the report and must not exceed 10 pages. Students are instructed to include their student ID at the beginning of the report but not their name or other identifying details so that marking remains anonymous. Screenshots are specifically required to demonstrate use of the student's ID number as the random seed; other WEKA results should be presented in the student's own tables or result formats. The brief also states that no research beyond the material covered in the module is required and therefore no citations or reference list are required. The assignment explicitly prohibits the use of Generative AI tools for creating content and prohibits using GenAI tools or proofreading services for proofreading. Students are expected to complete the practical work themselves and explain their own technical choices and results.
Read Model Answer →