Big Data Analytics / Machine Learning
3,000 words
Machine Learning on Big Data Using PySpark: Large-Scale Data Analysis and Predictive Modelling
This group-based Machine Learning on Big Data project requires students to apply machine learning techniques to a large real-world dataset using PySpark DataFrames and Spark machine-learning libraries. Students select a substantial dataset, ideally between approximately 300 MB and 1 GB, from sources such as Kaggle, workplace data or other valid repositories, and develop an end-to-end big-data analytics workflow. CN7030 CRWK 26T1 The project begins with data loading and preprocessing using PySpark. Students are expected to handle missing values, perform data normalisation and feature engineering, identify class imbalance and propose appropriate mitigation strategies. Where text datasets are selected, additional preprocessing may include stemming, lemmatization and TF-IDF representation. CN7030 CRWK 26T1 The modelling stage requires implementation of an appropriate machine-learning approach using PySpark MLlib or Spark ML. The brief expects a multiclass rather than binary classification problem and allows techniques including multiclass classification, ensemble learning, clustering and text mining. Students must justify their model choice and consider model robustness, bias and variance when attempting to improve predictive performance. CN7030 CRWK 26T1 Students then perform hyperparameter tuning using techniques such as grid search or random search and evaluate the resulting model with appropriate measures. Relevant evaluation outputs may include accuracy, F1-score, precision, recall and a confusion matrix. Results should also be visualised or clearly presented and interpreted to identify meaningful patterns and performance characteristics. CN7030 CRWK 26T1 The project additionally requires consideration of Legal, Social, Ethical and Professional (LSEP) issues. Students discuss potential ethical concerns associated with their dataset, including bias and privacy risks, and propose suitable mitigation strategies. The final work is consolidated into a single user-friendly HTML analytics report that clearly presents the group's preprocessing, modelling, optimisation, evaluation and interpretation. CN7030 CRWK 26T1 CN7030 CRWK 26T1 Overview word count: approximately 335 words. If you are also uploading the presentation separately to the Reference Library, that should be a second entry under “Presentations and Academic Posters”, because the presentation forms a distinct 40% component and assesses understanding of Spark, preprocessing, modelling, optimisation, evaluation and responses to examiner questions. CN7030 CRWK 26T1
Read Model Answer →
Big Data Analytics / Data Analytics
4,000 words
Big Data Analytics Using Python and Business Intelligence with Tableau
This individual Big Data Analytics assessment requires students to critically analyse data using programming languages, statistical techniques, data visualisation methods and business intelligence software. The assessment combines practical data analytics using Python with interactive business intelligence and dashboard development using Tableau, requiring evidence of technical implementation, research, critical appraisal and justification of the selected analytical approaches. The first section, worth 70%, is based on a dataset containing accidental drug-related deaths recorded in Connecticut between 2012 and 2024. The dataset contains 12,964 observations and 49 variables. Students are required to conduct exploratory data analysis using Python, develop three to four research questions, formulate null and alternative hypotheses, and apply appropriate statistical methods. The analytical process also requires an evaluation of alternative technologies and methodological approaches, supported by relevant research. Students must justify their selected methodology and present a clear workflow diagram. The solution-development stage involves data preprocessing, descriptive statistical analysis, visualisation, answering the research questions and conducting statistical significance testing to determine whether the null hypothesis should be accepted or rejected. Evidence of coding and a link to working code are also required. The final Python component requires evaluation of the findings, consideration of limitations and recommendations for future development using emerging technologies. The second section, worth 30%, focuses on Business Intelligence using Tableau and uses a historical Olympic Games dataset containing 271,116 rows and 15 columns. Students analyse relationships between medals and host cities, athlete age and medal type, season and medal counts, and sex and medal type. The section culminates in an interactive Tableau dashboard containing at least four interconnected sheets, where changes to relevant parameters are reflected across the dashboard. Overall, the assessment develops practical competence in Python-based analytics, statistical reasoning, research-question development, hypothesis testing, data visualisation and interactive business intelligence dashboard design. Overview word count: approximately 350 words. AI note: the brief permits AI for limited support such as grammar, structure, organisation of ideas and suggestions, but states that the main content, analysis and conclusions must remain the student's own work. AI use must also be declared.
Read Model Answer →