Visit hbs.edu

Using Analytics to Find Value in Education Data

The following insights are derived from a recent Assembly talk featuring Hywel Benbow, regarding applying data analytics to enhance the performance of educational institutions. We presented a few question to Hywel during this talk, and what follows is a summary of his responses.

Could you speak to some overarching and generalizable ways educational organizations could leverage data to drive performance, growth, and innovation? 

The transformative power of analytics is undeniable, it plays a pivotal role in revolutionizing education on multiple fronts. Firstly, it streamlines administrative tasks from admissions to astute resource allocation, boosting organizational efficiency. It also brings a new dimension to staff recruitment and retention strategies by tailoring hiring processes to specific needs such as hiring teachers adept at teaching multiple subjects during periods of growth and expansion, optimizing the recruitment process and supporting strategies for future campaigns.

On the educational side, data analytics transforms the learning experience. Analytics facilities personalized learning by recognizing individual students’ needs, preferences, abilities, and learning pace. Adaptive learning systems further fine-tune the educational journey. These platforms adjust in real time ensuring the learning journey of every student is optimized. Beyond real time adjustments, analytics can proactively identify students who might be at risk, facilitating timely interventions, and predicting future student performance, ensuring educators remain prepared. 

The impact doesn’t stop with analytics alone. Emerging technologies like AI, machine learning, augmented and virtual reality are seen as innovative and immersive tools, enhancing the learning experience and removing some of the barriers, particularly for students with physical or geographical limitations. Collectively, analytics and emerging technologies are reshaping education, making it more efficient, personalized, and responsive to the needs of students and institutions. 

Can you share your thoughts on how education institutions can build the capabilities to be data and insight-driven? 

Education institutions are poised at an interesting juncture where data-informed insights can significantly enhance both operational efficiency and the quality of education. To transition into being data and insight-driven, several integral steps need to be taken.

Firstly, there needs to be strong leadership support to establish this culture—leadership teams must embrace and champion the use of data to inform decisions and enhance operational efficiency, essentially setting the tone for the entire institution. Creating general awareness among faculty, leadership, and board members is also crucial. An informed and enthusiastic faculty can be the linchpin in effectively transitioning to a data-informed approach. 

Awareness alone isn’t enough, promoting and embedding data fluency and literacy is another pivotal element. It’s not about transforming educators into analytics but ensuring they are equipped with the wider skillset to use data effectively. Collaboration between data analysts and domain experts is encouraged to elevate the quality of questions asked and the analytical outcomes.

Infrastructure is the backbone of any data initiative. As such, ensuring that the organization’s data and digital ecosystem is aligned with the organizations overarching strategy becomes indispensable.

Finally, there is deep responsibility in handling data. Data governance, which includes maintaining data quality, proper data collection, and data protection, is underscored as a foundational element for effective data-informed initiatives. Without robust governance, even the most insightful data can become a liability.

Could you talk about a few examples in which you used data analytics to help stakeholders in educational organizations make informed decisions, focusing on decisions that are commercial or business-facing?  

While data analytics is a necessity to succeed commercially, two key areas where data has a distinct impact across K-12 schools, universities, and colleges are admissions and customer experience.

Data analytics plays a crucial role in dissecting the admissions processes, pinpointing where potential students fall out of the admissions funnel through to gaining a deeper understanding of the end-to-end journey students and parents undergo, from enrolling to graduating or leaving. 

This is closely tied to the concept of customer experience in education, especially in K-12 schools, where students and parents constitute two distinct customer groups. Recognizing the needs and desires of both groups is pivotal, the essence of education is inherently emotional thereby magnifying the importance of catering to the aspirations and concerns of both these groups. Happy students and satisfied parents are critical for student retention. Happy parents also become promoters, providing brand loyalty and positive comments leading to increased admissions and revenue, which is paramount from a commercial perspective.

But there is another layer to this relationship. Parental and student feedback, often rich with insights about strengths and challenges is incredibly valuable. When channeled constructively this feedback can identity issues, themes, trends and help transform performance or highlight where there is a perception challenge. On a positive front, feedback can be turned into compelling narratives, which when used for marketing and communications, can attract prospective new students.

How have you used data to build capacity and improve performance of individuals and teams in the educational organizations you led? How can data analytics help educators optimize their impact in the classroom, help students improve performance and learning outcomes, and help administrators streamline and optimize services? 

Data analytics excels at improving efficiency and productivity, an example being automating repetitive tasks, freeing professionals to focus on more impactful endeavors. This liberation inadvertently paves the way for rich, spontaneous collaborations. When analytics experts liaise with professionals from diverse departments, the combined outcomes can be quite profound.

For educators, data analytics isn’t just a tool, it offers valuable support, enabling data-informed decision-making. It guides educators with insights, these alongside their contextual knowledge enhance teaching and student performance. The real power of data analytics comes when different datasets are utilized together, creating comprehensive and timely views of students encompassing a fuller perspective on their needs. 

Technology plays a large part but should be supportive of the wider goals rather than the driver. Innovations like Chat GPT exemplify how technology can be a catalyst for creativity and exploration and helping to streamline tasks. The integration of technology in education equips students and teachers with assistive tools for enhancing the way they work, this, when used well improves productivity and outcomes. With the job market continually evolving towards tech-centric roles, it’s imperative for students to be fluent in the developing and using technology. Being able to incorporate different tools, thought their own learning and through seeing how their school utilize them is a positive development.

What are some risks to be cognizant of when applying data analytics in the context of educational organizations? What precautions should be taken to make sure sensitive student data is kept secure? 

Firstly, data security and privacy take center stage. Education settings deal with a considerable amount of sensitive data, therefore safeguarding these datasets is paramount. This involves secure storage and tailored access rights for individuals like administrators, teachers, and board members. Regular reviews and adjustments are also essential to ensure the right access is in place as roles are and projects evolve. 

Misinterpreting data is a significant concern, particularly in unfamiliar contexts. Without understanding the context, erroneous conclusions can be drawn, leading to ill-advised decisions. Collaborative efforts between education experts and data analysts, involving open communication, relentless questioning, and mutual guidance, effectively mitigate this risk.

Upholding ethical standards is also key to preserve trust within the educational community. It’s essential that collected data serves its intended purpose, transparency with students, parents, and staff on how data is used is also essential. When integrating external datasets with internal ones, latent biases may seep in, skewing analyses and outcomes. Such biases, as evidenced in certain outputs of machine learning tools including ChatGPT, can lead to flawed conclusions and actions. Balancing data security, interpretation, and ethical considerations remain central in the educational landscape. 

How should educational organizations deal with potential biases in educational data, that impact decision making, especially in relation to students, assessment, and performance evaluation. 

There is an inherent responsibility to ensure that biases embedded within educational data don’t compromise the decision-making process, especially concerning assessments and performance evaluations. It’s important to have a clear understanding of the data’s origin and composition, especially when using data in the context of predictive modeling for student performance and education analytics, as doing so can help recognize and address potential biases.

Recognizing the data’s nuances and inherent biases is the first step to effectively counteract them. And this vigilance amplifies when transitioning data insights across varied cultural and demographic contexts. For instance, utilizing data derived from Western educational settings within a predictive model for Middle Eastern ones, teeming with a plethora of nationalities and diverse educational backgrounds, can lead to glaring inaccuracies. Such transitions don’t just risk misinterpretation; they can inadvertently entrench biases.

Many large data sets come from Western countries with mature data collection systems, making them more suitable for use in similar contexts. While these can be a valuable source in insights for policy development in the same geographies, they may not resonate with the same authenticity in countries with an emerging education landscape.

By critically evaluating data sources, being sensitive to contextual nuances, and continuously checking for biases, the education sector can ensure that data analytics supports improved outcomes.

What is the current state of the application of data analytics to augment human and business performances in the educational landscape, in the context of the Middle East (UAE)? How does this state compare to how data analytics is being used in the educational landscape in the US and the UK?  

Have you faced any resistance or hesitancy to implementing data analytics? And how did you possibly deal with that? 

In the Middle East, data analytics is a rapidly emerging field that has witnessed significant growth in the past few years. This development is a response to the region’s strong emphasis on personalized learning, driven by the diverse cultural and linguistic backgrounds of students and the increasing demand from parents for customized education to enhance student outcomes. As a result, advanced analytics tools are gaining traction in education, not only for personalized learning but also for enhancing efficiency through the analysis of student and staff performance. The integration of AI technology, such as Chat GPT, is also growing in Middle Eastern educational settings, much the same as the rest of the world. 

Comparing the Middle East to more mature regions like Europe and the U.S., the Middle East is rapidly narrowing the gap, with its best schools performing at the same level as their peers in established regions. However, the Middle East is still in the process of building its data infrastructure, while mature regions have well-established systems in place helping to shape policy and strategy. In the coming years as more historical data is available the Middle East will be on a similar footing.

In industries where data analytics is less mature or has been less of an everyday feature, resistance and apprehension are common. Overcoming this resistance entails shifting the focus from uncovering problems to collaboratively identifying and solving them. An internal marketing approach can showcase the benefits of data analytics, emphasizing its goal to enhance efficiency and address specific concerns. Collaboration and a problem-solving orientation are pivotal in demonstrating the value of data analytics. It’s very much a “how can data analytics help” approach that removes resistance.

Looking forward, the Middle East is uniquely positioned. Unhindered by some of the legacy constraints that occasionally tether older regions, it possesses the agility to leapfrog into the future. As the regions continues its upward trajectory, emerging countries may increasingly look to the Middle East for insights into adapting and innovating educational practices, establishing the region as a hub for educational innovation. 

What do you see the future of data analytics in the educational landscape to be in the aforementioned regions? In what specific ways do you foresee data analytics disrupting the educational landscape, for good and for bad, particularly in relation to the advent of Artificial Intelligence and Large Language Models such as ChatGPT? 

The future of education analytics holds great promise, driven by increasingly accessible and affordable technologies. The Middle East, in particular, is poised for substantial advancements over the next 5 to 10 years. This progress is attributed to the accumulation of more and better data and, substantial government involvement in elevating educational standards, facilitated by the region’s openness to change, unlike more established systems in the US and the UK. An unexpected proponent of this evolution was the COVID-19 pandemic. It laid bare the essence of robust infrastructure capable of underpinning remote and digital education. The Middle East, and in particular schools in the UAE demonstrated greater preparedness in this regard.

Predictive analytics is expected to play an expanded role in education, particularly in assessing students’ future performance. As schools amass more data, it will allow predictive analytics to be increasingly leveraged to anticipate student outcomes and enhance personalized learning. 

While implementing such technology can be a challenge for state-level schools or those with budget constraints, the decreasing cost of technology over time is expected to increase accessibility. Assistive technologies like Chat GPT and Google Bard are likely to become more common in education, complementing traditional teaching and learning tools. It’s pertinent to remember these are assistive technologies and are there to support elements of teaching rather than replace it. As technology continues to evolve, it is poised to have a substantial impact on education in the years ahead, from teaching, learning and administrative perspectives.

What are a few important challenges the education sector has to grapple with related to data infrastructure and governance? 

In terms of governance and infrastructure, building a culture where the use of data within an organization becomes common place is vital. Governance, often seen as a strict term, should be associated with security, protection, and ethics. Elevating data literacy and fluency levels across the organization can help mitigate governance challenges, as it supports everyone in understanding the importance of data protection, data quality and data ethics. 

Another daunting hurdle is the fragmentation of data, addressing the challenge of data silos is a challenge. Organizations need to move away from having data scattered across different unconnected systems and toward building a cohesive ecosystem that seamlessly manages data. The real power of data is unlocked when users are able to utilize different datasets together to uncover deeper insights. Ensuring the digital and data ecosystem is aligned allows this to happen.

The availability of cloud systems has become more cost-effective, encouraging a shift from legacy practices to more cohesive systems. Scalability is also a key challenge, as the volume of data collected in the education sector is expected to increase significantly. The infrastructure required by to succeed must be both expansive and agile, able to evolve with surges and respond to unforeseen shifts, much like the pandemic-induced digital pivot.

The mounting volume also signals an impending demand for adept data analysts. This surge, however, is not exclusive to the education sector, culminating in a fierce battle for talent acquisition. Efforts to integrate digital analytics into curriculums, such as the UK’s digital curriculum, aim to address this challenge and ensure a future workforce with ingrained data analysis skills. 

The bedrock of any successful endeavor is a robust foundation, and this axiom holds true, unequivocally, when it comes to data and analytics.

As a closing remark, do you have any advice for students and parents as to why they should care about data analytics? 

Understanding the whole picture of student learning outcomes is essential, given that various factors can influence different student experiences. For instance, a high-ability student whose potential might remain unfulfilled, due to unrecognized capabilities or challenges in their wellbeing. Harnessing diverse data, can equip educators with a better perspective of the student, allowing them to understand which areas need additional focus or attention. Collecting the right data and using it in the right ways minimized the number of students who may miss reaching their potential. 

From a parent’s perspective, having teachers understand a child’s needs, strengths, weaknesses, preferred pace of learning, and interaction style is crucial for effective education. While every parent values the safety and happiness of their children, they are also discerning about their child’s preparedness for subsequent academic phases, regardless of age, curriculum or geographical nuances. Integrating data analytics proves invaluable in catering to these aspirations. The goal of personalized learning is to ensure that each learner reaches their full potential. This means recognizing that not every student excels in the same way or at the same pace. Data analytics can play a key role in helping educators, counselors, and teachers set students up for success and guide them through their educational journey.

Engage With Us

Join Our Community

Ready to dive deeper with the Digital Data Design Institute at Harvard? Subscribe to our newsletter, contribute to the conversation and begin to invent the future for yourself, your business and society as a whole.