Written by James Wilkinson and Glaucia Rosas, Directors of EduTec Alliance

Generative AI (GenAI) emerged in 2023 amid a wave of optimism, hailed as a potential game-changer for education. Promises of freeing teachers from administrative burdens, saving 10–20 hours per week, and enabling more meaningful student interactions captured the imagination of educators and technologists alike. The premise? Streamlined workflows would lead to better outcomes for students.

In the wake of this excitement, the education technology market saw a dramatic influx of tools claiming to revolutionize teaching and learning. At last count, nearly 250 new GenAI-powered edtech tools have been launched, each touting bold claims.

But how many of these tools truly deliver measurable impact? As a trusted digital advisory partner for COBIS and a leader in edtech consulting, The EduTec Alliance set out to answer this question. The result was the AI Lighthouse Schools Programme (AILSP)—a long-term initiative designed to evaluate the real-world effectiveness of GenAI in schools and share actionable insights. This initiative brings together leading international schools to evaluate AI tools against defined use cases and share insights with the broader education community.

Participating schools benefited from access to The EduTec Alliance’s extensive knowledge base, regular updates on AI trends, and opportunities to collaborate with peers. By fostering a shared understanding of what works—and what doesn’t—the programme empowers schools to make informed decisions about AI adoption.

Here, we present some key lessons for school leaders, drawn from our analysis of AI tools and their applications across various educational contexts. For those interested in taking AI forward, we also outline a step-by-step framework for moving from investigation to implementation, ensuring AI (and any tech investment) delivers maximum value.

1. The Promise vs. Reality of GenAI in Education

The promise of AI is alluring: freeing teachers from repetitive tasks, improving feedback systems, and driving personalized learning. However, the reality is more complex.

Our research shows that while GenAI can indeed enhance specific aspects of school operations, its effectiveness is highly dependent on the use case. For instance:

• Assessment & Feedback tools are leading the way, delivering the most consistent and meaningful results. Tools like Flint and Brisk have demonstrated significant value, providing teachers with actionable insights while reducing workload.
• Content Creation, while promising, remains inconsistent. Variability in tool performance—even within the same tool on different days—can undermine reliability. This is an area where cautious optimism is warranted.
   

2. The Importance of Strategic Tool Selection

One of the most striking trends we’ve observed is the growing emphasis on rationalizing AI tools. Schools are moving away from adopting numerous disparate platforms and instead opting for a single, officially sanctioned tool.

This approach offers several advantages:

• Focused Professional Development: Teachers receive in-depth training on one platform, leading to greater confidence and proficiency.
• Streamlined Support: IT teams can provide targeted support, ensuring smoother implementation.
• Cost Efficiency: Consolidating tools reduces redundancy and eliminates unnecessary expenditures.

By contrast, unsanctioned tools often go unsupported, creating disparities in technology use and undermining overall efficacy.
 

3. Addressing Emerging Challenges

While the potential of GenAI is significant, school leaders must be mindful of the challenges it introduces.

Energy Consumption and Sustainability

Training and operating AI models demand immense computational power, leading to substantial energy use. For example, Microsoft’s decision to restart the mothballed Three Mile Island nuclear plant highlights the scale of this issue. Schools committed to ecological values must weigh the benefits of AI against its environmental impact.

Pricing Transparency

The true costs of AI tools remain opaque. Many major providers are currently operating at a loss, with multibillion-dollar deficits projected for the foreseeable future. As these companies move towards financial viability, schools may face steep price hikes. Planning for potential cost increases is essential.

Inconsistency and Unpredictability

GenAI tools are inherently variable. Changes to the underlying Large Language Models (LLMs), combined with adjustments by tool vendors, can lead to inconsistent results. This unpredictability must be acknowledged and addressed in staff training to set realistic expectations.
 

4. From Investigation to Implementation: A Step-by-Step Framework

Implementing AI (or any technology) effectively requires a systematic approach. Here's how schools can move from research to operationalization:

1. Define Value Propositions
   Identify specific challenges or opportunities the technology should address, such as automating feedback or enhancing engagement.
2. Conduct a Value Proposition Analysis
   Assess the potential benefits, costs, and alignment with your school’s goals for each proposition.
3. Perform a Feasibility Study
   Examine the technical, financial, and human resource requirements to determine the practicality of implementation.
4. Run a Pilot
   Test the tool in a controlled environment with a small group of users to evaluate its effectiveness and identify areas for improvement.
5. Design the Project
   Develop a detailed implementation plan, including timelines, training programs, and stakeholder communication strategies.
6. Build and Integrate
   Work with IT teams and vendors to integrate the tool into your school’s systems. Ensure data security and compliance with regulations.
7. Operationalize and Monitor
   Roll out the tool to the broader school community and establish processes for ongoing evaluation and optimization.

This framework ensures that schools not only select the right tools but also implement them in a way that maximizes their impact.
 

5. Embedding AI into School Strategy

AI’s greatest potential lies in its ability to enhance—not replace—human expertise. To achieve this, schools need a coherent digital strategy that aligns technology with educational goals. Key components include:

• Integrating AI into Processes: Ensure tools support the school’s operations and objectives, not just as add-ons but as integral components.
• Fostering a Culture of Experimentation: Encourage teachers to pilot and innovate with AI tools while providing robust training and support.

Conclusion

AI is not a magic solution but a tool that can transform education when adopted thoughtfully. By following a structured framework and addressing emerging challenges head-on, school leaders can ensure their investments in technology deliver meaningful results.