Launching the School's Data Core (Cloud Data Lake): Bridging the Gap in EdTech


I am excited to see this project finally reach fruition at bbsync.curiousit.ca. This platform is about more than just moving bits and bytes; it offers critical business continuity for our school. These workflows often require a very specialized skill set to maintain. Very few organizations have a department with more than one person with these skills, if they are lucky enough to have one at all. Having a front end application like this makes the work visible and provides that vital piece of mind that critical workflows and functions can continue. This keeps the core focus on what schools do best, which is the students and their learning.

This milestone was only possible for two reasons:

  • Generative AI has evolved enough to be a fantastic assistant for developing complex ideas and correcting code.

  • Blackbaud leads and invests in allowing organizations to access their own data through well-documented and prolific APIs securely and easily.


This Data Core app acts as a central command grid where a user can trigger and schedule sync scripts for attendance or enrollments. It also manages our Google Classroom lifecycles and exports SQL data directly to Google Sheets. I have even integrated a Gemini-powered AI terminal that can query our live database schema to give us instant status updates.

By moving these high-level processes into a visual dashboard, I ensure the school's data remains accessible and our operations stay resilient. It is a great example of aligning technology strategy with our organizational vision.

The system was built using the Flask framework, where Python is used to auto generate a secure token to pull data from Blackbaud to the Google Cloud SQL database. Once the data arrives, it is checked, parsed, and processed by a self healing engine that ensures the table schemas are maintained automatically.


Comments