Francesco Sciuti

Francesco Sciuti

CEO @Devmy, DevRel Expert @Codemotion, Google Developer Expert (GDE), Microsoft MVP, Google Certified Developer, LEGO Serious Play Facilitator, Projects Manager, Software Engineer, Speaker/Evangelist/Trainer, AWS UG Lead Francesco is a Google Developer Expert, Google Certified Developer, Microsoft MVP ed AWS UG Leader and an accomplished programmer with several years of experience in enterprise programming , high skilled in web development (frontend and backend) and in team project management. I’ve worked for a long time as a employee and then as a freelancer, but nowadays I has my own company: Devmy – Software Factory (former Acadevmy), founded with my friend Andrea. He was also Content Manager and DevRel of Codemotion, the largest tech community in Europe with more than 200,000 developers, as well as the largest IT conference in Italy and one of the most important in Europe. I love reading comics (strictly Batman!), playing the drums, riding a motorbike, playing padel and spending a lot of time with his beloved family.
Eye Tracking & a11y on the Edge: Build an Eye Tracking With AI Running on Your Device!
JSNation US 2025JSNation US 2025
Upcoming
Eye Tracking & a11y on the Edge: Build an Eye Tracking With AI Running on Your Device!
Today it's possible to create advanced eye tracking systems without specialized hardware but simply using a standard webcam and the inevitable AI. But the real difference is made by the model that is already completely on the edge and therefore on the device or browser, allowing you to work even offline!

With 'AI on the edge' technologies for facial and eye detection, a bit of linear regression, and a real-time calibration system that adapts to the user and environment, I will show, using only JavaScript and on-device AI models,  the results of the experiment, discussing accuracy, current limitations, and potential improvements.

The challenges faced in on-device optimization are many to balance precision and performance, but this experiment opens new possibilities for accessible applications in human-machine interaction, behavioral studies, and accessibility systems, all created with open source technologies and common hardware!