A simple. playful IOS App for Toad, a beloved bakery across the Camberwell campus.
TOAD BAKERY
Toad Bakery is a simple IOS game app adapting a word game logic with a twist of collecting letters with real-time object detection.
Project Overview
This project seamlessly intertwines word games with real-time object detection, employing the YOLOv3 machine learning algorithm.
Here’s the gameplay: Players are given the name of a pastry from Toad Bakery, but with some letters omitted. They are then tasked to use their smartphones to scan their surroundings for objects. Through the integration of YOLOv3, the game efficiently recognizes the objects captured by the phone’s camera. For every object detected, players collect the first letter of the object's name. The ultimate objective is to accumulate the correct letters to complete the pastry's name.
'Toad Bakery' serves as an engaging educational experience, demonstrating the creative application of machine learning algorithms in real-world scenarios. It’s an entertaining concoction of pastry-themed puzzles and technological applications, making it a perfect treat for both tech aficionados and word game enthusiasts.
Here’s how 'Toad Bakery' incorporates essential components of an engaging game
Compelling Storyline and Theme
Feedback and Rewards System
As players successfully detect objects and collect letters, they receive instant rewards, they collected the mystery pastry from Toad Bakery. There are new pastries for players to unlock, stimulating players to keep playing the game.
Wireframe
Players are given the name of a pastry from Toad Bakery but with some letters omitted. They are then tasked to use their smartphone cameras to scan their surroundings for objects. For every object detected, players collect the first letter of the object's name. The ultimate objective is to accumulate the correct letters to complete the pastry's name.
User Testing was done multiple times to ensure the user experience is intuitive, and the game is more dynamic and interesting, letting the users want to press that play again button.
When the timer runs out, the player loses the game.
Future Steps
The 'Toad Bakery’ concept can be expanded and diversified to create an entire ecosystem of games and educational applications beyond its initial scope.
Wordle-Style Game with Object Detection: Adapt the ‘Toad Bakery’ concept into a Wordle-style game where players use real-time object detection to guess words. Players could be given a set number of attempts to guess the word by detecting objects whose names' letters can be used to form the word.
Language Learning App: Incorporate language learning elements by having players detect objects and learn their names in different languages. For instance, if they detect a 'bread', they will learn how to say 'bread' in Spanish, French, German, etc. This way, players can learn new languages while having fun with the object detection feature.
Educational Game for Children: Transform ‘Toad Bakery’ into an educational platform for children, where they can learn about alphabets, spelling, and objects by using object detection to identify items and spell their names.
Thank you so much to everyone who helped me to bring this project to life.
Heartfelt Acknowledgements:
First and foremost, I would like to extend my sincere appreciation to the team at Toad for graciously agreeing to collaborate on this project. Your support and contributions have been invaluable.
I am deeply grateful to the dedicated staff at Apple European Headquarters for their commendable efforts and professionalism that enabled the successful execution of the presentation. Your commitment to excellence is truly inspiring.
Additionally, I must express my gratitude to all the individuals who participated in user testing. Your feedback was instrumental in honing the final product and ensuring its quality.
Lastly, a special mention is warranted for Joel and Xiaowan, whose unwavering support and collaboration have been pivotal in this academic year. My heartfelt thanks for making this journey so rewarding and fulfilling.
Thank you all for your immeasurable contributions!!
