Have you ever considered the challenges faced by visually impaired individuals as they age? Vision loss, impacting over 90% of sensory input, can decrease physical activity and heighten health risks for aging individuals, making maintaining a healthy diet even more crucial.
However, cooking independently can be difficult for them. Our solution, LookNCook, empowers visually impaired seniors to cook for themselves and supports their health.
- Goal 2: No Hunger
- Goal 3: Good health and well-being
- Goal 10: Reduced inequality
We aimed to achieve Goal 10: Reduced Inequality by supporting elderly individuals with visual impairments to cook in the kitchen just as easily as those without disabilities.
In particular, we focused on the common issue of inadequate nutrition among elderly individuals with visual impairments. By recommending recipes tailored to the user's age and basic health situation, we sought to achieve Goal 3: Good Health and Well-being and ultimately target 2.2 of Goal 2: No Hunger, which is to end all forms of malnutrition.
With LookNCook, users can receive personalized ingredient recommendations based on their user information and the contents of their refrigerator.
For users who are visually impaired, the app analyzes the cooking environment for potential hazards and notifies them to ensure safety
LookNCook provides step-by-step cooking instructions for its recipes, making the cooking process accessible and manageable.
We'll walk you through our application, step-by-step.
The application aids visually impaired with a voiceover guide.
| Screen | Guide |
|---|---|
 |
Press the begin button and take a picture of your refrigerator. |
| Screen | Guide |
|---|---|
 |
You'll get a list of ingredients in your fridge, and application will read each ingredients for you. |
| Screen | Guide |
|---|---|
 |
You'll get personalized recipe recommendations, each informing you about the difficulty, and the kinds of ingredients used in the recipe. |
| Screen | Guide |
|---|---|
 |
The application will inform you the ingredients needed in the recipe, and the location of the ingredient in the fridge. |
| Screen | Guide |
|---|---|
 |
Take a picture of the cooking environment, and the application will analyze potential hazards in cooking environment. |
| Screen | Guide |
|---|---|
 |
The application will read the instructions. Happy cooking ! |
LookNCook application uses Firestore to store data and Cloud Run to deploy. For analyzing fridge image and cooking environment, we used Gemini api.
If a dangerous situation arises for the user, we utilize FCM (Firebase Cloud Messaging) to send notifications to the caregiver.
| Soobeen Kim | Yongjae Kim | Hyunjin Kim | Soeun Uhm |
|---|---|---|---|
 |
 |
 |
 |
| Flutter/Design | Flutter | ML | Server |