Skip to content

FTIsland : Language Bridge with Multicultural Families (GDSC CAU SC Team 11)

Notifications You must be signed in to change notification settings

GDSC-CAU/FTIsland-FE

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

🏝️ Fairy-Tale Island 🏝️

image

πŸ“Œ Project Overview

We noted the phenomenon of poor pre-school language education for children when their primary caregivers are poor at the language of their country of residence in an era where there are many multicultural families. In multicultural families, the subject of language education is children and primary caregivers.

We provide a fairy tale reading service that allows main caregivers and children to bond with each other and acquire language and culture of their country of residence.

πŸ“Œ Problem

According to a national survey of multicultural families conducted in Korea in 2021, the biggest difficulty in raising children was Korean language instruction (26.8%) for those under the age of 5 and learning instruction (50.4%) for those over the age of 6.

In a typical family, the caregiver is proficient in the language, so the child is naturally able to acquire it. However, in a multicultural family, the primary caregiver is less likely to acquire a language because the primary caregiver may be inexperienced in the language of the country of residence. The degree of language learning also has a significant impact on pre-school children's educational attainment.

πŸ“Œ Solution

Children's storybooks read by their parents in childhood have excellent language learning effects. So, with this in mind, we propose a ${\textsf{\color{#39A7FF}"Dual Language Storybook"}}$ solution that enables both children and primary caregivers to naturally learn languages in multicultural families.

We have chosen high quality education among the UN's sustainable development goals, and the specific goal is ${\textsf{\color{#39A7FF}4.2 Equal Access to Quality Pre-school Education.}}$

Caregivers can read fairy tale books with their children to acquire culture and language, and learn words. After reading the fairy tale books, the "Think" question allows them to think deeply about the contents of the fairy tale and induce them to interpret them in their own way for social learning. It also allows caregivers and children to bond by having conversations about the book.

There are four areas for indicators at the United Nations to see if children's development is on track. Our solution sought to improve in terms of literacy and social/emotional learning among the four.

Reading fairy tales with parents naturally helps them learn about letters and improve their reading skills. Also, think-about questions can induce conversations between parents and children, forming an emotional bond. Social learning is possible through social thinking, while thinking about the contents of fairy tales to answer questions.

  1. One of the ways preschoolers learn a language is "reading fairy tales together." Using our solution, the primary caregiver can also read fairy tales, learn words, and practice pronunciation with a guide through TTS. This allows the primary caregiver to read fairy tales to children, too.
  1. Our solution allows us to read fairy tales together and provide "think" questions to create conversational topics, and to communicate and bond by sharing stories about fairy tales together.

πŸ“Œ Demo Video

demo.video.mp4

πŸ“Œ Architecture

image

${\textsf{\color{#4285f4}G}\textsf{\color{#ea4335}o}\textsf{\color{#fbbc05}o}\textsf{\color{#4285f4}g}\textsf{\color{#34a853}l}\textsf{\color{#ea4335}e}}$ Products

  • Google Cloud Platform
  • Google Cloud Storage (Bucket)
  • Google Cloud SQL
  • Google translation API
  • Google text to speech API

πŸ“Œ Start Guide

πŸ–₯ Front-end

Requirements

Before getting started, ensure you have the following installed:

  • Node.js
  • npm (Node Package Manager)

Install and Clone

  1. Clone the Repository:
git clone https://github.com/GDSC-CAU/FTIsland-FE.git
  1. Change Directory:
cd FTIsland-FE
  1. Install Dependencies:
npm install

Environment Variables Setup

  1. Create a .env.local File
  • Create a .env.local file in the root directory of your project.
  1. Set Environment Variables
  • Set the required environment variables in the .env file. For example:
NEXT_PUBLIC_GOOGLE_CLOUD_API_KEY={ /* Your gcp key */ }
NEXT_PUBLIC_SERVER_URL=http://localhost:8080

Run

To run the front-end application, follow these steps:

  1. Development Mode:
npm dev
  1. Test

πŸ–₯ Back-end

Requirements

Before getting started, ensure you have the following installed:

  • MySQL
  • Java (JDK17)
  • IntelliJ IDEA

Install and Clone

  • Clone the Repository:
git clone https://github.com/GDSC-CAU/FTIsland-BE.git
  • Open
  1. In IntelliJ IDEA, open the folder for that clone path and select the "build.gradle" file to open it.
  2. When the gradle plug-in elephant appears, press it to add dependency.
  3. If you have a build problem, change to Build Tools in settings: IntelliJIDEA -> Gradle or vice versa.
  4. If you still have a problem, set the gradle JVM version to 17.

Environment Variables Setup

  1. You must enter the API Key in the yml file to run. Running as it is may not support some of the features.
  2. The mysql setting must be as follows.
  • In mySQL workbench, set the root user's password to 0000.
mysql -u root
set password = password('0000');
  • Create database under the name 'ft'
create database ft;

Run

  • In "com.FTIsland.BE" folder, Run "BeApplication" file.
  • Test
    Open http://localhost:8080 or use the POSTMAN to check the api operation.

πŸ“Œ Fairy-Tale Island

Sample books from here.

Main Page Side Menu
Book Title Book Contents
My Stories Vocabulary

πŸ“Œ Next Steps

  1. Currently, it is for multicultural families living in Korea, and registered fairy tales are mainly for traditional fairy tales in Korea. In order to target more multicultural families in more countries, many traditional fairy tales from various countries will be registered. Traditional fairy tales allow you to feel the culture or customs of a country, and if there are traditional fairy tales from various countries, you can understand the culture by reading fairy tales about your parents' home country.

  2. In a multicultural family, a child's poor language proficiency due to the language proficiency of the main caregiver can also be resolved through drawing. While drawing about keywords, you can naturally acquire words and form a bond by drawing together. In the future, we will add a function of drawing fairy tale illustrations by using our own imagination about the contents of the fairy tale.

  3. The current version of the solution offers only Korean, English, Japanese, and Chinese, but the backend code provides both languages from countries provided by the Google translation API, so adding a country to the main/subordinate language option can support many countries without additional memory consumption or code modification.

πŸ“Œ Contributors

Minkyeong Kim Yunjin Kim Youngeun Jun Seungwon Choi
Back-end / AI / Video Server / Back-end Front-end / Design Front-end / Design