말하면척척

"Summok Cheokcheok" is a voice app usage assistant designed for digitally vulnerable groups, such as the elderly and people with disabilities, who have difficulty reading small print or operating smartphones with their hands.

Those who used to get stuck in front of complex, multi-step screens can now complete daily tasks independently—such as ordering, booking tickets, and using public services—simply by speaking. The assistant reads the screen aloud and assists with requested taps and input.

📌 Key Features

Voice Requests
If you make a request using everyday language, such as "Check my Wrist Doctor points," it understands what assistance you need.

Screen Reading
It reads the text and buttons on the app screen you are currently viewing to check the progress of your task.

Tap/Input Assistance
It performs the requested task step-by-step according to pre-prepared procedures. It assists with pressing buttons, entering text, and navigating screens. The progress is displayed directly on the screen, and you can stop the process at any time.

Supported Apps
It currently supports Seoul Metropolitan Government public apps (Wrist Doctor 9988, Seoul Donghaeng Map, Call Taxi for the Disabled, Seoul Donghaeng Map, Ttota Subway, etc.) and is continuously expanding its support. 👥 This app is helpful for:

Elderly users who find it difficult to use apps due to small text and complex screens

Users who have difficulty reading the screen due to low vision, etc.

Users who experience discomfort with touch operations due to hand tremors, upper limb disabilities, etc.

🔔 Accessibility Service Usage Notice

"Malhamyeon Cheokcheok" is an accessibility tool that utilizes the Accessibility Service API.

Purpose of Use: When a user makes a request via voice, it reads text and buttons on the screen and performs the requested button presses, scrolling, or text input. It operates only when requested by the user.

Operation Method: The AI ​​only plays the role of understanding what support task is requested; actual screen operations are performed according to fixed procedures (scripts) pre-written and verified by the developer. The app does not plan or execute tasks on its own.

Information Collected and Used: To process requests, voice commands (converted into text), screen information (visible text and screen images), a list of installed apps, and device information are encrypted and transmitted to the server. This information is used solely for request execution and service quality improvement.

Non-Collection & Non-Use: We do not collect or sell sensitive information such as passwords or payment details, and we do not use keystroke monitoring functions. Data is not used for advertising or tracking purposes.

Consent and Control: Accessibility permissions are notified of their purpose within the app, and users are guided to the settings only after obtaining consent. You can turn them off at any time via Settings > Accessibility.

🔒 Privacy Protection

Login: Google/Kakao Easy Login

Collected Items: Age group, gender, residential area (for statistical purposes), voice command content, app screen information (text/images), list of installed apps, device information, execution logs

Protection Measures: Data is encrypted during transmission and storage, and managed in accordance with the Privacy Policy.

🚀 Moving Forward

We will continue to expand the apps and tasks we can assist with. Following public service apps, we are expanding to include everyday apps such as taxi hailing, shopping, and health management, aiming to lower digital barriers.

"Speak Up" is part of a digital inclusion project in partnership with the Seoul AI Foundation, helping those who struggle with digital technology to utilize smartphone services independently.

📌 Inquiries: fluiz.kaist@gmail.com

📌 Privacy Policy: https://fluiz-kaist.notion.site/AI-273a1edee10180c5b665e56593a04d0a