Translation & Text Recognition App

A cross-platform mobile application
Project Overview
·       A cross-platform mobile applicationdeveloped using React Native, designed to bridge communication gaps byproviding real-time English to Chinese translations, image-based textrecognition via AWS Textract, and voice input functionalities.
Technologies
Technologies: ReactNative, OpenAI API, AWS Textract, AWS Lambda, AWS S3, Mobile Sensing andControl.
Introduction
Design and Implementation
The TranX - Translation and Text Recognition App follows a client-server architecture, where the client is the mobile application running on iOS and Android devices, and the server is the OpenAI API used for text translation. The app is built using React Native, a cross-platform framework, allowing for efficient development and deployment on multiple platforms. Features and Problem Addressing:
1. Text Translation: The application allows users to enter English text or use voice input for translation to Chinese. By integrating with the OpenAI API, TranX leverages advanced natural language processing capabilities to provide accurate and efficient translations, addressing the language barrier between English and Chinese speakers.
2. Text Recognition: TranX incorporates text recognition functionality, enabling users to extract text from images. This feature addresses the problem of understanding and translating text in images, such as signs, menus, or documents. By leveraging the Text Recognition library, the app extracts the text from the image, allowing users to translate the recognized text.
3. Voice Input: The app offers voice recognition functionality, allowing users to input text by speaking instead of typing. This feature enhances usability and accessibility, catering to users who prefer voice input or have limited typing abilities. It addresses the problem of overcoming the language barrier by providing an alternative input method.
Integration with Native and External APIs: TranX integrates with various native and external APIs to enable its functionalities:
1. OpenAI API: The app integrates with the OpenAI API for text translation. It sends the English text to the API and retrieves the translated text in Chinese. This integration ensures accurate and context-aware translations.
2. Voice API: The Voice library is used to capture speech and convert it into text for translation. The API handles the voice recognition process, enabling users to input text through spoken language.
3. React Native Camera: The app utilizes the React Native Camera library to access the device's camera for capturing images. This integration enables users to perform text recognition on images and extract text for translation.