-
Notifications
You must be signed in to change notification settings - Fork 14
Sirius Mobile
The Sirius Mobile Application creates a mobile interface for a user to record and ask questions using the Sirius service in the clarity ecosystem.
The mobile app allows the user to record audio, take photos, or type questions and send them to the Sirius services in the clarity ecosystem. The app is written in HTML, Javascript, and CSS using Apache Cordova. Communication between the app and the backend services are done using Apache Thrift.
The mobile app uses the Cordova Capture libraries to record audio and take pictures. After capturing media, it requests the Sirius service from the clarityeco command center. The command center returns a host and port number of a Sirius service, to which the app sends a request. Based on the query input, the Sirius service will request speech-recognition, image-matching, and question-answer services from the command center. After sending the requests to these services, it returns the answer to the mobile app, which uses a text-to-speech library to speak the answer.
To modify the mobile app, you must have the thrift compiler installed on your machine, as well as cordova. Once downloaded, you can use the cordova command line interface to build the native mobile apps based on the javascript code. The repo currently includes built projects for Android and iOS, but you must have the SDKs installed to rebuild them.
The app can be modified by changing the index.html and javascript files under the source/www/ folder. Use the cordova build <platform> command when in the source folder to build the native app.