Livra is an interactive book reader companion system developed to increase the interest of reading and learning for specially children. It mainly provides the usage of Augmented reality, Text detection and recognition, Text to speech and many other functionalities for the users. They can capture text and search for meanings, add comments and save them, download and experience the models provided for books and various other things using Livra. It also helps book readers to understand the content of the book properly with visual and graphical involovement. The system contains an android application for users and a web platform through which book publishers can add their content to be used by book readers. Livra mobile app is developed using Android studio and java, with some other libraries and tools for implementing all the functionalities. This Repositary contains the source code for the Android application.
Livra app is based on Android Studio with many supporting libraries and tools. Android Studio version 3.5 was used as the integrated development environment. Sceneform version 1.15.0 was used to Implement the augmented reality related functionalities of the application. It is an SDK developed by Google based on their ARcore platform, which enables to build augmented reality applications without the explicit usage of OpenGL libraries. Apart from that Android Vision library for text detection and barcode recognition, Okhttp 3 for connection between application and web platform, Android material design for UI implementation are the main support packages used in ‘Livra’. SQLite integration to Android is used to implement the local database which stores the details of downloaded books and content, saved words and comments.
dark and light themes of main menu
You can add books and content to your library in two separate methods. Those are by scanning the book's barcode or by searching the book's title.
To use this method you should have the book physically or an image of the book's barcode. Click the ‘Add Book’ button to start adding books. Align Book’s barcode within the camera box until a beep sound comes through.It is better to have more light on the barcode for quick recognition. App will show you the ISBN of the book when the barcode is detected. Select Search For Details and It will take a small time to search in our database. You can see the details of the book if the book is available on our system. If there is any AR content available the number of models will be displayed below. Click ‘View AR content’. The button will be diabled if there is no content in the database. Select the content you want to download and select Download Content. Now the content will be downloaded and the book will be added to your library.
Select Add Book as in the previous option. Without scanning the barcode you can click the ‘Search Database’ button. Type the title or part of title of the book you want to search for. Click the search button and wait for the results to appear. Select a book from results and proceed to the next step. Refer from step 7 in the previous option.
You can access all downloaded books and content through the library. To go to the library just click the ‘My Library’ button on the menu. You can search a book by its title from the search bar. If you long click a book the book will be selected and highlighted. Now you can click the ‘Remove’ button in red to delete the whole book or models of the book as required. Click a book to enter the AR view of that book.
Here you can experience the content downloaded previously. To place a model first you have to find a horizontal plane from your surroundings. Hold the phone still until the camera detects a plane and display scattered dots around that plane. Now you can select a model from the bottom panel and touch on the detected plane to place it. Generated model will have a shrinking animation indicating that it is the current selected model. A 3D transformation button will appear in the top corner. By clicking it the transformation panel will drop down. From there you can scale up, down, rotate and deselect the selected model. You can place any number of models in the scene. By clicking any model it will be selected. To remove a model from the scene you have to select it and click the red delete button at the top. If the model you placed is animated (indicated by the ⏩ icon on the model card) you can select an animation from the animation dropdown.
Text detection is another functionality available in our app. First you have to hold the text in front of the camera and click the capture button in the text detection interface. All detected text will be displayed with three buttons at the bottom. First button is the speak button. If you click the speak button whole detected text will be read out in the speak mode. But if you want to pronounce a single word or a phrase select it by long clicking it and then click the speak button. Second button is the dictionary button.You can select a word and click the dictionary button to get the definitions of that word. You should be connected to the internet for this. After receiving definitions you can save the word for later reference. Third button is the comment button from where you can save a comment on a selected phrase of detected text. The comment can also be linked with a book in the library.
From here you can access and search the previously saved words and comments as you like.
This is a small learning activity intended for small children to learn the alphabet with interaction. Letter Placement After you click the Alphabet Game button on the menu you will see an interface like AR view. You can place randomly selected letters all around you by tapping on the detected planes. The app will pronounce the placed letter giving children the chance to identify the letter. If you click the Change Letter button you can select and fix a letter to be generated when you tap the screen again. The Game The Start Game button starts the activity. In this activity 6 random letters will be placed around you automatically and you have to select the relevant letter as the app's instructions. After all 6 letters are found the game will end.
On the settings popup you can adjust some criterias according to your preference. Theme - you can change between light and dark themes. Text size - you can set text size of detections to Small, Medium or Large. Voice Support - if switched active app will read out all the toast messages you receive. It is mostly intended for small children. Audio settings - you can adjust the pitch and the speed of the app's voice including speak mode and voice support.
You can add books and content to the web platform which can be used by all the users of the system. At first you have to create an account as a publisher.
Go to our Livra web platform by clicking the this link. Click the ‘Publishers’ button on the top right hand corner and select ‘register’. Add your details according to the given descriptions and click Register. Login to the account with those credentials.
Click the ‘Add book’ option on the top navigation panel. Fill the required details about the book. You can add up to 3 images, but the first image will be used as the main cover image of the book. Then add the book to the platform.
Click the ‘Add content’ option right next to the previous one and fill the details. You can link your content only with a book added through your account. The content must have at least 100 character long description. If the content you are uploading has embedded animation, check the ‘Animated?’ checkbox at the bottom. Same as books the first image of the three images will be used as the cover image for that content. Currently all the content you upload should be in the format of ‘.sfb’ for our app to recognize and render your content successfully. Now you can add the content.
- Ar content available - Inferno, Icon(Animated), A Column of Fire,The Separation, Conspiracy of Evil
- Without content - Collections, Artemis Fowl, A Game of Thrones, The Hunger Games