AI News Summarizer with Cloudflare Workers AI and public LoRAs
![coverimg](https://private-user-images.githubusercontent.com/8932430/348360431-a9b9920b-a2a8-460f-95f2-6e919b397a78.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk0MzA3MTAsIm5iZiI6MTczOTQzMDQxMCwicGF0aCI6Ii84OTMyNDMwLzM0ODM2MDQzMS1hOWI5OTIwYi1hMmE4LTQ2MGYtOTVmMi02ZTkxOWIzOTdhNzgucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTNUMDcwNjUwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9YmViNmRlNTY4NzYyYzRjYzNhOTNmNTY5MDExODc0NmU3MTYyNGQ4YzE0ZjE1NTk4Yjg0ZWVlYzMxMTJjYTA0OCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.SnxA4ncfVKWUHP-ts3XFAVN1gA32oyJigIePPbKlBJA)
Run fine-tuned inference with adapters trained with Low-Rank Adaptation for free.
This project uses the mistral-7b-instruct-v0.1
fine-tune and cf-public-cnn-summarization
LoRA adapter.
To run the app--
-
Install the necessary libraries with
pip install -r requirements.txt
. -
Make a .env file with the following, replacing the Cloudflare API Token and Cloudflare Account ID with your own credentials from your Cloudflare dashboard Workers & Pages Overview:
CF_API_TOKEN=XXX
CF_ACCOUNT_ID=XXX
- Run
streamlit run app.py
to run the app. - ✨tada🎉