AI News Summarizer with Cloudflare Workers AI and public LoRAs
![coverimg](https://private-user-images.githubusercontent.com/8932430/348360431-a9b9920b-a2a8-460f-95f2-6e919b397a78.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2MTcxMzcsIm5iZiI6MTczOTYxNjgzNywicGF0aCI6Ii84OTMyNDMwLzM0ODM2MDQzMS1hOWI5OTIwYi1hMmE4LTQ2MGYtOTVmMi02ZTkxOWIzOTdhNzgucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxNSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTVUMTA1MzU3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OGNmZGU1ZmFiMzJiZjI4OTg3NGZiMTU3ODIyNTQ5NDk4YjE3MDcxYjQ2ZTEzYzJmNDI1YWM1NmVjYzBkYTViOSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.MVwu4JBgAVIDX_hfGJnCLXLrYtLt_ELj9s5HBd5EQ7Y)
Run fine-tuned inference with adapters trained with Low-Rank Adaptation for free.
This project uses the mistral-7b-instruct-v0.1
fine-tune and cf-public-cnn-summarization
LoRA adapter.
To run the app--
-
Install the necessary libraries with
pip install -r requirements.txt
. -
Make a .env file with the following, replacing the Cloudflare API Token and Cloudflare Account ID with your own credentials from your Cloudflare dashboard Workers & Pages Overview:
CF_API_TOKEN=XXX
CF_ACCOUNT_ID=XXX
- Run
streamlit run app.py
to run the app. - ✨tada🎉