Skip to content

Commit

Permalink
Update README.MD
Browse files Browse the repository at this point in the history
  • Loading branch information
augyg authored Nov 29, 2021
1 parent 69e7731 commit 324bb53
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions README.MD
Original file line number Diff line number Diff line change
@@ -1,3 +1,13 @@
# Scrappy #

provides a number of functions that allow for easily scraping certain patterns from websites as well control functions that allow you to rotate between multiple sites and rotate proxies in order to deal with common bot detection problems faced by scrapers.

Main functions:

```code
getHtml :: Manager -> Url -> IO (Manager, Html)
elemParser :: Elem -> [(String, Maybe String)] -> Maybe (ParsecT s u m a) -> ParsecT s u m (Elem' a)
runScraperOnHtml :: ParsecT s u Identity a -> Html -> Maybe [a]
```

0 comments on commit 324bb53

Please sign in to comment.