Skip to content

Commit

Permalink
Adds additional BLOOM examples (huggingface#418)
Browse files Browse the repository at this point in the history
* BLOOM announcement

* Adds new BLOOM examples
  • Loading branch information
BritneyMuller authored Jul 12, 2022
1 parent a849753 commit efe1fed
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
Binary file added assets/86_bloom/bloom-examples.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 2 additions & 2 deletions bloom.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ thumbnail: /blog/assets/86_bloom/thumbnail.png
display: block;
margin-left: auto;
margin-right: auto;
width: 50%;
width: 100%;
}
</style>
<h1>🌸 Introducing The World's Largest Open Multilingual Language Model: BLOOM 🌸</h1>
Expand Down Expand Up @@ -39,7 +39,7 @@ With its 176 billion parameters, BLOOM is able to generate text in 46 natural la

Researchers can [now download, run and study BLOOM](https://huggingface.co/bigscience/bloom) to investigate the performance and behavior of recently developed large language models down to their deepest internal operations. More generally, any individual or institution who agrees to the terms of the model’s [Responsible AI License](https://bigscience.huggingface.co/blog/the-bigscience-rail-license) (developed during the BigScience project itself) can use and build upon the model on a local machine or on a cloud provider. In this spirit of collaboration and continuous improvement, we’re also releasing, for the first time, the intermediary checkpoints and optimizer states of the training. Don’t have 8 A100s to play with? An inference API, currently backed by Google’s TPU cloud and a FLAX version of the model, also allows quick tests, prototyping, and lower-scale use. You can already play with it on the Hugging Face Hub.

<img class="grandmahugs" style="center" padding="5px" width="550" src="/blog/assets/86_bloom/bloom-demo.png"></a>
<img class="grandmahugs" style="center" width="950" src="/blog/assets/86_bloom/bloom-examples.jpg"></a>

This is only the beginning. BLOOM’s capabilities will continue to improve as the workshop continues to experiment and tinker with the model. We’ve started work to make it instructable as our earlier effort T0++ was and are slated to add more languages, compress the model into a more usable version with the same level of performance, and use it as a starting point for more complex architectures… All of the experiments researchers and practitioners have always wanted to run, starting with the power of a 100+ billion parameter model, are now possible. BLOOM is the seed of a living family of models that we intend to grow, not just a one-and-done model, and we’re ready to support community efforts to expand it.

Expand Down

0 comments on commit efe1fed

Please sign in to comment.