Skip to content

This repository contains code and resources for training the BERT (Bidirectional Encoder Representations from Transformers) model from scratch. Training BERT from scratch is a resource-intensive process, and this repository provides the necessary scripts and instructions to undertake the training process.

Notifications You must be signed in to change notification settings

MunishD/BERT-from-Scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

About

This repository contains code and resources for training the BERT (Bidirectional Encoder Representations from Transformers) model from scratch. Training BERT from scratch is a resource-intensive process, and this repository provides the necessary scripts and instructions to undertake the training process.

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published