Google announced MUM (Multitask Unified Model) on May 18th, 2021 as a new milestone in understanding information. MUM uses the T5 text-to-text framework and is 1,000 times more powerful than BERT. Google announced on September 29th, 2021 that they will be integrating MUM into search over the next few months.
MUM uses something called T5. It’s a text-to-text framework, it’s kind of one of the iterations or improvements to BERT, but it’s a 1,000 times more powerful than BERT. This is not BERT, this is something new.