tutobase

Sign In

1

State of AI Report 2021

stateof.ai/

  • MachineLearning

  • news

  • opinion

Description:

Summary Slide: Research: - The Transformer architecture has expanded far beyond NLP and is emerging as a general purpose architecture for machine learning. - Large language models (LLM) are in the scale-out phase and have become “nationalised” where each country wants their own LLM. - AI-first approaches have taken structural biology by storm: proteins and RNA (cellular machinery) is being simulated with high fidelity. - JAX emerges as a popular ML framework as the pace of research productivity accelerates/researchers become first class citizens. - Talent: - China universities have rocket
+ Expand description

Posted by NaN_Loss 5 days ago

save post

Sign in or register to leave a comment

Sort by:

1

[deleted]

5 days ago

[deleted]

Popular topics

  • transformers

  • ConvNets

  • NLP

  • MachineLearningTheory

  • SGD

  • regularization

  • math

  • NeuralNetworks

  • GANs

  • Backpropagation

  • LSTMs

  • ComputerVision

  • VariationalAutoencoder

  • LogisticRegression

  • ReinforcementLearning

Popular tags

  • blog post

  • tutorial

  • with code

  • notebook(s)

  • beginner

  • video playlist

  • graduate course

  • book

  • advanced

  • video

  • free course

  • opinion

  • annotated paper

  • library

  • repository