Two years later/два года спустя

[anhinga_drafts]

Two years since my last post in this journal, and two years since the revolutionary events of the first half of 2020

Comments

[anhinga_drafts]

There has been important breakthroughs in understanding Large Language Models (the most consequential seems to be the Simulator theory by Janus (September 2022)).

Also, the deployment of practically useful systems reached entirely new levels in the last few months. Rapid progress in text-to-image, breakthroughs associated with ChatGPT and related systems, etc.

We are approaching the third anniversary of the GPT-3 revolution, and it seems that a new rather unprecedented "phase transition" is starting to happen.

[anhinga_drafts]

GPT-4: The Third Deep Learning revolution

AlexNet; GPT-3; GPT-4

[anhinga_anhinga]

o1-o3: The Fourth Deep Learning Revolution

(the intervals between those revolutions are getting shorter: 7.5 years, 3 years, 18 months)