r/mlscaling
7k members
ML/AI/DL research on approaches using large models, datasets, and compute: "more is different"
Popular Topics in r/mlscaling
Top 10 / 137 topics discussed
#1
Training
: "Google announces a demo run of Training an LLM across 50,944 Cloud TPU v5e chips (in 199 Cloud TPU v5e pods)"
35 posts
#2
Models
: ""Training Dynamics of Contextual N-Grams in Language Models", Quirke et al 2023 (many circuits are learned abruptly in phase transitions lowering loss, but on top of them, other nth-order circuits develop slowly which do not; reduces interference to free up capacity?)"
24 posts
#3
Language
: ""Training Dynamics of Contextual N-Grams in Language Models", Quirke et al 2023 (many circuits are learned abruptly in phase transitions lowering loss, but on top of them, other nth-order circuits develop slowly which do not; reduces interference to free up capacity?)"
22 posts
#4
Language Models
: ""Training Dynamics of Contextual N-Grams in Language Models", Quirke et al 2023 (many circuits are learned abruptly in phase transitions lowering loss, but on top of them, other nth-order circuits develop slowly which do not; reduces interference to free up capacity?)"
19 posts
#5
Scaling
14 posts
#6
Data
: ""Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP", Nguyen et al 2022"
11 posts
#7
Openai
: "Openai rumors: breakthrough math model Q* was relevant to board's actions"
11 posts
#8
Gpt
: "Bill Gates tells a German newspaper that Gpt5 won't be much better than Gpt4: "a limit has been reached""
9 posts
#9
Llms
8 posts
#10
Ai
: "‘Mind-blowing’ IBM chip speeds up Ai"
8 posts
Popular Themes in r/mlscaling
Top themes discussed
#1
News
: "Google delays any Gemini launch to 2024?"
7 posts
#2
Self-Promotion
: "GNoME: graph NN for discovering crystals; A-Lab: autonomous lab for synthesizing solid material"
5 posts
#3
Solution Requests
: "What embedding model do you guys use?"
1 post
#4
Money Talk
: "What do we learn from the GPT-4 price drop?"
1 post
#5
Opportunities
: "Exponentially Faster Language Modelling"
1 post
Popular Posts in r/mlscaling
Member Growth
Daily New Members
59
Monthly Growth
25.34%
Weekly Growth
1.96%
Daily Growth
0.42%
Similar Subreddits to r/mlscaling
r/ChatGPT
3.7M members
7.61% / mo
r/singularity
1.6M members
7.69% / mo
r/slatestarcodex
59k members
1.32% / mo
r/MachineLearning
2.8M members
0.79% / mo
