r/mlscaling

7k members
ML/AI/DL research on approaches using large models, datasets, and compute: "more is different"

Popular Topics in r/mlscaling

Top 10 / 137 topics discussed
#1
Training
: "Google announces a demo run of Training an LLM across 50,944 Cloud TPU v5e chips (in 199 Cloud TPU v5e pods)"
35 posts
#2
Models
: ""Training Dynamics of Contextual N-Grams in Language Models", Quirke et al 2023 (many circuits are learned abruptly in phase transitions lowering loss, but on top of them, other nth-order circuits develop slowly which do not; reduces interference to free up capacity?)"
24 posts
#3
Language
: ""Training Dynamics of Contextual N-Grams in Language Models", Quirke et al 2023 (many circuits are learned abruptly in phase transitions lowering loss, but on top of them, other nth-order circuits develop slowly which do not; reduces interference to free up capacity?)"
22 posts
#4
Language Models
: ""Training Dynamics of Contextual N-Grams in Language Models", Quirke et al 2023 (many circuits are learned abruptly in phase transitions lowering loss, but on top of them, other nth-order circuits develop slowly which do not; reduces interference to free up capacity?)"
19 posts
#5
Scaling
14 posts
#6
Data
: ""Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP", Nguyen et al 2022"
11 posts
#7
Openai
: "Openai rumors: breakthrough math model Q* was relevant to board's actions"
11 posts
#8
Gpt
: "Bill Gates tells a German newspaper that Gpt5 won't be much better than Gpt4: "a limit has been reached""
9 posts
#9
Llms
8 posts
#10
Ai
: "‘Mind-blowing’ IBM chip speeds up Ai"
8 posts

Popular Themes in r/mlscaling

Top themes discussed
#1
News
: "Google delays any Gemini launch to 2024?"
7 posts
#2
Self-Promotion
: "GNoME: graph NN for discovering crystals; A-Lab: autonomous lab for synthesizing solid material"
5 posts
#3
Solution Requests
: "What embedding model do you guys use?"
1 post
#4
Money Talk
: "What do we learn from the GPT-4 price drop?"
1 post
#5
Opportunities
: "Exponentially Faster Language Modelling"
1 post

Member Growth

Daily New Members
59
Monthly Growth
25.34%
Weekly Growth
1.96%
Daily Growth
0.42%

Similar Subreddits to r/mlscaling

/r/ChatGPT/

r/ChatGPT

3.7M members
7.61% / mo
/r/singularity/

r/singularity

1.6M members
7.69% / mo
/r/slatestarcodex/

r/slatestarcodex

59k members
1.32% / mo
/r/MachineLearning/

r/MachineLearning

2.8M members
0.79% / mo

Discover your audience

GummySearch is an audience research toolkit for 130,000 unique communities on Reddit.

If you are looking for startup problems to solve, want to validate your idea or find your first customers online, GummySearch is for you.

Sign up for free, get community insights in minutes.

Tell me more
Get started
Audience Research