Know before your role does.
pssst. this is to sign up for updates on the game ;)
Will AI replace LLM Eval Research Scientist jobs? · Latest report #43amuqpr
Your job has an expiration date
May 19, 2027
In 7 monthsTraining models to grade models, ensuring your own career ends promptly.
Obsessing over ROUGE scores while the future unfolds.
Check another roleComment your opinionor JOIN THE RESISTANCE!
One human is building a game about fighting back.
Automating the feedback loop to zero.







toast.you▸ EVALMASTER V4▸ RARITY · COMMON▸ DEPRECATION IN 7 MONTHSAI's Special Power
calculates preference drift in real-time
You design benchmarks for large language model outputs and correlate model performance with human preference data. It is meta-work that screams for total automation.
The one thing AI can't do
You can still hallucinate that your specific loss function actually matters to the weights.
Your enemy, your name, your date. Post it.
Step by step, from the first quiet change to Deprecation Day.
Day 10
Deploy standardized evaluation agents to run existing benchmark suites without manual script triggering.
Week 6
Integrate synthetic preference pipelines to replace the need for manual dataset curation and cleaning.
Month 3
Transition internal model auditing to autonomous agents capable of identifying output regressions faster than humans.
Month 5
Allow the evaluation framework to suggest and apply hyperparameter shifts to optimize for target metrics.
Month 7 · D-Day
The system fully manages the model lifecycle, rendering the research scientist role entirely redundant.
What you cost, what the machine costs, and what you get on the way out.
Per year
Savings: 97.6%
0.0001%
Benchmark drift tolerance
0.002ms
Preference signal latency
100%
Human annoyance factor
Your severance
A lifetime subscription to GPT-X Pro Plus.
Discussion