Eugene Yan+

eugeneyan starred chenglou/freerange

yeap the plan is to map products to semantic IDs which the model can understand

yeap the plan is to map products to semantic IDs which the model can understand

code for data prep, training the RQ-VAE, SASRec, Qwen3-8B, chatting with the mod

code for data prep, training the RQ-VAE, SASRec, Qwen3-8B, chatting with the model, etc github.com/eugeneyan/se...

demo of the LLM-recommender hybrid returning both semantic IDs & english, and: •

demo of the LLM-recommender hybrid returning both semantic IDs & english, and: • steering recs via natural language • explaining the recommendation • naming the bundle of recommendations • multi-turn conversation to get recs watch till the end for the bloopers lol www.youtube.com/watch?v=_0n4...

For example, given a sequence of items, it can recommend the next best item. But

For example, given a sequence of items, it can recommend the next best item. But better than that, you can steer the recommendations with natural language! And it can explain why it gave that recommendation, as well as creatively name recommendation bundles.

I've been nerdsniped by the idea of Semantic IDs. Here's the result of my trai

I've been nerdsniped by the idea of Semantic IDs. Here's the result of my training runs: • RQ-VAE to compress item embeddings into tokens • SASRec to predict the next item (i.e., 4-tokens) exactly • Qwen3-8B that can return recs and natural language! eugeneyan.com/writing/sema...

Wrote an intro to evals for long-context Q&A systems: • How it differs from basi

Wrote an intro to evals for long-context Q&A systems: • How it differs from basic Q&A • What dimensions & metrics to eval on • How to build llm-evaluators • How to build eval datasets • Benchmarks: narratives, technical docs, multi-docs eugeneyan.com/writing/qa-e...

Some thoughts on leadership: eugeneyan.com/writing/lead... • What makes an excep

Some thoughts on leadership: eugeneyan.com/writing/lead... • What makes an exceptional leader? • What do exceptional leaders do? • Leadership styles: Commando, soldier, police

For example, Amazon started to implement the first version of Amazon Prime in la

For example, Amazon started to implement the first version of Amazon Prime in late 2004 and announced it on February 2 2005, six weeks later. An account of how it came amount and lots of anecdotes here. vox.com/recode/2019/... Also this list: patrickcollison.com/fast

The best leaders I’ve worked with operate with perma-urgency. They act like earl

The best leaders I’ve worked with operate with perma-urgency. They act like early founders, mindful of existential threats. And they can balance speed, sustainability, and repay tech debt. Ultimately, customers love it and teams thrive when we ship fast to deliver delight.

converted all images to webp and hopefully made the site faster. something i wou

converted all images to webp and hopefully made the site faster. something i wouldn't have bothered in the past

Previously, these tasks weren't worth the effort but now they can be done in hou

Previously, these tasks weren't worth the effort but now they can be done in hours. What an amazing time to build and play =D

Had a fun couple of hours this weekend with Codex & Windsurf • Migrated off depr

Had a fun couple of hours this weekend with Codex & Windsurf • Migrated off deprecated jekyll-algolia to official sdk (better indexing) • Added recommendations + relevance scores to each post • Improved site responsiveness; fixed dark mode flicker • Marie Kondo-ed unused files & dead code

In orgs pushing the envelope, there's always a minority that can be counted on t

In orgs pushing the envelope, there's always a minority that can be counted on to get shit done against all odds, driven by force of will, resourcefulness, influence, etc. When you identify them, vest in them authority, autonomy, and step back and watch them perform miracles.

opps! thanks for letting me know, fixed!

opps! thanks for letting me know, fixed!

p.s., If you’re interested in topics like this, my friends Ben and Swyx are orga

p.s., If you’re interested in topics like this, my friends Ben and Swyx are organizing the AI Engineer World’s Fair in San Francisco on 3rd - 5th June. Come talk to builders deploying AI systems in production. Here’s a big discount for tickets: ti.to/software-3/a...

Here's the code for the mcp-server (src), prompts (context), and generated summa

Here's the code for the mcp-server (src), prompts (context), and generated summaries from May 4th (summaries). github.com/eugeneyan/ne...

Here's a three-minute demo of news-agents in action. It's pretty cool at the 30-

Here's a three-minute demo of news-agents in action. It's pretty cool at the 30-second mark how the sub-agents get spawned! We then see the main agent assigning tasks and polling for progress, and finally shutting the sub-agents down when they're done with their assigned tasks.

To better understand MCPs and agentic workflows, I built news-agents to generate

To better understand MCPs and agentic workflows, I built news-agents to generate a daily news recap. The main agent spawns sub-agents, assigning them news feeds to parse and summarize, and then generates a final overall summary plus analysis. eugeneyan.com/writing/news...

@hamel.bsky.social & @sh-reya.bsky.social are two of the world's best on evals.

@hamel.bsky.social & @sh-reya.bsky.social are two of the world's best on evals. They've built evals for 35+ AI apps & helped teams ship confidently. Now they'll teach everything they know on building evals that work. Enrollment closes in 4 days. Secret 35% discount code: maven.com/parlance-lab...

The Art of Doing Science and Engineering: Learning to Learn by Richard Hamming o

The Art of Doing Science and Engineering: Learning to Learn by Richard Hamming only $1.99 for the Kindle version today: amazon.com/dp/B088TMLQDC

Surround yourself with people whose "work" is their calling, craft, and play. T

Surround yourself with people whose "work" is their calling, craft, and play. They are intrinsically motivated, are driven to excel and do what's right, and and get so much shit done just because it's fun.

because you’ll keep discovering new ground truth that previous ground truth didn

because you’ll keep discovering new ground truth that previous ground truth didn’t cover. in conventional ML, you’d get a ton of ground truth, typically your entire traffic (e.g., search, fraud, forecast errors). now, unless you design your product with implicit feedback, you need to label data

yeap, some human oversight still needed for now

yeap, some human oversight still needed for now

Product evals are misunderstood. Many teams think that adding another tool, metr

Product evals are misunderstood. Many teams think that adding another tool, metric, or llm-as-judge will solve all their problems and save their product. But that just dodges the hard truth and avoids the real work. Here's how to fix your process instead. eugeneyan.com/writing/eval...

did you define what rlvr was in the writeup?

did you define what rlvr was in the writeup?

The default state of projects is to drift toward entropy; you need to actively r

The default state of projects is to drift toward entropy; you need to actively resist & reverse it.