Discussion about this post

User's avatar
Marius Laurusevicius's avatar

Building without domain expertise is one thing; grading the output is where it returns. Stanford's RegLab team ran the first preregistered evaluation of AI legal research tools, published in the Journal of Empirical Legal Studies, and measured hallucination rates of 17 percent for Lexis+ AI and 33 percent for Westlaw AI-Assisted Research across 202 queries hand-scored by legal experts. Both products had marketed the opposite. Nobody without legal training could have scored those answers. So the founder lesson holds on the build side and inverts on the buy side.

Immanuel Santosh's avatar

The no-domain-expertise rule holds for law, but I'd separate two things he's merging: not knowing the industry, and not knowing the customer's workflow.

Legora closed that gap by hiring lawyers early to build eval sets. Most founders skip that step, call it "learning fast," and end up shipping features nobody asked for.

Learning speed is the leading indicator only when it's directed at the buyer's actual day, not just the market's vocabulary.

3 more comments...

No posts

Ready for more?