Skip to main content

🐈‍⬛ Becca Bailey

Essays Speaking & Technical Writing Projects About

Essays Speaking & Technical Writing Projects About

← Speaking & Technical Writing

Blog July 14, 2026

LLM Coding, Human Judgment, and Krippendorff's Alpha

LinkedIn

Cover image for “LLM Coding, Human Judgment, and Krippendorff's Alpha” — Cover image

Summary

How I validated an LLM's categorization of careers-page language against my own coding, using Krippendorff's alpha to measure agreement beyond chance and treating disagreements as a signal about unclear categories or ambiguous text.

Read article →

Related

LLM-as-a-Judge in Practice: What I Learned When Two AIs Disagreed About Google

Becca Bailey

© 2026 Becca Bailey. All rights reserved.

beccanelsonbailey@gmail.com LinkedIn GitHub Substack