Administrative Law Judges, Adjudicators, and Hearing Officers
Every task in this role, whether it passes the census's structural hand-over screen, which models pass it, and why. It is a screen, not a claim about what AI can do: a task can pass and still be beyond the systems of the day. The stricter and looser rules re-vote every task, and small differences between roles are noise.
Passes the screen · 3 of 14 tasks
Explain to claimants how they can appeal rulings that go against them.
quick to check, an existing check settles it, and a mistake is cheap · 7.0% of the role's time · $138M · passed by Claude Sonnet, Gemini 3.1 Pro · the models disagreed
Issue subpoenas and administer oaths in preparation for formal hearings.
quick to check, an existing check settles it, and a mistake is cheap · 4.3% of the role's time · $85.3M · passed by Claude Sonnet, Gemini 3.1 Pro · the models disagreed
Schedule hearings.
quick to check, an existing check settles it, and a mistake is cheap · 4.3% of the role's time · $84.1M · all three pass it
Does not pass
Review and evaluate data on documents, such as claim applications, birth or death certificates, or physician or employer records.
reason given most often: no existing check settles it · 10.5% of the role's time · $208M
Prepare written opinions and decisions.
reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 9.5% of the role's time · $189M
Determine existence and amount of liability according to current laws, administrative and judicial precedents, and available evidence.
reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 9.5% of the role's time · $189M
Confer with individuals or organizations involved in cases to obtain relevant information.
reason given most often: no existing check settles it · 8.4% of the role's time · $167M
Research and analyze laws, regulations, policies, and precedent decisions to prepare for hearings and to determine conclusions.
reason given most often: no existing check settles it · 7.8% of the role's time · $154M
Recommend the acceptance or rejection of claims or compromise settlements according to laws, regulations, policies, and precedent decisions.
reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 7.6% of the role's time · $151M
Authorize payment of valid claims and determine method of payment.
an accountable sign-off — stays with a person · 7.6% of the role's time · $150M
Monitor and direct the activities of trials and hearings to ensure that they are conducted fairly and that courts administer justice while safeguarding the legal rights of all involved parties.
reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 7.4% of the role's time · $147M
Conduct hearings to review and decide claims regarding issues, such as social program eligibility, environmental protection, or enforcement of health and safety regulations.
reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 7.3% of the role's time · $144M
Rule on exceptions, motions, and admissibility of evidence.
reason given most often: nobody can tell quickly whether it worked, and no existing check settles it · 6.0% of the role's time · $120M
Conduct studies of appeals procedures in field agencies to ensure adherence to legal requirements and to facilitate determination of cases.
reason given most often: nobody can tell quickly whether it worked, and no existing check settles it · 2.6% of the role's time · $52.3M
Where this role works
| Industry | Workers | Wage bill | Passes the screen | All three pass |
|---|---|---|---|---|
| State Government, excluding Schools and Hospitals (OEWS Designation) | 8650 | $1.0B | $155M | $42.5M |
| Federal Executive Branch (OEWS Designation) | 5090 | $741M | $115M | $31.5M |
| Local Government, excluding Schools and Hospitals (OEWS Designation) | 2370 | $237M | $36.8M | $10.1M |