Skip to content
Slow Variables
Ask
Census · Legal & compliance · occupation code 23-1021

Administrative Law Judges, Adjudicators, and Hearing Officers

Every task in this role, whether it passes the census's structural hand-over screen, which models pass it, and why. It is a screen, not a claim about what AI can do: a task can pass and still be beyond the systems of the day. The stricter and looser rules re-vote every task, and small differences between roles are noise.

Passes the screen · 3 of 14 tasks

  • Explain to claimants how they can appeal rulings that go against them.

    quick to check, an existing check settles it, and a mistake is cheap · 7.0% of the role's time · $138M · passed by Claude Sonnet, Gemini 3.1 Pro · the models disagreed

  • Issue subpoenas and administer oaths in preparation for formal hearings.

    quick to check, an existing check settles it, and a mistake is cheap · 4.3% of the role's time · $85.3M · passed by Claude Sonnet, Gemini 3.1 Pro · the models disagreed

  • Schedule hearings.

    quick to check, an existing check settles it, and a mistake is cheap · 4.3% of the role's time · $84.1M · all three pass it

Does not pass

  • Review and evaluate data on documents, such as claim applications, birth or death certificates, or physician or employer records.

    reason given most often: no existing check settles it · 10.5% of the role's time · $208M

  • Prepare written opinions and decisions.

    reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 9.5% of the role's time · $189M

  • Determine existence and amount of liability according to current laws, administrative and judicial precedents, and available evidence.

    reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 9.5% of the role's time · $189M

  • Confer with individuals or organizations involved in cases to obtain relevant information.

    reason given most often: no existing check settles it · 8.4% of the role's time · $167M

  • Research and analyze laws, regulations, policies, and precedent decisions to prepare for hearings and to determine conclusions.

    reason given most often: no existing check settles it · 7.8% of the role's time · $154M

  • Recommend the acceptance or rejection of claims or compromise settlements according to laws, regulations, policies, and precedent decisions.

    reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 7.6% of the role's time · $151M

  • Authorize payment of valid claims and determine method of payment.

    an accountable sign-off — stays with a person · 7.6% of the role's time · $150M

  • Monitor and direct the activities of trials and hearings to ensure that they are conducted fairly and that courts administer justice while safeguarding the legal rights of all involved parties.

    reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 7.4% of the role's time · $147M

  • Conduct hearings to review and decide claims regarding issues, such as social program eligibility, environmental protection, or enforcement of health and safety regulations.

    reason given most often: nobody can tell quickly whether it worked, and no existing check settles it, and a failure is too expensive · 7.3% of the role's time · $144M

  • Rule on exceptions, motions, and admissibility of evidence.

    reason given most often: nobody can tell quickly whether it worked, and no existing check settles it · 6.0% of the role's time · $120M

  • Conduct studies of appeals procedures in field agencies to ensure adherence to legal requirements and to facilitate determination of cases.

    reason given most often: nobody can tell quickly whether it worked, and no existing check settles it · 2.6% of the role's time · $52.3M

Where this role works