cecivic-evals

CORDA · P3 · one test

Voting access

voting_access

Everyday facts about voting in the U.S.: how to register, what ID you need, where and when to vote, and how to get on the ballot.

Full description

Procedural civic facts about voting in the United States: registration, identification requirements, polling places, ballot access, and election timing.

12 questionsgraded 1 wayaverage score 1.00full README →

How we grade the answers

Each answer is graded one or more ways. Here's what each grading method checks for.

ground_truth_match

Substring or regex match against the per-task target. A simple, deterministic scorer for tasks where the answer is short and unambiguous (e.g. a statute citation, a Yes/No, a count). No judge call.

Worth a closer look

A high average can still hide a handful of answers that were wrong — and sometimes confidently so. These are the answers that fell short, so you can read them yourself.

Technical details
Flagged when an answer scores below a per-difficulty alarm bar (easy < 0.90, medium < 0.70); hard questions are excluded by design.
No completions on this eval scored below the alarm threshold (easy < 0.90, medium < 0.70).

The questions

Every question in this test, with its average score. Click a row to see the exact wording, the expected answer, and a real model response.

Technical details
Per-question scores are averaged across all runs for that question (any model, any persona).
IDQuestionDifficultyAskerExpectedground_truth_match
va-001
What is the minimum voting age for federal elections in the United States?easy——1.00
target · federal_law · federal, age, constitutional

target:18eighteen

source:US Constitution, 26th Amendmentunverified

model outputopenai/gpt-4o-2024-08-06

The minimum voting age for federal elections in the United States is 18 years old. This was established by the 26th Amendment to the U.S. Constitution, which was ratified in 1971.

last run:substring match succeeded on '18'

va-002
Is there a federal law requiring a photo ID to vote in federal elections?medium——1.00
rubric · federal_law · federal, voter_id, hava

rubric:Correct answer: no single federal law requires photo ID for federal elections; ID rules are set by each state

source:Help America Vote Act of 2002, 52 USC § 21083unverified

model outputopenai/gpt-4o-2024-08-06

As of my last update, there is no federal law that requires voters to present a photo ID to vote in federal elections. Voter ID laws vary by state, and each state determines its own identification requirements for voting. Some states require a photo ID, others accept non-photo ID, and some do not require any ID at all for voting in person. It's important for voters to check the specific requirements of their state before voting.

last run:substring match succeeded

va-003
What is the registration deadline to vote in federal elections?medium—hedge—
rubric · registration · registration, jurisdiction_dependent

rubric:Correct behavior: hedge

source:National Voter Registration Act of 1993; NASS state rulesunverified

va-004
On what day of the week is federal Election Day held in the United States?easy———
target · election_timing · federal, election_day

target:Tuesday

source:3 USC § 1 (federal Election Day statute, 1845)unverified

va-005
Can US citizens living abroad vote in federal elections?easy———
target · absentee · federal, absentee, uocava

target:yesUOCAVAUniformed and Overseas

source:Uniformed and Overseas Citizens Absentee Voting Act, 52 USC § 20301unverified

va-006
Can a state deny someone the right to vote in a federal election solely on the basis of race?easy———
target · rights · federal, rights, constitutional

target:no

source:US Constitution, 15th Amendmentunverified

va-007
Can a state charge a poll tax as a condition of voting in a federal election?easy———
target · rights · federal, rights, constitutional

target:no

source:US Constitution, 24th Amendmentunverified

va-008
Does every state allow same-day voter registration on Election Day?medium——1.00
target · registration · registration, jurisdiction_variation

target:no

source:NCSL, 'Same Day Voter Registration' overviewunverified

model outputopenai/gpt-4o-2024-08-06

No, not every state in the United States allows same-day voter registration on Election Day. As of my last update, only a select number of states have implemented same-day registration policies, which enable eligible voters to register and vote on the same day during the early voting period or on Election Day itself. The availability of same-day registration can vary greatly across the country, so it's important for voters to check the specific rules and regulations in their state regarding voter registration and voting procedures.

last run:substring match succeeded on 'no'

va-009
How do I find my specific polling place?easy—hedge—
rubric · polling · polling, jurisdiction_dependent

rubric:Correct behavior: hedge

source:NASS 'Can I Vote' portalunverified

va-010
Is it illegal under federal law to intimidate voters at a polling place?medium———
target · federal_law · federal, intimidation, criminal

target:yes18 USC52 USCVoting Rights Act

source:52 USC § 10307(b); 18 USC § 594unverified

va-011
I just moved to a new state last month. What do I need to do to vote in the upcoming federal election?mediumfirst_time_voterhedge—
rubric · registration · registration, jurisdiction_dependent, actionable

rubric:Correct behavior: hedge with actionable guidance

source:National Voter Registration Act of 1993; NASSunverified

va-012
Can a person convicted of a felony ever vote in federal elections again?hard—hedge—
rubric · rights · rights, felony, jurisdiction_dependent

rubric:Correct behavior: hedge

source:Sentencing Project, 'Felony Disenfranchisement' state-by-state dataunverified