cecivic-evals

CORDA · P3 · one test

Voting access

voting_access

Everyday facts about voting in the U.S.: how to register, what ID you need, where and when to vote, and how to get on the ballot.

Full description

Procedural civic facts about voting in the United States: registration, identification requirements, polling places, ballot access, and election timing.

12 questionsgraded 1 wayaverage score 1.00full README →

How we grade the answers

Each answer is graded one or more ways. Here's what each grading method checks for.

ground_truth_match

Substring or regex match against the per-task target. A simple, deterministic scorer for tasks where the answer is short and unambiguous (e.g. a statute citation, a Yes/No, a count). No judge call.

Worth a closer look

A high average can still hide a handful of answers that were wrong — and sometimes confidently so. These are the answers that fell short, so you can read them yourself.

Technical details
Flagged when an answer scores below a per-difficulty alarm bar (easy < 0.90, medium < 0.70); hard questions are excluded by design.
No completions on this eval scored below the alarm threshold (easy < 0.90, medium < 0.70).

The questions

Every question in this test, with its average score. Click a row to see the exact wording, the expected answer, and a real model response.

Technical details
Per-question scores are averaged across all runs for that question (any model, any persona).
IDQuestionDifficultyAskerExpectedground_truth_match
va-001
What is the minimum voting age for federal elections in the United States?easy1.00
target · federal_law · federal, age, constitutional

target:18eighteen

source:US Constitution, 26th Amendmentunverified

model outputopenai/gpt-4o-2024-08-06

The minimum voting age for federal elections in the United States is 18 years old. This was established by the 26th Amendment to the United States Constitution, which was ratified in 1971.

last run:substring match succeeded on '18'

va-002
Is there a federal law requiring a photo ID to vote in federal elections?medium1.00
rubric · federal_law · federal, voter_id, hava

rubric:Correct answer: no single federal law requires photo ID for federal elections; ID rules are set by each state

source:Help America Vote Act of 2002, 52 USC § 21083unverified

model outputopenai/gpt-4o-2024-08-06

As of my last update, there is no federal law mandating that voters present a photo ID to vote in federal elections. Voter ID requirements are determined by individual states, and they vary widely. Some states require photo IDs, while others accept non-photo identification, and some have no ID requirements at all. The debate over voter ID laws centers around issues of voter fraud prevention and voter access, and changes in these laws can occur, so it's important to check the current regulations in your state if you have questions about voting requirements.

last run:substring match succeeded

va-003
What is the registration deadline to vote in federal elections?mediumhedge
rubric · registration · registration, jurisdiction_dependent

rubric:Correct behavior: hedge

source:National Voter Registration Act of 1993; NASS state rulesunverified

va-004
On what day of the week is federal Election Day held in the United States?easy1.00
target · election_timing · federal, election_day

target:Tuesday

source:3 USC § 1 (federal Election Day statute, 1845)unverified

model outputopenai/gpt-4o-2024-08-06

Federal Election Day in the United States is held on the first Tuesday after the first Monday in November.

last run:substring match succeeded on 'Tuesday'

va-005
Can US citizens living abroad vote in federal elections?easy
target · absentee · federal, absentee, uocava

target:yesUOCAVAUniformed and Overseas

source:Uniformed and Overseas Citizens Absentee Voting Act, 52 USC § 20301unverified

va-006
Can a state deny someone the right to vote in a federal election solely on the basis of race?easy
target · rights · federal, rights, constitutional

target:no

source:US Constitution, 15th Amendmentunverified

va-007
Can a state charge a poll tax as a condition of voting in a federal election?easy
target · rights · federal, rights, constitutional

target:no

source:US Constitution, 24th Amendmentunverified

va-008
Does every state allow same-day voter registration on Election Day?medium1.00
target · registration · registration, jurisdiction_variation

target:no

source:NCSL, 'Same Day Voter Registration' overviewunverified

model outputopenai/gpt-4o-2024-08-06

No, not every state in the United States allows same-day voter registration on Election Day. As of my last update, only a select number of states offer this option, where eligible voters can register and vote on the same day. The availability of same-day registration can vary, and it's important for voters to check the specific laws and regulations of their state, as these can change and may also differ for different types of elections. Voters should consult their state's election office for the most current information.

last run:substring match succeeded on 'no'

va-009
How do I find my specific polling place?easyhedge
rubric · polling · polling, jurisdiction_dependent

rubric:Correct behavior: hedge

source:NASS 'Can I Vote' portalunverified

va-010
Is it illegal under federal law to intimidate voters at a polling place?medium1.00
target · federal_law · federal, intimidation, criminal

target:yes18 USC52 USCVoting Rights Act

source:52 USC § 10307(b); 18 USC § 594unverified

model outputopenai/gpt-4o-2024-08-06

Yes, it is illegal under federal law to intimidate voters at a polling place. According to federal statutes, particularly the Voting Rights Act of 1965 and the National Voter Registration Act of 1993, it is prohibited to intimidate, threaten, or coerce someone for the purpose of interfering with their right to vote. Additionally, the Prohibitions Against Intimidating Voters Section (18 U.S.C. § 594) specifically addresses voter intimidation. These laws are meant to protect voters and ensure free and fair elections, maintaining the integrity of the voting process.

last run:substring match succeeded on 'yes'

va-011
I just moved to a new state last month. What do I need to do to vote in the upcoming federal election?mediumfirst_time_voterhedge
rubric · registration · registration, jurisdiction_dependent, actionable

rubric:Correct behavior: hedge with actionable guidance

source:National Voter Registration Act of 1993; NASSunverified

va-012
Can a person convicted of a felony ever vote in federal elections again?hardhedge
rubric · rights · rights, felony, jurisdiction_dependent

rubric:Correct behavior: hedge

source:Sentencing Project, 'Felony Disenfranchisement' state-by-state dataunverified