journal-entry JR-SAFEGUARDS-2026-7F14
Handoff study safeguards and data boundary
Handoff Study Safeguards
Objective and disposition
Determine whether EX-HANDOFF-2026-0D7A can produce decision-relevant evidence without unnecessary surveillance, sensitive-source exposure, inaccessible participation, or coercive research practices.
Disposition: feasible only as a minimal-data, sandboxed study using authorized public or purpose-built synthetic task fixtures. Recruitment remains blocked until a qualified human-subjects/ethics determination and a named data steward approve the final protocol.
Challenged assumptions
- Screen or keystroke recording is needed to measure reconstruction. Rejected. The primary outcome can be scored from a submitted plan, one predeclared verification result, coarse timestamps, and reviewer ratings.
- Removing names makes workplace traces safe. Rejected. Repository contents, rare task facts, timing, and expertise combinations can identify people or expose proprietary information.
- A uniform time cap is fair. Rejected. It can measure disability or tool accessibility rather than the intervention [EV-SAFEGUARDS-2026-D8E5].
- WCAG conformance proves inclusion. Rejected. It is a floor for relevant digital materials, not evidence that disabled developers can participate equivalently.
- A low-risk software study can self-declare exemption. Rejected. The actual sponsor and jurisdiction must make or obtain the applicable determination.
Data-flow and minimization model
| Stage | Permitted data | Prohibited data | Control |
|---|---|---|---|
| Fixture intake | authorized public snapshot or synthetic completed task; answer key held separately | private customer code, personal messages, production data, secrets, unresolved vulnerabilities | fixture owner attests authorization; secret/PII scan; manual review |
| Recruitment | contact channel, consent state, accommodation request, broad expertise/familiarity bands | diagnosis, unrelated demographics, manager ratings, covert employee selection | consent record separated from response ID; no manager recruitment pressure |
| Study workspace | immutable fixture, assigned handoff condition, accessible task instructions | participant's real repository, credentials, network tokens, personal dotfiles | disposable sandbox; network off by default; least privilege |
| Observation | start/end event, submitted plan, declared confidence, clarification request, allowlisted verification result | screen/audio/video, keystrokes, clipboard, browser history, continuous IDE telemetry | event-level logging only; no background recorder |
| Review | pseudonymous response, concealed answer key, condition-hidden format where feasible | identity, employer, accommodation details | two independent reviewers; role-based access |
| Analysis | outcome scores and broad prespecified strata | free-text identifiers, small-cell disclosure, individual performance reports | aggregate reporting; suppress identifiable cells |
| Disposal | audit record and aggregate results | raw response artifacts after retention deadline | verified deletion log and backup-expiry check |
Threat review
| Threat | Consequence | Required prevention/detection |
|---|---|---|
| Secret or proprietary fixture content | confidentiality breach | public/synthetic boundary, automated scan plus human review, immediate stop |
| Malicious or unsafe verification step | device/network harm | disposable sandbox, no production access, allowlisted read-only or test action |
| Participant re-identification | employment or reputational harm | random study ID, separate consent mapping, broad strata, small-cell suppression |
| Coercion or performance surveillance | invalid consent and workplace harm | no direct-manager recruitment, no performance use, withdrawal without penalty |
| Accessibility exclusion | biased estimate and participant burden | accessible formats/tools, accommodation channel, preflight with disabled participants |
| False confidence induced by handoff | unsafe downstream action | synthetic/public tasks, harm rubric, stop on critical unsafe behavior |
| Reviewer exposure or bias | confidentiality loss or invalid scores | least access, blinded condition, adjudication, agreement threshold |
| Over-retention | expanding breach and secondary-use risk | purpose-bound retention, deletion verification, no reuse without new consent/review |
Accessibility protocol
- Publish instructions and consent in structured text with equivalent semantics for diagrams and non-text material.
- Ensure keyboard-only operation, visible focus, sufficient contrast, zoom/reflow, and assistive-technology compatibility for the selected editor and forms.
- Offer an accommodation channel before assignment without requiring diagnosis.
- Predeclare participant-specific timing or break accommodations. Use the same accommodation in both conditions; analyze elapsed time only as secondary.
- Do not infer cognitive ability from speed or clarification behavior.
- Run a small participatory preflight with disabled developers before the treatment-effect study. Automated checks alone are insufficient.
- Record accessibility-critical failures as harms and pause the affected task, rather than treating the response as ordinary missing data.
Consent and participant protections
Consent must identify the research purpose, procedures, expected duration, foreseeable privacy/accessibility/workplace risks, data collected and not collected, retention, access, reporting, compensation, contact, and the right to withdraw without penalty. Compensation must not depend on correctness or task completion. Results must not be provided to employers as individual performance data. Deception is not justified by the present design.
The protocol should recruit across relevant expertise levels without using a convenience sample of subordinates. It should state that direct participant benefit is not established and distinguish research from job evaluation.
Provisional retention and access policy
- Collect only the fields listed in the data-flow table.
- Store the consent/identity map separately from study responses.
- Limit raw access to the study lead and named data steward; reviewers receive only pseudonymous material needed for scoring.
- Default raw retention: until scoring audit and any required review are complete, then delete within 90 days. The approved protocol must replace this default if law, sponsor policy, publication, or participant consent requires a different period.
- Retain aggregate, disclosure-reviewed results and non-identifying protocol artifacts. Do not publish raw plans if they can expose participant writing style or source details.
- No secondary use, model training, or cross-study linkage without new authorization and, where applicable, renewed consent/review.
Required gates before recruitment
- Sponsor, jurisdiction, funding, publication intent, and participant relationship documented.
- Qualified IRB/human-subjects/ethics determination obtained where applicable; repository agents do not self-certify exemption.
- Named principal investigator/study owner and data steward.
- Final consent and withdrawal/deletion process reviewed.
- Fixture authorization, secret/PII scan, and safe-action allowlist complete.
- Accessible tools/materials checked and participatory preflight completed.
- Data access, encrypted storage, retention, incident response, and deletion verification approved.
- Rubric reliability threshold and critical-harm definitions preregistered.
Stop and incident criteria
Immediately stop the affected session and preserve only the minimum incident record if a secret, personal data, unapproved network access, security event, participant distress, consent withdrawal, accessibility-critical barrier, or critical unsafe action occurs. Pause the study if reviewer reliability fails, the protocol drifts, small cells risk identification, or an accommodation cannot be provided without invalidating the task. Resume only after documented review.
Confidence, limitations, and remaining unknowns
Confidence is Medium that a minimal-data design is feasible. Confidence is Low that it will be accessible and legally/ethically authorized until participatory preflight and qualified review occur. This analysis is not legal advice, an IRB determination, a penetration test, or direct disabled-participant evidence.
Unknowns include actual jurisdiction and sponsor, available accessible tooling, whether condition blinding survives format differences, appropriate retention, and whether public/synthetic fixtures represent real handoff difficulty.
Follow-on research and engineering implications
- Baseline design must use the same sandbox, data fields, accommodation policy, and safe verification action in both conditions.
- Preregistration must include incident handling, exclusions, accessibility failures, reviewer agreement, and missing-data rules.
- Build only disposable fixture/scoring infrastructure; do not connect the study to production repositories or employee telemetry.
- Validate the primary score against later execution before treating it as a production quality metric.