Evaluate 50 AI-generated summaries against research abstracts
Project brief
Assess five batches of ten public biomedical abstracts and their AI-generated summaries using a supplied rubric. Rate readability, fidelity and omissions, and identify wording not supported by the source. This is a text-quality study, not clinical advice.
Delivery deadline: 2026-10-05. Expected production time: 5 calendar days after funding and receipt of agreed materials. Confirm the exact scope and materials before accepting the contract.
Project materials will be shared with shortlisted applicants during scoping and supplied before work begins.
Required materials: Authorized abstract/summary pairs, rating rubric and example calibration.
Submit the work and acceptance evidence through RenX. Include relevant examples, your approach and proposed AI/agent use. Additional tools, licenses, travel, advertising and other third-party costs require separate agreement.
Deliverables & acceptance
What you'll deliver
- Completed ratings for 50 pairs with evidence-based error notes.
What the result must meet
- All 50 pairs have the required ratings and source-linked explanations.
- Judgments follow the rubric and distinguish readability issues from factual misstatements.