Welcome to a survey on AI-assisted Data Management Plans (DMPs)! This survey aims to evaluate the potential of large language models (LLMs) in drafting high-quality, compliant Data Management Plans to assist researchers submitting proposals to federal funders.

As part of your participation, you will review and provide feedback on sample NIH (National Institutes of Health) DMPs, some human and some LLM generated. You will be guided through the following pages:

• Background Information
  You will be asked to provide information about your professional role, experience with DMPs, and attitudes toward the use of AI in research. All questions are optional and serve to contextualize your feedback.
• Evaluation of DMPs
  You will successively review three randomly assigned NIH DMPs and assess the quality of each of their 6 sections based on standardized criteria, including technical accuracy, completeness, and clarity. You may also provide qualitative feedback and point out any issues you observe. Each one may have been written by a human or an LLM, and you will be asked to make a guess which it is.

Your participation plays a vital role in shaping the future of LLM-assisted research infrastructure. This study was determined to not meet the definition of human subjects research by the UC Davis IRB (FWA No: 00004557, IORG: 0000251) . No identifiable information will be collected. All responses will be anonymous and used solely for product development research, in accordance with ethical and regulatory standards.

Your answers will be saved as you go to a new page. You can go back and change answers at any time. Once you submit on the final page, your answers cannot be changed anymore.

This survey is conducted jointly by teams from the California Medical Innovations Institute and the California Digital Library. If you have any questions, feedback, or suggestions, please reach out to Nahid Zeinali at [email protected].