Curriculum Quality Surveys Information

lab

The AACP Graduating Student, Alumni, Preceptor and Faculty surveys were first released based on Standards 2007 in 2007. These curriculum quality perception surveys were revised by the AACP Institutional Research and Assessment Committee (IRAC), AACP staff, and ACPE staff in spring 2015 to reflect the changes in Standards 2016. The surveys can be used by the colleges and schools of pharmacy both as a curriculum assessment tool and to provide data during a self-study and accreditation review. The Graduating Student and Faculty surveys are now available for school administration until July 1st and the Alumni and Preceptor surveys are now available for school administration until August 31st. 

Principles of Good Use for the AACP Curriculum Quality Perception Surveys

Curriculum Quality Surveys Frequently Asked Questions 

Survey Administrators

What are the Curriculum Quality Surveys?

Graduating Student, Alumni, Preceptor and Faculty surveys were first released based on Standards 2007 in 2007.  The purpose of these surveys was to help member colleges and schools gather data for both continuous program improvement and accountability (accreditation) purposes.  These curriculum quality perception surveys were revised by the AACP Institutional Research and Assessment Committee (IRAC), AACP staff, and ACPE staff in spring 2015 to reflect the changes in Standards 2016 such as the inclusion of the CAPE Educational Outcomes 2013 as Standards 1-4 and other wording changes for items that had not performed as well. The first administration of these revised surveys occurred in 2016. These surveys continue to be periodically reviewed by IRAC.

The intent of the surveys is for colleges and schools of pharmacy to use them as both a curriculum assessment tool and to provide data during a self-study and accreditation review.

How are the surveys administered?

The four surveys can only be administered through AACP's online centralized survey system. Colleges/schools of pharmacy are not permitted to copy or disseminate the surveys.

When do the surveys open?

The Graduating Student and Faculty surveys open the first Monday in March and close at the end of June. The Alumni and Preceptor survey open the first Monday in May and close at the end of August.

Are the colleges/schools notified when they are open?

Yes, AACP sends an e-mail to the survey coordinator at each of the colleges/schools when the surveys are available for use. This e-mail includes the names of staff members that have been assigned to administer the survey in previous years. Survey coordinators are given approximately one week to add or delete staff members with access to the administration of the survey before an e-mail with survey instructions is sent to those assigned staff. At least one reminder e-mail of the survey closing date is also sent.

Are e-mail addresses required for each participant?

Individual e-mail addresses are required for each person you want to survey. The online survey system creates a unique survey link for each participant, which is used to access the survey. This assures that the participants complete the survey only once. Please include only one e-mail address per individual.

Do I have to type in each e-mail address for everyone I want to survey?

The college/school survey administrator can manually type in each e-mail address or they can upload a list of survey takers into the survey system. The Excel file should include first name, last name, e-mail address, and campus location (optional) as separate fields.  A sample file is available within the online survey system.  We recommend downloading the sample file to use as a template prior to importing your list into the system.

What is done with the e-mail addresses that are uploaded into the system?

Individual name and e-mail addresses are stored in the system during the administration of these surveys; however, AACP does not contact the individuals nor do we give, share, sell or transfer any individual-specific information to any party other than the college/school of pharmacy that provided the information. 

Who administers the surveys?

Each college/school of pharmacy administers the graduating student, alumni, preceptor and/or faculty survey. It is the responsibility of the college/school to administer the survey by determining a timeline, opening the survey, sending the invite and reminder emails and closing the survey. Invite and reminder e-mails are not sent by AACP; they are sent through the online survey system for which a valid college/school e-mail address must be provided. The e-mail that participants receive comes from that college/school contact.

How do I open the survey after I have imported my e-mail list?

Once your e-mail list has been imported into the survey system you can then use the "invite newly added participants" link in order to open the survey and send e-mails to your participants. In the "from" line please include a university e-mail address that survey participants may e-mail with questions regarding the survey.

Can I personalize the invite and/or reminder e-mails?

AACP provides standardized text for the invite and reminder e-mails; however, each school has the ability to change the text as needed.

What should I do if my e-mails to survey participants are not being received?

If only a few e-mails have not been received by your survey participants, please double check the participants' e-mail addresses to make sure the addresses were correctly entered into the system.

If a large number of e-mails are not being received, your college/school's spam filter is most likely blocking the e-mails. Please refer to the following points below:

  • Notify the individual who administers your institution's spam filtering/blocking software that your survey invitation e-mail will be received from aacp.org and that it will be coming from the following IP address: 50.23.218.199. Please also inform them of the e-mail address that you used in the "from" line of the message and the date that the messages were sent.
  • Please use the "remind" link to resend the invitation e-mails to your participants after your I/T department has the necessary information to white list the e-mails.
  • If your I/T department requires additional information, please contact Jamie Taylor
How should I respond to survey participants that are unable to access the survey using their survey link?

If the survey link does not take your participants directly to the survey please ask them to carefully copy and paste the entire survey link into their web browser.  If a survey taker receives an error message that the survey they are trying to take is no longer available or that the user is not found in the system the survey taker most likely has not copied the full survey link into the address bar of his/her web browser. 

Why are some participants unable to view the questions properly and/or unable to save their answers?

Your college/school's I/T firewall may limit the number of connections that can connect to the survey system at one time. If you are administering the survey in a group setting please check with your I/T department prior to administering the survey regarding the current firewall configurations.

Who should be participants for each of the surveys?
  • Graduating Student survey: All students graduating from your Pharm.D. as a first professional degree program should be included.
  • Faculty survey: All full-time and/or part-time faculty at your college/school of pharmacy with teaching responsibility for the Pharm.D. as a first professional degree should be included.
  • Alumni survey: The alumni survey is intended to be administered to alumni no more than five years post graduation.
  • Preceptor survey: All preceptors that have precepted students in the current academic year.
How long does it take to complete each of the surveys?

It is estimated that the Graduating Student survey takes 30 minutes to complete. The Faculty, Alumni and Preceptor surveys take approximately 15-20 minutes.

Can I add additional questions to the survey(s)?

An optional feature allows the survey administrator to add a link to the end of the AACP surveys requesting that participants answer additional questions relating specifically to the institution. The link will direct them to an online survey instrument developed by your institution using their own online survey tool (e.g. SurveyMonkey, Qualtrics). Please be aware that AACP is unable to link user responses from the AACP surveys with your college/school's online survey tool. 

How can I try to increase the response rates for our school's surveys?

There are many potential ways to boost the response rates for your surveys. First, make sure that you have planned a timeline in advance of administration that allows for at least two reminder messages to be sent. We recommend beginning survey administration at least four weeks prior to the close of a survey. Second, make sure that the list of survey takers that you upload into the system is as clean and accurate as possible. Consider partnering with other departments on campus to ensure that you have the best contact information, particularly for alumni and preceptors. Third, consider representative sampling for the Alumni and Preceptor surveys so that you can better target individuals with reminders to complete the survey.

Will I receive any data reports once we finish administering the survey(s)?

When the survey is closed by your institution you will be able to download a summary report and raw data report specific to your college/school. Demographic data for the Faculty survey and gender identity and sexual orientation data for all four surveys are only provided in summary and will not be included in the raw data report. Data reports may be downloaded after closing the survey by using the "download raw data report" and "download summary report" links in the survey portal. Summary reports of all participating schools will be posted on the AACP Web site near the end of July for the Graduating Student and Faculty surveys and the end of September for the Alumni and Preceptor surveys. Peer comparisons consisting of five or more schools will be available within the "Reports" area of the survey system for participating institutions during this same timeframe. 

What is the best way for me to use the information in the summary reports?

A user's guide that makes recommendations regarding suggested timing of surveys, data interpretation, peer comparisons and follow-up strategies is available at the top of this page.

For additional questions or comments please notify Jamie Taylor, Associate Director of Institutional Research and Effectiveness, at 703-739-2330 ext. 1020.

 

 

Why was the demographic section in the Curriculum Quality Surveys expanded and how will these data be reported?

For the 2018 surveys, AACP expanded the gender identity item and included a sexual orientation item. These changes were made in the spirit of inclusivity and clarity.  In order to not be intrusive, an option of “prefer not to disclose” is available as one of the selection options for gender identity and sexual orientation. These changes support the AACP Core Values of Inclusiveness and Learning and the AACP Diversity Statement.

These data will only be reported in aggregate within the summary report to protect the confidentiality of respondents. These data will not be available in the raw data report.
 

How will these additional demographic data in the Curriculum Quality Surveys be used?

Data collected on gender identity and sexual orientation will provide AACP with meaningful population data and also provide schools with necessary data for targeting resources and other student and faculty support services. 

How are survey data protected in the AACP survey system?

Our vendor uses standard password policies as well as insists upon full 2048‐bit SSL for security‐weary systems. Passwords are protected in the database using custom written MD5 one‐way encryption (and unique non‐standard salts). Other sensitive data are stored in the database using custom written two‐way DES encryption with project‐unique keys.

Web traffic and connection to 3rd parties in sensitive systems like MNOHS’ project are forced where possible (reliant on 3rd party) to use HTTPS protocol. The Firewall allows HTTP (if necessary), HTTPS and SMTP (outgoing mail) traffic without the need for an SSH Tunnel. Remote Desktop Connection (RDC), SQL enabled via SSH tunnel. Strict SSH connection source IP policy is in effect.
 

Survey Respondents

Why was the demographic section in the Curriculum Quality Surveys expanded and how will these data be reported?

For the 2018 surveys, AACP expanded the gender identity item and included a sexual orientation item. These changes were made in the spirit of inclusivity and clarity.  In order to not be intrusive, an option of “prefer not to disclose” is available as one of the selection options for gender identity and sexual orientation. These changes support the AACP Core Values of Inclusiveness and Learning and the AACP Diversity Statement.

These data will only be reported in aggregate within the summary report to protect the confidentiality of respondents. These data will not be available in the raw data report.

How will these additional demographic data in the Curriculum Quality Surveys be used?

Data collected on gender identity and sexual orientation will provide AACP with meaningful population data and also provide schools with necessary data for targeting resources and other student and faculty support services.