Evaluation of Compensation Data Collected Through the EEO-1 Form (2023)
Chapter: Appendix B: Data-Handling Procedures Used for Original Data Analysis
Appendix B
Data-Handling Procedures Used for Original Data Analysis
OBJECTIVE 1
Is the analytical approach fully documented, and are the data publicly available so that the results can be replicated?
Requirement A
Data collection, analysis, and modeling efforts should be fully documented throughout the project. Methods used for analytical activities should be presented clearly in the report or in an appendix, as though prepared for a journal article, and all assumptions and data limitations should be cataloged and acknowledged in the body of the manuscript.
Procedure Used
Substantive chapters (Chapters 2–7) were reviewed by chapter authors and program staff to ensure descriptions of data collection, methods, and analyses were complete. Assumptions and limitations were noted in each relevant chapter. SAS programs for developing analytical datasets and performing analyses are available on request to the National Academies of Sciences, Engineering, and Medicine’s public access file.
Requirement B
If independent contractors or consultants are commissioned for the project, their names and qualifications should be described in the report or in an appendix.
Procedure Used
See Appendix D for biographical sketches of RTI International project staff and programmers.
Requirement C
The project’s public access file should have (1) the raw data; (2) any original analysis instruments; and (3) the documentation necessary to replicate the collection, analysis, or modeling activities relevant to the results presented in the report. Instructions for accessing this information should be provided in the report.
Studies involving the use of proprietary data and/or software, classified information, personally identifiable information, or other restricted information may be exempt from public availability requirements, with institutional approval.
Procedure Used
EEO-1 Components 1 and 2 data analyzed for this report have been determined as exempt from public access file inclusion.
OBJECTIVE 2
How have data and analyses been checked for errors?
Requirement A
Internal panel efforts, wherein several panel members and/or project staff replicate the work; or appointment of an independent, volunteer expert to check for errors and/or replicate the analysis; or commissioning of a paid consultant to verify the work according to a specified plan; or similar mechanism. Such replication efforts should be documented and described in the report or in an appendix.
Procedure Used
The overall analysis plan for this report was prepared by panel members with subject matter, statistical, and survey methodology expertise. The plan was reviewed by program staff and RTI International project staff with statistical and programming expertise. The plan was implemented by RTI International staff according to the quality-assurance plan included in this appendix. Results were reviewed by program staff and panel members with subject matter, statistical, and survey methodology expertise.
OBJECTIVE 3
Is the analytical methodology appropriate and representative of best practices?
Requirement A
The report should include a justification of the panel’s choice of methodology.
Procedure Used
Each relevant chapter (Chapters 4–7) provides a justification of methodology.
Requirement B
Appointment of one or more expert reviewers with specific knowledge of the analytic or modeling techniques employed, to carefully examine those sections of the report.
Procedure Used
The required expertise of external reviewers was described in the slate of potential reviewers considered for external review.
This page intentionally left blank.
