Federal statistical agencies exist to provide accurate and timely information relevant for policy and public use. Federal statistics can describe economic conditions, delineate societal problems, and inform policymaking and the evaluation of programs. To provide the relevant statistical information needed by policymakers in Congress and the executive branch, as well as by other users, statistical agencies must have a solid understanding of the public policy issues, federal programs, and information needs
in their domains and they must have a clear mission (see Practice 1). A major advantage of the decentralized federal statistical system in the United States is that separate federal statistical agencies are located in appropriate departments and are closer to the policymakers and programs in those areas. However, this can also present a challenge when different agencies produce different statistical estimates of the same or similar phenomena. It is essential that statistical agencies coordinate and collaborate with one another (see Practice 7) to ensure that coherent and consistent statistical information is provided on major policy issues, such as the federal collection and dissemination of race and ethnicity data (see Appendix A).
To ensure that they are providing relevant information, statistical agencies need to reach out to a wide range of their data users, including staff in their own departments and other federal departments who use their data, members of Congress and congressional staff, state and local government agencies, academic researchers, businesses and other organizations, organized constituent groups, and the media.
Agencies may need to expend considerable energy to open avenues of communication more broadly with current and potential users (see Practice 9). The recently introduced requirement that federal agencies create learning agendas could assist statistical agencies in prioritizing their outreach activities (Commission on Evidence-Based Policymaking, 2017; Foundations for Evidence-Based Policymaking Act of 2018, 2019; Office of Management and Budget [OMB], 2019b).
Statistical agencies have used a variety of approaches to engage with users. Advisory committees, such as the Census Bureau’s National Advisory Committee, are one tool to obtain the views of users outside a statistical agency (National Research Council [NRC], 1993b, 2007a).1 Many agencies obtain advice from committees that are chartered under the Federal Advisory Committee Act.2 Some agencies obtain advice from committees and working groups that are organized by an independent association, such as the American Statistical Association’s Committee on Energy Statistics for the Energy Information Administration. Regardless of the exact organization of these advisory committees, statistical agencies should examine the
___________________
1 Some statistical agencies had advisory committees that were later disbanded by their departments. This has occurred for the Bureau of Transportation Statistics and the National Center for Education Statistics.
2 Examples include: the Board of Scientific Counselors for the National Center for Health Statistics; the Data Users Advisory Committee and the Technical Advisory Committee for the Bureau of Labor Statistics; the Census Scientific Advisory Committee and the National Advisory Committee for the Census Bureau; and the Federal Economic Statistics Advisory Committee, which provides substantive and technical advice cutting across the major economic statistics programs of three agencies: the Bureau of Economic Analysis, the Bureau of Labor Statistics, and the Census Bureau. See https://apps.bea.gov/fesac/. See also PL-92-463.
institutional affiliation and occupation of advisory committee members to ensure equitable coverage in representation.
Additionally, holding workshops and conferences for data users or engaging with them at professional conferences are valuable activities for facilitating interchange among users and agency staff (NRC, 2013c). Online mechanisms, such as blogs and web surveys, may assist a statistical agency in obtaining input from users (see Practice 9). Similarly, agencies can use web analytics to better understand their user base and to assess the accessibility and usability of their website and data products. Offering positions to data users as fellows or temporary employees can also help a statistical agency gain a richer perspective on user interests and concerns.
Statistical agencies should periodically review their data collection programs and products to make sure they remain relevant (see Practice 6). Relevance should be assessed, not only for particular programs or closely related sets of programs but also for an agency’s complete portfolio, to assist each agency in making the best choices among program priorities given available resources.
To increase data quality and relevance, an agency’s own staff should actively analyze its data (Martin, 1981; Norwood, 1975; Triplett, 1991). Such analyses may examine correlates of key social or economic phenomena or study the statistical error properties of the data. Carrying out such work can lead to improvements in the quality of the statistics, to the identification of new needs for information and data products, to a reordering of priorities, and to a deeper understanding of data users’ needs (see Practice 5).
The substantive analyses that statistical agencies produce as a regular part of their dissemination and research activities will likely be helpful to policy analysis units in their departments, as well as other data users. These analyses typically describe relevant conditions and trends over time and across geographic areas and population groups (e.g., high school completion rates by race, poverty rates for each year, or state variation in employment rates). A statistical agency may expand upon such initial analyses at the request of a policy analysis unit or other data user, for example by examining trends for particular population groups, while being mindful of the agency’s responsibility to remain independent from undue influence (Principle 4). Further, statistical agencies have an obligation to provide useful statistical information to Evaluation Officers to conduct their work.
However, statistical agencies should be careful not to become involved with policy development or implementation (beyond policies directly affecting their operations), because these activities could affect their ability (or the perception of their ability) to conduct impartial and objective statistical activities. Examples of policies that are appropriate for statistical agencies to help develop and implement include statistical system policies, federal data quality standards, research access, privacy protections, and
information technology security protocols—all as they relate to statistical operations (see Practices 2, 3, 4 and 8). Beyond such exceptions, a statistical agency should neither make policy recommendations nor conduct substantive analyses of policies, although it may advise on the availability and strengths and limitations of relevant information in a policy-neutral manner. The distinction between analysis consistent with the mission of a statistical agency and policy analysis is not always clear, and a statistical agency must carefully consider the extent of policy-related activities that are appropriate for it to undertake to maintain its primary mission of providing impartial and objective statistical information for public use (see Practices 1 and 2). Principle 1 is summarized in Box 3-1, below.
Key Message:
Federal statistical agencies must provide objective, accurate, and timely information that is relevant to important public policy issues.
Key Supporting Practices:
The value of a statistical agency rests fundamentally on the accuracy and credibility of its data products. Because few data users have the resources to verify the accuracy of statistical information, users rely on an agency’s reputation to disseminate high-quality, objective, and useful statistics in an impartial manner. Only if its products are viewed as credible can an agency be regarded as working in the national interest, not beholden to a particular set of users (Ryten, 1990; see Practice 2).
Credibility therefore stems from the respect and trust of users and stakeholders in the statistical agency. Agencies build this respect and trust, not only by producing accurate and objective data and meeting all of their deadlines for the release of their statistics, but also by adhering to the
other principles for federal statistical agencies and by following some key practices. When different agencies produce similar or related estimates, it is essential that statistical agencies coordinate and collaborate with one another (see Practice 7) to ensure that users understand the differences and can determine which data are most useful for their needs.
Agencies build and maintain respect and trust through clear public commitments to professional practice and transparency in all that they do. For example, statistical agencies should actively engage with users in determining priorities for data collection and analysis; make their data widely available on an equal basis to all users, formally and informally (see Practice 9); conduct research to improve efficiency and data quality (see Practices 3 and 5); and fully inform users of the strengths and limitations of the data (see Practice 10). Such activities demonstrate an agency’s respect toward, and openness with, its users and stakeholders.
A statistical agency’s website is a key vehicle for conveying not only its statistical data, but also key information about its data. Providing clear and easy access for users to locate, work with, and understand the strengths and limitations of the agency’s data is a vital part of an agency’s mission (see Practice 1) and requires ongoing efforts to continue to meet users’ and stakeholders’ evolving needs. An agency’s website can enhance its credibility by providing information about its policies for data access (e.g., explaining which tables and microdata files are publicly available and which data require approval to access in secure sites to protect confidentiality; see Practice 8); scientific integrity policies; standards for data quality and for documenting sources of error in data collections and estimation models (see Practice 3); procedures and schedules for the release of new and continuing data series; procedures for timely notice of errors and corrections to previously released data; procedures and schedules for archiving historical data; and documentation of ongoing research efforts to provide accurate statistics that meet users’ needs (see Practice 5). To support its credibility, it is essential that each statistical agency website be clearly distinguishable from its associated parent agency, particularly if that parent agency is a regulatory, direct service, or policy development agency.3
To keep up with an ever-changing society and technology and thereby maintain the trust of their users and stakeholders, statistical agencies need to recruit, develop, and retain high-quality professional staff who are dedicated to providing high-quality products and upholding high ethical standards (see Practice 4). Statistical agencies also need to regularly review and evaluate
___________________
3 Note that the Trust Regulation authorizes each recognized statistical agency or unit to maintain a distinctive, outward-facing website with its own domain name and with adequate control over the website content and management to uphold the fundamental responsibilities. See final § 1321.4(e)(3) and Appendix A.
their programs and share the results of these evaluations with their users and stakeholders (see Practice 6). Principle 2 is summarized in Box 3-2, below.
Key Message:
Federal statistical agencies must have credibility with those who use their data and information.
Key Supporting Practices:
Nearly every day of the year, individuals, household members, businesses, state and local governments, and other organizations provide information about themselves when requested by federal statistical agencies. Without the cooperation of these data subjects, federal statistical agencies could produce very little useful statistical information.
Some information provided is required by law or regulation for government tax and transfer programs, such as reports of employers’ wages to state employment security agencies or payments to program beneficiaries. A small number of federal statistical surveys are so important that participation is mandatory. But most of the data come from the voluntary cooperation of respondents. In all cases, the willing cooperation of data subjects reduces costs and promotes accuracy.
Because virtually every person, household, business, state or local government, and organization is the subject of some federal statistics, public trust is essential for the continued effectiveness of federal statistical agencies. Individuals and entities providing data directly or indirectly to federal statistical agencies must trust that the agencies will appropriately
handle and protect their information. Implicitly and explicitly, they expect the following:
Federal statistical agencies not only have legal and ethical obligations that require them to fulfill these expectations; they also have the obligation to effectively communicate how they fulfill them. Consistent ethical conduct on the part of a statistical agency is critical for obtaining the trust of the general public and of data subjects, whether those subjects are individuals, organizational entities, or custodians of administrative records. Statistical agencies should coordinate and collaborate with each other to ensure that their communications and internal practices are clear and consistent, as this will strengthen the trust of data subjects who may interact with more than one agency (see Practice 7).
Data subjects must trust that the information the agency seeks is important for the government to collect and is being collected in a competent manner, for the good of the larger society, and only for the purposes that the agency has described (see Practice 2). To engender trust, a statistical agency should also respect the privacy of data subjects in other ways and ensure that each individual’s consent to respond to a survey is given knowingly and with full information. Agencies should describe the intended and likely future uses of the data being collected, the data’s relevance for important public purposes, and the extent of confidentiality protection that will be provided. Agencies should minimize the intrusiveness of questions and the effort needed to respond to them, and they should seek administrative or other non-survey sources to fulfill needs consistent with each agency’s requirements for information (see Practices 5 and 8). Trust among data
subjects also requires that an agency treat respondents with courtesy in appreciation for their time (National Academies of Sciences, Engineering, and Medicine [NASEM], 2016a).
The mission of federal statistical agencies is to produce statistical information by aggregating the data provided by individuals, businesses, or other entities. These agencies pledge to use the information they collect only for statistical purposes, not to provide individual records for any administrative, regulatory, or judicial use, and to make every effort to protect the confidentiality of individual information in the data they publish. This pledge is supported by many statistical agencies’ individual statutes as well as the Confidential Information Protection and Statistical Efficiency Act of 2018 (Title III of Foundations for Evidence-Based Policymaking Act of 2018, 2019). (See Appendix A.)
Data subjects must be able to trust that a statistical agency will scrupulously honor its pledge of confidentiality and will fulfill the expectations noted above. Earning this trust, however, goes beyond what the agency is simply required to do by law, and recognizes that there are many potential threats, some outside the control of the statistical agency, that the agency must anticipate and guard against. In the world of “big data” and the “dark web,” agencies must guard against the use of external data to re-identify information provided by individuals. Agencies must consistently innovate in privacy-protecting technologies to protect—to the extent possible—against re-identification of individual records in statistical data products. (See NASEM, 2017a,c, 2024c; and Practice 8.)
When data are obtained from the administrative records of other federal, state, or local government agencies or other third-party providers, the same requirements of trust building apply to justify their cooperation.4 Data-providing organizations need to trust that their records are important and legitimate for a statistical agency to obtain, that their own restrictions on data access will be honored, and that the statistical agency will make every effort to minimize their burden in responding.
An effective statistical agency has policies and practices to instill the highest possible commitment to professional ethics among its staff and build a culture of confidentiality. When issues arise or guidance is unclear, it must be able to rely on its staff to keep this culture (see Practices 3 and 4).
We end by acknowledging that statistical agencies’ mandate to establish and maintain the trust of data subjects, holders, and users is made more difficult when overall trust in government data and government agencies
___________________
4 See (OMB, 2014a) in Appendix A, which asserts the legitimacy and benefits of use of administrative data from other federal agencies for statistical agency purposes. It also provides guidance for best practices and procedures to engender mutual respect and trust and facilitate such data sharing.
is waning (American Statistical Association, 2024; NASEM, 2023b). Some of this diminished trust is due to disparagement of particular statistical releases or agencies by public figures. An unfavorable climate raises the need for statistical agencies to focus intently on practices that help to build and maintain trust. Principle 3 is summarized in Box 3-3, below.
Key Message:
Federal statistical agencies must have the trust of those whose information they obtain.
Key Supporting Practices:
A statistical agency must be impartial and execute its mission without being subject to pressures to advance any political or personal agenda. It must avoid even the appearance that its collection, analysis, or reporting processes might be manipulated for political or other purposes. Only in this way can a statistical agency serve as a trustworthy source of objective, relevant, accurate, and timely information (Bohman, 2024; Bowen, 2023; Citro et al., 2023; Cohen, 2023; Habermann & Louis, 2020; Habermann et al., 2023).5 Their independence and their high-quality products also allow statistical agencies to perform another increasingly important service for the country: they assist and improve citizens’ understanding of statistical products amid an avalanche of information of varied provenance and quality (American Statistical Association, 2024; Behzad et al., 2023).
___________________
5 The importance of independence from undue external influence is reflected in national statute and regulation, as well as international guidance. See (Foundations for Evidence-Based Policymaking Act of 2018, 2019; OMB, 2014b) in Appendix A and (European Statistical System Committee, 2017; United Nations Statistical Commission, 2014) in Appendix C.
Statistical agencies and the statistical data they produce can play a key role in informing policymakers, but they are not and should not be responsible for developing or implementing policy (see Practice 1) beyond policies relevant to the activities of the statistical agencies themselves (as noted in Principle 1). For this reason, statistical agencies should be distinct from units of a larger department that carry out administrative, regulatory, law enforcement, or policymaking activities.
It is also essential that a statistical agency be independent of other undue external influence in developing, producing, and disseminating statistics. “Undue external influences” are those from outside the agency that seek to undermine its impartiality, nonpartisanship, or professional judgment. Independence from any undue outside influence fosters trust among data subjects and credibility with data users. Examples of undue external influence include attempting to dictate measurement methods for a statistical agency’s programs; to delay or speed up (e.g., before or after an election) the release of statistical data; to suppress or alter scientific or technological findings and conclusions; and to alter the content of press releases to “spin” the findings to promote a particular viewpoint. Undue external influence also includes creating new positions for political appointees in a statistical agency with decision authority over the content, methods, and release of a statistical agency’s data.
To fulfill this principle, a statistical agency must have the necessary authority and support to protect its independence (see Practice 2); however, a broad view of this authority is needed. Statistical agencies exist in a complex ecosystem and are governed by their legislative authority, which may give ultimate responsibility for the activities of the agency to the secretary of the department, as well as by the OMB and congressional committees. Within this broad framework, a statistical agency must maintain its credibility as an impartial purveyor of information (American Statistical Association, 2024; Bowen, 2023; Citro et al., 2023; Cohen, 2023; Habermann & Louis, 2020; Habermann et al., 2023). The provisions of a statistical agency’s authorizing legislation can help promote its independence from political or other undue external influences.
For the head of an agency, independence and protection from undue political influence can be strengthened by the method of the person’s appointment (Habermann et al., 2023). A method widely regarded as bolstering the professional independence of an agency head is appointment by the President with confirmation by the Senate for a fixed term and with a statutory requirement that the appointee be selected with appropriate professional qualifications, as is the case for the commissioner of the Bureau of Labor Statistics (BLS) and the director of the Census Bureau.6 It may also be desirable that
___________________
6 The heads of the Bureau of Justice Statistics (BJS), the Bureau of Transportation Statistics (BTS), and the National Center for Education Statistics (NCES) had been appointed by the President and confirmed by the Senate in the past; these positions were changed, two to become Presidential appointments without Senate confirmation (BJS and NCES) and one to become a career civil servant (BTS).
the leader’s term not coincide with the presidential term to better ensure that professional criteria, rather than political ones, guide the appointment process. Appointment by the President with Senate confirmation for a term that is at the pleasure of the President, as is the case for the head of the Energy Information Administration (EIA), provides less assurance of independence (however, it is worth noting that EIA does have other strong legislative protection for the authority of its administrator). Appointment of a qualified career civil servant as the head of an agency is another method considered helpful for maintaining the independence of a statistical agency.7
Having its agency head report directly to the secretary of the department can also be helpful for a statistical agency to maintain a position of independence from political or other undue external influence. Such access allows the head to inform new secretaries about the role of their statistical agency and to directly present the case for new or changed statistical initiatives. Such direct access currently is provided by legislation for BLS and EIA. Other statistical agencies have one or more layers of departmental management between the statistical agency head and the secretary (see Figure B-2 in Appendix B). Over time there has been an increase in the “layering of statistical agencies,” that is, positioning them lower in their department’s administrative structure, a trend that the National Research Council (NRC, 2009c, p. 226) has identified as “a subtle, but increasingly common” threat to independence because it increases the number of political appointees and career staff who could seek to exercise control over the agency without transparency to external stakeholders or users (Habermann et al., 2023; Hartman et al., 2014).
Another means to protect against political and other undue external interference is for the statistical agency to have its own funding appropriation from Congress separate from that for other departmental agencies or programs.8 (See Practice 2.) This provides greater visibility and accountability to Congress, both by the agency and by its department, something
___________________
7 Agencies headed by career civil servants, many of whom hold their positions for long periods of time, include the Bureau of Economic Analysis; the Bureau of Transportation Statistics; the Economic Research Service in the U.S. Department of Agriculture; the National Agricultural Statistics Service; the National Center for Health Statistics; the National Center for Science and Engineering Statistics (NCSES); the Office of Research, Evaluation, and Statistics (ORES) in the Social Security Administration; and the Statistics of Income (SOI) Division in the Internal Revenue Service.
8 Most, but not all, federal statistical agencies receive appropriations directly. Three federal statistical agencies—National Center for Science and Engineering Statistics, Statistics of Income, and Office of Research, Evaluation, and Statistics—receive funding through appropriations to their parent agencies. In addition, some federal statistical agencies, such as NCES, are not involved in the annual budget request and communication process.
that is reinforced when the statistical agency participates in appropriations briefings. Other funding arrangements, such as the statistical agency being completely dependent on allocations from the budget of its parent department or agency, risk giving the department a great deal of leverage over the statistical agency without transparency to external stakeholders and users, and potentially compromising its ability to fulfill its mission.
A key aspect of a federal statistical agency’s mission is its ability to release its statistical products without review or approval by policy officials outside the statistical agency (see Practice 2). Some agencies have this authority spelled out in statute, while others have departmental policies that support it. OMB provides governmentwide protocols and assurances on the release of key federal statistics and publishes in advance a release calendar for the entire year for Principal Federal Economic Indicators.9 A strong internal and external evaluation program (see Practice 6) can also help ensure that all agency statistical programs are adhering to standard procedures and are not manipulated.
In the long run, the effectiveness of an agency depends on its reputation for impartiality: thus, an agency must be continually alert to possible infringements on its credibility and be prepared to strenuously resist such infringements (Bohman, 2024). OMB has stated that it is also the responsibility of the statistical agency’s department to “enable, support, and facilitate federal statistical agencies and recognized statistical units” as they implement their responsibilities to produce objective data.10 A federal statistical agency that has the respect and trust of its stakeholders and users, who can help publicly defend the agency, is better equipped to ward off or resist attempts by others to exert political or other undue external influence on the agency (see Principle 3). Within an agency, the professional staff’s adherence to the mission of the agency and its quality standards and ethical principles (see Practices 3 and 4) is also key to the agency’s preservation of its independence from political or other undue external interference.
Over the past decade, the federal government has issued a series of policies and frameworks to reaffirm and further support scientific integrity, including statistical production. These policies aim to protect against undue external influence in scientific processes by specifically rejecting the suppression or alteration of scientific findings by political officials; requiring transparency and accessibility of scientific findings; and requiring the selection of policy staff in scientific roles to be based on scientific and technological knowledge, credentials, experience, and integrity. (See Appendix A.) Principle 4 is summarized in Box 3-4, below.
___________________
9 See OMB’s Statistical Policy Directives No. 3 (OMB, 1985) and No. 4 (OMB, 2008) in Appendix A.
10 See OMB’s Statistical Policy Directive No. 1 (OMB, 2014b) in Appendix A.
Key Message:
Federal statistical agencies must be independent from political and other undue external influence in developing, producing, and disseminating statistics.
Key Supporting Practices:
Federal statistical agencies cannot be static. They must continually improve and innovate to be able to create reliable information on new policy questions, to provide objective information in a cost-effective way, to reduce respondent burden, and to meet user demands for more timely and granular information for statistical purposes.
Policy needs shift and evolve, and the society and economy that federal statistical agencies seek to measure are also evolving and changing at a rapid pace. To provide relevant information, statistical agencies must attend to changes in policy issues in their domain, identify emerging needs, and work with their data users and stakeholders to identify gaps in the agency portfolio or potential new statistical products that are needed (see Practice 9; NASEM, 2020a, 2023e; OMB, 2024b). One option to address needs for new information is for the agency to create experimental series; doing so allows the agency and its users time to evaluate a new data product without impacting existing data series (see Practice 5; NASEM, 2021b). The past few decades have seen an explosion of new data sources, some providing more geographic detail and timelier (some in near real time) information than federal statistical programs. Users have come to expect more, better, and ever more timely data. At the same time, individuals and businesses have been less and less willing to complete federal surveys and provide information to the government (a phenomenon that also affects private-sector surveys). Declining response rates have increased agency data collection costs, while federal statistical agency budgets have generally declined in real terms for more than a decade. Thus, agencies need to improve and innovate even to maintain their current programs.
These tensions of increasing user demand for relevant and timely statistics, agency requirements for credible data products, and significantly declining response rates amid increasing costs result in a critical challenge for statistical agencies today. The issues involved have been well-established (Advisory Committee on Data for Evidence Building, 2022; American Statistical Association, 2024; Commission on Evidence-Based Policymaking, 2017; NASEM, 2021a), but solving them requires statistical agencies to develop creative, innovative, and collaborative solutions to maintain the integrity of the statistics that are produced. Recent innovations in data sharing policies (see Practice 9 and Appendix A) appear promising to deliver improved access to data users and enhanced leveraging of alternative data sources to offset survey data collections, where possible. Additionally, examining and signaling sufficient fitness for use for a given statistical product could help agencies manage the level of effort required for data quality. These initiatives must be monitored rigorously.
Agencies should pursue state-of-the-art methods to acquire data, produce statistics, and provide access to their underlying data. Recent federal policy emphasis on open data sources and open data tools, most notably in the OPEN Government Data Act, Title II of the Evidence Act, and implemented in part through Data.gov, has promoted wider access to data for evidence building (Foundations for Evidence-Based Policymaking Act of 2018, 2019; OMB, 2013b, 2016b). Title II requires federal agencies to publish their nonconfidential data files online as open data, using standardized, machine-readable data formats, with their metadata included in the Data.gov catalog.
Agencies should engage in regular, periodic reviews of their major data collection programs that consider how to produce relevant, accurate, and timely data in the most cost-effective manner possible, while seeking to maintain comparability in key statistics over time and across geographies (see Practice 6). In ongoing programs that would be disrupted by the implementation of continuous improvements, a common practice is to bundle changes to implement several at the same time. For example, classifications such as the North American Industry Classification System (NAICS) are updated every 5 years and agencies may implement other changes at the same time as these updates occur. Agencies should ensure that the intervals between major research and development activities do not become so long that data collection programs deteriorate in quality, relevance, and efficiency (see Practice 6). When changes are made to ongoing data series, agencies should provide information to help users bridge across the old and new series.
Effective evaluations and communication are particularly necessary to inform and implement agencies’ decisions to terminate programs or series (see Practice 6). Such terminations can be an essential step to allow an agency to maintain relevance when its resources are constrained.
An effective statistical agency keeps up to date on developments in theory and practice that may be relevant to its program. Examples of such developments include new uses for data about collection processes (that is, paradata); new techniques for imputing missing data (NRC, 2004b, 2010a) or for combining data from more than one source and estimating error in the resulting statistics; new methodologies for addressing data confidentiality and disclosure avoidance; and new techniques, such as artificial intelligence, for analyzing and processing data (NASEM, 2017a,d, 2023c; NRC, 2013a; OMB, 2024b).
Among several new developments in statistical methods, perhaps the greatest interest has been in the advancement of artificial intelligence and its growing application to both data production and analysis. Artificial intelligence methods are now being applied to statistical processes, for example to improve automated coding of job titles to standard occupation classification categories. Nonetheless, like the whole of society, federal statistical agencies are challenged to consider ways to use artificial intelligence techniques to improve timeliness and efficiencies while accounting for equity and quality concerns (National Artificial Intelligence Initiative Act, 2020; OMB, 2024f; Office of Science and Technology Policy, 2022). Innovation in this area will require sufficient staff and information technology resources to maintain existing programs while experimental data and methods are tested, reviewed, improved, and subsequently adopted (Executive Office of the President, 2023; Office of Science and Technology Policy, 2023a).
Statistical agencies need a robust research program that includes statistical methods, quality assessments, and evaluations of potential new data sources.11 An effective statistical agency seeks out and carefully evaluates the quality and utility of potential new data sources and methods to harness information that could be useful for statistical purposes. Nontraditional data sources, such as sensor or transactions data, and fuller use of administrative records can potentially contribute to statistical programs by (a) augmenting information obtained from traditional sources such as surveys; (b) replacing information elements previously obtained from traditional sources; (c) providing earlier estimates that are later benchmarked with traditional sources; and (d) analyzing information streams to identify needed changes (see Practice 5). Agencies also need the appropriate information technology infrastructure and technical skills to handle alternative data sources. History has repeatedly shown that research conducted within federal statistical agencies on subject areas, methods, and operations can lead to large productivity gains in statistical activities for a relatively low cost (Citro, 2016; NRC, 2010c).
___________________
11 See for example https://www.statspolicy.gov/assets/docs/ICSP-The%20Use%20of%20Private%20Datasets%20by%20Federal%20Statistical%20Programs-1-6-2023.pdf.
An effective statistical agency has a culture of continual improvement and innovation. All employees, and not just research staff, should be encouraged to seek to innovate and improve their functions within the organization. Staff in production and support areas should seek to improve processes, methods, and cost-effectiveness (see Practice 3). A statistical agency also needs to hire staff with cutting-edge skills and maintain and enhance the skills of its current staff through ongoing training and development opportunities so that it can continually improve and innovate (see Practice 4). To take the greatest advantage of staff with new and improved skills and to better support their operations, statistical agencies should maintain and regularly upgrade their information technology infrastructure (NASEM, 2017a, 2023c).
The decentralized nature of the U.S. federal statistical system can make it difficult for federal statistical agencies to easily learn from each other, but interagency and international collaborations can provide important and useful means for improving statistical programs. Some issues, such as accessing and using new data sources (NRC, 2008a), are common to many statistical agencies and can benefit from collaborative research across organizations (see Practice 7).
Finally, it is important to note that the imperative to innovate implies that successful statistical agencies must be able to devote sufficient resources to many components of sustaining innovation on an ongoing basis. That is, agencies must be able to modernize and develop new products even as they continue reporting on a timely basis within their existing systems. Resource availability for innovation is now complicated by the rising costs of conducting existing surveys, due to falling response rates. Principle 5 is summarized in Box 3-5, below.
Key Message:
Federal statistical agencies must continually seek to improve and innovate their processes, methods, and statistical products to better measure an ever-changing world.
Key Supporting Practices: