Research Reports

Digital Data Management and Analytic Pilots

PUBLIC RELEASE
March 2025

COMPLETED
August 2024 (Revision)

AUTHORS:  Dr. Philip S. Antón1, Dr. Laura Freeman2
STEVENS INSTITUTE OF TECHNOLOGY 1, VIRGINIA TECH NATIONAL SECURITY INSTITUTE 2

This technical report describes the follow-on efforts for Digital Data Management and Analytic Pilots, which focused on establishing use cases for innovative analyses of acquisition data, and establishing a data science environment for analysis of sensitive acquisition data known as DARCIE: Defense Acquisition Research, Collaboration and Innovation Environment. These efforts are consistent with the initiatives outlined in IDEAS: Innovative, Data-Enabled Acquisition Strategy.

Building on the successful establishment of the pilot DARCIE 1.0 environment in the previous research task, this new research task identified the requirements to develop the next phase of DARCIE. Two primary goals were to expand access and improve the user experience. The AIRC research team held conversations with three Federally Funded Research and Development Centers (FFRDCs) to understand the lessons that they learned in establishing their enclaves for processing controlled unclassified information (CUI). The researchers also met with Snowflake, Palantir and Scale AI to discuss their capabilities and ways they could potentially contribute to the DARCIE environment. This information served as inputs to the research team, which then developed a baseline set of requirements for further development of DARCIE.

The research team found that the need for DARCIE continues to be strong as the pilot DARCIE environment was used to support analysis of Department of Defense (DoD) obligation data by the Planning, Programming, Budgeting, and Execution (PPBE) Reform Commission. The U.S. Marine Corps also piloted the use of DARCIE for analysis of CUI for the Defense Data Grand Prix, providing a model for how CUI data competitions could take place within the AIRC. Additionally, the research team met several times with representatives from the U.S. Air Force Research Institute for Tactical Autonomy to figure out the best methods to support their needs.

The research team recommends continued DARCIE development as the need remains strong. The resulting infrastructure will help achieve the intent of the statute that established AIRC, which included provisions to establish data repositories and develop analytical capabilities to enable researchers and acquisition professionals to access and analyze historical data sets to support research and develop new policies and practices.