Annual Report for FY 2023 Extramural Acquisition Innovation and Research Activities: Engaging Academia to Improve Acquisition Outcomes

Annual Report

Annual Report for FY 2023 Extramural Acquisition Innovation and Research Activities: Engaging Academia to Improve Acquisition Outcomes

PUBLISHED
March 2024

COMPLETED
January 2024

This third annual report from the Acquisition Innovation Research Center discusses AIRC’s efforts during fiscal year 2023 toward designing and piloting the Defense Civilian Training Corps; applying systems engineering to improve test and evaluation for defense acquisition programs; devising reform options for the Planning, Programming, Budgeting, and Execution (PPBE) Commission; and several other initiatives.

AIRC’s main goals include improving the acquisition ecosystem through various approaches (e.g., digital transformation, data science, systems engineering, workforce development, incentives alignment, artificial intelligence (AI), agile hardware/software development, and system/process integration and interoperability).

While AIRC is just three years old, the center is producing promising new and innovative ideas. Many of these ideas address major structural challenges and issues in defense acquisition and sustainment policy and practice. Major efforts such as DCTC illustrate what AIRC can do when provided with resources, DoD engagement, and support to address major DoD challenges.

Annual Report for FY 2022 Extramural Acquisition Innovation and Research Activities

Annual Report

Annual Report for FY 2022 Extramural Acquisition Innovation and Research Activities

PUBLISHED
October 2022

This report reflects on a growth year for AIRC after it was established in September 2020. Initial research projects and investments have matured and produced a large number of practical pilot ideas for tackling some of the DoD’s most enduring organizational challenges for improving acquisition outcomes. AIRC’s 32 initiatives to date involve a broad range of functions across acquisition as well as key inputs such as requirements and budgets (through the Planning, Programming, Budgeting, and Execution [PPBE] system).

The sponsor base over the first two years has grown to include 13 DoD entities. This reflects strong strategic engagement from entities across the Fourth Estate—organizations in the Office of the Secretary of Defense (OSD), the Joint Staff, and the Defense Agencies. AIRC is also working to strengthen its support from the Military Services to initiate important research tasks on key challenges.

In FY 2022, AIRC initiatives have produced thought-provoking and actionable results and outputs that hold potential for major improvements, such as:

  • New requirements approval processes that might cut requirement approval time in half.
  • Data strategy and tools that could improve decision making by more efficiently leveraging extramural analytic capabilities (while retaining needed security for sensitive data).
  • Pilots and activities to focus technological innovation and application on warfighting outcomes and priorities.

Annual Report for FY 2021 Extramural Acquisition Innovation and Research Activities

Annual Report

Annual Report for FY 2021 Extramural Acquisition Innovation and Research Activities

PUBLISHED
September, 2021

The FY 2020 National Defense Authorization Act (NDAA) mandated in section 2361(a) of title 10 U.S. Code, the establishment of an extramural acquisition innovation research activity in academia. In response and on behalf of the Secretary of Defense, the Under Secretary of Defense (USD) for Acquisition and Sustainment (USD(A&S))—with active support and involvement from the USD for Research and Engineering (USD(R&E))—created the Acquisition Innovation Research Center (AIRC) as part of the Systems Engineering Research Center (SERC), a Department of Defense (DoD) University Affiliated Research Center (UARC).

Initiated on September 30, 2020, AIRC involves 20 extramural U.S. universities in the SERC network plus collaboration with two military universities to provide innovative academic research, analysis, experiments, prototypes, and demonstrations on enduring challenges in defense acquisition policies, practices, education, and training.

The statutory activities of AIRC are:

  • research to improve acquisition policies and practices;
  • prototypes and demonstrations of new acquisition practices;
  • data repositories and analytical capabilities; executive education;
  • and ongoing reviews of the implementation of recommendations on acquisition policies and practices (see section 2361a(d) of title 10 U.S.C. for details).

IP Evaluation and Valuation Study

Research Reports

IP Evaluation and Valuation Study

PUBLIC RELEASE
March 2022

COMPLETED
October 2021

AUTHORS: Dr. Claudia Stewart, Karrie Wessing, JD, Mr. Michael Ryan, Richard Beutel, JD, and Ms. Sonia Kaestner
GEORGETOWN UNIVERSITY

This Study aimed to develop lean and appropriately customizable Intellectual Property (IP) management modalities that:

●  can be fully integrated into acquisition and product support strategies; and
●  can acquire only the necessary deliverables and license rights at the appropriate time to secure DoD’s interests throughout the product life cycle.

IP evaluation and valuation research was conducted through complementary projects:

●  a literature review that established baseline historic, existing, and emerging IP acquisition Multi-service Tactics, Techniques and Procedures (MTTPs) with regard to technical data and computer software;
●  interviews with subject matter experts; and
●  projects such as an IP Workshop and the development of a systemigram.

Information from each project was studied to determine impinging and mitigating factors for tension points between the Government and Industry. It became clear as work proceeded that there would be little access to actual negotiated contracts. This made untenable achieving deliverables regarding contracting involving IP and making specific recommendations regarding MTTPs. The focus was shifted to criticality of certain issues in the IP acquisition process. Among the recommendations generated from the research:

●  Focus on Valuation

●  Develop appropriate expertise for negotiations and related workforce education

● Use flexible contracting vehicles when possible

●  Incentivize small company and nontraditional commercial engagement with the Government

●  Address impediments created by an ensconced culture

IP Data Repository

Research Reports

IP Data Repository Study

PUBLIC RELEASE
March 2022

COMPLETED
October 2021

AUTHORS:  Dr. Laura Freeman and Dr. Brian Mayer
VIRGINIA TECH

In support of the Acquisition Innovation Research Center (AIRC), Virginia Tech was tasked to develop a data and electronic information repository for models, samples, templates, and exemplars of Intellectual Property (IP). Through the use of the “FAIR” principles (Findability, Accessibility, Interoperability, and Reusability), the team researched government data using a two-tiered approach that explored the requested data fields in the AIRC Performance Work Statement (PWS) and publicly available metadata to create a longitudinal topology of DoD contracting activity.

From the analysis of the available data on SAM.gov, the team constructed queries to build and update the tasked repository. The team created a semi-automated search tool for the SAM.gov database to structure acquisition data and enable further exploratory analysis of data on the DoD’s Major Defense Acquisition Programs (MDAPs), Other Transaction Authorities (OTAs), Vendor Contracted Organizations, Funding Organizations, and Patents. This semi-automated search tool enabled the team to explore more than 15M unique contracting activities across 12M unique PIIDs containing obligations of $1,797B in funding (2018-2021). This semi-automated tool may be applicable to SAM.gov as well as other download-limited APIs for future AIRC projects.

Although the team accomplished analysis on open-source SAM.gov data, full access to DoD contracting data is necessary for future AIRC Digital Data Strategy development. The team found access to DoD contracting data to be restricted and “view only”, which limited the application of analytics for improving decision making, curating data and developing an IP repository.

Digital Acquisition and Data Strategy Forum

Digital Acquisition and Data Strategy Forum

Hosted virtually on December 8, 2021: 9:00am – 1:00pm EST (ZoomGov)

THEMATIC FOCUS:

The objective of this forum is to help shape the vision, strategy, principles, and implementation steps for the DoD Digital Acquisition and Data Strategy that the DoD is developing for acquisition and sustainment. As you are aware, recent advances in data collection, storage, curation, and sharing—coupled with increased analytic capabilities from data science, machine learning, and artificial intelligence—have enabled organizations to fundamentally rethink how they organize, execute, and deliver improved and responsive capabilities. The digital transformation of practices and processes have the potential to revolutionize DoD acquisition and sustainment to improve warfighter capabilities at lower costs and at more responsive speeds. This forum will engage DoD, industry, and academia leaders in open discussion on digital transformation generally and its opportunities for improving defense acquisition outcomes. Our goals are to identify best practices and lessons learned from, identify key principles, discuss and improve our draft vision and strategy for transforming defense acquisition, coordinate and identify action officers from across the military departments and defense agencies, and identify next steps for implementation.

AGENDA: WEDNESDAY, DECEMBER 8, 2021 – 9:00 AM – 1:00 PM EST

WELCOME & OPENING REMARKS

Dr. Dinesh VermaExecutive Director, Acquisition Innovation Research Center

Dinesh Verma
Executive Director, AIRC

Mark Krzysko
SES, Principal Deputy Director, Data & Analytics, OUSD(A&S)

OPENING KEYNOTE: Transformation Best Practices and Lessons

Mike Sutcliff
CEO, Metta Industries, Inc.

Mike Sutcliff is the Retired Founder/Group CEO at Accenture Digital – a $22 billion dollar business unit with responsibility for the global Applied Intelligence practice.   The Applied Intelligence practice included a combination of data services, technology platforms, and more than 6000+ PhD/Master’s level data scientists working across industries on a global basis.  Mike retired after 34 years at Accenture in March 2020.  Mike is currently working as an Operating Partner with Advent Private Equity evaluating and coaching companies in the technology, data, and applied intelligence markets.  He is active on three boards of directors and launching three startup companies in the healthcare, digital content, and technology markets. Mike is CEO of a technology startup company in stealth mode with plans to introduce new technologies to the market in 2022.

DoD Digital Acquisition and Data Strategy

Phil Anton
Stevens

Laura Freeman
Virginia Tech

EXECUTIVE PANEL: Challenges, Opportunities, and Next Steps for Digital Acquisition

Mark Krzysko
moderator

TRANSFORMATION PANEL: Lessons, Principles, and Feedback from Industry Transformation Experts

Laura Freeman
moderator

CHALLENGE KEYNOTE

Steve Blank
Adjunct Professor, Stanford University & Founding Faculty Member, The Gordian Knot Center for National Security Innovation

Steve Blank is an Adjunct Professor at Stanford and Senior Fellow for Innovation at Columbia University. He has been described as the Father of Modern Entrepreneurship.  Credited with launching the Lean Startup movement and the curriculums for the National Science Foundation Innovation Corps and Hacking for Defense and Diplomacy, he’s changed how startups are built; how entrepreneurship is taught; how science is commercialized, and how companies and the government innovate.

Steve is the author of The Four Steps to the Epiphany and The Startup Owner’s Manual which revolutionized how startups were built– and his May 2013 Harvard Business Review cover story redefined how large companies can innovate at speed.

Steve is a founding faculty member of the Gordian Knot Center for National Security Innovation at Stanford, where his latest class is Technology, Innovation and Great Power Competition, is providing crucial insight on how technology will shape all the elements of national power (our influence and footprint on the world stage).

FUNCTIONAL PANEL: Digital Innovation Opportunities

Philip Anton
moderator

WRAP UP & NEXT STEPS

Mark Krzysko

2021 Annual Sponsor Research Review

2021 Annual Sponsor Research Review

EVENT OVERVIEW     |     KEYNOTE     |      SAFETY

nov2

NOVEMBER 2

ACQUISITION INNOVATION / RESEARCH TRANSITION

National Press Club | HYBRID


Learn about the new Acquisition Innovation Research Center (AIRC)

Explore Initial AIRC Research

Join us for a Keynote and Panel on Acquisition Innovation

See demos of research that has transitioned to the systems engineering and acquisition communities in:
+ Digital Engineering
+ Mission Engineering
+ Security Engineering
+ Policy Engineering

nov3

NOVEMBER 3

SYSTEMS ENGINEERING RESEARCH

VIRTUAL


Join us for a Keynote and Panel on Systems Engineering Modernization

Explore the latest SERC research:
+ Digital Engineering
+ Mission Engineering
+ Trusted Systems
+ Velocity
+ AI & Autonomy
+ Human Capital Development

nov4

NOVEMBER 4

STUDENT
RESEARCH

VIRTUAL


NEW! Free tutorials:
+ Digital Engineering
+ Security Engineering
+ Explore the latest SE doctoral research

See the 2021 SERC ANNUAL RESEARCH REVIEW (sercuarc.org) announcement for further information and to register.

KEYNOTE

Mr. Christopher C. O’Donnell

Performing the Duties of the Assistant Secretary of Defense for Acquisition

FULL BIOGRAPHY

Mr. Chris O’Donnell is currently performing the duties of the Assistant Secretary of Defense for Acquisition. In this position, he advises the Under Secretary of Defense for Acquisition and Sustainment (USD(A&S)), the Deputy Secretary of Defense, and the Secretary of Defense on matters relating to the Department of Defense (DoD) Acquisition System, acquisition program management, and the development of strategic, space, intelligence, tactical warfare, command and control, and business systems.

Prior to coming to the Pentagon, he was the Head of the Acquisition and Technology Department, at the Naval Explosive Ordnance Disposal Technology Division. He led a group of scientists, engineers and technicians that develop, test, acquire and maintain equipment for the over 5,000 Joint Service Explosive Ordnance Disposal (EOD) Technicians. He has received the Office of the Secretary of Defense Medals for Exceptional and Meritorious Civilian Service, two Navy Superior Civilian Service Awards, a David Packard Excellence in Acquisition Award, a Secretary of Defense Award for Excellence and a Naval Sea Systems Command Collaboration Award. He is married to Amy, the Deputy Technical Director at the Naval Surface Warfare Center, Indian Head. Their three children are Alan, a Virginia Tech Electrical Engineer; Calaa, a University of Washington Architect; and Caitie, a Clemson Electrical Engineer.

PANEL ON AIRC SYSTEMIC IMPACT

Preceding the Panel, the following three briefings discussing systemic issues around acquisition innovation were delivered:

– “Digital Acquisition & Sustainment: A Vision and Strategy for Improving Outcomes​” by Dr. Philip S. Antón, AIRC Chief Scientist

– “Transforming Public-Private Ecosystems: Understanding and Enabling Innovation in Complex Systems” by Dr. William “Bill” B. Rouse, Georgetown University

– “Acquisition Policy Test Range and Operations ” by Dr. Dennis K. McBride, Virginia Tech

Jeannette Evans-Morgis
Paul Mann
Mr. Mark E. Krzysko, SES
Principal Deputy Director for Acquisition Data and Analytics within OSD
Philomena Zimmerman

Jeannette Evans-MorgisSES, Chief Systems Engineer, Department of the Army

Paul MannSES, Chief Systems Engineer, Department of the Navy

Mark Krzysko, SES, Principal Deputy Director, Data & Analytics, OUSD(A&S)

Philomena ZimmermanDirector, Engineering Tools and Environments, OUSD(R&E)

Moderated by  Dr. Dinesh Verma, Executive Director, AIRC

SAFETY

– All event attendees are expected be fully vaccinated before coming to the Club for any reason. Visitors may be asked to provide proof of vaccination or a negative COVID-19 test result taken within the last 72 hours.

– Complete the screening process and have your temperature scanned. (A fever is generally described as a body temperature above 100.4 degrees Fahrenheit.) Entry may be denied based on results of screening.

– Per DC Mayor Bowser’s Order #2021-097, effective July 31, 2021 the District of Columbia requires all persons over the age of two (regardless of vaccination status) to wear a mask or face covering in all indoor spaces, except when actively consuming food or drink.

– Practice proper hygiene and sanitization including hand washing and the use of touchless hand sanitizer dispensers throughout the Club in accordance with CDC recommendations.

LEARN MORE: National Press Club Safety Protocols

Fall 2021 Acquisition Innovation Forum

FALL 2021
Acquisition Innovation Forum

Intellectual Property Valuation in the Defense Acquisition Process

Hosted virtually on September 9, 2021: 9:00am – 1:00pm EST (ZoomGov)

THEMATIC FOCUS:

Intellectual Property Valuation in the Defense Acquisition Process

For the DoD to maintain its competitive edge globally, it must be able to rapidly improve its capabilities, which includes increased engagement with the commercial sector to acquire novel and/or rapid upgrade technologies – particularly from small companies and nontraditional contractors. Cost-effective IP acquisition for the government must account for program life-cycle needs as well as the value of the commercial provider’s IP within their business model. An understanding of each other’s minimal IPR requirements will lead to better tailored negotiations and contracts.

Development of appropriately customizable IP management modalities that can be fully integrated into acquisition and product support strategies, that are lean and cost-effectively acquire only the necessary deliverables and license rights at the appropriate time to secure DoD’s interests throughout the product life cycle, as well as development of metrics to assess the outcomes of novel contracting approaches and preparedness of the acquisition workforce will facilitate more “successful” negotiations.

A set of panel discussions on the challenges in IP valuation and its impacts on technology acquisitions and innovation in the DoD, including new approaches to address the issues.

This workshop is for thought leaders, acquisition practitioners, and interested researchers from the government, industry and academia.

The aim of the workshop is to elucidate the issues and challenges facing the defense acquisition community in technology, data rights and software acquisitions, particularly with regard to valuation of intellectual property and impacts on innovation within the DoD.

Panelists and participants will help to identify critical aspects of the IP valuation and acquisition process that can be addressed to improve the process and enhance innovation, with suggested topic areas for additional study by teams of academics, government personnel and industry representatives.

AGENDA: THURSDAY, SEPTEMBER 9, 2021 – 9:00 AM – 1:00 PM EST

Introduction to AIRC

Dr. Dinesh Verma, Executive Director, SERC & AIRC

PANEL 1: Evaluating IP’s Role in Driving Innovation and Competitiveness

Moderator:
Stan Soloway, President and CEO, Celero Strategies, LLC.

PANELISTS

Moshe Schwartz_sq

Alison Brown, President and CEO, NAVSYS Corporation
William C. Greenwalt, Nonresident Senior Fellow at the American Enterprise Institute
Adriana Luedke, Director and Associate General Counsel, Lockheed Martin
Moshe Schwartz, President, Etherton and Associates

KEYNOTE:
John Tenaglia, Principal Director, Defense Pricing and Contracting, Department of Defense

Introduction of Keynote Speaker
Richard Gray, Director, Intellectual Property Cadre, OUSD (Acquisition & Sustainment)

PANEL 2: IP Valuation: Impacts on Industry Engagement and Innovation

Moderator:
Steven Schooner, Esq., Nash & Cibinic Professor of Government Procurement Law, George Washington University

PANELISTS

Lorna_Tedder_sq

Bill Elkington, Managing Member, Mind IC
Ben McMartin, Managing Partner, Public Spend Forum
Lorna Tedder, Principal DoD Program Manager and Agile Acquisition SME, The MITRE Corporation
Tim Webb, Venture Capitalist and Independent Entrepreneurship Consultant

DISCUSSION

Outcomes and Closing Remarks

Defense Data Grand Prix 2022-2023

Defense Data Grand Prix 2022-2023

Faculty-Led Applied Data Science Opportunity

The Department of Defense (DoD) is seeking faculty-led student teams to tackle compelling, real-world problems with data science. These challenges offer ready-made practicums that can be integrated with graduate courses and research seminars.

The Acquisition Innovation Research Center (AIRC)—a partnership of 22 U.S. universities—has established a Defense Data Grand Prix prize competition that allows you and your students to get access to these data and problems in semester-long competitions.  

The Defense Data Grand Prix is a challenge effort to solve the most difficult data science issues faced within our government today. These include technology as well as non-technology barriers to enterprise analytics.  For example, the Defense Logistics Agency handles over $42B in goods and services annually from food, equipment, fuel, and armament causing vast amounts of data in our supply-chain tracking system.  The DLA needs to fuse this vast amount of data, optimize it, and analyze it through cutting-edge applications. To leverage modern data science approaches to bear, DLA must grapple with system and data architectures and data governance policies. DLA is soliciting innovative solutions to these and other data science barriers.

In Heat 1, teams worked with DLA analysts to recommend ways to improve access to applicable data. Heat 2 focused on implementing approaches to making data accessible for analyses. Click here for more information on Heats 1 and 2.

Competitors will apply advanced data visualization techniques on findings from the defense acquisition data in Heat 3. Teams may investigate problems such as:

• Aviation Supplier Predictions
Manufacturing Stores and Materiel Shortages
Balancing Freedom of Information with Operations Security
Industrial Capability Program Material Identification

KEY DATES   |   OVERVIEW    |   CONTACT

CHALLENGE STRUCTURE OVERVIEW

The Defense Data Grand Prix is a three heat, 18-month competition to encourage collaboration among academic teams, government sponsors, and corporate sponsors.   It is designed to afford maximum interaction between sponsors and competitors, and reward innovation and shareable findings. Awards will be made to the top teams through their universities after each heat for the authoring and submission of full reports and supporting materials from their efforts. Submissions will be shared amongst all competitors to promulgate best practices and concepts in subsequent heats.  Competitor teams may participate in any or all heats.

HEAT 1

HEAT 1: PLANNING

FALL 2021

Competitors will propose data science objectives and approaches to creating data access and analytics methods. The final submission will be a white paper.

HEAT 2

HEAT 2: ACCESS

SPRING 2022

Competitors will demonstrate scalable access and sharing of real, transformed, or synthetic defense acquisition data. The final submission will be the relevant accessible data sets, a briefing and/or white paper describing their data set, data dictionary and information security, access, and sharing guidelines.

HEAT 3

HEAT 3: ANALYTICS

FALL 2022

Competitors will apply advanced analytics and visualize findings from defense acquisition data.  The final submission will be a white paper and/or briefing, or demonstration of analytic approach(es) and findings.

Within each heat, competition divisions will be established that align with government data owners/sponsors priorities. Competitors will self-select the division in which they intend to compete. Judging will be conducted, and awards administered between the divisions.

A few of the example problem areas include:
Foreign Military Sales (FMS) Order Processing Levels
Predicting Lead-Time Variability
Purchase Request Workload Management Tool
AI Technologies, Freedom of Information Act (FOIA) and Operations Security

At the beginning of each heat, competitors will be provided an overview of operational problems, data characteristics, and other information relevant for their challenge.  This will be via remote video conference, and competitors will select their division after this seminar.

Unlike other data competitions in which problems are well defined and sample data are provided, this competition will begin with problem identification and data inspection.  Teams will be encouraged to work with government sponsors to understand their problems, data, and constraints.  This collaboration will begin with an informational seminar arranged by AIRC at the beginning of each heat.  Subsequent interactions between government sponsors and competitors will be determined and coordinated by the sponsors.  Teams will be expected to address ethics, leadership, and project management.  Successful teams in this competition will:

  1. Participate in government sponsor seminars with other competitors to learn about data, problems and organizations;
  2. Document data and information system architectures to determine curation and sharing needs and constraints;
  3. Apply ethical and legal considerations;
  4. Identify high impact approaches and rationally select among them;
  5. Implement mathematical approaches based on sponsor needs;
  6. Exercise project management skills and effectively contribute to a team;
  7. Interact with a client and deliver the project’s outcomes; and
  8. Effectively provide or present findings to government sponsors.

The Defense Data Grand Prix is a partnership of multiple DoD components.  The principal sponsors are:

DoD Chief Data Officer (CDO) is responsible for strengthening data management across the DoD and accelerating the transition to a data-centric culture.  The CDO oversees the implementation of the DoD Data Strategy, the data governance process, data standards and policies, and the promotion of data acumen across the DoD workforce.

Office of the Under Secretary of Defense for Acquisition and Sustainment (OUSD (A&S)) is responsible for all matters relating to acquisition, including the Defense Acquisition System; system design and development; production; logistics and distribution; installation maintenance, management, and resilience; military construction; procurement of goods and services; material readiness; and maintenance.

Defense Logistics Agency (DLA) and Headquartered in Fort Belvoir, VA, DLA manages the end-to-end global defense supply chain for the five military services, 11 combatant commands, other federal, state, and local agencies and partner and allied nations.  DLA provides more than $40B in goods and services annually.  It supplies 86 percent of the military’s spare parts and nearly 100 percent of fuel and troop support consumables and manages the reutilization of military equipment.

Heat 1 – Fall 2021

23 August – 26 September 2021: Registration

29 September 2021: Orientation Seminar

√ 30 January 2022: Submissions Due

√ 1–4 February 2022: Judging

√ 14 February 2022: Award Ceremony / Submissions Published

Heat 2 – Spring 2022

√ 13 December 2021 – 14 February 2022: Registration

√  28 March 2022: Orientation Seminar

√  30 June 2022: Submissions Due

√  1-8 July 2022: Judging

√  11 July 2022: Award Ceremony / Submissions Published

Heat 3 – Fall 2022

√  1 July – 9 September 2022: Registration

√  13 September 2022: Heat 3 Begins (Orientation Seminar)

√  15 December 2022: Submissions Due

√   19 – 23 December 2022: Judging

√  January 2023: Award Ceremony / Submissions Published

Based on selection by the DoD, awards will be made to the top teams through their universities in compensation for the authoring and submission of full reports and supporting materials from their efforts.

Heat 1: $100k ($40k first place, $30k second place, $20k third place, $10k fourth place)

Heat 2: $100k ($40k first place, $30k second place, $20k third place, $10k fourth place)

Heat 3: $100k ($40k first place, $30k second place, $20k third place, $10k fourth place)

Winning teams will receive award certificates from a senior DoD official in recognition of their accomplishments.

  1. Teams must be coached or led by an eligible university faculty member. A faculty member may coach more than one team but will be limited to one award.
  2. There are no restrictions on the number of teams that can participate from any eligible academic institution.
  3. Teams will be required to sign non-disclosure and data sharing agreements with government sponsors.
  4. All findings will be open source.
  5. Competitors may be sponsored by extramural entities. Any such relationships are the responsibility of the individual teams.
  6. Competitors are subject to the rules and policies of their academic institution.
  7. Federal employees who represent eligible academic institutions may compete but are ineligible for cash prizes.

1. Heat 1:  The final submission will be a white paper describing their effort and results.

The best teams will be selected by the DoD to receive an award through their universities to develop and provide a full report, data, and algorithms on their effort.

2. Heat 2: Competitors will demonstrate scalable access and sharing of real, transformed, or synthetic defense acquisition data. The final submission will be the relevant accessible data sets, a briefing and/or white paper describing their effort, data, and results.

The best teams will be selected by the DoD to receive an award through their universities to develop and provide a full report, data, and algorithms on their effort, including the data set with a data dictionary and information security, access, and sharing guidelines.

3. Heat 3: Competitors will apply advanced analytics and visualize findings from defense acquisition data. The final submission will be a white paper and/or briefing, or demonstration of analytic approach(es) and findings. The use of multimedia is permitted here but no voice-over should be used. The presentations (when applicable) should be created as either a PowerPoint file or a PDF document. Multimedia files may be included as .mp4 files inside a zipped folder with the presentation, along with a readme coversheet.

The best teams will be selected by the DoD to receive an award through their universities to develop and provide a full report, data, and algorithms on their effort.


Information on submissions for all heats:

Multiple files will be submitted in a zip file. A coversheet that acts as a “readme” should be included and should explain clearly each file included in the zipped folder. Since the data set may be very large, it may be shared using an online platform (Google Drive, Dropbox, etc.) and teams will provide a shareable download link. This link must be accessible for at least six months beyond the duration of the competition.

To enable double-blind judging, submissions shall not include any personally identifying information (PII) including implied ownership of cited works (you can cite prior work, but you cannot allude to it being your prior work). Any such PII will be redacted prior to judging. The name of the team and its members may be included on a cover page, preferably submitted as a separate document along with the other products in a zip file and labeled “Team Members.” The zip file itself can contain the Team name used at the time of registration.

Submissions shall not contain any hyperlinks to outside webpages or other documents, unless allowed for explicitly in a specific heat.

Submissions in Heats 1 and 2 shall not contain any multimedia (e.g., videos, animations).

Participants in Heats 2 and 3 do not have to continue using their proposed methodology or the data that was personally acquired in a previous heat. All products from previous heats are open-source and are therefore “fair-game” to use by anyone in later heats.

Heat 2 of the Defense Data Grand Prix is open to teams of participants from the universities in the SERC/AIRC collaborator network.[1] and HBCU/MSI institutions.[2]  Future heats are intended to be open to more institutions, subject to approval by the Contracting Officer.  All team members must be from the same academic institution. All members of participating teams must be U.S. citizens or U.S. Permanent Residents and be 18 years of age or older as of 30 August 2022.

Violation of the rules contained herein or intentional or consistent activity that undermines the spirit of the Challenge may result in disqualification. The Challenge is void wherever restricted or prohibited by law.

[1]  The SERC/AIRC collaborator universities are: Auburn, Carnegie Mellon, Georgetown, Georgia Tech, Massachusetts Institute of Technology (MIT), Old Dominion, Penn State, Purdue, Stevens Institute of Technology (lead), Texas A&M, University of Alabama in Huntsville, University of Massachusetts Amherst, University of Maryland, University of Southern California (USC), University of Virginia, and Virginia Tech. Collaborating military universities include the Air Force Institute of Technology and the Naval Postgraduate School.

[2] Historically Black Colleges and Universities (HBCUs) and Minority Serving Institutions (MSIs) are encouraged to participate in this Challenge.

The following terms and conditions apply to all participants in this Challenge.

Publication:  Teams are encouraged to publish their activities and findings from this competition.  Participants agree to confer, consult, and acquire the consent of the Government prior to the publication or presentation of any Challenge materials, materials associated with the Challenge, or data derived from the Challenge, to assure that no PROPRIETARY INFORMATION or RESTRICTED-ACCESS INFORMATION is released, patent rights are protected, accuracy is ensured, and that no claims are made on behalf of the Government. Publication and/or presentation may be delayed for a reasonable time to afford needed protection.

Costs: The Government and AIRC are not responsible for any costs incurred by challenge participants, including the development of white papers, quad charts, presentation materials, the model, travel, technology, demonstrations, and any other associated costs. All costs incurred throughout the execution of the Challenge are the responsibility of the participants.

Results of the Challenge: Winners will be announced at the conclusion of each heat. AIRC will also announce the winners on the AIRC website and social media channels.

Release of Claims: The participant agrees to release and forever discharge any and all manner of claims, equitable adjustments, actions, suits, debts, appeals, and all other obligations of any kind, whether past or present, known or unknown, that have or may arise from, are related to or are in connection with, directly or indirectly, this challenge or the participant’s submission.

Compliance with Laws: The participant agrees to follow and comply with all applicable federal, state, and local laws, regulations, and policies.

Governing Law: This challenge is subject to all applicable federal laws and regulations. ALL CLAIMS ARISING OUT OF OR RELATING TO THESE TERMS WILL BE GOVERNED BY THE FEDERAL LAWS AND REGULATIONS OF THE UNITED STATES OF AMERICA.

Indemnification: Because of the number of anticipated challenge entries, AIRC cannot and will not make determinations on whether third-party materials in the challenge submissions have protectable intellectual property interests. By participating in this challenge, each participant (whether participating individually, as a team, or as a commercial entity) warrants and assures the Government that any data, analytic approaches, systems, algorithms, or other intellectual property (IP) used for the purpose of submitting an entry for this challenge, were obtained legally and through authorized access to such data, tools, or IP. By entering the challenge and submitting the challenge materials, the participant agrees to indemnify and hold the Government and SERC/AIRC universities harmless against any claim, loss, or risk of loss for patent or copyright infringement with respect to such third-party interests.

Publicity: The Participants may be featured on Federal and SERC/AIRC websites, in newsletters, social media, and in other print and electronic outreach materials. Except where prohibited, participation in this Challenge constitutes the consent to the DoD or AIRC’s use of each Participant’s name, likeness, photograph, logo, voice, opinions, public summary, and hometown and state information for promotional purposes through any form of media, worldwide, without further permission, payment, or consideration.

Due to the nature and objectives of this competition, all findings submitted for judging will be open source.  The DoD and SERC/AIRC are granted the right to publicize Participant names and, as applicable, the names of Team members and legal entities that participated in the submission following the conclusion of the Challenge. By participating in the Challenge, each Participant represents and warrants that they are the sole author or owner of IP in connection with the submission, or otherwise has the necessary rights to use the submission for purposes of the Challenge, including having any and all rights necessary to grant the license rights identified in this section. Each Participant further represents and warrants that the Submission does not infringe any copyright or any other rights of any third party of which the Participant is aware. If open-source code is used in this Challenge, then Participants must only use open-source code licensed under an open-source initiative-approved license (see www.opensource.org) that in no event limits commercial use of such code or model containing or depending on such code.

Judging Panel

The judging panel will consist of AIRC staff members and representatives from government sponsor agencies. Final award selection will be made by DoD officials.

Judging Criteria

Each team will produce a final product that will be evaluated by multiple judges from various partnering institutions and sponsors. The product specifications are subject to change for the different heats, as detailed previously in the Challenge Structure Overview and Team Submissions sections.

Each submission will be judged based on the following criteria with each judge independently scoring each solution on a scale of 1–4 for each category.  Rankings for each division will be selected by adding all judges’ scores to determine the highest scoring solution.

Impact:  To what degree will the approach positively impact the sponsor’s mission?

Acceptability:  How broadly can this approach be implemented?  Is the approach aligned with DoD and Federal equities?

Suitability: To what degree does the approach suit the needs of the sponsor?

Feasibility: To what degree do technical or workforce hurdles to scaled implementation exist?  Are associated costs affordable and commensurate with the expected benefits?

Judging will be performed in a “double-blind” fashion to avoid bias. This scheme also requires that participants not include any language that may identify them or their previous works (including work done during previous heats or efforts from outside the competition that can be used to identify them).

CALL FOR RESEARCH PROPOSALS

2021 Phase I
Call for Research Proposals

Closed for submissions

The deadline has now passed and this call is closed to any further submissions.

The following is an open call to all faculty, fellows, and research staff at SERC/AIRC universities for 2-page research proposals related to the topics included in this solicitation. Our intent is to also consider proposals from faculty at non-SERC/AIRC universities within the United States.

This is not a formal government solicitation but rather a mechanism to reach out to existing and potential colleagues within academia to participate with us in this endeavor. Research proposals will be assessed for funding as incubator research projects for the Summer of 2021.

Research Topic Categories

  1.   Workforce Upskilling under Continuous Change
  2.   Management and Business Knowledge Representation for Decision-Making
  3.   Aligning Workforce and Organizational Incentives for Agility and Innovation
  4.   Innovative Test Approaches to Enhance Organizational Agility
  5.   Return-on-Investment from Digital Transformation

Proposers Meeting:

A virtual meeting was held to further explain this research funding opportunity, clarify the simple process involved, and answer questions. For more information, a recording of the meeting and FAQs are available below.

To apply for Phase I incubator funding, submit a short description of your proposed research concept, addressing the first six Heilmeier Catechism [1] criteria  used to “help Agency officials think through and evaluate proposed research programs,” namely:

  1. What are you trying to do? Articulate your objectives using absolutely no jargon.
  2. How is it done today, and what are the limits of current practice?
  3. What is new in your approach and why do you think it will be successful?
  4. Who cares? If you are successful, what difference will it make?
  5. What are the risks?
  6. How much will it cost? [i.e., How much are you requesting for Phase 1?] [2]

Proposals and all supporting material must be concise; proposals must be no longer than two (2) pages in length. An additional page can be included to contain endnote references, graphics, and URL links to faculty/researcher bios or CVs. Include the names of the research team, lead university, partner universities (if any), and research challenge area with the title of your proposed research task. Format should be text extractable PDFs or Microsoft Word files.

The overall value of the submissions will be judged based on several criteria, including: intellectual merit, clarity of the vision, novelty, past performance of the investigators, the potential strategic impact on and importance for the DoD, and the degree of taking full advantage of academia’s multi-disciplinary research capabilities. For past performance, please include references to previous research reports and published papers. If there are other sponsors within the DoD who may be interested in your proposed research and might provide matching funds or project guidance, please include this information as well.

Submissions should be made through the AIRC website submission form tab. Research proposal responses are due by May 14, 2021 by 11:59 pm EDT.

Please contact Ms. Kara Pepe at kpepe@stevens.edu if you have any questions about this research opportunity or the proposal response format.

———-

[1] https://www.darpa.mil/work-with-us/heilmeier-catechism

[2] Note: If your Phase I summer seedling is successful, the Phase II proposal generated during Phase I will need to address all criteria in the Heilmeier Catechism, including the last two:

  1. How long will it take?
  2. What are the mid-term and final “exams” to check for success?

19 APRIL 2021
Call for Research Proposals Open

28 APRIL 2021
Proposers Meeting
3:00 pm EDT (12:00 pm PDT)

14 MAY 2021
Proposals Due

14 JUNE 2021
Awards Announced