Opportunity

Safeguarded AI: Theory

  • ADVANCED RESEARCH AND INVENTION AGENCY

F02: Contract notice

Notice reference: 2024/S 000-011717

Published 11 April 2024, 9:28am



Section one: Contracting authority

one.1) Name and addresses

ADVANCED RESEARCH AND INVENTION AGENCY

96 EUSTON ROAD,

LONDON

NW12DB

Email

clarifications@aria.org.uk

Country

United Kingdom

NUTS code

UKI31 - Camden and City of London

Justification for not providing organisation identifier

Not on any register

Internet address(es)

Main address

https://www.aria.org.uk/programme-safeguarded-ai/

one.3) Communication

The procurement documents are available for unrestricted and full direct access, free of charge, at

https://www.aria.org.uk/programme-safeguarded-ai/

Additional information can be obtained from the above-mentioned address

Tenders or requests to participate must be submitted electronically via

https://www.aria.org.uk/programme-safeguarded-ai/

one.4) Type of the contracting authority

Body governed by public law

one.5) Main activity

General public services


Section two: Object

two.1) Scope of the procurement

two.1.1) Title

Safeguarded AI: Theory

two.1.2) Main CPV code

  • 73110000 - Research services

two.1.3) Type of contract

Services

two.1.4) Short description

ARIA is an R&D funding agency built to unlock scientific and technological breakthroughs that benefit everyone. We empower scientists and engineers to pursue research at the edge of what is technologically or scientifically possible.

We reach across disciplines, sectors and institutions to shape, fund and manage projects across the R&D ecosystem, from startups to universities, to break down silos and discover new pathways.

We're looking for proposals for Safeguarded AI: Theory, for info see https://www.aria.org.uk/programme-safeguarded-ai/

two.1.6) Information about lots

This contract is divided into lots: No

two.2) Description

two.2.2) Additional CPV code(s)

  • 73110000 - Research services

two.2.3) Place of performance

NUTS codes
  • UK - United Kingdom

two.2.4) Description of the procurement

As AI becomes more capable, it has the potential to power scientific breakthroughs, enhance global prosperity, and safeguard us from disasters. But only if it's deployed wisely.

Current techniques working to mitigate the risk of advanced AI systems have serious limitations, and can't be relied upon empirically to ensure safety. To date, very little R&D effort has gone into approaches that provide quantitative safety guarantees for AI systems, because they're considered impossible or impractical.

By combining scientific world models and mathematical proofs we will aim to construct a 'gatekeeper', an AI system tasked with understanding and reducing the risks of other AI agents.

In doing so we'll develop quantitative safety guarantees for AI in the way we have come to expect for nuclear power and passenger aviation.

Our goal: to usher in a new era for AI safety, allowing us to unlock the full economic and social benefits of advanced AI systems while minimising risks.

For more info see https://www.aria.org.uk/programme-safeguarded-ai/

two.2.5) Award criteria

Price is not the only award criterion and all criteria are stated only in the procurement documents

two.2.6) Estimated value

Value excluding VAT: £2,900,000

two.2.7) Duration of the contract, framework agreement or dynamic purchasing system

Duration in months

12

This contract is subject to renewal

No

two.2.10) Information about variants

Variants will be accepted: No

two.2.11) Information about options

Options: Yes

Description of options

Additional funding, scope and duration could be added to any contracts awarded.


Section three. Legal, economic, financial and technical information

three.1) Conditions for participation

three.1.1) Suitability to pursue the professional activity, including requirements relating to enrolment on professional or trade registers

List and brief description of conditions

See ARIA website https://www.aria.org.uk/programme-safeguarded-ai/


Section four. Procedure

four.1) Description

four.1.1) Type of procedure

Competitive procedure with negotiation

four.1.8) Information about the Government Procurement Agreement (GPA)

The procurement is covered by the Government Procurement Agreement: No

four.2) Administrative information

four.2.2) Time limit for receipt of tenders or requests to participate

Date

28 May 2024

Local time

12:00pm

four.2.4) Languages in which tenders or requests to participate may be submitted

English


Section six. Complementary information

six.1) Information about recurrence

This is a recurrent procurement: No

six.3) Additional information

Detailed timelines can be found in the programme call information on ARIAs website: https://www.aria.org.uk/programme-safeguarded-ai/

The application process consists of one stage:

- Submission of a proposal - the deadline for submission of proposals is 28.05.24 (12:00 BST).

The total funding value is the estimated budget available. We expect to fund multiple applicants.

Funding is anticipated to be award via both contracts and grants. For information on how we fund https://www.aria.org.uk/faqs-funding/

six.4) Procedures for review

six.4.1) Review body

Not Applicable, see the ARIA Act 2022

London

Country

United Kingdom