Contract

AISI ChemBio - LLM Benchmarking (Chem)

  • DESNZ & DSIT Group Commercial

F03: Contract award notice

Notice identifier: 2025/S 000-005318

Procurement identifier (OCID): ocds-h6vhtk-048a68

Published 17 February 2025, 11:04am



Section one: Contracting authority

one.1) Name and addresses

DESNZ & DSIT Group Commercial

22-26 Whitehall

London

SW1A 2EG

Contact

Joseph Sewell

Email

joseph.sewell@dsit.gov.uk

Country

United Kingdom

Region code

UK - United Kingdom

Internet address(es)

Main address

https://www.aisi.gov.uk/

one.4) Type of the contracting authority

Ministry or any other national or federal authority

one.5) Main activity

General public services


Section two: Object

two.1) Scope of the procurement

two.1.1) Title

AISI ChemBio - LLM Benchmarking (Chem)

two.1.2) Main CPV code

  • 73000000 - Research and development services and related consultancy services

two.1.3) Type of contract

Services

two.1.4) Short description

AISI requires a Supplier to help develop it evaluations related to chemistry and biology (CB). The Supplier will help deploy and expand its automated benchmarking suite and support its human uplift studies related to biological capabilities. Supplier(s) will develop questions or tasks, develop grading rubrics, and provide expert human baselines and expert human grading. For each deliverable, AISI will provide detailed guidance.

two.1.6) Information about lots

This contract is divided into lots: No

two.1.7) Total value of the procurement (excluding VAT)

Value excluding VAT: £950,000

two.2) Description

two.2.3) Place of performance

NUTS codes
  • UK - United Kingdom

two.2.4) Description of the procurement

AISI requires a Supplier to help develop it evaluations related to chemistry and biology (CB). The Supplier will help deploy and expand its automated benchmarking suite and support its human uplift studies related to biological capabilities. Supplier(s) will develop questions or tasks, develop grading rubrics, and provide expert human baselines and expert human grading. For each deliverable, AISI will provide detailed guidance.

two.2.5) Award criteria

Price

two.2.11) Information about options

Options: No

two.2.13) Information about European Union Funds

The procurement is related to a project and/or programme financed by European Union funds: No


Section four. Procedure

four.1) Description

four.1.1) Type of procedure

Open procedure

four.1.8) Information about the Government Procurement Agreement (GPA)

The procurement is covered by the Government Procurement Agreement: Yes

four.2) Administrative information

four.2.1) Previous publication concerning this procedure

Notice number: 2024/S 000-025623


Section five. Award of contract

Contract No

6988

Title

LLM Benchmarking (Chem)

A contract/lot is awarded: Yes

five.2) Award of contract

five.2.1) Date of conclusion of the contract

10 February 2025

five.2.2) Information about tenders

Number of tenders received: 3

Number of tenders received by electronic means: 3

The contract has been awarded to a group of economic operators: No

five.2.3) Name and address of the contractor

Deloitte LLP

London

Country

United Kingdom

NUTS code
  • UK - United Kingdom
The contractor is an SME

No

five.2.4) Information on value of contract/lot (excluding VAT)

Initial estimated total value of the contract/lot: £950,000

Total value of the contract/lot: £950,000

five.2.5) Information about subcontracting

The contract is likely to be subcontracted

Value or proportion likely to be subcontracted to third parties

Proportion: 9 %

Short description of the part of the contract to be subcontracted

Wet Lab Studies to be subcontracted.


Section six. Complementary information

six.4) Procedures for review

six.4.1) Review body

DSIT

London

Country

United Kingdom