Menu

Engineering & CAD

Engineering datasets and tasks for AI.

Starting with ship design and CAD. Discuss a scoped dataset of drawings, models and completed records, or commission tasks with reference solutions and verifiers.

Discuss a pilot Open the CAD sample task

Generated part · the toleranced bore is what the verifier measures

Why engineering needs its own data

A design can look right and still fail.

On the co-authored design tasks in PLE, Google’s engineering benchmark, the best agent’s deliverables meet 91% of constraints on average. Only 41.3% meet every hard constraint.

Shape is not function.

Two parts can match almost everywhere and differ on the one bore, slot or wall that decides whether they assemble, seal or carry the load.

Intent lives in the history.

Why a plate thickened or a duct moved sits in a class comment, an RFI or a change order, not in the final file.

Every drawing is also a number.

A tank holds a volume, a floor a quantity of concrete, a part a price. An agent that edits the drawing without recomputing them has done half the job.

Source: Physical-Engineering’s Last Exam, Google Cloud AI Research, October 2026.

Domains

Choose the engineering domain.

  • Ship design and naval architecture

    Small tankers, workboats and offshore vessels: general arrangement, lines plan, tank capacity, intact stability and loading conditions, structure and scantlings, and class approval comments.

    Pilots open

  • Construction and building design

    Architectural, structural and MEP drawing sets, BIM and IFC models, revisions, RFIs and clash reports, and quantity take-offs.

    Pilots open

  • Mechanical parts and assemblies

    Fixtures, brackets, plates and turned parts: parametric models with feature history, drawings with tolerances and fits, bills of materials and revisions.

    Pilots open

  • Energy and utilities engineering

    Solar plants and water works: layouts, single-line diagrams, P&IDs, bills of materials, tenders, and commissioning and maintenance records.

    Scoping

  • Industrial and product design

    Product surfaces, assemblies and design reviews, with design for manufacture and assembly.

    Next

Agent access

What can the agent use?

The same task in three access modes separates an agent that cannot read the drawing from one that cannot do the engineering.

fs

Files

Native 3D models and drawings, read through a CAD kernel in code.

px

Pixels

Drawing sheets and rendered views only, as an engineer reads a PDF.

fn

Tools

CAD operations as tool calls: rotate, section, measure, query.

How generated and practitioner-authored tasks are built

What a set contains

The model, the drawings, and why they changed.

What a set can include in each domain.

Domain
What a ship-design set contains
ArtefactWhat it holdsDelivered as
General arrangement and profileSpaces, tanks and equipment, deck by deckPDF and DXF
Lines plan and offsetsHull form: stations, waterlines, buttocks; the offset tableDXF, CSV
Capacity plan and tank tablesVolume, centre of gravity and free-surface moment per tank, by soundingPDF, CSV
Stability bookletHydrostatics, cross curves, loading conditions, righting-lever curves and criteriaPDF, CSV
Structural drawingsMidship section, scantlings, shell expansion, detailsPDF and DXF
3D model, where one existsHull form; structure and outfitting where modelledSTEP, IFC or the native export
Revisions and class commentsWhat changed, why, and the class society comment it answersJSON, with the PDFs
What a construction and building-design set contains
ArtefactWhat it holdsDelivered as
Drawing setsArchitectural, structural and MEP sheets: plans, sections, details, title blocks and revision cloudsPDF, and DWG or DXF
BIM modelElements by discipline, with type, level, material and propertiesIFC or the native export
Schedules and bill of quantitiesDoor, window and finish schedules; measured quantities by itemCSV, with the PDFs
Revisions and RFIsEach revision, the RFI or instruction that prompted it, and the answerJSON, with the PDFs
Clash reportsClashes between disciplines, their status and how each was resolvedBCF or CSV
SpecificationsMaterials, workmanship and the standards each section citesPDF and text
What a mechanical parts set contains
ArtefactWhat it holdsDelivered as
Parametric part modelsFeature tree, sketches, constraints and named parametersThe native file where licensed, or a CadQuery script for generated parts, plus STEP
DrawingsViews, dimensions, tolerances and fits, the title block and revision tablePDF and DXF
Revision historyEach change order: what changed, why, and the message that asked for itJSON, with the emails
Bills of materialsParts, quantities and materials, with supplier part numbers removedCSV
Manufacturing contextRouting, machine, cycle time and the quote the part was priced onJSON or SQLite
InspectionMeasured dimensions against the drawing, pass or fail, and reworkCSV
What an energy and utilities engineering set contains
ArtefactWhat it holdsDelivered as
LayoutsSolar array and plant layouts; pipework and pumping stationsPDF and DXF
Single-line diagramsStrings, inverters, protection and cable ratingsPDF and DXF
P&IDsLines, pumps, valves and instruments, with the equipment listPDF and DXF, CSV
Bills of materials and quotationsEquipment and quantities, with the quotation or tenderCSV, with the PDFs
Commissioning and maintenanceTest sheets, punch lists and maintenance logs against the designCSV, with the PDFs

Task families

Inspect the jobs in your domain.

Ship design and naval architecture
TaskThe agent mustVerified by
Tank capacity and trimCompute volumes, centres and trim for a loading condition from the tank plan and hydrostaticsRecomputation, with a tolerance per quantity
Intact stability checkBuild the righting-lever curve and check it against the intact stability criteriaRecomputed curve; each criterion pass or fail
Drawing consistencyFind where the general arrangement, tank plan and structure disagreeSet match against known conflicts
Answer a class commentRevise a drawing or calculation so it meets the commentDeliverable checks on the revised values
Construction and building design
TaskThe agent mustVerified by
Quantity take-offMeasure concrete, steel, areas and counts from the drawings or the BIM modelRecomputation from the model, with a tolerance per item
Clash detectionFind where structure, services and architecture collideSet match against known clashes
Drawing to BIM consistencyFind where the drawing set and the model disagreeSet match against known discrepancies
Code complianceCheck egress widths, or beam spans against their loads, under the applicable ruleRule recomputation; each clause pass or fail
Mechanical parts and assemblies
TaskThe agent mustVerified by
Drawing to modelBuild the parametric part a drawing describesThe geometry verifier below
Apply a change orderEdit the part to a change request, regenerate it and re-quote itThe geometry verifier, and a recomputed quote
Read the drawingAnswer what only the drawing set can answer: counts, fits, cross-sheet referencesTyped answer, compared field by field
Make it manufacturableFlag what the plant cannot make or hold to tolerance, and propose the cheapest fixRecomputation from the plant’s capability table
Energy and utilities engineering
TaskThe agent mustVerified by
Bill of materials from the drawingsTake off modules, inverters, cable, pipe and valves from the layout, single-line diagram or P&IDRecomputation from the drawings, with a tolerance per item
Single-line diagram checkCheck string sizing, cable ratings and protection against the design rulesRule recomputation; each clause pass or fail
Commissioning against designFind where the commissioning records, the P&ID and the equipment list disagreeSet match against known discrepancies

How verification works

We measure the feature, not the silhouette.

Three gates must pass first; fail one and the score is zero. Then each weighted check is scored on its own, so the score shows what broke.

  1. Reads gate

    The file exists and reads; a submitted script rebuilds on a clean kernel. A part that only looks finished stops here.

  2. Valid solid gate

    Closed and valid, one body where one is asked for.

  3. Units and size gate

    The stated units, inside the stated working volume.

  4. Envelope and shape checks

    Overall size, volume and overlap against the reference.

  5. Features checks

    Each toleranced bore, slot, wall and hole pattern, measured on the solid; faces checked for type.

  6. Engineering checks

    Mass, capacity, stability or the quote, recomputed where the task asks for them.

Compare the sample submissions

Questions

Before you scope a set.

Own engineering records? Data partnerships

Which designs are excluded?

No naval or government vessels, and no third-party drawings without cleared rights. Engineering licensing requirements.

How is a set scoped?

We agree the domain, the access mode, the task families, the source, the volume and the splits in a written scope before any task is built.

Scope an engineering set with us.

Tell us the engineering capability and the file formats your agent uses. We agree the source material, deliverables and acceptance checks before building a pilot.

Request a sample pack