
Adau1452 dsp core
EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

Execution-based benchmark for open-book KiCad PCB reconstruction agents
Cm4 matx is an open-source printed circuit board by EDA-bench, from the EDA-bench/eda-bench repository on GitHub. It is a 4-layer board of 243.8 × 243.8 mm with 214 parts on 600 nets.
It is built around the MAX6639ATE+, PI7C9X2G404SLBFDE and TCA9548ARGER, with the GSD090012SEU, MIC2019YM6-TR and AP7363-10D among its other parts. Its parts include 77 capacitors, 71 resistors, 22 ICs, 20 connectors and 2 crystals. It belongs with the computers and single-board computers boards and the Raspberry Pi (Linux) boards of this library.
EDA-bench is a native Harbor dataset for evaluating agents on complete KiCad project construction. The repository contains the benchmark itself; Harbor supplies agent adapters, model configuration, sandbox lifecycle, retries, concurrency, trajectories, artifacts, result storage, and result inspection.
The active dataset is dataset/. It contains 35 self-contained Harbor tasks and one benchmark-specific aggregate metric. There is no separate benchmark runner, provider harness, provenance uploader, or task download layer.
The dataset is validated against Harbor 0.19.0:
uv tool install 'harbor==0.19.0'Docker must be available for local runs. Until the versioned images are published, build the shared agent and verifier images once:
./images/build.shEvery task then runs independently with ordinary Harbor using the image references in its own task.toml.
Run the complete local dataset with any Harbor-supported agent and model:
harbor run \
--path dataset \
--agent '<agent>' \
--model '<model>' \
--n-concurrent 4Run one task while developing:
harbor run \
--path dataset/usb_c_female_breakout \
--agent '<agent>' \
--model '<model>'Run an oracle smoke test without configuring a model:
harbor run --path dataset/usb_c_female_breakout --agent oracleHarbor writes jobs to jobs/ by default. Each trial includes its resolved configuration, trajectory, verifier output, declared final_project artifact, and reward. Inspect them with:
harbor view jobsEach task asks the agent to create a complete KiCad project under:
/workspace/final_project/The task instruction names the required .kicad_pro, .kicad_sch, and .kicad_pcb files. The agent environment includes KiCad and ngspice.
Grading runs in Harbor's separate verifier mode with networking disabled. Harbor stops the agent environment, transfers only the declared /workspace/final_project artifact, and starts the shared verifier image named in task.toml. The verifier evaluates the submitted schematic, PCB, connectivity, external I/O behavior, physical realization, ERC/DRC results, and task-specific functional contract. It writes:
reward.json: Harbor reward channels (reward, overall_score, task_score, build_success, and submission_exists)grading.json: the complete deterministic grading recordwork/: generated ERC, DRC, and ngspice evidenceThe verifier image contains the task reference project and scoring code. Those files are never mounted into the agent environment.
dataset/
├── dataset.toml # Harbor dataset manifest and exact task digests
├── metric.py # difficulty-weighted benchmark aggregation
└── <task_id>/
├── instruction.md
├── task.toml # Harbor schema, image refs, task selector
├── environment/ # required Harbor directory; image is prebuilt
├── contract/ # task-specific static and functional I/O data
└── solution/ # Harbor oracle and sole reference project
images/ # one agent image and one verifier image
verifier/ # one shared KiCad evaluator implementationdataset/ owns task-specific data, verifier/ owns shared scoring logic, and images/ owns container dependencies. Rebuild the images and refresh the manifest after changing any of them:
harbor sync dataset
git diff -- dataset/dataset.tomlThe custom metric preserves the benchmark's difficulty-weighted score: task rewards are weighted 1.0 for very easy, 1.5 for easy, 2.0 for medium, 3.0 for hard, 4.0 for very hard, and 5.0 for extreme. Missing rewards count as zero.
Publishing is intentionally separate from development. When a release is approved, authenticate to the Harbor registry, verify the manifest is clean, and publish the public dataset:
harbor auth login
harbor auth status
harbor sync dataset
harbor publish dataset --public --tag '<version>'Until a registry release exists, use --path dataset; do not use a registry dataset name.
The paper and artifacts/ reports are retained research records. They are not executable benchmark infrastructure. New evaluations should use Harbor job results as the canonical run record.
See DATA_CARD.md for scope, access policy, grading details, licensing, and limitations.
| Qty | Value | Footprint | References |
|---|---|---|---|
| 50 | 100nF | CM4_MATX:C_0402_1005Metric_Pad0.74x0.62mm_HandSolder | C2, C11, C12, C13, C14, C16, C17, C19, C21, C23, C25, C27, C28, C30, C32, C33 +34 |
| 24 | 10uF | CM4_MATX:C_0603_1608Metric_Pad1.08x0.95mm_HandSolder | C10, C15, C20, C22, C24, C26, C29, C31, C35, C36, C37, C38, C41, C48, C51, C71 +8 |
| 14 | 330 | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R36, R37, R38, R39, R40, R73, R74, R75, R76, R77, R79, R80, R81, R82 |
| 12 | 5.1k | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R41, R42, R43, R44, R45, R51, R52, R53, R67, R72, R91, R92 |
| 9 | MountingHole | CM4_MATX:MountingHole_3.2mm_M3_Pad_Via | H1, H2, H3, H4, H5, H6, H7, H8, H9 |
| 8 | 33 | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R54, R55, R56, R57, R58, R59, R60, R61 |
| 8 | 4.7K | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R5, R7, R30, R31, R32, R33, R34, R35 |
| 8 | 49.9 | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R83, R84, R85, R86, R87, R88, R89, R90 |
| 7 | 143 1% | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R23, R24, R25, R26, R27, R28, R29 |
| 7 | MIC2019YM6-TR | CM4_MATX:SOT95P280X145-6N | U10, U11, U12, U13, U14, U15, U16 |
| 5 | 100K 5% | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R3, R8, R9, R10, R11 |
| 4 | MountingHole | CM4_MATX:MountingHole_2.7mm_M2.5 | H10, H11, H12, H13 |
| 3 | Jumper_3_Open | CM4_MATX:PinHeader_1x03_P2.54mm_Vertical | JP1, JP2, JP3 |
| 3 | PCIe_x16 | CM4_MATX:10018783-10113TLF | J13, J14, J15 |
| 2 | 12K 1% | CM4_MATX:R_0603_1608Metric_Pad0.98x0.95mm_HandSolder | R6, R22 |
| 2 | 16pF | CM4_MATX:C_0402_1005Metric_Pad0.74x0.62mm_HandSolder | C4, C5 |
| 2 | 2.2K 1% | CM4_MATX:R_0603_1608Metric_Pad0.98x0.95mm_HandSolder | R12, R13 |
| 2 | 470 1% | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R20, R21 |
| 2 | 72309-8014BLF | CM4_MATX:723098014BLF | J4, J10 |
| 2 | AP7363-10D | CM4_MATX:TO-252-3_TabPin2 | U4, U19 |
| 2 | Conn_01x22_Female | CM4_MATX:Hirose_FH12-22S-0.5SH_1x22-1MP_P0.50mm_Horizontal | J3, J5 |
| 2 | Conn_02x04_Odd_Even | CM4_MATX:PinHeader_2x04_P2.54mm_Vertical | J17, J20 |
| 2 | Conn_02x05_Odd_Even | CM4_MATX:PinHeader_2x05_P2.54mm_Vertical | J8, J9 |
| 2 | Fan_CPU_4pin | CM4_MATX:FanPinHeader_1x04_P2.54mm_Vertical | M1, M2 |
| 2 | TPD4EUSB30 | CM4_MATX:USON-10_2.5x1.0mm_P0.5mm | U7, U9 |
| 1 | 1.43k 1% | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R15 |
| 1 | 100uF | CM4_MATX:C_1206_3216Metric_Pad1.33x1.80mm_HandSolder | C18 |
| 1 | 10104110-0001LF | CM4_MATX:101041100001LF | J11 |
| 1 | 1888811-1 | CM4_MATX:TE_1888811-1 | J6 |
| 1 | 1K 1% | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R19 |
| 1 | 24MHz | CM4_MATX:Crystal_SMD_3225-4Pin_3.2x2.5mm_HandSoldering | Y1 |
| 1 | 32.768KHz | CM4_MATX:Crystal_SMD_MicroCrystal_CC7V-T1A-2Pin_3.2x1.5mm_HandSoldering | Y2 |
| 1 | 39-28-1243 | CM4_MATX:SHDR24W125P550X420_2X12_5160X960X1310P | J7 |
| 1 | 475 1% | CM4_MATX:R_0402_1005Metric_Pad0.72x0.64mm_HandSolder | R14 |
| 1 | 74LVC1G07GW | CM4_MATX:SOT65P212X110-5N | U6 |
| 1 | AP2822CKETR-G1 | CM4_MATX:SOT95P282X145-5N | U5 |
| 1 | AP7363-33D | CM4_MATX:TO-252-3_TabPin2 | U2 |
| 1 | ARJM11C7-502-AB-ER2-T | CM4_MATX:ARJM11C7502ABER2T | J18 |
| 1 | Battery_Cell | CM4_MATX:BatteryHolder_Keystone_103_1x20mm | BT1 |
| 1 | CM4_A | CM4_MATX:DF40C100DS04V51 | J2 |
| 1 | CM4_B | CM4_MATX:DF40C100DS04V51_B | J1 |
| 1 | Conn_02x20_Odd_Even | CM4_MATX:PinHeader_2x20_P2.54mm_Vertical | J19 |
| 1 | FSUSB42MUX | CM4_MATX:SOP50P490X110-10N | U3 |
| 1 | GSD090012SEU | CM4_MATX:GSD090012SEU | J16 |
| 1 | M24C04-RMN6TP | CM4_MATX:SOIC127P600X175-8N | IC3 |
| 1 | MAX6639ATE+ | CM4_MATX:TQFN-16-1EP_5x5mm_P0.8mm_EP3.1x3.1mm | U1 |
| 1 | PCF85263AT | CM4_MATX:SO-8_3.9x4.9mm_P1.27mm | U18 |
| 1 | PI7C9X2G404SLBFDE | CM4_MATX:QFP40P1600X1600X160-129N | IC2 |
| 1 | RT9742GGJ5 | CM4_MATX:TSOT-23-5 | U8 |
| 1 | SS-52100-002 | CM4_MATX:SS52100002 | J12 |
| 1 | STATUS0 | CM4_MATX:TestPoint_Pad_D1.0mm | TP2 |
| 1 | STATUS1 | CM4_MATX:TestPoint_Pad_D1.0mm | TP3 |
| 1 | STATUS2 | CM4_MATX:TestPoint_Pad_D1.0mm | TP1 |
| 1 | TCA9548ARGER | CM4_MATX:Texas_RGE0024C_EP2.1x2.1mm | U17 |
| 1 | USB2517-JZX | CM4_MATX:QFN50P900X900X100-65N-D | IC1 |

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents

EDA-bench/eda-bench
Execution-based benchmark for open-book KiCad PCB reconstruction agents



NVIDIA-AI-IOT/my-jetson-nano-baseboard
An open source Jetson Nano baseboard and tools to design your own.

JhonVelasquez/Embedded_system_Synchronize_Plant
Project of a embedded system that synchronizes signals in a plant. There is electronic (PCB) and software design (FreeRTOS for STM32F7).



johonkanen/efinix_soc_board
Efinix Ti135N484I3 Linux control card for the AC lab PSU baseboard (KiCad 10, scripted schematic)

sankarax/AQM420
Air Quality Monitoring project which includes the Arduino script integrating everything into the Blynk IoT app, schematics and the pcb build
It measures 243.8 × 243.8 mm and has 4 copper layers, 1.6 mm thick.
214 parts, built around the MAX6639ATE+, PI7C9X2G404SLBFDE, TCA9548ARGER and GSD090012SEU. The full list of its parts is on this page, with links to each part's symbol and footprint where PCBKit's library has them.
From the EDA-bench/eda-bench repository on GitHub, at the commit this page was made from: the board is dataset/cm4_matx/solution/reference/cm4_matx.kicad_pcb. PCBKit opens the board in the browser, with nothing to install.
Its repository states no licence, so its author keeps all rights: ask EDA-bench before reusing the design.