Compliance | Schema Benchmarks

Using the JSON Schema Test Suite, we test each library against the official JSON Schema specification. The test suite contains a large number of test cases that cover various aspects of JSON Schema validation, including different data types, formats, and validation rules.

Target

Validation Semantics Roundtrip

Libraries that use JSON Schema directly, such as typebox or ajv.

Copy to clipboardCopy to clipboard
const receivedValid = Schema.Check(schema, data);
assert(receivedValid === expectedValid);

Results indicate compliance with the JSON Schema test suite.

Library	Version	Source	/wk	Compliance
`zod`	`4.4.3`	Native	n/a	60.4% (1.04K / 1.72K)
`sury`	`11.0.0-rc.1`	Native	n/a	50.7% (872 / 1.72K)
`arktype`	`2.2.3`	Package	n/a	13.8% (238 / 1.72K)

Libraries that have their own representations of schemas, but can be created from JSON Schema, such as zod or arktype.

Copy to clipboardCopy to clipboard
const zodSchema = z.fromJSONSchema(schema);
const receivedValid = zodSchema.safeParse(data).success;
assert(receivedValid === expectedValid);

Results indicate how closely the library aligns with the formal semantics of JSON Schema.

Library	Version	Source	/wk	Compliance
`zod`	`4.4.3`	Native	n/a	60.4% (1.04K / 1.72K)
`sury`	`11.0.0-rc.1`	Native	n/a	50.7% (872 / 1.72K)
`arktype`	`2.2.3`	Package	n/a	13.8% (238 / 1.72K)

Libraries that can be converted from and to JSON Schema. The JSON schema is decoded to the library's internal representation, then re-encoded to JSON Schema. The result is fed to typebox for final validation (as it scores highest on validation benchmarks, so introduces the smallest amount of margin of error).

Copy to clipboardCopy to clipboard
const zodSchema = z.fromJSONSchema(schema);
const roundtripSchema = z.toJSONSchema(zodSchema, { target: "draft-07" });
const receivedValid = Schema.Check(roundtripSchema, data);
assert(receivedValid === expectedValid);

Failed tests indicate either lossy translation or a serialization error.

Library	Version	Source	/wk	Compliance
`zod`	`4.4.3`	Native	n/a	60.4% (1.04K / 1.72K)
`sury`	`11.0.0-rc.1`	Native	n/a	50.7% (872 / 1.72K)
`arktype`	`2.2.3`	Package	n/a	13.8% (238 / 1.72K)

Target

Code snippet

Code snippet

Code snippet

Package required

Code snippet

Code snippet

Code snippet

Package required

Code snippet

Code snippet

Code snippet

Package required

Preferences

Style

Theme

NPM browser

Code ligatures

Target

Code snippetCode snippet

Code snippetCode snippet

Code snippetCode snippet

Package requiredPackage required

Code snippet

Code snippet

Code snippet

Package required