ZodObject that are `.refine` or `.superRefine` returns a ZodEffects type #2474

morganjbt · 2023-06-01T15:55:01Z

Zod version 3.21.4

Problem

Using .refine() or .superRefine() on ZodObject (z.object()) prevents the use of .shape or .merge() method as the returned type is a ZodEffects and not a ZodObject.

Example

const schema1 = z.object({ foo: z.string() }) // = type ZodObject
const schema2 = z.object({
  bar: z.string(),
  attributeRelatedToBar: z.string(),
}).superRefine(handleSchema2Errors) // = type ZodEffects

/**
 * Impossible because `.merge` expect `schema2` to be type of `ZodObject` instead of `ZodEffects`:
 * TS2352: Conversion of type 'ZodEffects […] to type 'ZodObject ' may be a mistake because
 * neither type sufficiently overlaps with the other.
 * If this was intentional, convert the expression to 'unknown' first.
 */
const finalSchema = schema1.merge(schema2)

/**
 * Same error with `.shape` that expect a `ZodObject` instead of `ZodEffects`:
 * TS2339: Property 'shape' does not exist on type 'ZodEffects'.
 */
schema2.shape.bar
schema2.shape.attributeRelatedToBar

Expected behavior

Using .superRefine() or .refine() on z.object() should return a ZodObject type
– or –
.merge() & .shape should be functional on ZodEffects applied to a ZodObject.

The text was updated successfully, but these errors were encountered:

thibaultleouay · 2023-06-14T15:30:11Z

You should use .and
see #1147

morganjbt · 2023-06-16T14:11:43Z

You should use .and see #1147

@thibaultleouay
Thank you. But I don't see .and as a solution but as a workaround 😄.

matjaeck · 2023-08-10T15:26:44Z

Using .superRefine() or .refine() on z.object() should return a ZodObject type

This is the expected behavior. The unexpected behavior needs to be documented.

I don't see how .and is a replacement for calling refine or superRefine on a whole object to be able to access the properties in validation logic.

matjaeck · 2023-08-11T13:28:50Z

Using .superRefine() or .refine() on z.object() should return a ZodObject type

This is the expected behavior. The unexpected behavior needs to be documented.

I don't see how .and is a replacement for calling refine or superRefine on a whole object to be able to access the properties in validation logic.

I solved this by adding a wrapper object around the actual object to validate. This way it is possible to use refine on nested objects while returning a type compatible with ZodTypeAny.

const schema2 = z.object({
wrapper: z.object({
bar: z.string(),
attributeRelatedToBar: z.string(),
}).superRefine(handleSchema2Errors)
}).

Then add a wrapper middleware to wrap the post data before you parse it and add some custom unwrapper to get the proper form field errors.

MidasVE · 2023-08-24T14:06:21Z

It also prevents the use of discrimatedUnion.

JacobWeisenburger · 2023-09-26T17:00:24Z

Is this what you are looking for?

const schema1 = z.object( { foo: z.string() } )
const schema2 = z.object( {
    bar: z.string(),
    attributeRelatedToBar: z.string(),
} )

const finalSchema = schema1.merge( schema2 ).superRefine( handleSchema2Errors )

schema2.shape.bar // z.ZodString
schema2.shape.attributeRelatedToBar // z.ZodString

If you found my answer satisfactory, please consider supporting me. Even a small amount is greatly appreciated. Thanks friend! 🙏
https://github.com/sponsors/JacobWeisenburger

morganjbt · 2023-09-28T15:10:13Z

Is this what you are looking for?
[Code]
const schema1 = z.object( { foo: z.string() } )
const schema2 = z.object( {
    bar: z.string(),
    attributeRelatedToBar: z.string(),
} )

const finalSchema = schema1.merge( schema2 ).superRefine( handleSchema2Errors )

schema2.shape.bar // z.ZodString
schema2.shape.attributeRelatedToBar // z.ZodString
If you found my answer satisfactory, please consider supporting me. Even a small amount is greatly appreciated. Thanks friend! 🙏
https://github.com/sponsors/JacobWeisenburger

The schema is a validation schema and must be fully functional. So in my context, this is a necessity to have a refine|superRefine to make the validation work.

There is a problem between ZodObject and ZodEffects type that needs to be fixed.
I don't want to use a workaround.

Even if I wanted to use a workaround, the solution you suggested would have been easy to find.

JacobWeisenburger · 2023-09-28T15:38:38Z

The schema is a validation schema and must be fully functional.

How is what I gave you not "fully functional"?

So in my context, this is a necessity to have a refine|superRefine to make the validation work.

I used superRefine in my solution. ✅

There is a problem between ZodObject and ZodEffects type that needs to be fixed.

I fail to see the problem that you are talking about. Please explain more.

I don't want to use a workaround.

Considering Zod doesn't release very often, your choices are to use a workaround in the mean time or wait for your problem to be addressed and then wait for it to be released. Based on how things have been going, that could be 6 months. If that's ok for you, then great.

Even if I wanted to use a workaround, the solution you suggested would have been easy to find.

Generally when someone tries to help you, it's not the best approach to belittle their efforts. But thanks.

morganjbt · 2023-09-28T16:07:30Z

How is what I gave you not "fully functional"?

I am working on a dynamic form that can change depending on the persona. So I've created a schema by input, which is then assembled according to the displayed input.
Some inputs have special validation and need a refine attached to a schema to be more reusable and easily importable.
In this case, if I have to do what you suggest for each schema, it doesn't make the code more readable or maintainable and can be prone to forgetting.

I used superRefine in my solution. ✅

Yes, but at the end of the final schema and if I need to merge multiple object, what the method refine receive in parameter will change according to what it's merged inside. Not easy to maintain.

I fail to see the problem that you are talking about. Please explain more.

To be more concrete, say I have a WYSIWYG input and I need to count how many characters are written (without taking into account html tags). To do that, I need to use refine to count plain text instead of generated html.
On top of that, I have multiple inputs that need special validation using refine/superfine according to persona and some user configuration.

Considering Zod doesn't release very often, your choices are to use a workaround in the mean time or wait for your problem to be addressed and then wait for it to be released. Based on how things have been going, that could be 6 months. If that's ok for you, then great.

I have another workaround on the validation side after a .safeParse(). I'm not happy with it, but it's the least dirty I can do for now.

Generally when someone tries to help you, it's not the best approach to belittle their efforts. But thanks.

Sorry, I didn't mean to be mean, but from the way I described the bug, you can imagine that I'm not a junior. The proposed solution wasn't very complex and the reason for this issue was a real problem with the library.
I just want to show this problem so that a solution can be found.

aryzing · 2023-09-29T20:04:21Z

Seems that .omit() isn't allowed after a .refine(), which is not useful.

matjaeck · 2023-10-02T13:37:06Z

@JacobWeisenburger

function validationFunction<SchemaA extends z.ZodTypeA 8000 ny, SchemaB extends z.ZodTypeAny>(schemas: MySchemaParamType<SchemaA, SchemaB>): SomethingThatUsesTheTypeInfo<SchemaA, SchemaB> { }

This will break when you pass it a schema that uses refine or superRefine, the resulting type ZodEffects does not extend ZodTypeAny (that constraint is required).

Goldiggy · 2024-01-09T10:17:27Z

Up on this topic ? Issue still the same with zod ^3.22.4

henriksjostrom · 2024-01-15T06:50:06Z

This unfortunately make complex types into a real pain to use with this library

razb-viola · 2024-01-21T06:24:45Z

I came across as well.
How to fix this?
By fix I mean that I want to keep the chaining of the schema, like merging another schema or do anything else.

If refine shouldn't mean to support this, what does so?

trey-yeager-FHR · 2024-01-22T17:06:38Z

I am running into the same issue but after using .transform. My use case is as follows:

const conversionFn = (val) => val === null ? undefined : val;

const parentSchema = z.object({
    // Accepts `number | null | undefined` but returns `number | undefined`
    numberProp: z.number().nullable().optional().transform<number | undefined>(conversionFn),
});

const childSchema = parentSchema.required({ numberProp: true });

Because my parentSchema.numberProp is set to a ZodEffect the .required does not apply to it since ZodEffect does not extend ZodOptional or ZodNullable.

It is also a similar problem when using .pipe which returns a ZodPipeline.

robokozo · 2024-02-22T17:25:42Z

I'm running into issues as well. It doesn't make sense to me for the object to transform itself into a different type if refine is chained to it.

const testSchema = z.object({
  foo: z.string()
})

const fooSchema = testSchema.shape.foo // works!

const testSchema2 = z.object({
  foo: z.string()
}).refine(x => true)

const fooSchema2 = testSchema2.shape.foo // does not work

oyatek · 2024-03-04T03:52:26Z

What not just apply your .refine + .transform at the end of all validations/merges/etc.? That's what we do.

mykhailo-ivankiv · 2024-03-11T19:11:14Z

@oyatek It breaks the composition

Example 1

Let's imagine that we have a reusable type utility:

// utils/reusableSchema.ts

export const activeDateTimes = z
  .object({
    activeFromDateTime: z.string().datetime().optional(),
    activeToDateTime: z.string().datetime().optional(),
  })
  .superRefine((data: ActiveDateTimes, ctx) => {
    if (
      data.activeFromDateTime &&
      data.activeToDateTime &&
      new Date(data.activeFromDateTime) > new Date(data.activeToDateTime)
    ) {
      ctx.addIssue({
        path: ['activeToDateTime'],
        code: z.ZodIssueCode.custom,
        message: 'Active to date should be after active from date',
      });

      ctx.addIssue({
        path: ['activeFromDateTime'],
        code: z.ZodIssueCode.custom,
        message: 'Active from date should be before active to date',
      });
    }
  });

And you want to reuse it in multiple places:

const userSchema = z.object({name: z.string}).merge(activeDateTimes)
const postSchema = z.object({title: z.string}).merge(activeDateTimes)
...

The current approach makes it difficult to implement a schema utility and, in some ways, breaks schema encapsulation.

Example 2

You have some schema that represent API endpoint

const user = z.object({
  id: z.string(),
  name: z.string(), 
  age: z.string()
}).refine(...)

But for the API POST method, you want to modify your schema and omit id prop

const createUserSchema = user.omit({id: true});

You may have noticed that there is an issue with the current implementation of your application. Specifically, you may need to refine some of the schemas during the latest stage of development. However, the proposed solution would require you to rewrite a large portion of your application.

TheBlindHawk · 2024-03-18T05:37:04Z

Same issue here!
I have pretty large object schemas that need to be changed altogether, and I am trying to use functions similar to the following for that.

export const ignoreDateTypeValidation = <Schema extends z.AnyZodObject>(schema: Schema) => {
  const entries = Object.entries(schema.shape) as [keyof Schema['shape'], z.ZodTypeAny][]
  const newProps = entries.reduce(
    (acc, [key, value]) => {
      acc[key] = value instanceof z.ZodDate ? z.any() : value
      return acc
    },
    {} as { [key in keyof Schema['shape']]: Schema['shape'][key] },
  )
  return z.object(newProps)
}

the issue is that the date validation does't get picked up because it is using refine()

export const pastDateSchema = z.date().refine((d) => d.getTime() <= Date.now(), { message: 'cannot use future dates' })

but I cannot use z.ZodEffects because then everything that isn't a date() validation is also going to get triggered.

acc[key] = value instanceof z.ZodEffects ? z.any() : value

The same goes if I use and(), since the outcome is that everything becomes an intersection instead of an effect.

Is there any way for me to pick up the validation type even after using refine?
I am fine with any workarounds for now

max06 · 2024-03-23T15:50:34Z

Same issue here - I'm trying to add/replace a part of a schema to avoid duplicating the code dozens of times:

export const specSchema = z.object({
  value: z.string(),
  project: projectSchema,
});

export const globalSchema = z.preprocess(
  (val: any) => {
    const { kind, name, displayName, ...other }: { [key: string]: any } = val;

    return {
      kind,
      metadata: { name, annotations: { displayName } },
      spec: other,
    };
  },
  z.object({
    kind: z.string().optional(),
    metadata: metadataSchema,
    spec: specSchema,
  })
);

but I can't use extend or merge to do that...

(I tried handing in the specSchema via function parameter, ending up with a valid schema, that is missing the type details about spec.)

Dan503 · 2024-04-03T10:41:52Z

This isn't only an issue for the object schema. It is an issue for all schemas.

.refine() and .superRefine() should return a schema that has all the same properties as what was there before it was used.

Dan503 · 2024-04-03T12:04:52Z

Making these changes to the repo fixes the core issue
master...Dan503:zod:2474-refine-not-returning-correct-types-info

I haven't made a PR because it still has type conflict errors and is failing a lot of unit tests.

mabitten · 2024-04-05T17:25:13Z

Has anyone managed to resolve this? I have this problem, I use .refine and now I want to use .pick but it doesn't exist in ZodEffect.

KikoCosmetics · 2024-04-27T18:00:40Z

I've stumbled upon this as well...

I create a super refiner programmatically, so I don't really have access to the base schema:

export function passwordsMatchRefiner<Augmentation extends typeof this.passwordTwins>(
        schema: Augmentation
): z.ZodEffects<Augmentation> {
    return schema.refine((data) => data.password === data.confirmPassword, {
        path: ["confirmPassword"],
        message: "error.passwords_dont_match"
    });
}


export const customerSignUpFieldsSchema = passwordsMatchRefiner(
    someSchema.merge(someOtherSchema)
);

what about this? (I just discovered innerType)

const myPickedSchema = customerSignUpFieldsSchema.innerType().pick({
  actionCode: !0
});

Does it suck? It that intended to be used this way?

Eric-Arz · 2024-05-08T15:47:51Z

@KikoCosmetics innerType() seems to remove the refine logic, at least for me it is no longer running. So no, this is not a solution.

colinhacks · 2024-05-08T17:35:31Z

This will be changed in Zod 4 — refinements will be stored in the schema itself instead of in an enclosing ZodEffects.

KikoCosmetics · 2024-05-08T21:49:10Z

@KikoCosmetics innerType() seems to remove the refine logic, at least for me it is no longer running. So no, this is not a solution.

In my scenario it is a solution, cause I only picked a field that is not refined.

But yes if I had to pick the passwords I should refine them again. Not very cool, but that’s essentially the reason why I created that ‘passwordMatchRefiner’ function…

BrendanC23 · 2024-07-09T18:50:44Z

@colinhacks Do you have any updates on when Zod 4 might be done? The current version has been great, but it sounds like Zod 4 will be a huge improvement.

joaofranciscoguarda · 2024-07-23T00:17:30Z

Struggling with the same problem... Waiting for Zod 4. Now its a bit painfull to reset another field if other is false.

Olalexy1 · 2024-07-23T04:13:05Z

I was hoping to get a workaround here, I have been battling this issue all day long, hopefully Zod 4 will be released soon.

samuellawerentz · 2024-07-24T17:13:39Z

Zod 4! We are waiting..!

matomesc · 2024-08-17T19:51:24Z

I have the same issue. I have a schema where I all .refine() and then later I need to call .pick(), .omit() and .merge() but these methods are not available in the ZodEffects type. Using .and() doesn't work either as the resulting ZodIntersection doesn't have these methods either.

Any timeline on the release of v4?

aalvarezwindey · 2024-10-10T16:56:43Z

I have the same issue. This is my use case: I want to transform a field to have other sibling value but transform over the whole z.ZodObject makes it a z.ZodEffect and I cannot use it in further schemas:

const fooAndBar= z
  .object({
    foo: z.string(),
    bar: z.string().nullish(),
  })
  .transform((val) => {
    return { ...val, bar: val.bar ?? val.foo};
  });

const otherSchema= z
  .object({
    ...
  })
  // Fails! fooAndBar is z.ZodEffect and cannot be used
  .merge(fooAndBar);

The same happens if I use .and because I use otherSchema later expecting it to be a z.ZodObject and not z.ZodIntersection

catinrage · 2024-11-17T11:31:19Z

any news on Zod v4 ?

damianobarbati · 2024-12-02T14:37:27Z

@matomesc same problem for me, did you guys find any solution to this? Is v4 going to solve the issue?

I actually need to extend my zod schemas and not being able to use .omit after refine is really troublesome.

wilfredjonathanjames · 2025-03-04T06:00:37Z

Due to an issue with .strict, .and is not a perfect solution either: #390 (comment)

NicolasGorga · 2025-03-22T23:48:56Z

Hey any updates on this or reliable to handle this cases?

NicolasGorga · 2025-04-30T21:12:40Z

Hey how are people actually solving this issue? seems like something almost everyone will experience...

BrendanC23 · 2025-05-01T13:27:40Z

This is fixed in Zod 4. See the announcement.

morganjbt changed the title ~~ZodObject that are .refine or .superRefine returns a ZodEffects type~~ [Bug] ZodObject that are .refine or .superRefine returns a ZodEffects type Jun 5, 2023

tlancina mentioned this issue Sep 6, 2023

Generated Zod types are lost with @@validate zenstackhq/zenstack#676

Closed

esafak mentioned this issue Sep 21, 2023

Make validators accept ZodEffects to handle refined schemas svecosystem/formsnap#47

Merged

JacobWeisenburger added the enhancement New feature or request label Sep 26, 2023

JacobWeisenburger changed the title ~~[Bug] ZodObject that are .refine or .superRefine returns a ZodEffects type~~ ZodObject that are .refine or .superRefine returns a ZodEffects type Sep 28, 2023

JacobWeisenburger added not-intuitive-behavior and removed enhancement New feature or request labels Sep 28, 2023

donaldpipowitch mentioned this issue Feb 8, 2025

Support merging ZodEffects (created from an object) into other objects #1147

Closed

wilfredjonathanjames mentioned this issue Mar 4, 2025

.strict() and .and() combined is not working #390

Closed

wilfredjonathanjames mentioned this issue Mar 4, 2025

[BUG]: No clear way to intersect or merge .strict + .refine/.superRefine objects. #4017

Open

alexmarqs mentioned this issue Mar 11, 2025

Use z.ZodType<object> instead of z.AnyZodObject alexmarqs/zod-config#21

Closed

Uh oh!

ZodObject that are .refine or .superRefine returns a ZodEffects type #2474

ZodObject that are .refine or .superRefine returns a ZodEffects type #2474

Comments

Uh oh!

Problem

Example

Expected behavior

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Example 1

Example 2

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

ZodObject that are `.refine` or `.superRefine` returns a ZodEffects type #2474

ZodObject that are `.refine` or `.superRefine` returns a ZodEffects type #2474