What behaviour do you expect?

As documented  in https://debezium.io/documentation/reference/stable/development/engine.html#engine-properties, if `errors.max.retries = 0` the engine should immediatel fail

What behaviour do you see?

Engine doesn't fail. Instead, it stops sending records

Do you see the same behaviour using the latest relesead Debezium version?

Yes