Jackson2Tokenizer ignores USE_BIG_DECIMAL_FOR_FLOATS deserialization feature

[ilya-murzinov]

Affects: spring-web-5.1.3.RELEASE

---

In org.springframework.http.codec.json.Jackson2Tokenizer ctor TokenBuffer is created without passing DeserializationContext inside com.fasterxml.jackson.databind.util.TokenBuffer. This leads to USE_BIG_DECIMAL_FOR_FLOATS being ignored when parsing.

private Jackson2Tokenizer(JsonParser parser, boolean tokenizeArrayElements) {
    Assert.notNull(parser, "'parser' must not be null");

    this.parser = parser;
    this.tokenizeArrayElements = tokenizeArrayElements;
    this.tokenBuffer = new TokenBuffer(parser); // <--- here
    this.inputFeeder = (ByteArrayFeeder) this.parser.getNonBlockingInputFeeder();
}

[ilya-murzinov]

@jhoeller unfortunately this issue is not fixed, see f6693e7#r33105391

[ilya-murzinov]

this issue is still reproducible in spring-web-5.1.6.RELEASE

[jhoeller]

I've revised this to create a fully configured DefaultDeserializationContext within the tokenizer, analogous to Jackson's own standard code paths. This will make it into 5.2 M1 tomorrow and into 5.1.7 in early May.

[ilya-murzinov]

Thanks @jhoeller, I've just tested your change and it works!