fix use paddle.incubate.jit.inference(model) errors (#9016)

* fix use paddle.incubate.jit.inference(model) errors

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

* fix jit_inference function

Author: chang-wenbin

paddlenlp/transformers/utils.py

@@ -167,6 +167,18 @@ def adapt_stale_fwd_patch(self, name, value):
             "StaticFunction"
         ):
             return value
+
+        # NOTE(changwenbin & zhoukangkang):
+        # When use model = paddle.incubate.jit.inference(model), it reportes errors, we fix it here.
+        # is_inference_mode API is only avaliable in PaddlePaddle develop，so we add a try except.
+        try:
+            from paddle.incubate.jit import is_inference_mode
+
+            if is_inference_mode(value):
+                return value
+        except:
+            pass
+
         if hasattr(inspect, "getfullargspec"):
             (
                 patch_spec_args,