(fix): test_regress_out_layer overflow issue

[ilan-gold]

• Noticed in Backport PR #3461 on branch 1.11.x (fix int for shortcut) #3640
• Tests included or not required because:

• Release notes not necessary because: testing issue

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 76.74%. Comparing base (def4f23) to head (41a877a).
Report is 1 commits behind head on main.

✅ All tests successful. No failed tests found.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #3641   +/-   ##
=======================================
  Coverage   76.74%   76.74%           
=======================================
  Files         113      113           
  Lines       12709    12709           
=======================================
  Hits         9754     9754           
  Misses       2955     2955