Keep the page, remove the apply button if any, also set the the jobPosting schema validThrough property in the past.

Also I reckon the Google Indexing API for jobPosting twitter.com/rrmdp/status/1674…