That is where tracking is very much in your favor. Have you messaged buyer to alert them that purchase is at location? I would do so for own sake as much as theirs. Maybe something has occurred to prevent them from knowing or being able to get it yet. Either way you have proof packaged shipped to proper location.
Unfortunate part is if returned you're out costs and get to file issue with ebay