Yes, for some reason I only see the option to add it into the url when I'm logged in to a peertube instance.
All you need to do is add on a ?start={seconds}s
to the end.
For example: https://tube.fediverse.games/w/tY1u9qFz85NprRYPmtdvEj?start=55s
Edit: re-reading this now, looks like I totally misunderstood your question. Please disregard.