Not possible analytically. You'd have to do it numerically. Do you have a specific x, a, w, and v in mind?
My thinking is to describe the motion of one of the polygons from the other's frame of reference and then check the path of each of its points against each of the stationary object's edges.
The equation's more complicated than what i wrote but i thought i'd start at the simplest scenario, with only one polygon in rotation and linear motion, and work my way up.
here's a better description of the equation i posted:
x = cos(a + w*t) + v*t, where
a is the starting orientation of point about the center of its orbit,
w is the point's angular velocity,
v is the x component of the point of rotation's linear velocity, and
t is time
I was hoping, since the path of the point in the xt and yt planes is well defined, i might be able to find the values of t for which x is a specific value and then check the value of y at t. I'm a bit out of my depth though, trying to solve the equation.
It seems this isn't possible. I appreciate the help though.
An interesting problem. Good luck with it.