Fort Yatate was a Mongol-occupied fort that held Ryuzo's men in captivity. After Jin infiltrates the fort and frees the Straw Hats, he learns that the men weren't being tortured by the Mongols, instead they were being fed and treated well by them.
It is located roughly 400m south of the Hiyoshi haiku, northwest of the nearest survivor camp