The Tasty as Pi Bakery has two locations! Each location offers the same flavors. Both locations display one pie of each flavor in a rectangle. The downtown location has $4$ rows in its display. The uptown location has $6$ rows in its display. If one of the locations has a square display, how many pies are in each of the other location's rows?
