The 23-story office tower would be at Bromfield and Washington streets in Downtown Crossing, but the organization that maintains the Old South Meeting House has some concerns about the potential for shadows.