Assuming the ATI card and the monitor use the normal pc-monitor
interface (analog not true digital) and assuming the terminal
command mode works try setting the vertical frequency or refresh
rate in the XF86Config file to 55-65 or just 60Hz. Ie. do not
use whatever the XF86Config utility defaults to for a monitor of
that reolution which is intended for normal CRT monitors..