President Barack Obama insisted Wednesday that higher taxes for the wealthy had to be a part of any deal on averting the fiscal cliff looming at year-end.

"We cannot afford to extend the Bush tax cuts for the wealthy," he said, while saying tax breaks for middle class families should stay in place.