I am surprised that Obama went literally more than a year without a press conference, considering that's supposed to be one of his strong points, and because he told everyone he would be constantly communicating to the public.
Ultimately, the public votes out presidents in bad times, regardless of politics. Martin Van "Ruin" inherited Jackson's fucked up economy, and was run out of office. Hoover saw the economy beginning to collapse around him within 7 months of taking office, and was tossed out in 1932. Carter had economic woes in the form of ridiculous stagflation numbers. The misery index was obscene, and so he was ousted.
On the same token, Washington, McKinley, Harding, Truman, and Reagan all inherited shitty economies, and they saw things turn around completely under their administrations. The only one of them that was eventually kicked out was Truman, because of the Korean War.