Gee, it looks like I was spot-on...
"On April 23, 2012, William Wilkins attended an inter-agency outreach meeting at the White House with the president and a range of senior-appointed officials from various government agencies," IRS spokesman Bruce Friedland said. "No IRS matters or tax issues were discussed. Wilkins did not meet with anyone else at the White House that day."
http://www.huffingtonpost.com/2013/07/24/irs-scandal-jack-lew_n_3648170.html