Office 2013 breaks Sharepoint 2010 - An exception of type Microsoft.SharePoint.Upgrade.SPUpgradeException was thrown

I have Office 2013 installed on my Server 2008 R2 and after installing Sharepoint 2010 when I tried to configure Central Administration, I got following error:

Failed to create the configuration database.
An exception of type Microsoft.SharePoint.Upgrade.SPUpgradeException was thrown.  Additional exception information: Failed to call GetTypes on assembly Microsoft.Office.InfoPath.Server, Version=14.0.0.0, Culture=neutral, PublicKeyToken=71e9bce111e9429c. Could not load file or assembly 'Microsoft.Office.InfoPath, Version=15.0.0.0, Culture=neutral, PublicKeyToken=71e9bce111e9429c' or one of its dependencies. The system cannot find the file specified. Could not load file or assembly 'Microsoft.Office.InfoPath, Version=15.0.0.0, Culture=neutral, PublicKeyToken=71e9bce111e9429c' or one of its dependencies. The system cannot find the file specified. Could not load file or assembly 'Microsoft.Office.InfoPath, Version=15.0.0.0, Culture=neutral, PublicKeyToken=71e9bce111e9429c' or one of its dependencies. The system cannot find the file specified. Could not load file or assembly 'Microsoft.Office.InfoPath, .....

During Google search, I got suggestion that I don't have MS Chart control, Although I already have VS 2012 and I was unable to overcome this error. Basically this error is all about incorrect Microsoft.Office.InfoPath.Server, Version=14.0.0.0 reference which SharePoint central admin tried to refer, after deleting following folder from C:\Windows\assembly\GAC_MSIL I was able to configure Central admin for SharePoint 2010:

Policy.14.0.Microsoft.Office.InfoPath
Policy.14.0.Microsoft.Office.InfoPath.Client.Internal.Host
Policy.14.0.Microsoft.Office.InfoPath.FormControl

then restart IIS and re-run Central Administator Wizard again, this time I got no error.