I am EE graduate myself. But I majored in Electrical engineering aspect (electricity generation/transmission, power supply etc.), but not nothing to do with hardware/chips design. I started programming at 25.
I have found that my biggest weakness is not programming, but the interviews where they grill you on CS fundamentals. Did you have to prepare for that?