Just to add my .02 cents.... to me it's a MAJOR difference... had the pleasure of driving a loaner 340i AND racing a 440i! Mind you it was stock vs. stock (m4 vs 440), and not accounting for driver error, it wasn't even close!!
The 340\440i are very capable, but there's a reason why the ///M is slightly more $$.