Red Hat CEO Jim Whitehurst is seen by many investors as a potential successor to IBM chief Ginni Rometty, according to a Wall Street analyst.