Almost certainly it's the former. Something like HML, for example, is specifically defined as "high minus low", ie long high stocks and short low ones. Market return is separate.