Further, Oldham wanted to make Jagger's charisma and flamboyance a focus of live performances. Jones saw his influence over the Stones' direction slide as their repertoire comprised fewer of the blues covers than he preferred; more Jagger/Richards originals developed, and Oldham increased his own managerial control, displacing Jones from yet another role.
According to Oldham in his book Stoned, Jones was an outsider from the beginning. When the first tours were arranged in 1963, he travelled separately from the band, stayed at different hotels, and demanded extra pay. According to Oldham, Jones was very emotional and felt alienated because he was not a prolific songwriter and his management role had been taken away. He "resisted the symbiosis demanded by the group lifestyle, and so life was becoming more desperate for him day by day. None of us were looking forward to Brian totally cracking up".
The toll from days on the road, the money and fame, and the feeling of being alienated from the group resulted in Jones' overindulgence in alcohol and other drugs. These excesses had a debilitative effect on his physical and mental health and, according to Oldham, Jones became unfriendly and antisocial at times.
In March 1967, Anita Pallenberg, Jones' girlfriend of two years, left him for Richards when Jones was hospitalised during a trip the three made to Morocco, further damaging the already strained relations between Jones and Richards. As tensions and Jones' substance abuse increased, his musical contributions became sporadic.