Things didn’t exactly go smoothly for Stephen Colbert on his second night as ‘The Late Show’ host when some hecklers in the audience did not take too kindly to his interview with Uber's CEO.

ET noted that while Colbert was talking to Travis Kalanick on Wednesday evening a few New York City cab drivers in the audience starting yelling things out.

"When they initially started shouting, it was just loud and you couldn't really understand them," one eyewitness said.

The Late Show did not air the heckling but others in the audience said the interview was interrupted more than once.

"When Stephen looked up to listen to them, they calmed down a little bit and explained that they were angry that Uber is taking away jobs from cab drivers and is disrupting the New York City taxi system," the witness said.

Colbert then addressed that issue with Kalanick who responded, "In the Uber world, you can use your own car. You don't pay $40,000 to rent a vehicle. You make more dollars per hour and it's flexible. You don't have a shift. You can turn on your work when you want to and you can turn it off."

As we previously reported, Colbert beat out his opponents when the show premiered on Tuesday evening with about 6.6 million viewers. Viewership on Wednesday, however, fell a bit and he took the No. 2 spot behind Jimmy Fallon.

Top image courtesy of Jeffrey R. Staab/CBS

For more entertainment and celebrity news follow Michelle on Twitter @PhilaMichelle