More than half (51%) of those surveyed believed that access to the internet on in-built screens in the vehicles would make it harder for drivers to keep their eyes on the road.
However, many managers also appeared to welcome some of the advantages that introducing connected cars would have on their business.
IN OTHER NEWS: Ford to have driverless cars on road by 2021
The majority (80%) said that better diagnosis of engine faults would be the biggest benefit, while 72% believed it would be improved fuel efficiency and 67% a reduction in wear and tear.
It is thought that one of the most effective ways for businesses to work out how well connected vehicles are performing is through using a specialist black box device.
RAC Telematics MD Nick Walker said that telematics is set to play a vital role in assessing driver behaviour as connected technology develops.
“A telematics device installed directly into the diagnostics port of the vehicle is the most accurate and reliable way of monitoring vehicle health and driver performance for each individual car, van or truck across the fleet.”
According to the poll of 500 businesses, 35% said they also have concerns about security, with many fearing connected cars could make it easier for driver data to be hacked.
In addition, 18% of those surveyed admitted they were worried that the rise in vehicle autonomy brought about by the technology would take too much responsibility away from drivers.
But installing a telematics device could be the best way to decide just how connected technology affects both vehicle and driver, according to RAC Business.
“RAC Telematics, for example, is able to access many more fault codes across the vast majority of makes and models than other available devices making much more data available to fleet managers.
“Clearly all these new technologies will complement each other in providing businesses with unprecedented levels of vehicle support. But at the moment, from what our research tells us, there is still work to do in terms of communicating exactly what connected technology means for drivers and fleet managers.”