I also found this OSM2Openlayers thing it’s very new and hence I’m not sure you can use it, but I think this will allow you to take OSM features and create icons on openlayers. You can watch the live example I’m not sure this is easier for you to understand, but using Openlayers to add data to already rendered Openstreetmap images might be easier.