And if you are still looking for raster tiles close to the osm-carto standard style, the Openstreetmap FR local chapter has a tilelayer with french labels, see layers.openstreetmap.fr - Tuiles pour contrôle de données / Tile service with dataa checks - though at the moment the tile renderer tile cache seems to be down. That layer uses name:fr labels if available in osm data.
Another raster tiles option is osMap carte du monde | OpenStreetMap carte en français | Carte interactive en français basée sur les données OpenStreetMap | osMap that uses the name:fr labels or latin-script fallbacks or automatic transliteration if none of the former is available for a label.