Blocked IP on overpass api?

lonvia · September 2, 2026, 7:03am

Looks like you are not sending a customized user agent. The default Python Requests user agent is on the ban list.

InfosReseaux · September 2, 2026, 1:59pm

It’s not true: we are using “Podoma/1.0”

db/20_changes_update.js

main


      
          }
          // If some feature are missing (ex. relation members), fetch them from Overpass API and insert into update table
          // curl parameters are chosen to respect OVerpass API best practices:
          // https://wiki.openstreetmap.org/wiki/Overpass_API#Instances_with_global_data_coverage
          // https://community.openstreetmap.org/t/overpass-api-performance-issues/140598/157
          script += `
          if [[ "\$missing_features" != "||" ]]; then
              IFS='|' read -ra missing_features_qry_res <<< \$missing_features
              echo "data=(\${missing_features_qry_res[0]} \${missing_features_qry_res[1]} \${missing_features_qry_res[2]}); (._;>>;); out meta;" > ${CONFIG.WORK_DIR}/missing_osm.overpass
          
              curl -d @${CONFIG.WORK_DIR}/missing_osm.overpass --retry 3 --retry-delay 35 --retry-max-time 250 -f -o "${CONFIG.WORK_DIR}/missing_osm.xml" -A "Podoma/1.0 (${CONFIG.WEBSITE_URL})" -X POST ${CONFIG.OVERPASS_URL} || true
              if [[ -f "${CONFIG.WORK_DIR}/missing_osm.xml" ]]; then
                  osmium cat -f opl -o "${CONFIG.WORK_DIR}/missing_osm.opl" "${CONFIG.WORK_DIR}/missing_osm.xml"
                  echo "  [\$((\$(date -d now +%s) - \$process_start_t0))s] \$(wc -l < ${CONFIG.WORK_DIR}/missing_osm.opl) features has been retrieved from overpass"
                  mawk -f ${OPL2FTS_FS} -v tagfilter="${project.database.osmium_tag_filter}" -v output_main="${CONFIG.WORK_DIR}/missing_osm.csv" -v output_users="${csvUsers}" ${awk_param_members} "${CONFIG.WORK_DIR}/missing_osm.opl"
          
                  ${PSQL} -c "\\COPY ${update_table} (osmid, version, changeset, action, contrib, ts, userid, tags, geom, tagsfilter) FROM '${CONFIG.WORK_DIR}/missing_osm.csv' CSV"
              else` + (OVERPASS_FATAL ? `
                  echo "ERROR: missing members could not be fetched from Overpass API"
                  exit 1` : `
                  echo "WARNING: missing members could not be fetched from Overpass API, continuing without them"`) + `

I was banned because retry times were too small between attempts and we’ve just fixed this yesterday