It is easy to judge, but we tried to build something reliable, cost effective and simple to manage. We have learnt.
We have dual redundant links via separate physical hardware from our side to our Tier 1 ISP. We unexpectedly discovered their equipment is a single point failure. Their extended outage is an extreme disappointment to us.
We are an extremely small team. The OSMF budget is tiny and we could definitely use more help. Real world experience.
We don’t run BGP because we don’t feel comfortable with the leap in requirements, cost (proper BGP capable routers) and we as a team don’t have deep experience with it. We also don’t have RIPE membership, or our own ASN (lease?) or our own IPv4 subnet (lease?)
Ironically we signed a contract with a new ISP in the last few days. Install is on-going (fibre runs, modules & patching) and we expect to run old and new side-by-side for 6 months. Significantly better resilience (redundant ISP side equipment, VRRP both ways, multiple upstream peers… 2x diverse 10G fibre links).