Vantiv Transaction Problems

One of our payment providers, Vantiv, had a full outage on Saturday morning from 6:48AM until 7:52AM Eastern. This impacted any registrations that were for races that used that back end payment processing. People trying to register during this time saw an error message and hopefully tried again later in the day. We are working... Continue Reading →

SLLLOOOWWW Site for 6 Minutes

Sorry! We ran a database migration (something we do often to upgrade the database to add tables or data fields) that really hit the servers hard for about 6 minutes from about 2:12PM until 2:18PM Eastern today. We apologize for the slow down - average response time rose to 5-10 seconds. The good news is... Continue Reading →

2017 Availability Report

Knock on wood, but it has been another great year for RunSignUp availability, hitting a perfect 100% for the second year in a row! As we covered in February when a major outage for many sites on the Internet like Slack, Trello and Venmo, RunSignUp's advanced infrastructure was able to weather the storm. And having... Continue Reading →

Participant Reports in a Disaster

One of the early disaster recovery mechanisms we built into RunSignUp is saving a full list of your participants in a CSV file once a day starting the week before your race. We send race directors an email link when this is first created each year. In the event RunSignUp is not available (knock on... Continue Reading →

Technology is Hard

Amazon, the leading Cloud provider had some major issues today. The screen shot on the right shows their status page around 1PM today - and RED is not good. Even USA Today, and CNN reported the 4-5 hour outage this afternoon: "People reported outages and delays on services like Slack, Trello, Sprinklr, Venmo and even... Continue Reading →

Sunday Afternoon Errors

UPDATE: We have made two changes to our system to try to improve this situation if it happens again. First, we have adjusted the settings on our New Relic Monitoring tool to try to catch this type of error so we can respond more quickly than hearing about errors from users. Second, we have added... Continue Reading →

Up ↑