Archive | Site Status RSS for this section

Project Activity Stats Restored and Improved

We are glad to announce that we have restored and overhauled the site stats for projects. Unlike our download stats, these include things like page visits, tracker hits, forum posts, etc. Let’s take a look:

project-statistics_-pdfcreator
Improved UI:

If you’re familiar with using our download stats, you’ll see that we’ve upgraded the stats system to have a more consistent and clean look.

Custom date reporting:
project-statistics_-allura-2

You can show stats for any custom date range you choose. (Please note, historical data prior to April 1, 2011 is still available via the original interface, and is currently being imported into the new system).

Improvements under the hood:

We have completely revamped the way our stats are calculated using our own homegrown open source project called Zarkov. You can expect to read more about this in an upcoming blog post, but in a nutshell, Zarkov is an event logger and aggregator we use internally. It’s written in Python and uses MongoDB.

What’s next?

Currently, we are working on importing old data from before April 1, 2011 and tweaking the project rankings and sitewide stats (to include SCM data for Bazaar and Mercurial, and fixing a few minor bugs).

We greatly appreciate everyone’s patience while we make things better.

CVS Fully Restored

CVS service has been completely restored for all projects. If you were one of the projects affected by the outage, please let us know if you are experiencing any problems. We have an ongoing commitment to continuing to provide this service for those currently using it, and your productivity is very important to us.

Further Update on CVS Outage

On 2011-07-16, one of our several CVS servers suffered a catastrophic multiple disk failure, resulting in full loss of the server. We have multiple backups of the data, and we believe only a very small time window exists for when data may have been lost (minutes). Due to the amount of data involved, and the complexities of the CVS offering, this is delaying our ability to bring the service back online for the impacted project set. This recovery is being further hampered by a disk failure on the host we’re migrating data to. Once we are confident that service will be stable, the disk failures resolved, and normal routine operations are functional, we will restore service. Our current best guess is that service will be restored on 2011-07-21. Our primary concern is ensuring data safety, followed by service availability.

Moving forward, we have a renewed commitment to the CVS service offering. We plan on a multi-pronged strategy to help protect from bitrot and improve CVS availability and uptime:

1. We plan on re-implementing the CVS service offering using current best practices
2. We plan on discouraging new projects from using the CVS service and directing them to something that is more current
3. We plan on helping projects interested in migrating to a more current SCM platform through documentation and direct assistance as needed

The re-implementation of the CVS offering will require additional future CVS downtime. That downtime is not anticipated to last more than a day per project during migration to the new platform. We do not at present have an estimate on when the new service will be deployed, but will provide ongoing updates as the plan is hashed out further.

Again, thanks for your continued patience and we apologize for any inconvenience caused.

Sincerely,
SF.net Service Operations Group

Update on CVS outage

There is a subset of our projects that have been affected by a hardware failure of one of our CVS servers, and we wanted to give you a quick update. Projects using CVS beginning with the letters b, c, g, l, p, q, t, u, and y are experiencing CVS downtime. We are moving these repos to different servers and will have more of an update for you tomorrow.

Thanks for your patience!

Update on Download Stats Outage

Some of you may have noticed your download stats have been offline for a while. We wanted to give you an update as to what’s been going on. In short, our stats system has been having performance issues that were slowing down the rest of the site, and as such, we’ve disabled them for the time being until we are able to optimize and improve performance.

We are currently developing a testfix and we will begin load testing the beginning of next week. If we have indeed solved our perceived problem, then we can restore stats at that time and proceed with full implementation of the fix behind the scenes. If not, we’ll have to keep stats quiet for a few more days while further debugging commences, and we can go from there.

If you’re a project admin, you should know that there has been no loss of statistical data, and we’re working hard to restore your access to the stats as soon as possible. We know you use these stats to benchmark and track how you’re doing, and we know they’re important to you. They’re important to us, too.

We greatly appreciate your patience while we optimize the download stats service, and we’ll keep you updated on our progress.