100 Petabytes moved!

June 29, 2015   |  Vas Vasiliadis

Last week we passed a pretty cool milestone for the Globus service: 100 petabytes of data moved! Even in this age of "big data", 100PB is a big number. How big, you ask? Well, 100PB is roughly...

...twice the entire written works of mankind, from the beginning of history, in all languages,
...1,000 times all of Twitter,
...8.88 million hours of HD video,
...21,276,596 DVDs,
...50 times all the material in US academic libraries,
...5 times the entire production of disk drives in 1995 (yeah, that's a pretty obscure one).

Globus is developed and operated by the University of Chicago, but our users move data all around the world:

  • The most northerly Globus endpoint is at N 65° 0' 0", W 18° 0' 0" in Sprengisandsleið, Iceland.
  • The most southerly Globus endpoint is at S 45° 52' 17.04", E 170° 30' 43.2" in Dunedin, New Zealand.
  • The most westerly Globus endpoint is at N 21° 18' 24.8400", W 157° 50' 60.00" in Honolulu, Hawaii, U.S.A.
  • The most easterly Globus endpoint is at S 40° 22' 8.7600", E 175° 37' 44.4000" in Palmerston North, New Zealand.

...and Queensland, New Zealand is the furthest we've travelled to present a Globus tutorial!

      Map of Globus endpoints.

 

Here are some other stops we made along the way:

  • Biggest transfer: 500.42TB
  • Smallest transfer: 1 byte
  • Longest running transfer: 182 days. Yes, it completed successfully—Globus is nothing if not persistent!
  • Fastest transfer: 58.5Gbps (average)
  • 55TB moved per day, on average, since the service was launched in November 2010
  • Average throughput: 637.7Mbps (since service launch)
  • First transfer request: Lisa Childers, Argonne National Laboratory.
  • 166,449 active Globus endpoints
  • 27,961 users registered

Now that's done and we're moving at full speed towards the next milestone: 1 exabyte.