NSF CI Compass: OOI Data Delivery User Experience
During a recent NSF CI Compass webinar, Jeffrey Glatstein, OOI Senior Manager of Cyberinfrastructure at WHOI, gave an inside look at how OOI has been rethinking and improving its approach to data delivery. His talk, “Data Delivery User Experience: Is it important to your facility?”, explored how the team has been working to make OOI’s massive data sets more accessible and usable for researchers and stakeholders.
Jeff oversees data systems that handle real-time streams from 900 instruments spread across 80 platforms. Altogether, OOI manages over 175 billion rows of data, 2.8 petabytes of raw data, and more than 13,000 hours of video. Jeff’s team is responsible for ensuring it remains readily accessible and usable by the research community.
Before the overhaul, users relied on a legacy portal called OOINET. While it provided basic functionality, it wasn’t always user-friendly. Users frequently cited long wait times, confusing interfaces, and difficulty locating specific data. These challenges sparked a full-scale effort, beginning in 2018, to improve the user experience from the ground up.
The approach placed strong emphasis on the user experience. Jeff and his team conducted interviews, reviewed previous feedback, and dug into system analytics to identify areas needing improvement. They looked at a range of technical solutions before ultimately partnering with Axiom Data Science to implement a new data access platform – what we now know as the OOI Data Explorer.
The webinar highlighted some of the major tech upgrades involved: Kafka for better message streaming, JupyterHub for advanced data access, Grafana for monitoring, and ERDDAP to improve data delivery. But what really set the project apart was its focus on making things easier and faster for users. Instead of relying only on on-demand plots, the new Data Explorer offers pre-generated visualizations and quicker access to datasets. Search tools were also upgraded, making it easier for users to find exactly what they’re looking for.
Scientists are now able to submit more precise queries, navigate the system with greater confidence, and achieve more effective search results. Jeff noted that the team remains focused on further enhancing the interface, broadening search capabilities, and streamlining the data download process to ensure an even better user experience.
Although Data Explorer has already delivered significant improvements, Jeff emphasized that OOI remains committed to continually enhancing overall functionality. These ongoing efforts reflect a broader mission: ensuring that the vast and valuable data collected from the ocean is not only accessible but also readily usable by the scientific community.
Credit: Jeffrey Glatstein
Credit: Jeffrey Glatstein