Introducing the new Data Explorer!

Last modified by Julia Gilmore on 2025-01-27, 13:44

Article de blogue en français ici.

We are excited to announce the official release of the new and improved Data Explorer in Borealis. Data Explorer is a comprehensive web application designed to support data exploration, analysis, and curation at the variable-level in Odesi and Borealis. 

Following the Odesi data repository migration from Nesstar to Borealis in fall 2023, feedback from the community indicated a need for additional functionality in connected tools to better support data depositors, curators, researchers and users. Over the past year, we re-developed the Data Explorer and Data Curation Tool (previously two separate tools) and combined them into a single, enhanced application connected to Borealis and Odesi.

Data Explorer supports users in Odesi and Borealis with viewing and exploring tabular data files and variables by groups or category/subject, variable metadata, summary frequencies and statistics, building cross-tabulations, charts, subsetting, and downloading data. 

The new Data Explorer allows authorized users to view and edit variable metadata using the Dataverse APIs and Data Documentation Initiative (DDI) metadata. New features enable data administrators and curators to create and edit variable-level metadata for tabular files (e.g., SPSS, R, Excel, CSV) in Odesi and Borealis for enhanced curation workflows, combining the full functionalities of the previous Data Curation Tool.

Data Explorer is an open-source web application built and developed by Scholars Portal (OCUL). The application is fully integrated with the open-source Dataverse repository project (dataverse.org) developed by IQSS, Harvard University together with global collaborators. 

An overview of the new features and functionalities in Data Explorer is provided below. To learn more about getting started with the new Data Explorer, refer to the Using the Data Explorer section of the Odesi User Guide, as well as two new video tutorials. 

Updated Web Interface

The new Data Explorer offers a refreshed, accessible web interface with updated navigation and icons. 

New navigational buttons for variable “Groups” and option to show “All Variables” are added, along with new “Cross Tabulation” and “Variables” tabs in order to view selected variables and categories to create tables and charts. 

The new user interface can be viewed in English or French, and users can view the application in dark mode, if desired. The updated interface also provides an improved experience for mobile-device users.

Screenshot indicates key variable navigation features (including the search bar and the items per page options) as well as language and dark mode settings 

Enhanced Variable Exploration

The new Data Explorer provides enhanced variable searching, filtering, viewing, and exploration capabilities. 

Users can search by variable names, labels, and IDs using the “Search table” bar at the top of the center panel. Users can also view and filter variables by groups, categories, and labels to view frequencies and build cross-tabulations and charts. 

Users can select the “View Variable” graph icon to view variable frequencies and chart data, summary statistics, and additional variable information such as questions, interview instructions, weights, universes, and more. Charted data shows values, categories, counts, count percentages, weighted counts, and weighted percentages. Users can select or deselect checkboxes for each variable to include or remove selected categories and values from the summary graphs provided.

In the “View Variable” window, users can navigate between adjacent variables using the navigation arrows to view more variables.

Screenshot of the Data Explorer user interface with emphasis placed on the “View Variable” button

Screenshot of the “View Variable” window denoting the window’s navigation arrows.

Screenshot of the View Variable window depicting the Chart data

Screenshot of the Summary statistics and variable information sections of the View Variable window.

Cross-Tabulations & Chart Builder

The new Data Explorer also provides improved functionality for creating cross tabulations and charts.

To build a cross tabulation, select the “Add to cross tabulation” icon for each desired variable. Once all variables have been selected, navigate to the “Cross Tabulation” window using the tab in the top left. 

Screenshot of the main Data Explorer user interface placing emphasis on the “Add to cross-tabulation” button.

From here, assign the variables as a row or column using the drop down menus, and apply any desired “Group” or “Category” filters. The table will automatically generate based on these inputs.

Screenshot of the cross-tabulations tab demonstrating how assigning variables as rows or columns affects the cross tabulation table construction.

Users now have the option to export cross tabulation tables and charts from Data Explorer in CSV format for further analysis. Toggling between Chart and Table to choose the desired export format, click the “Export chart/table as CSV” button.

Variable Subsetting & Download 

Users can also download select variables as a subset. From the variables tab, users can select the check boxes next to the desired variables in order and then click the “Download” drop-down button in the top right corner. The number of selected variables will appear next to the “Download” button. Select “Download selected variables as a subset”. 

Screenshot of the main Data Explorer user interface with the “Download” scroll down menu open.

Note that we strongly recommend downloading the original data file in addition to any subsets, and users are strongly encouraged to consult original data files and accompanying documentation when conducting data analysis for their research. 

Import DDI XML 

With newly combined functionality for both exploration and curation, the new Data Explorer allows depositors and curators to import and reuse DDI XML metadata. 

Alt-text: Screenshot of the main Data Explorer page with an emphasis placed on the “Import Metadata” button.

In the bottom left corner of the “Groups” panel in Data Explorer, select “Import Metadata”. From the “Import XML” page, depositors and curators can select or deselect DDI sections and texts to include in the import. 

Screenshot of the “Import XML” page, which includes the File Select option, as well as the “Select DDI sections and texts to include” check-box options.

Please note that the “Import XML” feature only allows for import and re-use of Dataverse-generated DDI metadata at this time. 

DDI Codebook HTML & PDF Download

Upon publishing a dataset, a DDI standard metadata ‘DDI Codebook’ will be automatically created for that dataset. This Codebook can be downloaded through the “Access File” drop-down option in Borealis. Under “Metadata Download” select “Variable Metadata” to download the DDI Codebook.Users can also access a DDI Codebook as an HTML or PDF file through the Data Explorer’s “Download” tab.

Screenshot of the Dataset main page with the “Access File” drop down menu with an emphasis placed on the “Variable metadata” download option.

Screenshot of the Data Explorer main user interface with the Download drop down menu open. Green arrows point towards the “Download PDF format file” and “Download HTML format file” options.

New Documentation & How-to Videos

With the release of the new Data Explorer, we have prepared updated documentation to support researchers, depositories, and curators with the new interface and functionalities. 

The existing Odesi User Guide and Borealis User Guide have been revised to reflect the new Data Explorer, including updated screenshots. The Borealis Admin Guide has also been updated to reflect changes to curation workflows using the new Data Explorer. 

Two new video tutorials are also now available on the Video Tutorials tab of the Odesi User Guide and on the Borealis YouTube channel. The first video provides an overview of the new Data Explorer. The second video provides more information about using Data Explorer for data curation. 

The GitHub Repository for Data Explorer is also publicly available. 

Contact Us

If you have any questions or concerns about the new Data Explorer, please reach out to odesi@scholarsportal.info and a member of our team will be in touch as soon as possible.

Posted by Gabby Crowley  · Permalink · Comments (0)