This is an old revision of the document!

About the UPData Project

The UPData project was developed from February to September 2011 by a team composed of several element from the Faculty of Engineering and also from Rectorate of the University of Porto.

The project sought to study the application of data curation practices to the data produced at the university in research contexts.


The university has already implemented some preservation practices concerning scientific publications; currently there are two operational repositories running at the Rectorate - U.Porto's Open and Thematic Repositories. Publications are usually the most visible part of the research work conducted at the University. However, they are only the culmination of the complete research workflow, which in most cases includes considerable data gathering and analysis effort.

Data curation of scientific datasets assumes therefore a relevant role in ensuring the preservation and reuse or this data.

We believed that the experience of the researchers had to be taken in to account when representing the current data production, preservation and reuse circumstances at U.Porto - by analysing such concerns we would be able to identify some relevant improvement opportunities to the data management lifecycle at the university.

Stages of the project

The project was split into four stages. The first consisted in a brief preliminary study of similar projects such as the Data Asset Framework or the Edinburgh DataShare. From this study, an interview guide was drafted to be used throughout the interviews conducted with researchers from several of the university's research institutions. These institutions served two main purposes: determining the current data safeguarding, organisation and sharing practises followed by these researchers and also listing the most useful features that they in a data repository. The interviews yielded a series of reports and datasets (when these were available) and allowed the team to have a general view of the data management reality at U.Porto, a pre-requisite for the next phase.

The second stage of the project consisted in selecting and documenting the set of functionalities to be implemented in the third (development) stage. Since U.Porto's repositories are running on the DSpace repository platform, we have decided that this projected scientific repository should use the same system. Since it is an open-source project, it can be extended. From the interviews conducted in the first phase of the project derived a use case report and the data model for this projected data curation extension.


The gathered datasets are undoubtedly different from each other, which poses challenges in the way they can be indexed, stored and searched. For this relatively short project, we have decided to build the extension around those datasets which could be more easily interpreted, both due to the current availability of the original authors and also due to their simpler structure (namely data tables).

After the requirements analysis phase, the system was implemented and made available at the Rectorate. It is based on DSpace 1.7.2 and was extended to include some data curation functionality. It offers the tools that potential curators need to follow the specified curation workflow

The extension allows collection administrators to index files submitted via the DSpace self-deposit workflow. This is done in by manually building an Excel spreadsheet for each file, in a specific format, and uploading it to the repository. These spreadsheets contain the series of logical data tables stored in the original file along with relevant metadata for each of these tables. The repository will then translate the uploaded sheet, storing the data into an XML-based format to ensure the preservation of the data. After the file is curated, it becomes possible to access an area where the file's data can be explored. This explorer area includes data filters which can be used to find the most relevant parts of the data. The data explorer view also allows users to download sections of the data, including the data shown after they apply any set of filters. Another implemented feature is a search panel which can be used to find tables by the columns that they must include or by the metadata values associated to them.

To allow for the parametrisation of the metadata values and columns which can be included in these spreadsheets, two administration panels were added to the original DSpace Administration area.

The last stage of the project included the deposit and curation of one of the datasets gathered during the interviews with the researchers, which provided the testing scenario for the developed extension.

Several support guides were also written throughout the project, from which we highlight the user's manual and several installation guides and tips.


From this experiment we were able to determine that there are real needs for data curation practices at U.Porto. Researchers are open to using a repository platform, but only if it offers a real advantage over simply storing their data in their own storage media. Better ways to access and retrieve data are the best way to encourage proper care for data, since they increase the visibility of the researcher's work by allowing others to take advantage of the original research effort.

Translations of this page: