{"id":1813,"date":"2013-09-27T19:32:18","date_gmt":"2013-09-27T19:32:18","guid":{"rendered":"https:\/\/notebooks.dataone.org\/?p=1813"},"modified":"2013-09-27T19:32:18","modified_gmt":"2013-09-27T19:32:18","slug":"dmptool-ux-ui-testing","status":"publish","type":"post","link":"https:\/\/notebooks.dataone.org\/data-science\/dmptool-ux-ui-testing\/","title":{"rendered":"User Experience Lab: DMPTool Usability Testing"},"content":{"rendered":"
Some earlier conversations<\/a> suggested that I would be assisting with a usability analysis of the DataUP Tool in the UTK-ORNL User Experience Lab<\/a>.<\/p>\n However, more recent discussions between Mike Frame with the USGS and Carly Strasser and Patricia Cruse with the California Digital Library have shifted focus to the Data Management Planning Tool (known by the name DMPTool).<\/p>\n The DMPTool<\/a> is another software program that I took some instruction in using as part of the 2013 University of New Mexico Walter Dean Environmental Information Management Institute<\/a>.\u00a0 I also had exposure to this tool as part of my coursework in Environmental Informatics<\/a> with Professor Frame<\/a>, in his role as an adjunct faculty member at the University of Tennessee School of Information Sciences<\/a>.<\/p>\n Towards better familiarizing myself with the DMPTool in advance of user experience testing, I think I should dig through my course files to locate copies of presentations and training materials related to the DMPTool.<\/p>\n The DMPTool<\/a> is part of the DataONE Investigator Toolkit<\/a>. Essentially a Web application, it is described on DataONE.org as follows:<\/p>\n \u00a0The DMPTool is a means for researchers to develop practical data management plans<\/a> consistent with agency requirements and available resources.<\/p><\/blockquote>\n Additional information is available online via a video demonstration: <https:\/\/dmp.cdlib.org\/help\/video_demo><\/p>\n And an online guide: <https:\/\/dmp.cdlib.org\/help\/guide<\/a>><\/p>\n This page essentially provides an explanation of who can use the tool, and tips for getting started including how to sign up and start a new plan.\u00a0 These fairly detailed instructions on using the DMPTool may be useful in designing some “task oriented” user experience and usability testing.<\/p>\n There is also a concise, bulleted overview of the DMPTool here: <http:\/\/blog.dmptool.org\/about-the-dmptool<\/a>\/><\/p>\n The DMPTool blog also features\u00a0 a Webinar series <http:\/\/blog.dmptool.org\/webinar-series\/<\/a>>, with recordings available for download.<\/p>\n Mike Frame relayed to UT-ORNL UEL staff that the DMP is undergoing an iterative development cycle.<\/p>\n It is possible that this is related to the DMPTool2 Project, which has its own project page here: <https:\/\/bitbucket.org\/dmptool\/main\/wiki\/DMPTool2Project<\/a>><\/p>\n From that project page, it is of interest that there is a timeline for “Recruiting UI design manager,” listed as “complete” on 3-15-13.\u00a0 At this time do not know who the UI design manager is, but this individual would likely be worthwhile talking to. I searched the DMPTool blog for “UI” <http:\/\/blog.dmptool.org\/?s=UI> but found no reference to a user interface design manager.\u00a0 A second search for ” ” brought up a blog entry stating “we now have a UI designer on-board at Purdue who will be working on the wireframe and UI aspects during this process.” It seems that the UI designer is based at Purdue.\u00a0 At any rate, Andrew Sallans – signing the post as DMPTool2 Project Manager, will be able to connect us with past efforts concerning UI\/UX testing on the DMPTool.<\/p>\n There is a full project proposal for DMPTool2 available online: https:\/\/bitbucket.org\/dmptool\/main\/downloads\/SloanDMPToolproposal.pdf<\/a><\/p>\n Objectives identified by Patricia Cruse, Director of the UC Curation Center at the California Digital Library include input on:<\/p>\n The expected benefit of this focus is to help assemble guidance for new and existing users.<\/p>\n Some information that will be forthcoming includes “wireframes” and a layout of graphics.\u00a0 “UI Wireframes Review” was reported “Complete” to the DMPTool wiki on May 24, 2013, so this is a more recently completed section.<\/p>\n Phase 2 “User Interface Available (static pages) for user testing and feedback is scheduled for October 2013, with full functionality in developer environment in November, and Beta release in December. So, this user experience testing appears to be timely.<\/p>\n Also, from this post: https:\/\/bitbucket.org\/dmptool\/main\/issue\/26\/usability-testing<\/a> it is apparent that UVA was doing some usability testing (posted 2011-08-21).\u00a0 It will be advantageous to coordinate with them to see what equipment they are using, what tests they have already done, and see if there is any particular unresolved issue that might inform testing for DMPTool2. (From recent correspondence and other information I have, the contact is likely Andrew Sallans<\/a> with University of Virginia Libraries.\u00a0 A quick google search reveals Andrew is “Head of Strategic Data Initiatives” and “Librarian for Digital Services” at Brown Science and Engineering Library.<\/p>\n I have a user account on DMPTool from setting up an account on DMPTool for me EIMI 2013 course, “Environmental Information Management.”<\/p>\n After logging in to my account, I can see the status of my plan.<\/p>\n I currently have one plan that I uploaded back in June – “Hobo Data Collection for 2013 EIM.” I guessed my user name, and fortunately found I had generated and saved a secure password for the DMPTool back in June with my online password manager (LastPass<\/a>). Interestingly, this is the URL that I have available: https:\/\/dmp.cdlib.org\/users\/new?institution_id=48<\/p>\n At the time that I set this up, I may have entered my affiliation as a University of New Mexico. I may also have signed up with my UNM netID. That’s because, as I recall, there was not a “University of Tennessee” affiliation – which is my home institution. So, I think re-visiting the available institutions would be worthwhile (looking at “institution_id” code would likely be valuable, and a key usability question – what does a user do when they encounter that their institution is not available to select?). As an example, there is a highlighted portion of Text that I only noticed after viewing the page several times.\u00a0 The text is located within a “text box” immediately to the right of the “login” portion of the site – it reads: “Anyone can use the DMP\u00a0Tool” and instructs users who don’t see their institution to use “None of the Above.”<\/p>\n On the log-in screen, I am shown the option to log in as a “new user” or “returning user.” There is some text with some text apparently directed at new users (It would be interesting to see if existing users look at this text, using an eye-tracking user-experience evaluation):<\/p>\n If your institution is listed below the DMP tool will provide links to local data management resources and support available to you.<\/p>\n <\/p>\n If you’re using the DMP tool for the first time you’ll be prompted to provide some additional information<\/p>\n <\/p><\/blockquote>\n There is also a drop-down menu with “Select Your Institution.”<\/p>\n Attempting to use Dreamweaver to extract the full list of institutions and save to an .xls file, via some transformations in Notepad++ to remove HTML markup. (Note: at present time I do not see the need to convert the file to an .XLS file, but it is now saved as a .txt file and archived at appropriate locations as described below).<\/p>\n After “viewing source” and copying out the portion of the HTML code pertinent to the drop-down, then pasting it into Notepad++, I can see that there are 102 listed option value choices for the drop down menu.<\/p>\n Note that “None of the Above” is an option, option value=”0″ and it is available at the very end of the drop-down menu.<\/p>\n Therefore, there are 101 institutions. This appears consistent with a recent news release of September 23 that “DMPTool adds 100th institution!” That article is linked online here: <http:\/\/blog.dmptool.org\/2013\/09\/24\/dmptool-adds-100th-institution\/<\/a>>.That article also lists to a wiki which apparently has updates for the institutions that participate: https:\/\/bitbucket.org\/dmptool\/main\/wiki\/Participants<\/a> (which incidentally lists 101, not 100 institutions.\u00a0 I surmise that UCOP does not count itself in the celebration of 100 institutions).<\/p>\n As I suspected, my home institution is “University of Tennessee” and the option value code is 91. \u00a0 As I had suspected, University of New Mexico is option value 48. It would be an interesting user experience question to know if I can change my institution to a new location, even if I previously set up my Data Management Plan at another institution.\u00a0 This might be something to try out. (Note: examining this more, it appears I am “locked” into using UNM, unless I change my institution using the “Edit DMPTool User information” tool available via\u00a0 the “Manage Profile” link on the home page.<\/p>\n I saved this text file as “DMPTool-Inst-List-20130927.txt” on my local machine at “C:\\Users\\tjessel\\Documents\\DataONE Research\\DMPTool-UX-2013,” e-mailed it to my UT Sharepoint repository folder, and uploaded it here: DMPTool-Inst-List-20130927<\/a><\/p>\n Upon logging in, I am taken to “My Data Management Plans”. I have the option to: edit, view, delete, share.<\/p>\n The option to export to Plain Text and Rich Text is also available.<\/p>\n I exported my class project data management plan as “Rich Text.” I am uploading that document to this research notebook: Hobo Data Collection<\/a> available at <https:\/\/notebooks.dataone.org\/wp-content\/uploads\/2013\/09\/Hobo-Data-Collection-.rtf<\/a>><\/p>\n For comparison to plain text, I also downloaded to my local machine and uploaded to this research notebook the .txt version: <https:\/\/notebooks.dataone.org\/wp-content\/uploads\/2013\/09\/Hobo-Data-Collection-.txt<\/a>>.<\/p>\n From the Web application page, some other basic information for my existing Hobo Plan is available.<\/p>\n That includes Plan Name; Solicitation Number (which I never supplied since my class project obviously did not have a solicitation number); Funder (I chose NSF-BIO: Biological Sciences (2013 – ); Status (I provided 5 of 5 questions – it would be worthwhile to look at those questions, I think).<\/p>\n I’m going to see if I can share my “Hobo Data Collection” using the [share] link. Clicking “share” appears to have generated a link:<\/p>\n http:\/\/dmp.cdlib.org\/pdf\/c4e0677e-2795-11e3-89eb-005056b30215.pdf<\/a><\/p>\n Note there is the option, after clicking [share] and generating a link, to [retract].<\/p>\n For the purposes of evaluating a “real” data management plan (versus my own data management plan that is far-from-professional or a bona fide examplar) it might be useful to search Google for the following:<\/p>\n “Data Management Plan” filetype:pdf and site:http:\/\/dmp.cdlib.org\/pdf\/<\/a><\/p>\n I’m surprised this yielded no results.<\/p>\n RE-execute, drop the extras in the URL (http)<\/p>\n “Data Management Plan” filetype:pdf and site:cdlib.org\/pdf\/<\/p>\n One result, and not of interest.\u00a0 Possible any DMPTool plan created is not available online.<\/p>\n Trying something broader: “Data Management Plan” AND cdlib.org\/pdf\/<\/p>\n Unfortunately I’m not seeing any published Data Management Plans available. Possible they are not indexed by Google.<\/p>\n Note: later during the course of today’s research effort, I found a page with a variety of example data management plans keyed to the specific type of funder template. These plans are listed here: https:\/\/dmp.cdlib.org\/pages\/funder_requirements<\/a>.There appear to be five sample data management plans for three types of funders. I am listing the direct hyperlinks below:<\/p>\n This one in particular seems to be an over-arching, generic example: https:\/\/dmp.cdlib.org\/documents\/Sample_Plan_DataOne.pdf<\/a><\/p>\n The “generic” plan was generated by the DMPTool in October 2011.\u00a0 Like my class project plan generated in June 2013, the DMPTool output includes 5 main headings:<\/p>\n It’s noteworthy that these differ from my class project DMPTool output’s headings:<\/p>\n This may be because the two Data Management Plans were created with a different profile.\u00a0 There is an institutional profile, and then there is the specific metadata profile.\u00a0 I’ve already extracted the 101 institutions current as of September 27, 2013.\u00a0 I think it’s worth looking at the various profiles available – this could be useful for understanding how various audiences might use the DMPTool.<\/p>\n Created a file.\u00a0 There are 20 total profiles at the moment:<\/p>\n DMPTool-Profile-List-20130927<\/a> <https:\/\/notebooks.dataone.org\/wp-content\/uploads\/2013\/09\/DMPTool-Profile-List-20130927.txt<\/a>><\/p>\n C:\\Users\\tjessel\\Documents\\DataONE Research\\DMPTool-UX-2013<\/p>\n These are the 20 supported “funding templates” as they appear on the drop-down menu:<\/p>\n Question: will each of the sections in the plan description be different, depending on the profile used? If so, may be worth waiting to see \/ inquiring if there is existing documentation on each template, rather than wading through each of the 20 to compare and contrast the templates. (Note: further research effort indicated there is at least a funder template available saved as a .RTF file).<\/p>\n I also think it is useful to look at the prompts for the various sections – it would be interesting to know if the prompts are different for each of the 20 templates. The funding requirements are described in detail here: <https:\/\/dmp.cdlib.org\/pages\/funder_requirements<\/a>>, and it seems to be the case that each funder has a unique text file associated with it. For example, “Gordon and Betty Moore Foundation” appears to have three requirements: Data description; Data management; Data sharing. In contrast, “NSF-Bio: Biological Sciences (2013- )” entails the 5 requirements as seen in my class project example using that template.\u00a0 Note the descriptions in the template are different from the prompts in the Web application (Web application prompts are more extensive, to be specific).<\/p>\n From my class project example using “NSF-BIO: Biological Sciences (2013- ),” I have the following prompts when interacting with the “edit” component of my “Hobo Data Collection” plan accessed via <https:\/\/dmp.cdlib.org\/plans\/6578\/edit>:<\/p>\n Data Collected, Formats and Standards<\/strong><\/p>\n Describe the data to be collected (actual observations) during your research including amount (if known). Name the type of data, the instrument or collection approach, and how the data will be sampled. If actual data are interpreted, note the interpretation. Describe any quality control measures. Also describe the final derivative products (datasets and software or computer code) and the analysis used including analytical software packages that are required for replication, etc. Describe the format of your data; think about what details (metadata) someone else would need to be able to use these files. Describe the structural standards that you will apply in making data and metadata available. For example, for most ecological data, documentation should be structured in Ecological Metadata Language (EML). An example of metadata could also be as simple as a “readme file” to explain variables, structure of the files, etc. Consider these questions<\/em>:<\/p>\n Data Storage and Preservation:<\/strong><\/p>\n Use this section to describe your long-term strategy for storing, archiving and preserving your data. Consider these questions<\/em>:<\/p>\n Dissemination Methods:<\/strong><\/p>\n Describe how and where you will make these data and metadata available to the community. Remember BIO is committed to timely and rapid data distribution; make sure you address how soon your data will be available. Indicate what data will be made available and preserved. Will data be accessible on a web page, by email request, via open-access repository, etc.? Consider these questions<\/em>:<\/p>\n Policies for Data Sharing and Public Access:<\/strong><\/p>\n Describe the policies under which these data will be made available. It is very important, the reason a DMP is required, that you specify how you will share your data with non-group members after the project is completed. If the data is of a sensitive nature\u2014privacy or ecological endangerment concerns, for instance\u2014and public access is inappropriate, address here the means by which granular control and access will be achieved (e.g. formal consent agreements, anonymized data, only available within a secure network, etc.). Consider these questions<\/em>:<\/p>\n \u00a0Roles and Responsibilities<\/strong><\/p>\n Explain how the responsibilities regarding the management of your data will be delegated. This should include time allocations, project management of technical aspects, training requirements, and contributions of non-project staff\u2014individuals should be named where possible. Remember that those responsible for long-term decisions about your data will likely be the custodians of the repository\/archive you choose to store your data. While the costs associated with your research (and the results of your research) must be specified in the Budget Justification portion of the proposal, you may want to reiterate who will be responsible for funding the management of your data. Don\u2019t forget to include contingency plans for the departure of key personnel from the project.<\/strong> Consider these questions<\/em>:<\/p>\n Next steps.<\/p>\n At this point, I believe I have fully explored the DMPTool site’s features. I’ll be interested in how a usability study shapes up.<\/p>\n The next likely steps will be:<\/p>\n Finally, I noticed that within the notebooks.dataone.org domain – there is a “Enriching DMPTool Content” category which is linked to about 20 notebook entries from the 2012 internships by user ramandell<\/a>.\u00a0 The entries can be accessed online: https:\/\/notebooks.dataone.org\/dmptool-content\/<\/a>. It may be useful to review these notebook entries for insights.<\/p>\n From the first entry, ramandell references the “UVa Usability\/UX team.”<\/p>\n Rachel suggests she would work on a DMPTool “kit” to send to target organizations.\u00a0 Might be worthwhile in considering “personas” of potential DMPTool users for UX testing.<\/p>\n Mentions a Laura Miller at UVa. Mentions a NOAA template. Provides potential questions for contents of the DMPTool. Provides potential questions concerning Resources provided by the tool. Considers Design of the tool (e.g., layout and design).<\/p>\n Week 3 entry – did not see anything catch my attention.<\/p>\n Week 4 entry – Rachel mentions some other DMP related tools – Columbia University earth scientists have their own tool<\/a>; there is also something called DMPonline.<\/p>\n Rachel discusses an early idea for a user test. She proposes a test of about 30 minutes, with a goal for 8 – 10 total tests.<\/p>\n She mentions potentially starting a “twitter feed” or other type of forum. She suggests that due to the limited duration of her appointment, it might not have “a chance to gain momentum and value to the community.”<\/p>\n Andrew Sallans replied in a comment “please do send us the specific protocol prior to testing” so it is likely that he will have some existing protocol from DMPTool1.<\/p>\n Week 4 post: – Mentions a User Test Protocol in Review – 10 questions, online survey, conducted virtually, and focusing on content rather than functionality.<\/p>\n Sallans mentioned potential interest from NOAA, Forest Service, and USGS.\u00a0 Might be “newer” target audiences to consider (perhaps specific types of earth scientists).<\/p>\n Week 6 has some interesting back and forth with Sallans and Rachel concerning qualitative evaluation of DMPTool – https:\/\/notebooks.dataone.org\/dmptool-content\/the-medium-is-the-message-2<\/a>\/.<\/p>\n This post has some useful materials, specifically a September 2011 DMPTool Usability Report – Laura Miller has this.<\/p>\n Learning more about Usability Testing, Updates and New Ideas<\/a><\/p><\/blockquote>\n\n
<\/a>
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n