{"id":8,"date":"2011-06-01T15:49:04","date_gmt":"2011-06-01T15:49:04","guid":{"rendered":"http:\/\/notebooks.dataone.org\/howmuchdata\/?p=8"},"modified":"2013-05-17T16:17:16","modified_gmt":"2013-05-17T16:17:16","slug":"potential-starting-points","status":"publish","type":"post","link":"https:\/\/notebooks.dataone.org\/ecological-data\/potential-starting-points\/","title":{"rendered":"Potential starting points"},"content":{"rendered":"<p>I have done a cursory exploration of some potential starting points for this project.\u00a0 Here&#8217;s my notes&#8230; which are a bit scattered. Let me know if you have questions.<\/p>\n<p>Ideas on where to start:<\/p>\n<ul>\n<li>Literature search on other estimates of data<\/li>\n<li>Definitions of data<\/li>\n<li>NEON: how they define data, estimate how much data they will produce, etc.<\/li>\n<li>Think about timeline: how much will amount of data change over time? What was it like in the past?<\/li>\n<li>Individual researchers: how much data do they generate? How much of the data is published versus how much is generated?<\/li>\n<li>Search for databases, database capacity<\/li>\n<li>Google search for definitions of data<\/li>\n<li>Comp sci textbooks?<\/li>\n<li>Data management (or database management) textbooks?<\/li>\n<li>Ecology\/envi bio textbooks?<\/li>\n<li>from libraries? (<a href=\"http:\/\/www.dartmouth.edu\/~osp\/resources\/policies\/dartmouth\/dataretention.html\">Dartmouth Example<\/a>)<\/li>\n<\/ul>\n<p>Websites to check out:<\/p>\n<ul>\n<li><a href=\"http:\/\/www.lesk.com\/mlesk\/ksg97\/ksg.html\" target=\"_blank\">http:\/\/www.lesk.com\/mlesk\/ksg97\/ksg.html<\/a><\/li>\n<li><a href=\"http:\/\/news.bbc.co.uk\/2\/hi\/technology\/3227467.stm\" target=\"_blank\">http:\/\/news.bbc.co.uk\/2\/hi\/technology\/3227467.stm<\/a><\/li>\n<li><a href=\"http:\/\/www.optitek.com\" target=\"_blank\">http:\/\/www.optitek.com\/<\/a><\/li>\n<li><a href=\"http:\/\/itknowledgeexchange.techtarget.com\/whatis\/how-much-digital-data-is-there-in-the-world-soon-to-pass-the-zettabyte-mark\/\" target=\"_blank\">http:\/\/itknowledgeexchange.techtarget.com\/whatis\/how-much-digital-data-is-there-in-the-world-soon-to-pass-the-zettabyte-mark\/<\/a><\/li>\n<li><a href=\"http:\/\/www2.sims.berkeley.edu\/research\/projects\/how-much-info-2003\/\" target=\"_blank\">Study at Berkeley; estimated amount of new info created each year<\/a><\/li>\n<li><a href=\"http:\/\/en.wikipedia.org\/wiki\/Exabyte\" target=\"_blank\">Wiki entry on exabyte<\/a><\/li>\n<li><a href=\"http:\/\/www.google.com\/url?sa=t&amp;source=web&amp;cd=7&amp;ved=0CE4QFjAG&amp;url=http%3A%2F%2Fwww.processor.com%2Farticles%2F%2FP2547%2F09p47%2F09p47graphics.pdf%3Fguid%3D&amp;rct=j&amp;q=estimate%20%22data%20production%22&amp;ei=Al3VTY7_LYW-sAPHg43xCw&amp;usg=AFQjCNGLD77SquPu8dWgvMficVuUo-5-Sw&amp;cad=rja\" target=\"_blank\">Something I found on google<\/a><\/li>\n<\/ul>\n<p>Papers to check out:<\/p>\n<ul>\n<li>[Bell 1994]. Alan Bell; <em>IBM Academy Digital Library Workshop<\/em> (Sept 12-13, 1994).<\/li>\n<li>[Census 1995]. United States Census Bureau <em>Statistical Abstract of the United States<\/em> Government Printing Office (1995).<\/li>\n<li>[Fargion 1996]. G. S. Fargion, R. Harberts, and J. G. Masek An Emerging Technology Becomes an Opportunity for EOS From the online file; see the URL: http:\/\/ecsinfo.hitc.com\/cdwg\/datamining\/overview.html.<\/li>\n<li>[Landauer 1986]. T. K. Landauer; &#8220;How much do people remember? Some estimates of the quantity of learned information in long-term memory,&#8221; <em>Cognitive Science,<\/em><strong>10<\/strong> (4) pp. 477-493 (Oct-Dec 1986).<\/li>\n<li>[Louis 1996 ]. Steve Louis <em>Cooperative High-Performance Storage in the Accelerated Strategic Computing Initiative<\/em> 5th NASA Goddard Conference on Mass Storage Systems and Technologies (Sept. 17-19, 1996 ). As reported by Ron Van Meter, <a href=\"http:\/\/www.isi.edu\/~rdv\/conferences\/goddard96.html\" target=\"_blank\">http:\/\/www.isi.edu\/~rdv\/conferences\/goddard96.html<\/a> .<\/li>\n<li>[Markoff 1997]. John Markoff; &#8220;When Big Brother is a Librarian,&#8221; <em>The New York Times<\/em> pp. 3, sec. 4 (March 9, 1997).<\/li>\n<li>[Mauldin 1995]. Matt Mauldin, &#8220;Measuring the Web with Lycos,&#8221; <em>Third International World-Wide Web Conference<\/em>, April 1995.<\/li>\n<li>[Mills 1996]. Mike Mills; &#8220;Photo Opportunity,&#8221; <em>Washington Post<\/em> pp. H01 (January 28, 1996)<\/li>\n<li>[Radding 1990]. Alan Radding; &#8220;Putting data in its proper place,&#8221; <em>Computerworld <\/em>pp. 61 (August 13, 1990).<\/li>\n<li>[Tenopir 1997]. Carol Tenopir, and Jeff Barry; &#8220;The Data Dealers,&#8221; <em>Library Journal<\/em> pp. 28-36 (May 15, 1997).<\/li>\n<li>[UNESCO 1995]. <em>UNESCO Statistical Yearbook<\/em> Bernan Press (1995).<\/li>\n<li>[Wells 1938]. H. G. Wells <em>World Brain<\/em> Methuen (1938).<\/li>\n<li>The World\u2019s Technological Capacity to Store, Communicate, and Compute Information (Martin Hilbert and Priscila L\u00f3pez)<em> Science 1 April 2011: 60-65.Published online 10 February 2011 [DOI:10.1126\/science.1200970] <\/em><\/li>\n<\/ul>\n<p>These papers are all on the server for you to access in a folder called &#8220;Reprints&#8221;. Their titles are <em>[Last name of first author][Last two numbers of publication year]. <\/em>Eg. Bollier10.pdf<\/p>\n<ul>\n<li>[1]\u00a0\u00a0\u00a0 D.\u00a0Bollier. The Promise and Peril of Big Data. Technical report, The Aspen Institute, 2010.<\/li>\n<li>[2]\u00a0\u00a0\u00a0 S.\u00a0Carlson. Lost in a sea of science data. <em>The Chronicle of Higher Education<\/em>, 52(42):A35, 6\/23\/2006 2006.<\/li>\n<li>[3]\u00a0\u00a0\u00a0 C.\u00a0Doctorow. Big data: Welcome to the petacentre. <em>Nature<\/em>, 455(7209):16\u201321, Sept. 2008. PMID: 18769411.<\/li>\n<li>[4]\u00a0\u00a0\u00a0 P.\u00a0B. Heidorn. Shedding light on the dark data in the long tail of science. <em>Library Trends<\/em>, 57(2):280\u2013299, 2008. Volume 57, Number 2, Fall 2008.<\/li>\n<li>[5]\u00a0\u00a0\u00a0 D.\u00a0Howe, M.\u00a0Costanzo, P.\u00a0Fey, T.\u00a0Gojobori, L.\u00a0Hannick, W.\u00a0Hide, D.\u00a0P. Hill, R.\u00a0Kania, M.\u00a0Schaeffer, S.\u00a0S. Pierre, S.\u00a0Twigger, O.\u00a0White, and S.\u00a0Y. Rhee. Big data: The future of biocuration. <em>Nature<\/em>, 455(7209):47\u201350, 2008.<\/li>\n<li>[6]\u00a0\u00a0\u00a0 C.\u00a0Lynch. Big data: How do your data grow?\u00a0 <em>Nature<\/em>, 455(7209):28\u201329, 2008.<\/li>\n<li>[7]\u00a0\u00a0\u00a0 O.\u00a0J. Reichman, M.\u00a0B. Jones, and M.\u00a0P. Schildhauer. Challenges and Opportunities of Open Data in Ecology. <em>Science<\/em>, 331(6018):703\u2013705, February 2011.<\/li>\n<li>[8]\u00a0\u00a0\u00a0 V.\u00a0S. Smith. Data publication: towards a database of everything. <em>BMC research notes<\/em>, 2(1):113, 2009.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>I have done a cursory exploration of some potential starting points for this project.\u00a0 Here&#8217;s my notes&#8230; which are a bit scattered. Let me know if you have questions. Ideas on where to start: Literature search on other estimates of data Definitions of data NEON: how they define data, estimate <a class=\"more-link\" href=\"https:\/\/notebooks.dataone.org\/ecological-data\/potential-starting-points\/\">Continue reading <span class=\"screen-reader-text\">  Potential starting points<\/span><span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[110],"tags":[],"_links":{"self":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts\/8"}],"collection":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/comments?post=8"}],"version-history":[{"count":4,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts\/8\/revisions"}],"predecessor-version":[{"id":1096,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts\/8\/revisions\/1096"}],"wp:attachment":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/media?parent=8"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/categories?post=8"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/tags?post=8"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}