Next Generation Data Integration Challenges

Future landscape-scale analyses will rely on more and larger datasets, more computationally intensive models, and an ever increasing rate of data inputs and outputs. The question on many project managers’ minds is "How will my systems/people/integration activities keep pace with these needs?"

While there is no simple solution to this challenge, we do have options. The LCC IDMN project working groups explored current and upcoming data management concerns and developed some guidelines for addressing:

• how do we anticipate data storage needs;
• how do we handle larger datasets;
• how do we handle the “many dataset” challenge;
• how and when do we need to support high performance computing and supercomputer access;
• how do we ensure data streaming from mobile devices and field stations are accurately captured and processed in a timely manner;
• how do we address the many different data types being produced by researchers;
• how do users find and use these data;
• how do we know how much use these data get;
• and, what do we do about long-tail research data?

This presentation will cover both current user stories and provide insight about upcoming Large Landscape Conservation data management and integration trends.