Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Big Data and RDBS (Relational DB). Do They Fit?

  1. Feb 2, 2016 #1

    WWGD

    User Avatar
    Science Advisor
    Gold Member

    Hi All,
    I am having trouble seeing how Relational Databases (RDBS) can be used in the world of big data.
    The inflow of data seems to be way too fast for the database to reflect what is going on at a given
    moment. I understand this issue is supposed to be addressed by data warehouses. Is this correct?
    If so, what kind of databases are used by data warehouses?
     
  2. jcsd
  3. Feb 2, 2016 #2

    Borg

    User Avatar
    Gold Member

    NoSQL databases like MongoDB, Hadoop, etc.
     
  4. Feb 2, 2016 #3

    jedishrfu

    Staff: Mentor

    Data warehouses use the same kinds of databases as "big data". Usually, information from the corporate database is extracted and organized into smaller data warehouses useful for doing analysis and forecasting of trends.

    As an example, the corporate database (amazon) might contain information on customers, their purchases and wishlists, what they looked at... whereas the datawarehouse might not care about the customers buying behavior but only the products that were purchased when, where and how but not who and from that forecast what stores need what inventory.
     
  5. Feb 2, 2016 #4

    WWGD

    User Avatar
    Science Advisor
    Gold Member

    Thanks. So it seems like a division of labor where corporate finds patterns and the warehouses deal with day to day?
     
  6. Feb 2, 2016 #5

    QuantumQuest

    User Avatar
    Gold Member

    RDBMS have themselves become more fast, reliable and secure - you can take examples of big vendors like Oracle, but there is no silver bullet in this case too, so as pointed out by jedishrfu some well - balanced combinations of both RDBS and NoSQL are used in practice, in order to have the most balanced workload. The exact "how" varies according to company's needs.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook




Similar Discussions: Big Data and RDBS (Relational DB). Do They Fit?
  1. Data fitting (Replies: 1)

Loading...