What is a Data Lake? Understanding the Buzzword

  • Thread starter Thread starter lomidrevo
  • Start date Start date
  • Tags Tags
    Data Lake
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
3 replies · 2K views
lomidrevo
Messages
433
Reaction score
250
I think the basic idea is quite clear, as for example defined by wikipedia:
A data lake is a system or repository of data stored in its natural/raw format, usually object blobs or files. A data lake is usually a single store of data including raw copies of source system data, sensor data, social data etc., and transformed data used for tasks such as reporting, visualization, advanced analytics and machine learning. A data lake can include structured data from relational databases (rows and columns), semi-structured data (CSV, logs, XML, JSON), unstructured data (emails, documents, PDFs) and binary data (images, audio, video).

But when I google more about this "technology", I am getting quite various ideas about what is considered as data lake. Some of them:
  • just a synonym to ETL approach to data processing
  • a distributed file system, like Apache Hadoop HDFS
  • NoSQL database with additional support of SQL, like for example MondogDB
  • or some proprietary architecture involving all of that and maybe some extra tools, like reporting, visualization and maybe machine learning?

How do you understand the term data lake? Is it just a buzzword?
 
  • Like
Likes   Reactions: sysprog
Physics news on Phys.org
pbuk said:
Yes. It can mean whatever the author wants it to mean.
that is my current impression, thanks :)
 
Maybe the 'data lake' is the 'reservoir' that engenders and sustains the 'cloud' ##-## I think that such metaphors are used for enablement of non-rigorous semblances of understanding ##-## I have encountered use of such fanciful terms much more by marketers than by engineers.
 
  • Like
Likes   Reactions: lomidrevo