Data Therapy

Data Therapy

We need a Data Mart!

We need a Data Warehouse!

We need a Data Lake!

We need a Data Scientist!

We need DataOps!

Chances are you already have DataOps running to some degree or another. DataOps may be called different things in different organizations, but basically they are the ones that make sure the data gets to where it needs to in a timely manner. 

A Data Warehouse, Mart, Lake are all projects that require a team (and time) to implement. Not to mention infrastructure, if done on-premise, or Cloud resources, which contrary to popular belief may be easy, but certainly is not cheap.

A Data Scientist can provide value and insight into your data so long as they are looking at the right data, and have the ability to enrich your data with other sources. Not to mention the resources they may need depending on your volume.

Traditional routes are tried and true, and there are lots of people within your organization that know the way and the tool-sets these traditional methods provide.

Hadoop, Spark, Cassandra, Neo4J are all "new" (to the enterprise maybe, but not to the community at large), which one solves your immediate problems? Which one is viable for the future? Should we just do traditional things, or should we start out on the road less traveled by others within our organization?

Which path do you take?

Chances are there are many more choices than just two.

Having a "sounding board" from outside your organization to discuss options in a non sales atmosphere is something that could be useful in these situations. Attend demo days of these new technologies, attend conferences, send some of your people to training.

Go, Learn things!

If you don't have the ability to do so, at least spend time speaking to someone who has done these things.

Sometimes, just having a conversation with a third party about your data may provide enough insight into where you need to go, that the path forward becomes obvious once seen.

Original article here

 

To view or add a comment, sign in

More articles by Doug Needham

  • Why Covid-19 will teach everyone what a Business Key is.

    I am a pariah. I care very deeply about the organization,storage, retrieval, access, security, and usability of data.

    14 Comments
  • A different way to represent your project work.

    On my blog, I wrote that job descriptions Suck! Not every job description I have ever seen is really bad, but what I…

  • Why data model?

    There are many opinions about best practices for modeling data. Although I am seeing more conditions where people do…

    5 Comments
  • Tips to win The Jackpot

    Win the Jackpot! The current powerball jackpot is above 1 Billion Dollars. My Facebook feed is full of people building…

  • Start Writing, and publishing! You can do it for 30 days!

    This blank sheet just said: "Start Writing". Choice words for the a new year.

    1 Comment
  • Just Write!

    Monday June 1st, my little book on Graphs and Data Structures is released on Amazon. Data Structure Graphs is a big…

    2 Comments
  • Comparing Data Science and Business Intelligence

    Over the past few years as I have been supporting more and more "non-traditional" (i.e.

  • What is your Spark Strategy?

    You have a Data Strategy? Awesome! You know where to put your data, how it's secured, who gets access, what forms are…

  • If the only tool you have is a hammer...

    There are some fundamental tools that everyone uses. Mathematics, Statistics, Calculus, Writing, Exposition, among…

  • DataOps

    I wrote a blog about DataOps, but I think this is truly just the beginning. What is DataOps? DataOps are the people…

Explore content categories