Forget Data Science

Forget Data Science

A very interesting conversation last night concluded with the idea that ANNs, DBNs, RBMs, RNNs, and other deep learning methods contain all of the tools one needs for all the tasks that data scientists are often given. Part of my job for the last few years has involved a wide gamut of tasks - natural language processing, geographical reasoning, filtering, clustering, anomaly detection, quantitative analysis, behavior comprehension, and so forth. Can all of these be tackled with just one base tool? I was really excited hearing this idea, so let's discuss it.

It was then suggested, don't even do the ugly first 50% of work that you are often tasked with as a data scientist. You know what I am talking about. The janitorial stuff: cleaning up data, tagging, and creating meta-data! I have to admit, the idea is appealing. Writing and editing SQL scripts to clean data can be cumbersome. Sometimes you end up writing scripts after the SQL to further massage the data. In bygone years, I programmed in Perl, but lately I'm using my new favorite darling, Julia, for the work.

Raw inputs work to create a deep network that will produce the results I want. I assume any model needs tweaking, or perhaps the selection of the most appropriate method of building the deep network. Finally, engineering the visuals, reports, and so forth. I am not sure it will be less work than what I am already doing, but it would simplify the approach. It would also mean becoming familiar with a tight set of machine learning tools, rather than a large set of diverse tools and statistics (as I have been doing).

I'm even more curious what you think about this? I haven't really made the argument here for those not familiar with the basics of Deep Learning. I will state that I've seen Deep Learning used for NLP (Digital Reasoning had remarkable success around 2010 adding it to their classifier, and that's just the start), visual data (these algorithms still lead all of the public challenges in terms of accuracy and speed), and audio data (for example, Microsoft has been using DNN for Cortana as far back as 2012.) Is there any problem not well suited to deep learning?

What are your thoughts?

To view or add a comment, sign in

More articles by Peter Mancini

  • AI Consciousness: Real or Fiction

    I have to shake my head when I hear the many suggestions of AI having consciousness. While modern AI have many layers…

    16 Comments
  • AI and World View

    Did you ever consider the World View of the AI you use? I didn't realize there were differing World Views in AI, until…

    1 Comment
  • AI and your Medical Results

    I had a recent visit to Vanderbilt Medical Center for an odd cluster of minor complaints. Basically, I hurt my ACL, I…

    1 Comment
  • Uncertainty is Unsustainable

    The title of this article comes from an episode of Rick and Morty. I was reminded of it today and it sparked a lot of…

  • Culture Shock: Logistics

    I wasn't expecting to have the life experience to write this article. Yet here we are! Over the last two months I've…

    2 Comments
  • The Paradox of the Chicken and the Egg pricing

    What is going on? People are raiding Costco and other big stores for the eggs. Prices are sky high on eggs.

    5 Comments
  • Undoing Confusion about the PAT-25 and AA-5342

    It is getting harder and harder to believe the news and the US Government these days. It feels like the US Government…

    5 Comments
  • Bitcoin VS Spooky Action at a Distance

    Nerds built Bitcoin. Can even nerdier nerds undo $1,168,226,964,804 in value? [Author's note: this article contains…

    7 Comments
  • Technologies are Rarely Questioned

    Inspired by Dr. Michelle Addington, Architect We assume they evolve and become obsolete as maturing scientific theories…

    5 Comments
  • Can ChatGPT cure Big Business Disease?

    Several years ago I was speaking with a great friend about Big Business Disease. This is when a company gets so big it…

    1 Comment

Others also viewed

Explore content categories