Some Trends in Data Management and Processing

Some Trends in Data Management and Processing

(a) Processing data locally before moving

To minimize data movement seems to be a future technology direction. Processing the data where data resides and then sending out processed data may reduce use of bandwidth and also may enhance latency.   Some platforms and applications may already been using this concept but now it is being used in wider range of applications. Active storage networks,  databases, IOT platforms are some of the new areas where it is seeing its application.

(b) Micro Databases 

Storage and databases optimised for specific data may be another direction.  IOT  databases gives a hint in that direction.  These optimised databases may have higher latency while loading but later, can give better query performance and processing can be faster. 

(c) Data coupled with Micro-Service

Core OS and other similar OS are driving development of applications based on micro service leading to distributed applications. A database based on micro service architecture may provide great advantage for such applications. Micro service coupled with its own micro database can be a great source of enhanced performance of such applications.

Source: Research publications, Technology White Papers etc 

Good one. Was wondering whether you could add data management trends pertaining pertaining macro data bases or legacy mega-data oriented applications from banking/life sciences industries as well here.

Like
Reply

To view or add a comment, sign in

More articles by Dr Virendra Gupta

  • Tensorflow 2.0 Keras APIs

    In this short article, there is effort to explain all three classes of APIs being offered by Tensorflow 2.0 Keras APIs…

    1 Comment
  • Software Programming Languages - Is there a case for standardisation

    I have been learning programming languages from the days of my engineering education. I started with Fortran, then…

    10 Comments
  • How to Start on Learning about Design Thinking

    Based on my research on design thinking, I will say that if you want to get quick essence and sense of Design Thinking,…

  • Cloud Services Monitoring Middleware

    An interesting paper from Cedillo, Jimenez-Gomez, Abraham and Insfran (2015) on monitoring middleware for cloud…

    1 Comment
  • Data Science: Discriminant Analysis

    As name of this technique indicates, this technique can help in identifying variables which can discriminate…

    2 Comments
  • Data Science: Factor Analysis

    Many times, in the business situations or otherwise, we may face very large number of variables or dimensions in the…

    1 Comment

Explore content categories