AUTOMATION USING PYTHON

Automation is the technology by which a process or procedure is performed with minimal human assistance. Automation or automatic control is the use of various control systems for doing tasks with minimal or reduced human intervention.

The main advantages of automation are:

• Increased throughput or productivity.
• Improved quality.
• Improved robustness of processes or product.
• Reduced direct human labor costs and expenses.
• Installation in operations reduces cycle time.

Need of Automation in Today's Technical World

We are living in a new automation age in which robot and computers can not only perform a range of function physical work activity better and more cheaply than humans, but are also increasingly capable of accomplishing body process that include cognitive capabilities. These include qualification tacit judgments, sensing emotion, or even drive activities that used to be considered too difficult to automate successfully. 

Let's jump upon the objective of this article.

We (our team) have automated some of the major technologies like Hadoop (Big Data), Machine Learning (AIML), Docker and AWS Services (EC2,EBS,S3,CloudFront) by integrating them together in a Python Script.

In python script, we have provided following features:

🔰 AWS SERVICES :-

Amazon Web Services offers reliable, scalable, and inexpensive cloud computing services. AWS launched in 2006 from the internal infrastructure that Amazon.com built to handle its online retail operations. AWS offers many different tools and solutions for enterprises and software developers that can be used in data centers. Groups such as government agencies, education institutions, nonprofits and private organizations can use AWS services.

Our menu provides following AWS services :

1. Configuring AWS CLI.
2. Creating and deleting key pair.
3. Creating and deleting Security groups.
4. Adding Inbound Rules to security group.
5. Launching, starting, stopping and terminating EC2 instance.
6. Creating EBS Volume and attaching it to EC2 Instance.
7. Creating, formatting and mounting a partition.
8. Configuring webserver.
9. Creating S3 bucket and uploading files in it.
10. Creating CloudFront Distribution.

__________ ________________________ __________

🔰 HADOOP :-

Hadoop is an open-source software framework for storing data and running applications on clusters of commodity hardware. It provides massive storage for any kind of data, enormous processing power and the ability to handle virtually limitless concurrent tasks or jobs. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.

Our menu provides following Hadoop services :

1. Installing Hadoop and JDK software in system.
2. Configuring Namenode and starting hadoop service.
3. Configuring Datanode and starting hadoop service.
4. Setting up Hadoop Cluster.

________ __________________________ ___________

🔰 Docker :-

Docker is an open platform for developing, shipping, and running applications. Docker enables you to separate your applications from your infrastructure so you can deliver software quickly. With Docker, you can manage your infrastructure in the same ways you manage your applications. It is a tool designed to make it easier to create, deploy, and run applications by using containers.

Our menu provides following docker services :

1. Installing and starting docker engine on system.
2. Pulling images from docker hub.
3. Launching, starting, stopping and deleting docker containers.
4. Remove images and containers.
5. View container and image info.

________ ____________________________ _________

🔰LVM PARTITION :-

LVM is a tool for logical volume management which includes allocating disks, striping, mirroring and resizing logical volumes. With LVM, a hard drive or set of hard drives is allocated to one or more physical volumes. LVM physical volumes can be placed on other block devices which might span two or more disks.

Our menu provides following LVM facilities:

1. Creating physical volume.
2. Creating volume groups.
3. Creating logical volume.
4. Creating LVM partition, formatting it and mounting it on datanode directory to provide elasticity to it.

________ ______________________________ ________

🔰ML MODEL :-

Machine learning is an application of artificial intelligence (AI) that provides systems the ability to automatically learn and improve from experience without being explicitly programmed. Machine learning focuses on the development of computer programs that can access data and use it learn for themselves.

Our menu provide a model that will predict salary of an employee based on his/her experience.

_______________________________________________________________________

So, this was a small description about the functionality of our Python TECHSTACK Menu.

In this way, our team successfully completed the TEAM_TASK_1.

Thank You !!