Creating a Menu based program using Python:Integrating all the different Technologies!!

Kanishka Shakya

5 min readNov 10, 2020

Here, we have created a menu program using python script and using this we have done the following program through which we can access them locally or remotely.

The Following Four Use cases are been solved by our Project :-

Amazon Web Services (AWS) is a subsidiary of Amazon providing on-demand cloud computing platforms and APIs to individuals, companies, and goverments, on a metered pay-as-you-go basis. These cloud computing web services provide a variety of basic abstract technical infrastructure and distributed computing building blocks and tools.
Apache Hadoop is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.
Docker is a set of platform as a service (PaaS) products that use OS-level virtualization to deliver software in packages called containers.Containers are isolated from one another and bundle their own software, libraries and configuration files; they can communicate with each other through well-defined channels.

Technologies which we integrated with Python are :

⚡Docker

⚡Big-data Hadoop

⚡Web-Server

⚡Some Services of

⚡AWS Cloud

⚡Linux Partition

⚡Some common command of linux

Commands which we integrated in docker:

🔅To install docker: yum install docker-CE — nobest

🔅To check the version of docker: docker — version

🔅To check the running container: docker ps

🔅To check all the stop container: docker ps -a

🔅To check status of docker: systemctl status docker

🔅To check the docker image: docker images

🔅To download the docker image: docker pull {}

🔅To Launch the docker container: docker run -it — name {} {}

🔅To check the logs of particular os: docker logs {}

🔅To Start the docker service: systemctl start docker

Commands which we integrated in AWS Cloud:

⚡ To configure aws cli: aws configure

⚡To describe instances: aws ec2 describe-instances

⚡To describe keypair: aws ec2 describe-key-pairs

⚡To describe volumes: aws ec2 describe-volumes

⚡To describe volume status: aws ec2 describe-volume-status

⚡To describe security group: aws ec2 create-key-pair — key-name {}

⚡To terminate instances: aws ec2 terminate-instances — instance-ids {}

⚡To create s3 bucket: aws s3api create-bucket — acl public-read — bucket {} — region {} — create-bucket-configuration LocationConstraint=ap-south-1

⚡To check list of s3 bucket: aws s3api list-buckets

⚡To delete the s3 bucket: aws s3api delete-bucket — bucket {}

⚡To put object in s3 bucket: aws s3api put-object — bucket {} — body {} — key {}

Working of Menu Program:-

AWS Operations:-

AWS EC2 operations are one of the most use by every user, new or pros. So including them in the menu is very useful. Amazon Web Services is a subsidiary of Amazon providing on-demand cloud computing platforms and APIs to individuals, companies, and governments, on a metered pay-as-you-go basis. These cloud computing web services provide a variety of basic abstract technical infrastructure and distributed computing building blocks and tools.

What is Ec2 ?

Amazon EC2 provides scalable computing capacity in the AWS cloud. Leveraging it enables organizations to develop and deploy applications faster, without needing to invest in hardware upfront. Users can launch virtual servers, configure security and networking, and manage cookies from an intuitive dashboard.

Let’s Start Pratical Session:-

We have created the functionality of Hadoop, Docker, AWS CLI and basic commands of Linux .

Now,Python Menu Interface:-

When we run this program we will have to choose if we want to perform the program locally or remotely and put on the image one by one.

Web-Server :

A web server is server software, or hardware dedicated to running this software, that can satisfy client requests on the World Wide Web. A web server can, in general, contain one or more websites. A web server processes incoming network requests over HTTP and several other related protocols.

Commands which we integrated in Big-data Hadoop :

🔅To configure Hadoop cluster : vim /etc/hadoop/hdfs-site.xml ,vim /etc/hadoop/hdfs-site.xml

🔅To start Hadoop cluster : hadoop-daemon.sh start namenode, hadoop-daemon.sh start datanode

🔅To check Hadoop cluster start or not: jps

🔅To check the reports of cluster: hadoop dfsadmin -report

Working of Menu Program:-

we can write commands and setup the Hadoop clusters, or manually create partitions, or even setup an AWS instance.