- Operations and Site reliability engineering principles
- Microservices architecture and Distributed application design principles
- CICD process from source code management, to build, deployment, test automation, and production deployments
- Infrastructure as a Service (IaaS) layer in any of the public cloud environments (AWS, Google Cloud, or Azure)
- Infrastructure as Code (IaC), and Deployment automation with any of the following (Terraform, Ansible, Chef, or Puppet)
- Container orchestration with any of the following tools (Kubernetes, Mesos, Docker Swarm, or ECS)
- OpenShift Container Platform (v3) in a multi service environment with experience in setting up Build, Test and Deployment automation to various stages till Production
- Development experience with any programming language
openshift profile
Ansible tutorial index
Ansible Topics:
BEFORE ANSIBLE :
WEB SERVER + APP SERVER + DB SERVER
1) Ansible Inventory
Ungrouped Hosts
Grouped Hosts
Groups of Groups
2) Ansible Server Installation.
Ansible Server Configuration file
- Update Username
- Update Keys
- Update SSH Parameters
- Update Roles
- Update Inventory
- Update MISC paramerters
How ansible picks the configuration
3) Setting up SSH KEYS to and checkig connection to remote nodes.
4) Ansible Facts.
- Default facts from nodes
- Create custom facts on nodes.
- How to print facts
5) Ansible Playbooks
- Define and use of 'hosts' parameter
- Define and use of 'become' parameter
- Define and use of 'gather_facts' parameter
- Define and use of 'tasks' parameter
- Define and use of 'vars' parameter
- Define and use of 'vars_files' parameter
- Define and use of 'vars_prompt' parameter
- Define and use of 'handlers' parameter
- Define and use of 'roles'
List of Modules to be discussed:
- setup
- ping
- yum
- yum_repository
- service
- copy
- get_url
- shell
- command
- set_fact
- authorized_key
- user
- debug
- file
- find
- fetch
- hostname
- include
- include_vars
- mail
- package
- stat
- unarchive
- gce
- ec2
- wait_for
- wait_for_connection
- Conditions
- when
- Loops
- with_items
- How to store output of one task and use it in another task.
- variables from:
- vars
- vars_files
- vars_prompt
- vars from inventory hosts
- vars from inventory groups
- Roles
6) Roles
- Create Role
- Define Role
- Write roles
- Role Dependencies
- Variables from Roles
- Variable Precendence.
7) MISC
- Ansible Vault
- Ansible Pull
- Ansible Galaxy
8) Ansible in Real Time
7) Ansible Tower
- Role-based access control
- Job scheduling
- Portal mode
- Fully documented REST API
- Tower Dashboard
- Cloud integration
-----------------------------------------------------------------
Linux interview prep
Most of the people are trying to learn Linux but they fail due to no direction to follow. Here is an directions to follow and learn Linux.
## Basics ##
1. Introduction to Linux -- http://bit.ly/Introcudtion_to_Linux
2. Linux Architecture -- http://bit.ly/Linux_Architecture
3. Windows Vs Linux Comparision -- http://bit.ly/Windows_Vs_Linux
4. Bash Shell features -- http://bit.ly/bash_shell
5. Linux Directory Structure -- http://bit.ly/Linux_Directory_structure
6. Linux Boot Process Detailed explanation - http://bit.ly/LinuXboot_process
7. Basic and Common Commands - http://bit.ly/Basicommands
8. All Linux Commands with there description - http://bit.ly/Linux_commands
25 Linux commands - http://bit.ly/29ZhNDn
#### System Administration Topics ##
9. Linux Text Editors - http://bit.ly/Text_Editors
10. Linux Operating System Installation - http://bit.ly/Linux_OS_Installation
11. User Profile Management - http://bit.ly/User_Profile_management
12. User Administration (User Creation, Modification and deletion) - http://bit.ly/User_Administration
13. Access Control List - http://bit.ly/29Md71v
14. Head, Sort, Tail, Uniq, Paste, Cut, Tr, Sed and diff commands with examples - http://bit.ly/String_commands
15. Soft Link Vs Hard Link - http://bit.ly/Soft_vs_hard_link
16. Search related commands Grep, find and locate - http://bit.ly/search_commands
17. Task Automation using crontab and at - http://bit.ly/Linux_crontab Crontab job schedules - http://bit.ly/29Metcy
18. File system and Creating Standard partitions - http://bit.ly/Creating_partition
19. Logical Volume Manager (LVM - Part1) - http://bit.ly/Linux_LVM
20. Logical Volume Manager (LVM - Part2) - http://bit.ly/Linux_LVM2
21. Disk quota management - http://bit.ly/Disk_quota
22. RPM / YUM - http://bit.ly/Linux_YUM
23. All RAID Levels explained - http://bit.ly/RAID_Levels
24. Creating and Managing Software RAID - http://bit.ly/Manage_RAID
## Advanced System Administration ##
25. Neworking installing and configuring the Network Card - http://bit.ly/Linux_networking
26. Configuring EPEL Repository - http://bit.ly/2a0lQCh
27. Network File System (NFS) - http://bit.ly/29Q7Tp7
28. Samba Server (SMB) - http://bit.ly/2ajNVAs
29. File Transfer Protocol (FTP) - http://bit.ly/29Q6G1h
30. Web Server / Apache (HTTPD) - bit.ly/2a7lnxB
31. Mail Server configuration (SMTP) - http://bit.ly/1QopUJy
32. DHCP Server installation and configuration - http://bit.ly/29RMzip
33. Master DNS Server installation and configuration - http://bit.ly/29FbQtF
34. LDAP Client with AutoFS - http://bit.ly/29FbQtF
35. Open LDAP Server installation - http://bit.ly/29Ye4qZ
36. SELinux Security - http://bit.ly/2a0lagi
37. SQUID Proxy Server - http://bit.ly/2a0lewB
38. MariaDB Installation - http://bit.ly/29RO1Rw
39. Recovering ROOT Password - http://bit.ly/29LZW1S
40. Secure Web Server Linux - http://bit.ly/2a2mTON
41. Local YUM Server configuration - http://bit.ly/1lpfjBm
42. PXE Boot Server installation and configuration - http://bit.ly/29LmApa
43. Process Management - http://bit.ly/1kW70fO
44. Creating Secret Web Server - http://bit.ly/29MWTI4
45. Creating Multi User Samba Share - http://bit.ly/2a2nC2w
46. Linux Boot Process - http://bit.ly/2a7mOMM
47. Swap File System - http://bit.ly/29RO00j
48. Firewalld configuration - http://bit.ly/29M0zbE
49. Kerberized NFS Shares - http://bit.ly/29RNZt0
50. Installation and Configuration NTP - http://bit.ly/29LR5kK
51. Setup Your Own Linux Lab - http://bit.ly/29LnWAf
## Interview Questions and Answers ##
52. Interview questions and answers - Part 1- http://bit.ly/1NRnpMv
53. Interview questions and answers - Part 2 - http://bit.ly/1NtRXp9
54. Interview questions and answers - Part 3 - http://bit.ly/1Sr7juF
## File system error resolution ##
55. mount: Argument list too Long - http://bit.ly/1Lg4qqm
56. ## Download E-Books - http://bit.ly/29Q6WwW
57. ## A Complete RHCSA and RHCE course content - http://bit.ly/2a2nxvC
Devops things to learn.
1. Lead evaluation, design, and implementation of container orchestration platform
2. Automation of systems provisioning/management and application deployment processes
3. Design, deploy, and maintain standards, best practices, and processes for production support, incident response and root cause analysis, capacity and performance management, health and security monitoring, disaster recovery, application building, packaging, configuration management, QA, and deployment.
4. Design and implementation of Service Discovery/Registration systems with integration with software and hardware load balancers
5. Work with engineers and product management teams across multiple organizations to advise and influence architecture and technical strategies.
6. Develop, and promote the development of, architectural/technical documentation, whitepapers, presentations, and proposals
1. Broad technical background in server, storage, network, virtualization, cloud, and DevOps areas. Highly energetic focus on constant learning
2. Excellent relationship and partnership building skills with customers, vendors, peers, and upper management, within and across organizational boundaries
3. Sharp analytical, problem solving, and creative thinking skills. Expert troubleshooting, debugging, and solution design and implementation skills
4. Extensive experience designing large scale distributed systems with deep understanding of design impacts on performance, reliability, operations, and security.
5. Extensive experience troubleshooting, debugging, and performance tuning at all levels (OS, network, application, database, and network) within large scale distributed systems
6. Extensive experience in shell scripting/programming skills, systems provisioning, automation, and configuration management tools
7. Experience designing and implementing container orchestration systems with Docker Swarm, Kubernetes, or Mesos
8. 5+yrs experience managing systems with automation tools such as Ansible, chef, or puppet
9. 4+yrs experience with automated server provisioning systems such as Cobbler/kickstart, Ubuntu MaaS, Vagrant, Packer, or Terraform
10. 4+yrs experience managing distributed host-based firewall rules with iptables, firewalld, or ufw
11. 3+yrs experience with monitoring systems such as Nagios/Zabbix/Zenoss (experience with Sensu highly preferred)
12. 2+yrs experience managing distributed block or object storage systems such as ceph, Gluster, or ScaleIO/ECS
13. 2+yrs experience with log management systems such as Splunk or ELK
14. 2+yrs experience with NGINX, HA Proxy, Varnish, or Squid
15. 2+yrs experience with SCM/Documentation/Project Management systems such as GitHub/GitLab/Stash, JIRA, and Markdown/Jekyll/Confluence
16. 2+yrs experience with Active Directory/LDAP integration of linux servers
Fwd: Job | Freelance training assignment- Devops/Aws
| |
Handpicked killer links on DevOps, ELK and Big Data
| ||||||||||||||||||||
| ||||||||||||||||||||
| |
docker tut
docker imp commands
--------------------
1) docker images
2) your could also pull a image and then run it saperately
docker pull centos:centos6 --> centos6 is the tags
2) docker run docker/ubuntu
or
2) docker run docker/ubuntu /bin/echo "hello world"
or
2) docker run -d ubuntu for i in `cat file`;do echo $i > file ;done
3) see containers if running
docker ps -a or docker ps
4) To createa custom images
a) mkdir customedocker/ ; cd customedocker
b) vi dockerfile
FROM ubuntu:latest
RUN apt-get -y update && apt-get install -y vim
CMD ls -al
c) docker build -t dockername1 .
d) docker run dockername1
5) remove containers
docker rm containerID
remove images
docker rmi imageid
6) running a webserver
a) docker run -P -d --name web1 nginx
b) docker port web1
c) docker stop web1
d) docker start web1
7) running a webserver with custom mount points
a) cd /var/www ; eccho "hello web" > index.html
b) docker run -P -d --name web nginx -v /var/www:/usr/share/nginx/html:ro -v /var/nginx/conf:/etc/nginx:ro
8) how to start a container and jump to command line
docker run -ti ubuntu /bin/bash
9) start container in background and run command in loop in container
docker run -P -d --name web1 nginx /bin/sh -c "while true ; echo \"i am doing \" ; sleep 1 ;done "
docker logs web1 < --- you will see whats running on the machine
10) if I need to move back to the one of the container terminals
docker exec -it container-id bash
11 ) after making chnages to a container we need to commit those changes
docker commit -m "some changes " -a "your user name" container-id aggeorge/nginx.01:v2
docker push aggeorge/nginx.01:v2
12) To see your history of commits
docker histroy aggeorge/nginx.01
13) set up of a wordpress website x
a) docker run --name wordpresmyql -e MYSQL_ROOT_PASSWORD=password -d mysql
b) docler ps -l
c) docker run -name mywordpress --link wordpresmyql:mysql -P -d wordpress
d) docker port mywordpress or docker ps -l
e) http://localhost:portnumber
14 ) installing docker compose
curl -L https://github.com/docker/compose/releases/download/1.7.1/docker-compose-`uname -s`-`uname -m` > /usr/local/bin/docker-compose
$ chmod +x /usr/local/bin/docker-compose
14) documentatin on docker compose
15) wordpress installation
devops test
----------------------------------------------------------------------------------------------------------------------
DEVOPS TEST 1
----------------------------------------------------------------------------------------------------------------------
The assignment expects you to set up one click deploy and provisioning of an environment with all
neccesary elements of a DevOps Toolchain.
Use Puppet / Chef / Ansible for the following setup
1. Apache tomcat server
2. Mysql Database, with configuration controlled through the tool
3. Apache Http Webserver
4. Web loadbalancer on Apache Server for Tomcat.
5. Jenkins for CI
With the setup in place
1. Make a continuous delivery (CD) pipeline in AWS using Jenkins, it should include CI Builds and other
jobs neccesary for the software delivery lifecycle
2. Create a DevOps Toolchain to completely automate the pipeline, the tool chain should be able to auto
provision and remove on-demand environments, along with devops toolchain hooked into every
environment that gets provisioned
3. Push a built WAR using Jenkins build pipeline into the VM
4. Also make sure that the location of tomcat and apache HTTPD should be flexible and controlled by
Puppet/Chef/Ansible, in case no specific value is provided it should fall back to defaults
NOTES:
1. You can make any assumptions and be as innovative and creative as possible in your usage of tools for DevOps tool-chain
2. You are expected to implement a CD pipeline with no use of shell scripts
3. Check-in the complete project (cookbooks, manifests, Jenkins build definitions etc.) into a GitHub
account and send us the repository location
4. Use the spring application https://github.com/spring-projects/spring- petclinic/ as source for the CI
And CD implementations.
5. Feel free to use AWS and share the working installation URL also, any charges incurred will be repaid irrespective of the interview result.
6. Recommended tool for AWS : Vagrant
------------------------------------------------------------------------------------------------------------------------
DEVOPS TEST 2
------------------------------------------------------------------------------------------------------------------------
Imagine you're part of a team that is starting a blogging application that would eventually run on the cloud (let's assume it's AWS). The team has decided to use Wordpress to get a simple blog running as a start. Your team of developers are going to be adding features to the blog. To help them speed their releases to Production, you want to template and automate building EC2 servers and a suitable AWS infrastructure.
First, you create Amazon AWS resources in a repeatable manner, using input parameters that will take default value and non-default values based on configuration file. You need to use Terraform in conjunction with Ansible to achieve this.
While the developers are writing code, you want to allow them to deploy code themselves. They should be able to deploy the blog app remotely using a simple command.
Here are the specs you want:
- OS: Ubuntu Server 14.04 64-bit
- App Server: Gunicorn/Nginx
- Python: 2.7
- Ansible
- Docker 1.10
- Wordpress official Docker image https://hub.docker.com/_/wordpress/
In developing the solution, use GitHub/BitBucket and try to keep a decent history of how you approached the project.
Deliverables:
(1) A GitHub repo with the Terraform configuration, Ansible playbook, Dockerfile, shell script(s) etc.
(2) A bash script that will:
- Launch the AWS infrastructure with EC2 servers.
- Begin the configuration management / bootstrapping of the server using Ansible.
- Finally start the blogging app as a Docker process.
DO NOT CHECK THIS INTO GITHUB WITH AWS KEYS.
Remember to use security groups to restrict port access. Prefix all of your AWS resources (when possible) with your first name (example: firstname-lastname.domain.com).
We should be able to perform the following commands and then interact with a functioning app in the browser.
cloud-automation.sh <app> <environment> <num_servers> <server_size>
ex: cloud-automation.sh hello_world dev 2 t1.micro
This should return the IP address of the load-balanced Wordpress application, after which, We can open a browser to http://33.33.33.10 and see the blog app come up!
Subscribe to:
Posts (Atom)