{"id":435,"date":"2021-10-10T00:46:40","date_gmt":"2021-10-09T16:46:40","guid":{"rendered":"https:\/\/heoffice.com\/?p=435"},"modified":"2021-10-10T00:46:41","modified_gmt":"2021-10-09T16:46:41","slug":"kops-create-cluster-on-aws-global","status":"publish","type":"post","link":"https:\/\/heoffice.com\/?p=435","title":{"rendered":"KOPS Create cluster on AWS Global"},"content":{"rendered":"\n<p><br>[ec2-user@ip-172-31-22-49 ~]$ dig ns dev.heoffice.com<\/p>\n\n\n\n<p>; &lt;&lt;&gt;&gt; DiG 9.8.2rc1-RedHat-9.8.2-0.62.rc1.56.amzn1 &lt;&lt;&gt;&gt; ns dev.heoffice.com<br>;; global options: +cmd<br>;; Got answer:<br>;; -&gt;&gt;HEADER&lt;&lt;- opcode: QUERY, status: NOERROR, id: 64454<br>;; flags: qr rd ra; QUERY: 1, ANSWER: 4, AUTHORITY: 0, ADDITIONAL: 0<\/p>\n\n\n\n<p>;; QUESTION SECTION:<br>;dev.heoffice.com. IN NS<\/p>\n\n\n\n<p>;; ANSWER SECTION:<br>dev.heoffice.com. 172800 IN NS ns-0.awsdns-00.com.<br>dev.heoffice.com. 172800 IN NS ns-1024.awsdns-00.org.<br>dev.heoffice.com. 172800 IN NS ns-1536.awsdns-00.co.uk.<br>dev.heoffice.com. 172800 IN NS ns-512.awsdns-00.net.<\/p>\n\n\n\n<p>;; Query time: 2 msec<br>;; SERVER: 172.31.0.2#53(172.31.0.2)<br>;; WHEN: Sat Oct 9 15:42:54 2021<br>;; MSG SIZE rcvd: 169<\/p>\n\n\n\n<p><br>[ec2-user@ip-172-31-22-49 ~]$ aws configure<br>AWS Access Key ID [None]: XXXX<br>AWS Secret Access Key [None]: XXXX<br>Default region name [None]: ap-southeast-1<br>Default output format [None]:<br> <br>[ec2-user@ip-172-31-22-49 ~]$ export AWS_ACCESS_KEY_ID=$(aws configure get aws_access_key_id)<br>[ec2-user@ip-172-31-22-49 ~]$<br>[ec2-user@ip-172-31-22-49 ~]$ export AWS_SECRET_ACCESS_KEY=$(aws configure get aws_secret_access_key)<br>[ec2-user@ip-172-31-22-49 ~]$ export NAME=myfirstcluster.example.com<br>[ec2-user@ip-172-31-22-49 ~]$ export NAME=dev.heoffice.com<br>[ec2-user@ip-172-31-22-49 ~]$ export KOPS_STATE_STORE=s3:\/\/dev.heoffice.com<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><br>[ec2-user@ip-172-31-22-49 ~]$ kops create cluster &#8211;zones=ap-southeast-1a &#8211;dns private ${NAME}<br>I1009 16:16:09.576473 25980 new_cluster.go:238] Inferred &#8220;aws&#8221; cloud provider from zone &#8220;ap-southeast-1a&#8221;<br>I1009 16:16:09.576560 25980 new_cluster.go:962] Cloud Provider ID = aws<br>I1009 16:16:09.632868 25980 subnets.go:180] Assigned CIDR 172.20.32.0\/19 to subnet ap-southeast-1a<br>I1009 16:16:11.343979 25980 create_cluster.go:724] Using SSH public key: \/home\/ec2-user\/.ssh\/id_rsa.pub<br>Previewing changes that will be made:<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p>A new kops version is available: 1.21.0<br>Upgrading is recommended<br>More information: https:\/\/github.com\/kubernetes\/kops\/blob\/master\/permalinks\/upgrade_kops.md#1.21.0<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p>I1009 16:16:19.488703 25980 dns.go:97] Private DNS: skipping DNS validation<br>I1009 16:16:20.924903 25980 executor.go:111] Tasks: 0 done \/ 77 total; 42 can run<br>W1009 16:16:21.034919 25980 vfs_castore.go:612] CA private key was not found<br>I1009 16:16:21.833381 25980 executor.go:111] Tasks: 42 done \/ 77 total; 15 can run<br>I1009 16:16:22.784956 25980 executor.go:111] Tasks: 57 done \/ 77 total; 18 can run<br>I1009 16:16:23.115469 25980 executor.go:111] Tasks: 75 done \/ 77 total; 2 can run<br>I1009 16:16:23.343995 25980 executor.go:111] Tasks: 77 done \/ 77 total; 0 can run<br>Will create resources:<br>AutoscalingGroup\/master-ap-southeast-1a.masters.dev.heoffice.com<br>Granularity 1Minute<br>LaunchTemplate name:master-ap-southeast-1a.masters.dev.heoffice.com<br>LoadBalancers []<br>MaxSize 1<br>Metrics [GroupDesiredCapacity, GroupInServiceInstances, GroupMaxSize, GroupMinSize, GroupPendingInstances, GroupStandbyInstances, GroupTerminatingInstances, GroupTotalInstances]<br>MinSize 1<br>Subnets [name:ap-southeast-1a.dev.heoffice.com]<br>SuspendProcesses []<br>Tags {k8s.io\/cluster-autoscaler\/node-template\/label\/node-role.kubernetes.io\/control-plane: , k8s.io\/cluster-autoscaler\/node-template\/label\/kubernetes.io\/role: master, kops.k8s.io\/instancegroup: master-ap-southeast-1a, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, k8s.io\/cluster-autoscaler\/node-template\/label\/kops.k8s.io\/instancegroup: master-ap-southeast-1a, k8s.io\/cluster-autoscaler\/node-template\/label\/node-role.kubernetes.io\/master: , k8s.io\/role\/master: 1, Name: master-ap-southeast-1a.masters.dev.heoffice.com}<br>TargetGroups []<\/p>\n\n\n\n<p>AutoscalingGroup\/nodes-ap-southeast-1a.dev.heoffice.com<br>Granularity 1Minute<br>LaunchTemplate name:nodes-ap-southeast-1a.dev.heoffice.com<br>LoadBalancers []<br>MaxSize 1<br>Metrics [GroupDesiredCapacity, GroupInServiceInstances, GroupMaxSize, GroupMinSize, GroupPendingInstances, GroupStandbyInstances, GroupTerminatingInstances, GroupTotalInstances]<br>MinSize 1<br>Subnets [name:ap-southeast-1a.dev.heoffice.com]<br>SuspendProcesses []<br>Tags {kops.k8s.io\/instancegroup: nodes-ap-southeast-1a, Name: nodes-ap-southeast-1a.dev.heoffice.com, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, k8s.io\/cluster-autoscaler\/node-template\/label\/node-role.kubernetes.io\/node: , k8s.io\/cluster-autoscaler\/node-template\/label\/kubernetes.io\/role: node, k8s.io\/cluster-autoscaler\/node-template\/label\/kops.k8s.io\/instancegroup: nodes-ap-southeast-1a, k8s.io\/role\/node: 1}<br>TargetGroups []<\/p>\n\n\n\n<p>DHCPOptions\/dev.heoffice.com<br>DomainName ap-southeast-1.compute.internal<br>DomainNameServers AmazonProvidedDNS<br>Shared false<br>Tags {kubernetes.io\/cluster\/dev.heoffice.com: owned, Name: dev.heoffice.com, KubernetesCluster: dev.heoffice.com}<\/p>\n\n\n\n<p>EBSVolume\/a.etcd-events.dev.heoffice.com<br>AvailabilityZone ap-southeast-1a<br>Encrypted true<br>SizeGB 20<br>Tags {k8s.io\/etcd\/events: a\/a, k8s.io\/role\/master: 1, kubernetes.io\/cluster\/dev.heoffice.com: owned, Name: a.etcd-events.dev.heoffice.com, KubernetesCluster: dev.heoffice.com}<br>VolumeIops 3000<br>VolumeThroughput 125<br>VolumeType gp3<\/p>\n\n\n\n<p>EBSVolume\/a.etcd-main.dev.heoffice.com<br>AvailabilityZone ap-southeast-1a<br>Encrypted true<br>SizeGB 20<br>Tags {k8s.io\/role\/master: 1, kubernetes.io\/cluster\/dev.heoffice.com: owned, Name: a.etcd-main.dev.heoffice.com, KubernetesCluster: dev.heoffice.com, k8s.io\/etcd\/main: a\/a}<br>VolumeIops 3000<br>VolumeThroughput 125<br>VolumeType gp3<\/p>\n\n\n\n<p>IAMInstanceProfile\/masters.dev.heoffice.com<br>Shared false<\/p>\n\n\n\n<p>IAMInstanceProfile\/nodes.dev.heoffice.com<br>Shared false<\/p>\n\n\n\n<p>IAMInstanceProfileRole\/masters.dev.heoffice.com<br>InstanceProfile name:masters.dev.heoffice.com id:masters.dev.heoffice.com<br>Role name:masters.dev.heoffice.com<\/p>\n\n\n\n<p>IAMInstanceProfileRole\/nodes.dev.heoffice.com<br>InstanceProfile name:nodes.dev.heoffice.com id:nodes.dev.heoffice.com<br>Role name:nodes.dev.heoffice.com<\/p>\n\n\n\n<p>IAMRole\/masters.dev.heoffice.com<br>Tags {KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, Name: masters.dev.heoffice.com}<br>ExportWithID masters<\/p>\n\n\n\n<p>IAMRole\/nodes.dev.heoffice.com<br>Tags {Name: nodes.dev.heoffice.com, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned}<br>ExportWithID nodes<\/p>\n\n\n\n<p>IAMRolePolicy\/master-policyoverride<br>Role name:masters.dev.heoffice.com<br>Managed true<\/p>\n\n\n\n<p>IAMRolePolicy\/masters.dev.heoffice.com<br>Role name:masters.dev.heoffice.com<br>Managed false<\/p>\n\n\n\n<p>IAMRolePolicy\/node-policyoverride<br>Role name:nodes.dev.heoffice.com<br>Managed true<\/p>\n\n\n\n<p>IAMRolePolicy\/nodes.dev.heoffice.com<br>Role name:nodes.dev.heoffice.com<br>Managed false<\/p>\n\n\n\n<p>InternetGateway\/dev.heoffice.com<br>VPC name:dev.heoffice.com<br>Shared false<br>Tags {Name: dev.heoffice.com, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned}<\/p>\n\n\n\n<p>Keypair\/apiserver-aggregator-ca<br>Subject cn=apiserver-aggregator-ca<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>Keypair\/ca<br>Subject cn=kubernetes<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>Keypair\/etcd-clients-ca<br>Subject cn=etcd-clients-ca<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>Keypair\/etcd-manager-ca-events<br>Subject cn=etcd-manager-ca-events<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>Keypair\/etcd-manager-ca-main<br>Subject cn=etcd-manager-ca-main<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>Keypair\/etcd-peers-ca-events<br>Subject cn=etcd-peers-ca-events<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>Keypair\/etcd-peers-ca-main<br>Subject cn=etcd-peers-ca-main<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>Keypair\/service-account<br>Subject cn=service-account<br>Type ca<br>LegacyFormat false<\/p>\n\n\n\n<p>LaunchTemplate\/master-ap-southeast-1a.masters.dev.heoffice.com<br>AssociatePublicIP true<br>CPUCredits<br>HTTPPutResponseHopLimit 1<br>HTTPTokens optional<br>IAMInstanceProfile name:masters.dev.heoffice.com id:masters.dev.heoffice.com<br>ImageID 099720109477\/ubuntu\/images\/hvm-ssd\/ubuntu-focal-20.04-amd64-server-20210907<br>InstanceType t3.medium<br>RootVolumeIops 3000<br>RootVolumeSize 64<br>RootVolumeThroughput 125<br>RootVolumeType gp3<br>RootVolumeEncryption true<br>RootVolumeKmsKey<br>SSHKey name:kubernetes.dev.heoffice.com-3f:50:d5:28:05:6c:3f:91:dc:2e:cc:65:cc:d3:98:93 id:kubernetes.dev.heoffice.com-3f:50:d5:28:05:6c:3f:91:dc:2e:cc:65:cc:d3:98:93<br>SecurityGroups [name:masters.dev.heoffice.com]<br>SpotPrice<br>Tags {KubernetesCluster: dev.heoffice.com, k8s.io\/cluster-autoscaler\/node-template\/label\/node-role.kubernetes.io\/control-plane: , k8s.io\/cluster-autoscaler\/node-template\/label\/kubernetes.io\/role: master, k8s.io\/cluster-autoscaler\/node-template\/label\/node-role.kubernetes.io\/master: , Name: master-ap-southeast-1a.masters.dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, k8s.io\/cluster-autoscaler\/node-template\/label\/kops.k8s.io\/instancegroup: master-ap-southeast-1a, k8s.io\/role\/master: 1, kops.k8s.io\/instancegroup: master-ap-southeast-1a}<\/p>\n\n\n\n<p>LaunchTemplate\/nodes-ap-southeast-1a.dev.heoffice.com<br>AssociatePublicIP true<br>CPUCredits<br>HTTPPutResponseHopLimit 1<br>HTTPTokens optional<br>IAMInstanceProfile name:nodes.dev.heoffice.com id:nodes.dev.heoffice.com<br>ImageID 099720109477\/ubuntu\/images\/hvm-ssd\/ubuntu-focal-20.04-amd64-server-20210907<br>InstanceType t3.medium<br>RootVolumeIops 3000<br>RootVolumeSize 128<br>RootVolumeThroughput 125<br>RootVolumeType gp3<br>RootVolumeEncryption true<br>RootVolumeKmsKey<br>SSHKey name:kubernetes.dev.heoffice.com-3f:50:d5:28:05:6c:3f:91:dc:2e:cc:65:cc:d3:98:93 id:kubernetes.dev.heoffice.com-3f:50:d5:28:05:6c:3f:91:dc:2e:cc:65:cc:d3:98:93<br>SecurityGroups [name:nodes.dev.heoffice.com]<br>SpotPrice<br>Tags {kubernetes.io\/cluster\/dev.heoffice.com: owned, k8s.io\/cluster-autoscaler\/node-template\/label\/kubernetes.io\/role: node, k8s.io\/cluster-autoscaler\/node-template\/label\/kops.k8s.io\/instancegroup: nodes-ap-southeast-1a, k8s.io\/cluster-autoscaler\/node-template\/label\/node-role.kubernetes.io\/node: , k8s.io\/role\/node: 1, kops.k8s.io\/instancegroup: nodes-ap-southeast-1a, Name: nodes-ap-southeast-1a.dev.heoffice.com, KubernetesCluster: dev.heoffice.com}<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-bootstrap<br>Location addons\/bootstrap-channel.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-core.addons.k8s.io<br>Location addons\/core.addons.k8s.io\/v1.4.0.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-coredns.addons.k8s.io-k8s-1.12<br>Location addons\/coredns.addons.k8s.io\/k8s-1.12.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-dns-controller.addons.k8s.io-k8s-1.12<br>Location addons\/dns-controller.addons.k8s.io\/k8s-1.12.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-kops-controller.addons.k8s.io-k8s-1.16<br>Location addons\/kops-controller.addons.k8s.io\/k8s-1.16.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-kubelet-api.rbac.addons.k8s.io-k8s-1.9<br>Location addons\/kubelet-api.rbac.addons.k8s.io\/k8s-1.9.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-limit-range.addons.k8s.io<br>Location addons\/limit-range.addons.k8s.io\/v1.5.0.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-storage-aws.addons.k8s.io-v1.15.0<br>Location addons\/storage-aws.addons.k8s.io\/v1.15.0.yaml<\/p>\n\n\n\n<p>ManagedFile\/dev.heoffice.com-addons-storage-aws.addons.k8s.io-v1.7.0<br>Location addons\/storage-aws.addons.k8s.io\/v1.7.0.yaml<\/p>\n\n\n\n<p>ManagedFile\/etcd-cluster-spec-events<br>Base s3:\/\/dev.heoffice.com\/dev.heoffice.com\/backups\/etcd\/events<br>Location \/control\/etcd-cluster-spec<\/p>\n\n\n\n<p>ManagedFile\/etcd-cluster-spec-main<br>Base s3:\/\/dev.heoffice.com\/dev.heoffice.com\/backups\/etcd\/main<br>Location \/control\/etcd-cluster-spec<\/p>\n\n\n\n<p>ManagedFile\/manifests-etcdmanager-events<br>Location manifests\/etcd\/events.yaml<\/p>\n\n\n\n<p>ManagedFile\/manifests-etcdmanager-main<br>Location manifests\/etcd\/main.yaml<\/p>\n\n\n\n<p>ManagedFile\/manifests-static-kube-apiserver-healthcheck<br>Location manifests\/static\/kube-apiserver-healthcheck.yaml<\/p>\n\n\n\n<p>Route\/0.0.0.0\/0<br>RouteTable name:dev.heoffice.com<br>CIDR 0.0.0.0\/0<br>InternetGateway name:dev.heoffice.com<\/p>\n\n\n\n<p>RouteTable\/dev.heoffice.com<br>VPC name:dev.heoffice.com<br>Shared false<br>Tags {Name: dev.heoffice.com, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, kubernetes.io\/kops\/role: public}<\/p>\n\n\n\n<p>RouteTableAssociation\/ap-southeast-1a.dev.heoffice.com<br>RouteTable name:dev.heoffice.com<br>Subnet name:ap-southeast-1a.dev.heoffice.com<\/p>\n\n\n\n<p>SSHKey\/kubernetes.dev.heoffice.com-3f:50:d5:28:05:6c:3f:91:dc:2e:cc:65:cc:d3:98:93<br>Shared false<br>KeyFingerprint e6:08:fd:49:5b:11:5a:41:74:b7:3c:b2:8a:35:25:41<br>Tags {Name: dev.heoffice.com, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned}<\/p>\n\n\n\n<p>Secret\/admin<\/p>\n\n\n\n<p>Secret\/kube<\/p>\n\n\n\n<p>Secret\/kube-proxy<\/p>\n\n\n\n<p>Secret\/kubelet<\/p>\n\n\n\n<p>Secret\/system:controller_manager<\/p>\n\n\n\n<p>Secret\/system:dns<\/p>\n\n\n\n<p>Secret\/system:logging<\/p>\n\n\n\n<p>Secret\/system:monitoring<\/p>\n\n\n\n<p>Secret\/system:scheduler<\/p>\n\n\n\n<p>SecurityGroup\/masters.dev.heoffice.com<br>Description Security group for masters<br>VPC name:dev.heoffice.com<br>RemoveExtraRules [port=22, port=443, port=2380, port=2381, port=4001, port=4002, port=4789, port=179, port=8443]<br>Tags {KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, Name: masters.dev.heoffice.com}<\/p>\n\n\n\n<p>SecurityGroup\/nodes.dev.heoffice.com<br>Description Security group for nodes<br>VPC name:dev.heoffice.com<br>RemoveExtraRules [port=22]<br>Tags {Name: nodes.dev.heoffice.com, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned}<\/p>\n\n\n\n<p>SecurityGroupRule\/from-0.0.0.0\/0-ingress-tcp-22to22-masters.dev.heoffice.com<br>SecurityGroup name:masters.dev.heoffice.com<br>CIDR 0.0.0.0\/0<br>Protocol tcp<br>FromPort 22<br>ToPort 22<\/p>\n\n\n\n<p>SecurityGroupRule\/from-0.0.0.0\/0-ingress-tcp-22to22-nodes.dev.heoffice.com<br>SecurityGroup name:nodes.dev.heoffice.com<br>CIDR 0.0.0.0\/0<br>Protocol tcp<br>FromPort 22<br>ToPort 22<\/p>\n\n\n\n<p>SecurityGroupRule\/from-0.0.0.0\/0-ingress-tcp-443to443-masters.dev.heoffice.com<br>SecurityGroup name:masters.dev.heoffice.com<br>CIDR 0.0.0.0\/0<br>Protocol tcp<br>FromPort 443<br>ToPort 443<\/p>\n\n\n\n<p>SecurityGroupRule\/from-masters.dev.heoffice.com-egress-all-0to0-0.0.0.0\/0<br>SecurityGroup name:masters.dev.heoffice.com<br>CIDR 0.0.0.0\/0<br>Egress true<\/p>\n\n\n\n<p>SecurityGroupRule\/from-masters.dev.heoffice.com-ingress-all-0to0-masters.dev.heoffice.com<br>SecurityGroup name:masters.dev.heoffice.com<br>SourceGroup name:masters.dev.heoffice.com<\/p>\n\n\n\n<p>SecurityGroupRule\/from-masters.dev.heoffice.com-ingress-all-0to0-nodes.dev.heoffice.com<br>SecurityGroup name:nodes.dev.heoffice.com<br>SourceGroup name:masters.dev.heoffice.com<\/p>\n\n\n\n<p>SecurityGroupRule\/from-nodes.dev.heoffice.com-egress-all-0to0-0.0.0.0\/0<br>SecurityGroup name:nodes.dev.heoffice.com<br>CIDR 0.0.0.0\/0<br>Egress true<\/p>\n\n\n\n<p>SecurityGroupRule\/from-nodes.dev.heoffice.com-ingress-all-0to0-nodes.dev.heoffice.com<br>SecurityGroup name:nodes.dev.heoffice.com<br>SourceGroup name:nodes.dev.heoffice.com<\/p>\n\n\n\n<p>SecurityGroupRule\/from-nodes.dev.heoffice.com-ingress-tcp-1to2379-masters.dev.heoffice.com<br>SecurityGroup name:masters.dev.heoffice.com<br>Protocol tcp<br>FromPort 1<br>ToPort 2379<br>SourceGroup name:nodes.dev.heoffice.com<\/p>\n\n\n\n<p>SecurityGroupRule\/from-nodes.dev.heoffice.com-ingress-tcp-2382to4000-masters.dev.heoffice.com<br>SecurityGroup name:masters.dev.heoffice.com<br>Protocol tcp<br>FromPort 2382<br>ToPort 4000<br>SourceGroup name:nodes.dev.heoffice.com<\/p>\n\n\n\n<p>SecurityGroupRule\/from-nodes.dev.heoffice.com-ingress-tcp-4003to65535-masters.dev.heoffice.com<br>SecurityGroup name:masters.dev.heoffice.com<br>Protocol tcp<br>FromPort 4003<br>ToPort 65535<br>SourceGroup name:nodes.dev.heoffice.com<\/p>\n\n\n\n<p>SecurityGroupRule\/from-nodes.dev.heoffice.com-ingress-udp-1to65535-masters.dev.heoffice.com<br>SecurityGroup name:masters.dev.heoffice.com<br>Protocol udp<br>FromPort 1<br>ToPort 65535<br>SourceGroup name:nodes.dev.heoffice.com<\/p>\n\n\n\n<p>Subnet\/ap-southeast-1a.dev.heoffice.com<br>ShortName ap-southeast-1a<br>VPC name:dev.heoffice.com<br>AvailabilityZone ap-southeast-1a<br>CIDR 172.20.32.0\/19<br>Shared false<br>Tags {Name: ap-southeast-1a.dev.heoffice.com, KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, SubnetType: Public, kubernetes.io\/role\/elb: 1}<\/p>\n\n\n\n<p>VPC\/dev.heoffice.com<br>CIDR 172.20.0.0\/16<br>EnableDNSHostnames true<br>EnableDNSSupport true<br>Shared false<br>Tags {KubernetesCluster: dev.heoffice.com, kubernetes.io\/cluster\/dev.heoffice.com: owned, Name: dev.heoffice.com}<\/p>\n\n\n\n<p>VPCDHCPOptionsAssociation\/dev.heoffice.com<br>VPC name:dev.heoffice.com<br>DHCPOptions name:dev.heoffice.com<\/p>\n\n\n\n<p>Will modify resources:<br>DNSZone\/Z0959566MQQXKRIXRA3V<br>PrivateVPC -&gt; name:dev.heoffice.com<\/p>\n\n\n\n<p>Must specify &#8211;yes to apply changes<\/p>\n\n\n\n<p>Cluster configuration has been created.<\/p>\n\n\n\n<p>Suggestions:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>list clusters with: kops get cluster<\/li><li>edit this cluster with: kops edit cluster dev.heoffice.com<\/li><li>edit your node instance group: kops edit ig &#8211;name=dev.heoffice.com nodes-ap-southeast-1a<\/li><li>edit your master instance group: kops edit ig &#8211;name=dev.heoffice.com master-ap-southeast-1a<\/li><\/ul>\n\n\n\n<p>Finally configure your cluster with: kops update cluster &#8211;name dev.heoffice.com &#8211;yes &#8211;admin<\/p>\n\n\n\n<p>[ec2-user@ip-172-31-22-49 ~]$ kops version<br>Version 1.20.2 (git-e6ca69f55e91f87080c897216115efb811673718)<br>[ec2-user@ip-172-31-22-49 ~]$ kops update cluster &#8211;name dev.heoffice.com &#8211;yes &#8211;admin<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p>A new kops version is available: 1.21.0<br>Upgrading is recommended<br>More information: https:\/\/github.com\/kubernetes\/kops\/blob\/master\/permalinks\/upgrade_kops.md#1.21.0<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p>I1009 16:16:55.872391 25990 dns.go:97] Private DNS: skipping DNS validation<br>I1009 16:16:56.155104 25990 executor.go:111] Tasks: 0 done \/ 77 total; 42 can run<br>W1009 16:16:56.228220 25990 vfs_castore.go:612] CA private key was not found<br>I1009 16:16:56.229843 25990 keypair.go:195] Issuing new certificate: &#8220;etcd-clients-ca&#8221;<br>I1009 16:16:56.239458 25990 keypair.go:195] Issuing new certificate: &#8220;apiserver-aggregator-ca&#8221;<br>I1009 16:16:56.255029 25990 keypair.go:195] Issuing new certificate: &#8220;etcd-manager-ca-main&#8221;<br>I1009 16:16:56.307880 25990 keypair.go:195] Issuing new certificate: &#8220;etcd-manager-ca-events&#8221;<br>W1009 16:16:56.322393 25990 vfs_castore.go:612] CA private key was not found<br>I1009 16:16:56.322466 25990 keypair.go:195] Issuing new certificate: &#8220;ca&#8221;<br>I1009 16:16:56.333760 25990 keypair.go:195] Issuing new certificate: &#8220;etcd-peers-ca-main&#8221;<br>I1009 16:16:56.335904 25990 keypair.go:195] Issuing new certificate: &#8220;etcd-peers-ca-events&#8221;<br>I1009 16:16:56.373952 25990 keypair.go:195] Issuing new certificate: &#8220;service-account&#8221;<br>I1009 16:16:58.006988 25990 executor.go:111] Tasks: 42 done \/ 77 total; 15 can run<br>I1009 16:17:00.474606 25990 executor.go:111] Tasks: 57 done \/ 77 total; 18 can run<br>I1009 16:17:01.014102 25990 executor.go:111] Tasks: 75 done \/ 77 total; 2 can run<br>I1009 16:17:02.046535 25990 executor.go:137] Task &#8220;AutoscalingGroup\/master-ap-southeast-1a.masters.dev.heoffice.com&#8221; not ready: waiting for the IAM Instance Profile to be propagated<br>I1009 16:17:02.046568 25990 executor.go:137] Task &#8220;AutoscalingGroup\/nodes-ap-southeast-1a.dev.heoffice.com&#8221; not ready: waiting for the IAM Instance Profile to be propagated<br>I1009 16:17:02.046578 25990 executor.go:155] No progress made, sleeping before retrying 2 task(s)<br>I1009 16:17:12.046722 25990 executor.go:111] Tasks: 75 done \/ 77 total; 2 can run<br>I1009 16:17:13.504328 25990 executor.go:111] Tasks: 77 done \/ 77 total; 0 can run<br>I1009 16:17:13.504367 25990 dns.go:157] Pre-creating DNS records<br>I1009 16:17:15.113041 25990 kubectl.go:134] error running kubectl config view &#8211;output json<br>I1009 16:17:15.113064 25990 kubectl.go:135]<br>I1009 16:17:15.113071 25990 kubectl.go:136]<br>W1009 16:17:15.113089 25990 update_cluster.go:308] error reading kubecfg: error getting config from kubectl: error running kubectl: exec: &#8220;kubectl&#8221;: executable file not found in $PATH<br>I1009 16:17:15.113097 25990 update_cluster.go:313] Exporting kubecfg for cluster<br>W1009 16:17:15.143823 25990 create_kubecfg.go:91] Did not find API endpoint for gossip hostname; may not be able to reach cluster<br>kOps has set your kubectl context to dev.heoffice.com<\/p>\n\n\n\n<p>Cluster changes have been applied to the cloud.<\/p>\n\n\n\n<p>Changes may require instances to restart: kops rolling-update cluster<\/p>\n\n\n\n<p>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/<br>authorized_keys id_rsa id_rsa.pub known_hosts<br>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/<br>authorized_keys id_rsa id_rsa.pub known_hosts<br>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/id_rsa.pub ubuntu@172.20.46.185<br>ssh: connect to host 172.20.46.185 port 22: No route to host<br>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/id_rsa.pub ubuntu@172.20.46.185<br>ssh: connect to host 172.20.46.185 port 22: No route to host<br>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/id_rsa.pub ubuntu@18.139.114.208<br>The authenticity of host &#8216;18.139.114.208 (18.139.114.208)&#8217; can&#8217;t be established.<br>ECDSA key fingerprint is 7a:38:cc:73:17:92:b4:ec:ee:c3:3e:b1:b1:7a:58:86.<br>Are you sure you want to continue connecting (yes\/no)? yes<br>Warning: Permanently added &#8216;18.139.114.208&#8217; (ECDSA) to the list of known hosts.<br>@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br>@ WARNING: UNPROTECTED PRIVATE KEY FILE! @<br>@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@<br>Permissions 0644 for &#8216;.\/.ssh\/id_rsa.pub&#8217; are too open.<br>It is required that your private key files are NOT accessible by others.<br>This private key will be ignored.<br>bad permissions: ignore key: .\/.ssh\/id_rsa.pub<br>Permission denied (publickey).<br>[ec2-user@ip-172-31-22-49 ~]$ chmod 600 .\/.ssh\/id_rsa.pub<br>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/id_rsa.pub ubuntu@18.139.114.208<br>Enter passphrase for key &#8216;.\/.ssh\/id_rsa.pub&#8217;:<br>Permission denied (publickey).<br>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/id_rsa.pub ubuntu@18.139.114.208<br>Enter passphrase for key &#8216;.\/.ssh\/id_rsa.pub&#8217;:<br>Enter passphrase for key &#8216;.\/.ssh\/id_rsa.pub&#8217;:<\/p>\n\n\n\n<p>[ec2-user@ip-172-31-22-49 ~]$ ssh -i .\/.ssh\/id_rsa.pub ubuntu@172.20.46.185<br>ssh: connect to host 172.20.46.185 port 22: No route to host<br>[ec2-user@ip-172-31-22-49 ~]$ kops validate cluster<br>Using cluster from kubectl context: dev.heoffice.com<\/p>\n\n\n\n<p>Validating cluster dev.heoffice.com<\/p>\n\n\n\n<p>INSTANCE GROUPS<br>NAME ROLE MACHINETYPE MIN MAX SUBNETS<br>master-ap-southeast-1a Master t3.medium 1 1 ap-southeast-1a<br>nodes-ap-southeast-1a Node t3.medium 1 1 ap-southeast-1a<\/p>\n\n\n\n<p>NODE STATUS<br>NAME ROLE READY<br>ip-172-20-46-185.ap-southeast-1.compute.internal master True<br>ip-172-20-61-249.ap-southeast-1.compute.internal node True<\/p>\n\n\n\n<p>Your cluster dev.heoffice.com is ready<br>[ec2-user@ip-172-31-22-49 ~]$ kops delete cluster &#8211;yes<\/p>\n\n\n\n<p>&#8211;name is required (for safety)<br>[ec2-user@ip-172-31-22-49 ~]$ kops delete cluster &#8211;name ${NAME} &#8211;yes<br>TYPE NAME ID<br>autoscaling-config master-ap-southeast-1a.masters.dev.heoffice.com lt-055e9d3f847bbfca1<br>autoscaling-config nodes-ap-southeast-1a.dev.heoffice.com lt-0773d0dd448fb6b27<br>autoscaling-group master-ap-southeast-1a.masters.dev.heoffice.com master-ap-southeast-1a.masters.dev.heoffice.com<br>autoscaling-group nodes-ap-southeast-1a.dev.heoffice.com nodes-ap-southeast-1a.dev.heoffice.com<br>dhcp-options dev.heoffice.com dopt-0a379f592a2ae240e<br>iam-instance-profile masters.dev.heoffice.com masters.dev.heoffice.com<br>iam-instance-profile nodes.dev.heoffice.com nodes.dev.heoffice.com<br>iam-role masters.dev.heoffice.com masters.dev.heoffice.com<br>iam-role nodes.dev.heoffice.com nodes.dev.heoffice.com<br>instance master-ap-southeast-1a.masters.dev.heoffice.com i-03904eaa8bb1fd6c2<br>instance nodes-ap-southeast-1a.dev.heoffice.com i-0d7daa92f8ae00ace<br>internet-gateway dev.heoffice.com igw-000d208578429094b<br>keypair kubernetes.dev.heoffice.com-3f:50:d5:28:05:6c:3f:91:dc:2e:cc:65:cc:d3:98:93 key-0bfaa591aa3779c85<br>route-table dev.heoffice.com rtb-0da1b317a36b12af9<br>route53-record api.dev.heoffice.com. Z0959566MQQXKRIXRA3V\/api.dev.heoffice.com.<br>route53-record api.internal.dev.heoffice.com. Z0959566MQQXKRIXRA3V\/api.internal.dev.heoffice.com.<br>route53-record kops-controller.internal.dev.heoffice.com. Z0959566MQQXKRIXRA3V\/kops-controller.internal.dev.heoffice.com.<br>security-group masters.dev.heoffice.com sg-08a53927aa9e324a8<br>security-group nodes.dev.heoffice.com sg-0025fca62430cb370<br>subnet ap-southeast-1a.dev.heoffice.com subnet-0bf41a8e447bb094e<br>volume a.etcd-events.dev.heoffice.com vol-0daa0c3d15ec8da57<br>volume a.etcd-main.dev.heoffice.com vol-080049ad88cce7f6b<br>volume master-ap-southeast-1a.masters.dev.heoffice.com vol-00086de84d320e875<br>volume nodes-ap-southeast-1a.dev.heoffice.com vol-0a8bd3ce789408392<br>vpc dev.heoffice.com vpc-095b321acc74c9157<\/p>\n\n\n\n<p>autoscaling-config:lt-055e9d3f847bbfca1 ok<br>autoscaling-config:lt-0773d0dd448fb6b27 ok<br>instance:i-03904eaa8bb1fd6c2 ok<br>instance:i-0d7daa92f8ae00ace ok<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>autoscaling-group:master-ap-southeast-1a.masters.dev.heoffice.com ok<br>keypair:key-0bfaa591aa3779c85 ok<br>autoscaling-group:nodes-ap-southeast-1a.dev.heoffice.com ok<br>route53-record:Z0959566MQQXKRIXRA3V\/api.internal.dev.heoffice.com. ok<br>iam-instance-profile:nodes.dev.heoffice.com ok<br>iam-instance-profile:masters.dev.heoffice.com ok<br>iam-role:masters.dev.heoffice.com ok<br>iam-role:nodes.dev.heoffice.com ok<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>volume:vol-00086de84d320e875<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-0025fca62430cb370<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-00086de84d320e875<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-0025fca62430cb370<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>volume:vol-00086de84d320e875<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-0025fca62430cb370<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>volume:vol-00086de84d320e875<br>volume:vol-080049ad88cce7f6b<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>route-table:rtb-0da1b317a36b12af9<br>security-group:sg-0025fca62430cb370<br>security-group:sg-08a53927aa9e324a8<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>vpc:vpc-095b321acc74c9157<br>subnet:subnet-0bf41a8e447bb094e<br>volume:vol-00086de84d320e875<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-0025fca62430cb370<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>security-group:sg-0025fca62430cb370<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>volume:vol-00086de84d320e875<br>dhcp-options:dopt-0a379f592a2ae240e<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-00086de84d320e875<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-0025fca62430cb370<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<\/p>\n\n\n\n<p>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-00086de84d320e875<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-0025fca62430cb370<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>volume:vol-00086de84d320e875<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>security-group:sg-0025fca62430cb370<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>volume:vol-00086de84d320e875<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>security-group:sg-0025fca62430cb370<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>security-group:sg-0025fca62430cb370<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>volume:vol-00086de84d320e875<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>security-group:sg-0025fca62430cb370<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>volume:vol-00086de84d320e875<br>dhcp-options:dopt-0a379f592a2ae240e<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>volume:vol-0a8bd3ce789408392 still has dependencies, will retry<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>Not all resources deleted; waiting before reattempting deletion<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-0a8bd3ce789408392<br>volume:vol-00086de84d320e875<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>security-group:sg-0025fca62430cb370<br>volume:vol-0a8bd3ce789408392 ok<br>volume:vol-00086de84d320e875 still has dependencies, will retry<br>volume:vol-0daa0c3d15ec8da57 still has dependencies, will retry<br>volume:vol-080049ad88cce7f6b still has dependencies, will retry<br>subnet:subnet-0bf41a8e447bb094e still has dependencies, will retry<br>internet-gateway:igw-000d208578429094b still has dependencies, will retry<br>security-group:sg-08a53927aa9e324a8 still has dependencies, will retry<br>security-group:sg-0025fca62430cb370 ok<br>Not all resources deleted; waiting before reattempting deletion<br>security-group:sg-08a53927aa9e324a8<br>route-table:rtb-0da1b317a36b12af9<br>subnet:subnet-0bf41a8e447bb094e<br>vpc:vpc-095b321acc74c9157<br>volume:vol-080049ad88cce7f6b<br>volume:vol-0daa0c3d15ec8da57<br>volume:vol-00086de84d320e875<br>dhcp-options:dopt-0a379f592a2ae240e<br>internet-gateway:igw-000d208578429094b<br>volume:vol-00086de84d320e875 ok<br>volume:vol-0daa0c3d15ec8da57 ok<br>volume:vol-080049ad88cce7f6b ok<br>subnet:subnet-0bf41a8e447bb094e ok<br>security-group:sg-08a53927aa9e324a8 ok<br>internet-gateway:igw-000d208578429094b ok<br>route-table:rtb-0da1b317a36b12af9 ok<br>vpc:vpc-095b321acc74c9157 ok<br>dhcp-options:dopt-0a379f592a2ae240e ok<br>Deleted kubectl config for dev.heoffice.com<\/p>\n\n\n\n<p>Deleted cluster: &#8220;dev.heoffice.com&#8221;<br>[ec2-user@ip-172-31-22-49 ~]$<br>[ec2-user@ip-172-31-22-49 ~]$<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ec2-user@ip-172-31-22-49 ~]$ dig ns dev.heoffice.com ;&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-435","post","type-post","status-publish","format-standard","hentry","category-web"],"acf":[],"_links":{"self":[{"href":"https:\/\/heoffice.com\/index.php?rest_route=\/wp\/v2\/posts\/435","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/heoffice.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/heoffice.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/heoffice.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/heoffice.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=435"}],"version-history":[{"count":1,"href":"https:\/\/heoffice.com\/index.php?rest_route=\/wp\/v2\/posts\/435\/revisions"}],"predecessor-version":[{"id":436,"href":"https:\/\/heoffice.com\/index.php?rest_route=\/wp\/v2\/posts\/435\/revisions\/436"}],"wp:attachment":[{"href":"https:\/\/heoffice.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=435"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/heoffice.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=435"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/heoffice.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=435"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}