AWS CodeDeploy 与 Spot 和按需实例混合的 Autoscaling 启动模板
Posted
技术标签:
【中文标题】AWS CodeDeploy 与 Spot 和按需实例混合的 Autoscaling 启动模板【英文标题】:AWS CodeDeploy with Autoscaling Launch Templates with Spot and On-Demand Instances mix 【发布时间】:2019-07-02 04:30:34 【问题描述】:可以将自动缩放组配置为使用启动模板而不是启动配置。我想使用它,因为当我使用启动配置配置自动缩放组时,我无法设置混合实例策略(按需 + 现货实例)。
我已经使用这样的配置创建了启动模板(名称“测试”):
AMI Ubuntu 16,
some security groups and IAM Role with EC2, AutoScaling and CodeDeploy full access
and all other settings in default *Not specified* state.
Launch Template ID lt-0e1111
Default Version Number 1
Launch Template Name test
Owner arn:aws:iam::11111111:user/itsp
Version 1 (Default)
Name test
Created by arn:aws:iam::179961111910:user/itsp
Description Not specified
Date Created February 8, 2019 at 12:47:54 AM UTC+3
AMI ID ami-0bf1924ed30c48a6a
Availability Zone Not specified
Security Groups Not specified
Instance Type t2.nano
Key pair name itsp
Security Group Ids sg-07e746cf0e4935b84,sg-0a45f7e6ac321614d,sg-27bf6d4b
Advanced Details:
Purchasing option Not specified
Spot request type Not specified
Spot interruption behavior Not specified
IAM Instance Profile Not specified
Stop - Hibernate behavior Not specified
Monitoring Not specified
EBS-optimized instance Not specified
Tenancy Host ID Not specified
RAM Disk ID Not specified
User Data Not specified
Elastic Inference Accelerator Not specified
Maximum Spot price Not specified
Spot expiry date -
Spot block duration Not specified
Shutdown behavior Not specified
Termination Protection Not specified
Placement Group Name Not specified
Tenancy Not specified
Tenancy Affinity Not specified
Kernel ID Not specified
Elastic Graphics Not specified
然后,我将使用该启动模板创建一个 AutoScaling 组。这是我的自动缩放组配置:
Launch Template test
Launch Template Version 1
Launch Template Description -
Instance Types -
Spot Diversity 0
Optional On-Demand Base 0
On-Demand Percentage 0%
Desired Capacity 1
Min 1
Max 1
Availability Zone(s) eu-central-1a
Subnet(s) subnet-53075e38
Classic Load Balancers -
Target Groups -
Health Check Type EC2
Health Check Grace Period 300
Instance Protection -
Termination Policies Default
Suspended Processes -
Placement Groups -
Default Cooldown 300
Enabled Metrics -
Creation Time Fri Feb 08 00:50:16 GMT+300 2019
Service-Linked Role arn:aws:iam::11111111111:role/aws-service-role/autoscaling.amazonaws.com/AWSServiceRoleForAutoScaling
我选择时似乎设置了这样的配置
*Fleet Composition - Adhere to the launch template
The launch template determines the instance type and purchase option (On-Demand or Spot).*
option 和我的 lauch 模板配置如上。
所以我的自动缩放组中没有斑点。
然后我用这样的配置在其中配置一个 CodeDeploy 应用程序“Application”和 DeploymentGroup“DG_TEST”:
Deployment type Blue/green
Service role ARN arn:aws:iam::11111111111111:role/CodeDeployRole
Deployment configuration CodeDeployDefault.AllAtOnce
Rollback enabled -
Environment configuration: Amazon EC2 Auto Scaling groups -> Name 'test'
好的,设置完所有内容后,我将 Autoscaling 组中的所需实例计数设置为 1,并在我的“测试”组中生成新的按需实例。
我现在开始使用 AWS CLI 命令进行蓝绿部署:
aws deploy create-deployment --application-name Application --s3-location bucket=codedeploybucket,key=application,bundleType=zip --deployment-group-name DG_TEST
我可以看到我的绿色队列中出现了具有相同 lauch 模板的新自动缩放组。
所以我们刚刚检查了我们所有的服务都按预期工作。
现在我想稍微调整一下我的自动缩放组配置,以便在其中混合按需和现场实例:
Fleet Composition - Combine purchase options and instances
Choose a mix of On-Demand Instances and Spot Instances and multiple instance types. Spot Instances are automatically launched at the lowest price available.
Instance Types:
t2.nano (1vCPUs, 0.5GiB)
t2.small (1vCPUs, 2GiB)
t2.micro (1vCPUs, 1GiB)
Maximum Spot Price - Use default (recommended)
Spot Allocation Strategy - Diversify Spot Instances across your 2 lowest priced instance types per Availability Zone
Optional On-Demand Base - Designate the first 0 instances as On-Demand
On-Demand Percentage 50% On-Demand and 50% Spot
Desired Capacity 1
Min 1
Max 1
我保存它并尝试相同的 AWS CLI 命令
aws deploy create-deployment --application-name Application --s3-location bucket=codedeploybucket,key=application,bundleType=zip --deployment-group-name DG_TEST
现在我的部署因这样的评论而失败:
The following validation error occurred: Valid requests must contain either LaunchTemplate, LaunchConfigurationName, InstanceId or MixedInstancesPolicy parameter. (Service: AmazonAutoScaling; Status Code: 400; Error Code: ValidationError; Request ID: 11111114-2b2b-11e9-93b7-11111111111)
另一个奇怪的事情是,如果我将 Launch Templae 配置为仅使用点:
Launch Template ID lt-00dc4c187d1111159
Default Version Number 1
Launch Template Name test2
Owner
arn:aws:iam::179961111910:user/itsp
Version 1 (Default)
Name test2
Created by arn:aws:iam::179961111910:user/itsp
Description Not specified
Date Created February 8, 2019 at 1:14:13 AM UTC+3
AMI ID ami-0bf1924ed30c48a6a
Availability Zone Not specified
Security Groups Not specified
Instance Type t2.micro
Key pair name itsp
Security Group Ids sg-0a45f7e6ac321614d,sg-07e746cf0e4935b84,sg-27bf6d4b
Advanced details
Purchasing option spot
Spot request type one-time
Spot interruption behavior Not specified
IAM Instance Profile CodeDeployRole (arn:aws:iam::1111111111:instance-profile/CodeDeployRole)
Stop - Hibernate behavior Not specified
Monitoring Not specified
EBS-optimized instance Not specified
Tenancy Host ID Not specified
RAM Disk ID Not specified
User Data Not specified
Elastic Inference Accelerator Not specified
Maximum Spot price Not specified
Spot expiry date -
Spot block duration Not specified
Shutdown behavior Not specified
Termination Protection Not specified
Placement Group Name Not specified
Tenancy Not specified
Tenancy Affinity Not specified
Kernel ID Not specified
Elastic Graphics Not specified
并在我的自动缩放组中使用该选项:
*Fleet Composition - Adhere to the launch template
The launch template determines the instance type and purchase option (On-Demand or Spot).*
然后在执行相同的部署命令后,我在 CodeDeploy 中收到另一个错误(部署失败的原因):
The IAM role arn:aws:iam::179966034910:role/CodeDeployRole does not give you permission to perform operations in the following AWS service: AmazonAutoScaling. Contact your AWS administrator if you need help. If you are an AWS administrator, you can grant permissions to your users or groups by creating IAM policies.
绝对不是这样,因为我在 CodeDeploy 中的角色拥有完整的 EC2、自动缩放和 CodeDeploy 访问权限。
我做错了什么还是错误?如何使用启动模板使用 codedeploy 配置混合自动缩放组(按需+现货实例)?提前致谢!
【问题讨论】:
【参考方案1】:我在使用 CodeDeploy 和 LaunchTemplates 时遇到了类似的问题。 看起来 CodeDeploy 仍然不支持 LaunchTemplates。
我们必须坚持LaunchConfigurations。它们仍然不支持版本控制,但在大多数情况下,它们几乎相同:/
我找不到 AWS 在哪里记录了将 LaunchConfigurations 迁移到 LaunchTemplates 时出现的小不兼容问题...但可以找到 here 更多信息。
纯粹的!
【讨论】:
以上是关于AWS CodeDeploy 与 Spot 和按需实例混合的 Autoscaling 启动模板的主要内容,如果未能解决你的问题,请参考以下文章
AWS EMR Presto 集群突然终止错误:作业流中的所有从属服务器都因 Spot 而终止
AWS ElasticBeanstalk、CodeDeploy 与 Capistrano、Mina、Vlad 等
AWS:帮助在 Codepipeline 中设置 CodeDeploy
在网络负载均衡器 + 目标组后面运行 SSH 的 AWS ECS 服务使用 CodeDeploy 部署缓慢
如何设置AWS CodeDeploy和EC2 CodeDeploy安全环境
[AWS DA] AWS CICD: CodeCommit, CodePipeline, CodeBuild, CodeDeploy