Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fargate agent provisioning issue #309

Open
jagadeeswar725863 opened this issue Feb 20, 2023 · 0 comments
Open

Fargate agent provisioning issue #309

jagadeeswar725863 opened this issue Feb 20, 2023 · 0 comments

Comments

@jagadeeswar725863
Copy link

Hello Team,

We are having issue after jenkins upgrade to the latest version. Below are the logs from jenkins.

===
Asked to provision 1 agent(s) for: plain_fargate
Feb 20, 2023 5:50:28 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSCloud provision
Will provision bes-01-ecs-plain_fargate-p0zp9, for label: plain_fargate
Feb 20, 2023 5:50:38 AM INFO hudson.slaves.NodeProvisioner update
bes-01-ecs-plain_fargate-p0zp9 provisioning successfully completed. We have now 2 computer(s)
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on tags: false
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on container definition: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on volumes: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on task role: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on execution role: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService registerTemplate
Match on network mode: true
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher runECSTask
[bes-01-ecs-plain_fargate-p0zp9]: Starting agent with task definition arn:aws:ecs:eu-central-1:296450026039:task-definition/bes-01-ecs-plain-template:6}
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher runECSTask
[bes-01-ecs-plain_fargate-p0zp9]: Agent started with task arn : arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: TaskArn: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: TaskDefinitionArn: arn:aws:ecs:eu-central-1:296450026039:task-definition/bes-01-ecs-plain-template:6
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: ClusterArn: arn:aws:ecs:eu-central-1:296450026039:cluster/devops-jenkins-bes-01-ecs-cluster
Feb 20, 2023 5:50:39 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: ContainerInstanceArn: null
Feb 20, 2023 5:51:01 AM WARNING org.jenkinsci.plugins.prometheus.DiskUsageCollector collect
Cannot collect disk usage data because plugin CloudBees Disk Usage Simple is not installed: java.lang.NoClassDefFoundError: com/cloudbees/simplediskusage/QuickDiskUsagePlugin
Feb 20, 2023 5:51:14 AM WARNING com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launchECSTask
[bes-01-ecs-plain_fargate-p0zp9]: ECS Task stopped: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
com.amazonaws.waiters.WaiterUnrecoverableException: Resource never entered the desired state as it failed.
at com.amazonaws.waiters.WaiterExecution.pollResource(WaiterExecution.java:78)
at com.amazonaws.waiters.WaiterImpl.run(WaiterImpl.java:88)
at com.cloudbees.jenkins.plugins.amazonecs.ECSService.waitForTasksRunning(ECSService.java:151)
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launchECSTask(ECSLauncher.java:158)
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launch(ECSLauncher.java:110)
at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:48)
at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:82)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)

Feb 20, 2023 5:51:14 AM WARNING com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher launch
[bes-01-ecs-plain_fargate-p0zp9]: Error in provisioning; agent=com.cloudbees.jenkins.plugins.amazonecs.ECSSlave[bes-01-ecs-plain_fargate-p0zp9]
Also: java.lang.Throwable: launched here
at hudson.slaves.SlaveComputer._connect(SlaveComputer.java:287)
at hudson.model.Computer.connect(Computer.java:445)
at hudson.slaves.CloudRetentionStrategy.start(CloudRetentionStrategy.java:75)
at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.start(OnceRetentionStrategy.java:83)
at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.start(OnceRetentionStrategy.java:46)
at hudson.model.AbstractCIBase.createNewComputerForNode(AbstractCIBase.java:192)
at hudson.model.AbstractCIBase.updateNewComputer(AbstractCIBase.java:221)
at jenkins.model.Jenkins.updateNewComputer(Jenkins.java:1669)
at jenkins.model.Nodes.addNode(Nodes.java:146)
at jenkins.model.Jenkins.addNode(Jenkins.java:2211)
at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:248)
at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823)
at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:94)
at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:69)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
java.lang.IllegalStateException: Task stopped before coming online. TaskARN: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launchECSTask(ECSLauncher.java:170)
at com.cloudbees.jenkins.plugins.amazonecs.ECSLauncher.launch(ECSLauncher.java:110)
at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:48)
at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:82)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)

Feb 20, 2023 5:51:14 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSSlave _terminate
[bes-01-ecs-plain_fargate-p0zp9]: Stopping: TaskArn arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f, ClusterArn arn:aws:ecs:eu-central-1:296450026039:cluster/devops-jenkins-bes-01-ecs-cluster
Feb 20, 2023 5:51:14 AM INFO com.cloudbees.jenkins.plugins.amazonecs.ECSService stopTask
Delete ECS agent task: arn:aws:ecs:eu-central-1:296450026039:task/devops-jenkins-bes-01-ecs-cluster/bb4e2c4caa9a4009a408fcbad395ed3f

==========

Jenkins version: 2.375.3
Amazon Elastic Container Service (ECS) / Fargate pluginVersion: 1.47
Amazon Web Services SDK :: ECSVersion: 1.12.406-370.v8f993c987059

Configuration details are below:

clouds:
- ecs:
allowedOverrides: "label"
cluster: "${ecs_cluster_arn}"
credentialsId: "devops-ecs-iam"
jenkinsUrl: "https://${master_domain}/"
name: "${master_name}-ecs"
numExecutors: 1
regionName: "eu-central-1"
templates:
- assignPublicIp: false
cpu: 1024
cpuArchitecture: "X86_64"
defaultCapacityProvider: false
enableExecuteCommand: false
ephemeralStorageSizeInGiB: 30
image: "$${devops-jenkins-${master_name}-aws-account-id}.dkr.ecr.eu-central-1.amazonaws.com/devops/bes3-build-env/best3-fargate/inbound-agent:1.0.0"
label: "plain_fargate"
launchType: "FARGATE"
memory: 0
memoryReservation: 2048
networkMode: "awsvpc"
operatingSystemFamily: "LINUX"
platformVersion: "LATEST"
privileged: false
remoteFSRoot: "/home/jenkins"
sharedMemorySize: 0
subnets: "${ecs_subnets}"
templateName: "plain-template"
uniqueRemoteFSRoot: false
executionRole: "${ecs_execution_role_arn}"
securityGroups: "${ecs_sec_group}"

Please help us to solve this issue.

Thanks.
Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant