May 27 17:40:56.737682 ip-10-0-141-245 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 17:40:56.737691 ip-10-0-141-245 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 17:40:56.737698 ip-10-0-141-245 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 17:40:56.737925 ip-10-0-141-245 systemd[1]: Failed to start Kubernetes Kubelet. May 27 17:41:06.802606 ip-10-0-141-245 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 17:41:06.802623 ip-10-0-141-245 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6c87785125da4e42a7376fd247f1e758 -- May 27 17:43:30.457046 ip-10-0-141-245 systemd[1]: Starting Kubernetes Kubelet... May 27 17:43:30.950477 ip-10-0-141-245 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:43:30.950477 ip-10-0-141-245 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 17:43:30.950477 ip-10-0-141-245 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:43:30.950477 ip-10-0-141-245 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 17:43:30.950477 ip-10-0-141-245 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 17:43:30.953562 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.953463 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 17:43:30.958332 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958316 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:30.958332 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958332 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958336 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958341 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958345 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958348 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958352 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958355 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958358 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958362 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958366 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958369 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958371 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958374 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958377 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958379 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958382 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958385 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958387 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958390 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958393 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:30.958396 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958395 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958398 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958401 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958404 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958408 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958411 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958413 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958416 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958418 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958421 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958423 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958426 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958428 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958431 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958433 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958436 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958438 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958442 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958444 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958447 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:30.958921 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958449 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958452 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958455 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958457 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958460 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958462 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958465 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958468 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958470 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958473 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958475 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958478 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958480 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958483 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958487 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958490 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958493 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958496 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958498 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958501 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:30.959411 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958504 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958506 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958509 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958511 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958514 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958519 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958523 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958525 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958528 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958531 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958533 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958536 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958538 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958540 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958543 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958546 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958549 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958551 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958554 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:30.959913 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958558 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958562 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958565 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958568 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958571 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958574 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.958993 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959000 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959003 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959006 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959009 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959012 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959015 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959018 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959021 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959023 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959026 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959029 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959032 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959034 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:30.960370 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959037 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959039 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959042 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959045 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959047 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959050 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959052 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959055 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959058 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959061 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959063 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959066 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959069 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959071 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959074 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959077 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959079 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959082 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959084 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959088 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:30.960951 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959090 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959093 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959096 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959098 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959101 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959104 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959106 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959109 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959111 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959114 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959116 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959119 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959121 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959123 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959126 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959128 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959131 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959133 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959136 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959139 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:30.961494 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959142 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959144 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959147 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959150 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959153 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959156 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959158 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959160 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959163 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959165 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959169 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959171 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959173 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959176 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959178 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959181 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959183 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959187 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959190 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959192 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:30.962002 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959195 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959198 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959200 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959203 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959206 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959208 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959211 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959213 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959218 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959222 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959224 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.959228 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960698 2566 flags.go:64] FLAG: --address="0.0.0.0" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960709 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960716 2566 flags.go:64] FLAG: --anonymous-auth="true" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960721 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960726 2566 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960729 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960734 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960739 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960742 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 17:43:30.962491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960745 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960749 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960752 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960755 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960758 2566 flags.go:64] FLAG: --cgroup-root="" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960761 2566 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960764 2566 flags.go:64] FLAG: --client-ca-file="" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960767 2566 flags.go:64] FLAG: --cloud-config="" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960770 2566 flags.go:64] FLAG: --cloud-provider="external" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960773 2566 flags.go:64] FLAG: --cluster-dns="[]" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960777 2566 flags.go:64] FLAG: --cluster-domain="" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960780 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960784 2566 flags.go:64] FLAG: --config-dir="" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960787 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960790 2566 flags.go:64] FLAG: --container-log-max-files="5" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960799 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960802 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960805 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960809 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960812 2566 flags.go:64] FLAG: --contention-profiling="false" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960815 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960818 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960821 2566 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960824 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960829 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 17:43:30.963021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960833 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960836 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960839 2566 flags.go:64] FLAG: --enable-load-reader="false" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960843 2566 flags.go:64] FLAG: --enable-server="true" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960846 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960851 2566 flags.go:64] FLAG: --event-burst="100" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960854 2566 flags.go:64] FLAG: --event-qps="50" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960857 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960860 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960863 2566 flags.go:64] FLAG: --eviction-hard="" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960867 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960870 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960873 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960876 2566 flags.go:64] FLAG: --eviction-soft="" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960879 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960882 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960884 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960887 2566 flags.go:64] FLAG: --experimental-mounter-path="" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960890 2566 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960893 2566 flags.go:64] FLAG: --fail-swap-on="true" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960896 2566 flags.go:64] FLAG: --feature-gates="" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960900 2566 flags.go:64] FLAG: --file-check-frequency="20s" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960904 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960907 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960911 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960914 2566 flags.go:64] FLAG: --healthz-port="10248" May 27 17:43:30.963625 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960917 2566 flags.go:64] FLAG: --help="false" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960919 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-141-245.ec2.internal" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960923 2566 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960926 2566 flags.go:64] FLAG: --http-check-frequency="20s" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960929 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960933 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960936 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960940 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960943 2566 flags.go:64] FLAG: --image-service-endpoint="" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960946 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960950 2566 flags.go:64] FLAG: --kube-api-burst="100" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960952 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960955 2566 flags.go:64] FLAG: --kube-api-qps="50" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960959 2566 flags.go:64] FLAG: --kube-reserved="" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960962 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960965 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960968 2566 flags.go:64] FLAG: --kubelet-cgroups="" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960971 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960974 2566 flags.go:64] FLAG: --lock-file="" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960977 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960980 2566 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960983 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960988 2566 flags.go:64] FLAG: --log-json-split-stream="false" May 27 17:43:30.964247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960992 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960994 2566 flags.go:64] FLAG: --log-text-split-stream="false" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.960997 2566 flags.go:64] FLAG: --logging-format="text" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961000 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961003 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961008 2566 flags.go:64] FLAG: --manifest-url="" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961010 2566 flags.go:64] FLAG: --manifest-url-header="" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961015 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961018 2566 flags.go:64] FLAG: --max-open-files="1000000" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961023 2566 flags.go:64] FLAG: --max-pods="110" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961025 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961029 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961031 2566 flags.go:64] FLAG: --memory-manager-policy="None" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961034 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961037 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961040 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961043 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961051 2566 flags.go:64] FLAG: --node-status-max-images="50" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961055 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961058 2566 flags.go:64] FLAG: --oom-score-adj="-999" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961061 2566 flags.go:64] FLAG: --pod-cidr="" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961063 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961069 2566 flags.go:64] FLAG: --pod-manifest-path="" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961072 2566 flags.go:64] FLAG: --pod-max-pids="-1" May 27 17:43:30.964827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961075 2566 flags.go:64] FLAG: --pods-per-core="0" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961078 2566 flags.go:64] FLAG: --port="10250" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961082 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961085 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d6989da2d84ae4f" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961088 2566 flags.go:64] FLAG: --qos-reserved="" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961091 2566 flags.go:64] FLAG: --read-only-port="10255" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961094 2566 flags.go:64] FLAG: --register-node="true" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961097 2566 flags.go:64] FLAG: --register-schedulable="true" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961100 2566 flags.go:64] FLAG: --register-with-taints="" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961104 2566 flags.go:64] FLAG: --registry-burst="10" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961107 2566 flags.go:64] FLAG: --registry-qps="5" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961110 2566 flags.go:64] FLAG: --reserved-cpus="" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961112 2566 flags.go:64] FLAG: --reserved-memory="" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961117 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961121 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961124 2566 flags.go:64] FLAG: --rotate-certificates="false" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961129 2566 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961132 2566 flags.go:64] FLAG: --runonce="false" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961135 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961138 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961141 2566 flags.go:64] FLAG: --seccomp-default="false" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961144 2566 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961147 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961150 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961153 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961156 2566 flags.go:64] FLAG: --storage-driver-password="root" May 27 17:43:30.965413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961159 2566 flags.go:64] FLAG: --storage-driver-secure="false" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961162 2566 flags.go:64] FLAG: --storage-driver-table="stats" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961165 2566 flags.go:64] FLAG: --storage-driver-user="root" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961168 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961171 2566 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961174 2566 flags.go:64] FLAG: --system-cgroups="" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961176 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961182 2566 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961185 2566 flags.go:64] FLAG: --tls-cert-file="" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961188 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961191 2566 flags.go:64] FLAG: --tls-min-version="" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961194 2566 flags.go:64] FLAG: --tls-private-key-file="" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961197 2566 flags.go:64] FLAG: --topology-manager-policy="none" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961200 2566 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961203 2566 flags.go:64] FLAG: --topology-manager-scope="container" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961206 2566 flags.go:64] FLAG: --v="2" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961210 2566 flags.go:64] FLAG: --version="false" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961214 2566 flags.go:64] FLAG: --vmodule="" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961218 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.961222 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961335 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961340 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961345 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961348 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:30.966046 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961351 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961354 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961357 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961360 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961363 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961367 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961369 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961372 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961375 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961378 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961381 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961383 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961386 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961389 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961391 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961394 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961397 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961399 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961402 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961405 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:30.966628 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961407 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961410 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961412 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961415 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961418 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961420 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961423 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961426 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961430 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961432 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961436 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961439 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961442 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961444 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961447 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961449 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961452 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961455 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961458 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961460 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:30.967166 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961463 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961467 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961471 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961474 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961477 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961480 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961483 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961485 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961488 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961490 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961493 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961496 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961498 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961501 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961504 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961507 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961509 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961513 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961517 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:30.967677 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961519 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961523 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961525 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961532 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961535 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961537 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961540 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961542 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961545 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961548 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961550 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961553 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961555 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961558 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961560 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961562 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961566 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961568 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961571 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:30.968331 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961574 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:30.968994 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961576 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:30.968994 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961579 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:30.968994 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.961581 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:30.968994 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.962399 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:43:30.970651 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.970631 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 17:43:30.970651 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.970651 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970700 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970706 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970709 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970713 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970716 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970719 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970723 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970728 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970731 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970734 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970737 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970739 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970743 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:30.970739 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970746 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970749 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970753 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970755 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970758 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970761 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970763 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970766 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970768 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970771 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970773 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970776 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970778 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970781 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970783 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970787 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970790 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970792 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970795 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970797 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:30.971078 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970800 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970802 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970806 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970810 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970812 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970815 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970818 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970820 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970823 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970825 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970828 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970831 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970834 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970836 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970839 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970842 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970845 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970847 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970850 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:30.971619 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970852 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970855 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970858 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970861 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970864 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970867 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970869 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970872 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970875 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970878 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970880 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970883 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970885 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970888 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970890 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970893 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970895 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970898 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970900 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970903 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:30.972094 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970905 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970907 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970910 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970913 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970919 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970921 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970924 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970927 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970930 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970932 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970935 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970937 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970939 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.970942 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.970947 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:43:30.972682 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971059 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971064 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971067 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971070 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971073 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971076 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971079 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971082 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971085 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971088 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971091 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971093 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971096 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971099 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971101 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971104 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971106 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971109 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971111 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971114 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 17:43:30.973055 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971117 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971121 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971125 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971128 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971131 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971134 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971137 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971140 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971143 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971145 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971148 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971150 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971153 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971155 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971157 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971160 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971162 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971165 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971167 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 17:43:30.973546 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971170 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971172 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971176 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971179 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971182 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971184 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971187 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971190 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971192 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971195 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971198 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971200 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971203 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971205 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971208 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971210 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971213 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971216 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971218 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 17:43:30.974033 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971221 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971223 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971226 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971228 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971231 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971233 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971236 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971238 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971241 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971243 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971246 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971249 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971251 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971253 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971256 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971258 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971261 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971263 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971266 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971268 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 17:43:30.974501 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971271 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971273 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971276 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971279 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971281 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971284 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971287 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:30.971289 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.971294 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 17:43:30.974995 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.972146 2566 server.go:962] "Client rotation is on, will bootstrap in background" May 27 17:43:30.980645 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.980630 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 17:43:30.982372 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.982360 2566 server.go:1019] "Starting client certificate rotation" May 27 17:43:30.982475 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.982456 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 17:43:30.982522 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:30.982496 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 17:43:31.009463 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.009437 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 17:43:31.011504 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.011483 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 17:43:31.028093 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.028070 2566 log.go:25] "Validated CRI v1 runtime API" May 27 17:43:31.034145 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.034129 2566 log.go:25] "Validated CRI v1 image API" May 27 17:43:31.036168 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.036150 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 17:43:31.038755 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.038736 2566 fs.go:135] Filesystem UUIDs: map[0b38615d-8577-41be-9cc2-689add62d44e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d403d182-75eb-4710-9a55-5c4e3b60cf4e:/dev/nvme0n1p4] May 27 17:43:31.038818 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.038755 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 17:43:31.044116 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.043998 2566 manager.go:217] Machine: {Timestamp:2026-05-27 17:43:31.043441544 +0000 UTC m=+0.449416016 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098233 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e09530bcad01577fdd326dd58ca7e SystemUUID:ec2e0953-0bca-d015-77fd-d326dd58ca7e BootID:6c877851-25da-4e42-a737-6fd247f1e758 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:3c:f9:46:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:3c:f9:46:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:9a:e2:f9:7e:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 17:43:31.044116 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.044103 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 17:43:31.044245 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.044184 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 17:43:31.047622 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.047581 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 17:43:31.047756 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.047626 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 17:43:31.047801 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.047766 2566 topology_manager.go:138] "Creating topology manager with none policy" May 27 17:43:31.047801 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.047775 2566 container_manager_linux.go:306] "Creating device plugin manager" May 27 17:43:31.047801 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.047782 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 17:43:31.048529 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.048520 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 17:43:31.049463 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.049446 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 17:43:31.050477 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.050466 2566 state_mem.go:36] "Initialized new in-memory state store" May 27 17:43:31.050585 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.050576 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 17:43:31.053827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.053815 2566 kubelet.go:491] "Attempting to sync node with API server" May 27 17:43:31.053876 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.053831 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 17:43:31.053876 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.053843 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 17:43:31.053876 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.053853 2566 kubelet.go:397] "Adding apiserver pod source" May 27 17:43:31.053876 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.053863 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 17:43:31.055010 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.054998 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 17:43:31.055057 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.055018 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 17:43:31.058262 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.058247 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 17:43:31.060079 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060066 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 17:43:31.060922 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060910 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 17:43:31.060966 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060932 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 17:43:31.060966 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060941 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 17:43:31.060966 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060947 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 17:43:31.060966 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060959 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 17:43:31.060966 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060965 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 17:43:31.061098 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060970 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 17:43:31.061098 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060976 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 17:43:31.061098 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060983 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 17:43:31.061098 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060989 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 17:43:31.061098 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.060997 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 17:43:31.061275 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.061266 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 17:43:31.062164 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.062154 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 17:43:31.062203 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.062168 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 17:43:31.065027 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.065009 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 17:43:31.065104 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.065029 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 17:43:31.065104 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.065038 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 17:43:31.065496 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.065483 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 17:43:31.065531 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.065521 2566 server.go:1295] "Started kubelet" May 27 17:43:31.065636 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.065593 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 17:43:31.065686 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.065642 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 17:43:31.065716 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.065710 2566 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 17:43:31.066334 ip-10-0-141-245 systemd[1]: Started Kubernetes Kubelet. May 27 17:43:31.066911 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.066799 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 17:43:31.067544 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.067530 2566 server.go:317] "Adding debug handlers to kubelet server" May 27 17:43:31.072344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.072322 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5829" May 27 17:43:31.073838 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.073824 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 17:43:31.074445 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.074426 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 17:43:31.074561 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.074548 2566 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 17:43:31.074659 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.074649 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 17:43:31.074842 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.074827 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 17:43:31.074984 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.074967 2566 reconstruct.go:97] "Volume reconstruction finished" May 27 17:43:31.074984 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.074985 2566 reconciler.go:26] "Reconciler: start to sync state" May 27 17:43:31.075197 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.075178 2566 factory.go:55] Registering systemd factory May 27 17:43:31.075282 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.075242 2566 factory.go:223] Registration of the systemd container factory successfully May 27 17:43:31.075429 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.075261 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.075634 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.075594 2566 factory.go:153] Registering CRI-O factory May 27 17:43:31.075634 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.075625 2566 factory.go:223] Registration of the crio container factory successfully May 27 17:43:31.075780 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.075682 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 17:43:31.075780 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.075701 2566 factory.go:103] Registering Raw factory May 27 17:43:31.075780 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.075717 2566 manager.go:1196] Started watching for new ooms in manager May 27 17:43:31.076709 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.076471 2566 manager.go:319] Starting recovery of all containers May 27 17:43:31.077150 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.077117 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 17:43:31.078596 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.078439 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5829" May 27 17:43:31.086066 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.086044 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:31.088128 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.088111 2566 manager.go:324] Recovery completed May 27 17:43:31.088525 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.088504 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-245.ec2.internal\" not found" node="ip-10-0-141-245.ec2.internal" May 27 17:43:31.092432 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.092416 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:31.094274 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.094255 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:31.094346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.094285 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:31.094346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.094295 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:31.094801 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.094786 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 17:43:31.094801 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.094799 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 17:43:31.094936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.094819 2566 state_mem.go:36] "Initialized new in-memory state store" May 27 17:43:31.097289 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.097275 2566 policy_none.go:49] "None policy: Start" May 27 17:43:31.097371 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.097294 2566 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 17:43:31.097371 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.097309 2566 state_mem.go:35] "Initializing new in-memory state store" May 27 17:43:31.138259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.138246 2566 manager.go:341] "Starting Device Plugin manager" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.138277 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.138287 2566 server.go:85] "Starting device plugin registration server" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.138531 2566 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.138542 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.138632 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.138708 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.138716 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.139271 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 17:43:31.155076 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.139305 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.176550 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.176517 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 17:43:31.177730 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.177717 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 17:43:31.177800 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.177740 2566 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 17:43:31.177800 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.177756 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 17:43:31.177800 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.177764 2566 kubelet.go:2451] "Starting kubelet main sync loop" May 27 17:43:31.177987 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.177806 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 17:43:31.181934 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.181917 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:31.239368 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.239306 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:31.240400 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.240386 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:31.240478 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.240413 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:31.240478 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.240424 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:31.240478 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.240448 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-245.ec2.internal" May 27 17:43:31.258324 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.258305 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-245.ec2.internal" May 27 17:43:31.258384 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.258327 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-245.ec2.internal\": node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.278916 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.278889 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal"] May 27 17:43:31.279002 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.278949 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:31.279728 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.279713 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:31.279800 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.279740 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:31.279800 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.279749 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:31.281089 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281077 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:31.281275 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281260 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.281313 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281295 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:31.281768 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281753 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:31.281835 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281785 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:31.281835 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281795 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:31.281835 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281796 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:31.281835 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281815 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:31.281961 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.281838 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:31.283070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.283053 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" May 27 17:43:31.283123 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.283094 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 17:43:31.283788 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.283773 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientMemory" May 27 17:43:31.283883 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.283794 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasNoDiskPressure" May 27 17:43:31.283883 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.283804 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeHasSufficientPID" May 27 17:43:31.284349 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.284336 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.297136 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.297121 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-245.ec2.internal\" not found" node="ip-10-0-141-245.ec2.internal" May 27 17:43:31.301091 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.301076 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-245.ec2.internal\" not found" node="ip-10-0-141-245.ec2.internal" May 27 17:43:31.376749 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.376722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37e6a25318b0f22f07f4382756ed2e48-config\") pod \"kube-apiserver-proxy-ip-10-0-141-245.ec2.internal\" (UID: \"37e6a25318b0f22f07f4382756ed2e48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" May 27 17:43:31.385069 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.385049 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.477540 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.477518 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37e6a25318b0f22f07f4382756ed2e48-config\") pod \"kube-apiserver-proxy-ip-10-0-141-245.ec2.internal\" (UID: \"37e6a25318b0f22f07f4382756ed2e48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" May 27 17:43:31.477648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.477549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fc5dba69328e341ab1f7999a9c4499e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"9fc5dba69328e341ab1f7999a9c4499e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.477648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.477574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fc5dba69328e341ab1f7999a9c4499e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"9fc5dba69328e341ab1f7999a9c4499e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.477648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.477638 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37e6a25318b0f22f07f4382756ed2e48-config\") pod \"kube-apiserver-proxy-ip-10-0-141-245.ec2.internal\" (UID: \"37e6a25318b0f22f07f4382756ed2e48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" May 27 17:43:31.485647 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.485630 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.578298 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.578224 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fc5dba69328e341ab1f7999a9c4499e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"9fc5dba69328e341ab1f7999a9c4499e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.578298 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.578265 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fc5dba69328e341ab1f7999a9c4499e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"9fc5dba69328e341ab1f7999a9c4499e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.578298 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.578295 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fc5dba69328e341ab1f7999a9c4499e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"9fc5dba69328e341ab1f7999a9c4499e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.578430 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.578317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fc5dba69328e341ab1f7999a9c4499e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal\" (UID: \"9fc5dba69328e341ab1f7999a9c4499e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.586346 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.586315 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.599471 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.599455 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:31.604223 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.604205 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" May 27 17:43:31.687324 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.687288 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.787760 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.787736 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.888283 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.888209 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:31.981806 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.981723 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 17:43:31.982398 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.981873 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 17:43:31.982398 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:31.981899 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 17:43:31.988658 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:31.988635 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:32.003946 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.003917 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:32.074389 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.074361 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 17:43:32.080956 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.080919 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 17:38:31 +0000 UTC" deadline="2027-12-08 00:34:56.713299631 +0000 UTC" May 27 17:43:32.080956 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.080953 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13422h51m24.632349517s" May 27 17:43:32.088827 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:32.088800 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:32.090930 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.090911 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 17:43:32.104140 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:32.104115 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e6a25318b0f22f07f4382756ed2e48.slice/crio-0e1310f235a9af9fa34b896394a2e66170212be3f8fe66a56cacd63cb0e4ea89 WatchSource:0}: Error finding container 0e1310f235a9af9fa34b896394a2e66170212be3f8fe66a56cacd63cb0e4ea89: Status 404 returned error can't find the container with id 0e1310f235a9af9fa34b896394a2e66170212be3f8fe66a56cacd63cb0e4ea89 May 27 17:43:32.104426 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:32.104411 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc5dba69328e341ab1f7999a9c4499e.slice/crio-93a77eb09c3d7a2fdd04cc47f5d5328e24b58336ee49caf7afde67820802fa34 WatchSource:0}: Error finding container 93a77eb09c3d7a2fdd04cc47f5d5328e24b58336ee49caf7afde67820802fa34: Status 404 returned error can't find the container with id 93a77eb09c3d7a2fdd04cc47f5d5328e24b58336ee49caf7afde67820802fa34 May 27 17:43:32.108443 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.108429 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 17:43:32.122690 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.122663 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dtntp" May 27 17:43:32.139665 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.139621 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dtntp" May 27 17:43:32.180526 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.180473 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" event={"ID":"37e6a25318b0f22f07f4382756ed2e48","Type":"ContainerStarted","Data":"0e1310f235a9af9fa34b896394a2e66170212be3f8fe66a56cacd63cb0e4ea89"} May 27 17:43:32.181478 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.181452 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" event={"ID":"9fc5dba69328e341ab1f7999a9c4499e","Type":"ContainerStarted","Data":"93a77eb09c3d7a2fdd04cc47f5d5328e24b58336ee49caf7afde67820802fa34"} May 27 17:43:32.189622 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:32.189589 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:32.290157 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:32.290123 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:32.390699 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:32.390622 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-245.ec2.internal\" not found" May 27 17:43:32.469916 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.469889 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:32.475659 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.475633 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" May 27 17:43:32.488395 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.488370 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 17:43:32.489510 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.489486 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" May 27 17:43:32.500058 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:32.500033 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 17:43:33.055489 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.055453 2566 apiserver.go:52] "Watching apiserver" May 27 17:43:33.062589 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.062561 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 17:43:33.065323 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.065295 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-pqtnw","kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal","openshift-image-registry/node-ca-wdf5c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal","openshift-multus/network-metrics-daemon-77w6f","openshift-network-diagnostics/network-check-target-llc8f","openshift-network-operator/iptables-alerter-2vh78","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b","openshift-cluster-node-tuning-operator/tuned-h2pg8","openshift-multus/multus-6k8p7","openshift-multus/multus-additional-cni-plugins-kbc5x","openshift-ovn-kubernetes/ovnkube-node-f2lpm"] May 27 17:43:33.069832 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.069812 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.071868 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.071847 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.072271 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.072249 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 17:43:33.072440 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.072314 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 17:43:33.072763 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.072745 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mbffp\"" May 27 17:43:33.073629 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.073583 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 17:43:33.073761 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.073735 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9x62h\"" May 27 17:43:33.073983 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.073966 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 17:43:33.074422 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.074402 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 17:43:33.075151 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.075133 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:33.075240 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.075217 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:33.077252 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.077232 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:33.077348 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.077294 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:33.077348 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.077326 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.079618 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.079249 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 17:43:33.079618 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.079352 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 17:43:33.079618 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.079506 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 17:43:33.079797 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.079632 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c9xsd\"" May 27 17:43:33.082702 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.082685 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.082799 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.082780 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.084994 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.084932 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6k8p7" May 27 17:43:33.085649 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.085622 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 17:43:33.085747 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.085622 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 17:43:33.085816 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.085745 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 17:43:33.085816 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.085628 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 17:43:33.085816 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.085807 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 17:43:33.086021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086004 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5dxbp\"" May 27 17:43:33.086113 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086045 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vmfqr\"" May 27 17:43:33.086174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01195a32-58bc-44eb-989d-1f67b8045e43-agent-certs\") pod \"konnectivity-agent-pqtnw\" (UID: \"01195a32-58bc-44eb-989d-1f67b8045e43\") " pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.086174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01195a32-58bc-44eb-989d-1f67b8045e43-konnectivity-ca\") pod \"konnectivity-agent-pqtnw\" (UID: \"01195a32-58bc-44eb-989d-1f67b8045e43\") " pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.086281 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-host\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.086281 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-serviceca\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.086281 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086224 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:33.086398 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086276 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz2fq\" (UniqueName: \"kubernetes.io/projected/e08b8fd2-9f51-4877-9809-f07df56538d9-kube-api-access-pz2fq\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:33.086398 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:33.086398 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wvbt\" (UniqueName: \"kubernetes.io/projected/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-kube-api-access-6wvbt\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.086636 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086618 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 17:43:33.086923 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.086866 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 17:43:33.087221 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.087043 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 17:43:33.087221 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.087145 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 17:43:33.087412 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.087329 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.087541 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.087524 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npwsw\"" May 27 17:43:33.089299 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.089280 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.089803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.089728 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 17:43:33.089803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.089750 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 17:43:33.089957 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.089853 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tmnzv\"" May 27 17:43:33.091208 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.091189 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 17:43:33.091208 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.091204 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wcshr\"" May 27 17:43:33.091442 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.091424 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 17:43:33.091442 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.091440 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 17:43:33.091742 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.091724 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 17:43:33.091994 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.091975 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 17:43:33.092279 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.092264 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 17:43:33.140259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.140229 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:38:32 +0000 UTC" deadline="2028-02-28 04:11:13.584571714 +0000 UTC" May 27 17:43:33.140259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.140251 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15394h27m40.44432292s" May 27 17:43:33.176059 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.176037 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 17:43:33.186595 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186566 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-log-socket\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.186734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186625 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01195a32-58bc-44eb-989d-1f67b8045e43-konnectivity-ca\") pod \"konnectivity-agent-pqtnw\" (UID: \"01195a32-58bc-44eb-989d-1f67b8045e43\") " pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.186734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e400806-f86f-4510-b251-9605f4ca87d7-cni-binary-copy\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.186734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-conf-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.186734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186732 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxpz\" (UniqueName: \"kubernetes.io/projected/9e400806-f86f-4510-b251-9605f4ca87d7-kube-api-access-wdxpz\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.186891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-registration-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.186891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7jcn\" (UniqueName: \"kubernetes.io/projected/e301669c-cc1e-4e8a-8863-23b563c25e50-kube-api-access-l7jcn\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.186891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-kubelet\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187038 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-run-netns\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187038 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-modprobe-d\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.187038 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.186967 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-kubernetes\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.187038 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-cni-bin\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187037 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-cni-netd\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovnkube-config\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187085 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5nsw\" (UniqueName: \"kubernetes.io/projected/3dd81c84-6744-493e-8a7d-e8b05fb3601e-kube-api-access-b5nsw\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbvmf\" (UniqueName: \"kubernetes.io/projected/97814507-19fa-46d3-802e-9e82582b6819-kube-api-access-tbvmf\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187139 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pz2fq\" (UniqueName: \"kubernetes.io/projected/e08b8fd2-9f51-4877-9809-f07df56538d9-kube-api-access-pz2fq\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187166 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-system-cni-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.187222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187191 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01195a32-58bc-44eb-989d-1f67b8045e43-konnectivity-ca\") pod \"konnectivity-agent-pqtnw\" (UID: \"01195a32-58bc-44eb-989d-1f67b8045e43\") " pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.187528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187358 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-os-release\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.187528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-device-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.187528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e301669c-cc1e-4e8a-8863-23b563c25e50-tmp\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.187528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-run-ovn-kubernetes\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97814507-19fa-46d3-802e-9e82582b6819-iptables-alerter-script\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.187528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187508 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-systemd\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187536 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-host\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187562 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-serviceca\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187587 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187642 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-host\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-kubelet\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-multus-certs\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-socket-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.187781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysctl-conf\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187782 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wvbt\" (UniqueName: \"kubernetes.io/projected/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-kube-api-access-6wvbt\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.187808 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-system-cni-dir\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187843 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.187890 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs podName:e08b8fd2-9f51-4877-9809-f07df56538d9 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:33.687859883 +0000 UTC m=+3.093834344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs") pod "network-metrics-daemon-77w6f" (UID: "e08b8fd2-9f51-4877-9809-f07df56538d9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.187983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-ovn\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-cni-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-serviceca\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-sys-fs\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-systemd-units\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188115 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-etc-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysctl-d\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-run\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188185 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-tuned\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188219 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-var-lib-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-env-overrides\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188262 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovn-node-metrics-cert\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e400806-f86f-4510-b251-9605f4ca87d7-multus-daemon-config\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-systemd\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-node-log\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188420 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-netns\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-var-lib-kubelet\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj5ng\" (UniqueName: \"kubernetes.io/projected/9ff15a6c-30d2-4672-a595-4d67dd6435a9-kube-api-access-cj5ng\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovnkube-script-lib\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.188583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-socket-dir-parent\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-etc-kubernetes\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-host\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-os-release\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-slash\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188693 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188708 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-cnibin\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188725 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01195a32-58bc-44eb-989d-1f67b8045e43-agent-certs\") pod \"konnectivity-agent-pqtnw\" (UID: \"01195a32-58bc-44eb-989d-1f67b8045e43\") " pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-hostroot\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188773 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cnibin\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97814507-19fa-46d3-802e-9e82582b6819-host-slash\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-etc-selinux\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfv8\" (UniqueName: \"kubernetes.io/projected/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-kube-api-access-jpfv8\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188936 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-lib-modules\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.188983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.189195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.189008 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 17:43:33.189727 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.189022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-k8s-cni-cncf-io\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.189727 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.189067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-cni-bin\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.189727 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.189096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-cni-multus\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.189727 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.189121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysconfig\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.189727 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.189142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-sys\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.192222 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.192206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01195a32-58bc-44eb-989d-1f67b8045e43-agent-certs\") pod \"konnectivity-agent-pqtnw\" (UID: \"01195a32-58bc-44eb-989d-1f67b8045e43\") " pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.197924 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.197906 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:33.198000 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.197929 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:33.198000 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.197941 2566 projected.go:194] Error preparing data for projected volume kube-api-access-rl9kw for pod openshift-network-diagnostics/network-check-target-llc8f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:33.198095 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.198003 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw podName:31944c76-f6be-45b0-a1b1-db6389b3c992 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:33.697989321 +0000 UTC m=+3.103963796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rl9kw" (UniqueName: "kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw") pod "network-check-target-llc8f" (UID: "31944c76-f6be-45b0-a1b1-db6389b3c992") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:33.200120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.200095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wvbt\" (UniqueName: \"kubernetes.io/projected/6b1ae8d7-ef2f-49c4-a7ab-24c423252380-kube-api-access-6wvbt\") pod \"node-ca-wdf5c\" (UID: \"6b1ae8d7-ef2f-49c4-a7ab-24c423252380\") " pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.200668 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.200650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz2fq\" (UniqueName: \"kubernetes.io/projected/e08b8fd2-9f51-4877-9809-f07df56538d9-kube-api-access-pz2fq\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:33.290154 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290123 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-run-ovn-kubernetes\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290154 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290158 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97814507-19fa-46d3-802e-9e82582b6819-iptables-alerter-script\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290180 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-systemd\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290217 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-kubelet\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290230 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-run-ovn-kubernetes\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290244 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-multus-certs\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290269 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-socket-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-systemd\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290293 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysctl-conf\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-kubelet\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-multus-certs\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290321 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-system-cni-dir\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290353 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-system-cni-dir\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.290377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290380 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-socket-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290419 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-ovn\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290455 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-cni-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-ovn\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290482 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-sys-fs\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290509 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-systemd-units\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290511 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-cni-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290534 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-etc-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290561 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysctl-d\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-sys-fs\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290585 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-run\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-etc-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290629 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-tuned\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysctl-conf\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290655 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.290891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290655 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-systemd-units\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290689 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-var-lib-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290713 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-env-overrides\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290739 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovn-node-metrics-cert\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290767 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e400806-f86f-4510-b251-9605f4ca87d7-multus-daemon-config\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97814507-19fa-46d3-802e-9e82582b6819-iptables-alerter-script\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290793 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-systemd\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290802 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysctl-d\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290828 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-node-log\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290835 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-systemd\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-run\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-node-log\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.290917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-var-lib-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291141 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291178 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-netns\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291197 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291207 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-var-lib-kubelet\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.291557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291235 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj5ng\" (UniqueName: \"kubernetes.io/projected/9ff15a6c-30d2-4672-a595-4d67dd6435a9-kube-api-access-cj5ng\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291260 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-env-overrides\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovnkube-script-lib\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291312 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-socket-dir-parent\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291339 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-etc-kubernetes\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291368 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291391 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-host\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e400806-f86f-4510-b251-9605f4ca87d7-multus-daemon-config\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291418 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-os-release\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291468 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-socket-dir-parent\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291490 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-os-release\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291510 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-host\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291518 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-slash\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-etc-kubernetes\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291548 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291623 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-cnibin\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291640 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-slash\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.292344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291651 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-hostroot\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291676 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cnibin\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291700 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97814507-19fa-46d3-802e-9e82582b6819-host-slash\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291725 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-etc-selinux\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291738 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovnkube-script-lib\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291751 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfv8\" (UniqueName: \"kubernetes.io/projected/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-kube-api-access-jpfv8\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291784 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-lib-modules\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291804 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291820 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291837 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-k8s-cni-cncf-io\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291853 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-cni-bin\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291868 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-cni-multus\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291883 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysconfig\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291898 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-sys\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291919 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-log-socket\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291936 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e400806-f86f-4510-b251-9605f4ca87d7-cni-binary-copy\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291954 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-conf-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293209 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291970 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxpz\" (UniqueName: \"kubernetes.io/projected/9e400806-f86f-4510-b251-9605f4ca87d7-kube-api-access-wdxpz\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291986 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-registration-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292017 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7jcn\" (UniqueName: \"kubernetes.io/projected/e301669c-cc1e-4e8a-8863-23b563c25e50-kube-api-access-l7jcn\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292032 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-kubelet\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-hostroot\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292051 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-run-netns\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292068 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-modprobe-d\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292069 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292083 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-kubernetes\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292090 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-var-lib-kubelet\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292117 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-netns\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292125 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cnibin\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292146 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-cni-bin\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292168 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97814507-19fa-46d3-802e-9e82582b6819-host-slash\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292177 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-cni-netd\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292204 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovnkube-config\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-etc-selinux\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.293936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292230 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5nsw\" (UniqueName: \"kubernetes.io/projected/3dd81c84-6744-493e-8a7d-e8b05fb3601e-kube-api-access-b5nsw\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-cni-bin\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292300 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-cni-netd\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292327 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-lib-modules\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292341 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-kubernetes\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292369 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-run-openvswitch\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292413 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-run-k8s-cni-cncf-io\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292448 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-cni-bin\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292477 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-host-var-lib-cni-multus\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-sysconfig\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-sys\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292597 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-log-socket\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292721 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovnkube-config\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ff15a6c-30d2-4672-a595-4d67dd6435a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292260 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbvmf\" (UniqueName: \"kubernetes.io/projected/97814507-19fa-46d3-802e-9e82582b6819-kube-api-access-tbvmf\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292860 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-system-cni-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292885 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-os-release\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292908 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-device-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.294458 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292934 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e301669c-cc1e-4e8a-8863-23b563c25e50-tmp\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.292964 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-cnibin\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-multus-conf-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e400806-f86f-4510-b251-9605f4ca87d7-cni-binary-copy\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-registration-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-device-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-os-release\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.291998 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293301 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-kubelet\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293354 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-modprobe-d\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293402 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3dd81c84-6744-493e-8a7d-e8b05fb3601e-host-run-netns\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293465 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e400806-f86f-4510-b251-9605f4ca87d7-system-cni-dir\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e301669c-cc1e-4e8a-8863-23b563c25e50-etc-tuned\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.295029 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.293713 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3dd81c84-6744-493e-8a7d-e8b05fb3601e-ovn-node-metrics-cert\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.295428 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.295149 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e301669c-cc1e-4e8a-8863-23b563c25e50-tmp\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.311978 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.311925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxpz\" (UniqueName: \"kubernetes.io/projected/9e400806-f86f-4510-b251-9605f4ca87d7-kube-api-access-wdxpz\") pod \"multus-6k8p7\" (UID: \"9e400806-f86f-4510-b251-9605f4ca87d7\") " pod="openshift-multus/multus-6k8p7" May 27 17:43:33.315237 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.315213 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfv8\" (UniqueName: \"kubernetes.io/projected/755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb-kube-api-access-jpfv8\") pod \"aws-ebs-csi-driver-node-w9b9b\" (UID: \"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.316290 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.316259 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj5ng\" (UniqueName: \"kubernetes.io/projected/9ff15a6c-30d2-4672-a595-4d67dd6435a9-kube-api-access-cj5ng\") pod \"multus-additional-cni-plugins-kbc5x\" (UID: \"9ff15a6c-30d2-4672-a595-4d67dd6435a9\") " pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.316512 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.316482 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5nsw\" (UniqueName: \"kubernetes.io/projected/3dd81c84-6744-493e-8a7d-e8b05fb3601e-kube-api-access-b5nsw\") pod \"ovnkube-node-f2lpm\" (UID: \"3dd81c84-6744-493e-8a7d-e8b05fb3601e\") " pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.316512 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.316501 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7jcn\" (UniqueName: \"kubernetes.io/projected/e301669c-cc1e-4e8a-8863-23b563c25e50-kube-api-access-l7jcn\") pod \"tuned-h2pg8\" (UID: \"e301669c-cc1e-4e8a-8863-23b563c25e50\") " pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.316675 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.316660 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:33.316776 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.316758 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbvmf\" (UniqueName: \"kubernetes.io/projected/97814507-19fa-46d3-802e-9e82582b6819-kube-api-access-tbvmf\") pod \"iptables-alerter-2vh78\" (UID: \"97814507-19fa-46d3-802e-9e82582b6819\") " pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.319240 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.319225 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 17:43:33.381945 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.381908 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:33.388707 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.388684 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wdf5c" May 27 17:43:33.398475 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.398451 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vh78" May 27 17:43:33.404133 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.404112 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" May 27 17:43:33.410102 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.410085 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" May 27 17:43:33.416652 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.416634 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6k8p7" May 27 17:43:33.423171 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.423152 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" May 27 17:43:33.427730 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.427712 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:33.694687 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.694652 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e400806_f86f_4510_b251_9605f4ca87d7.slice/crio-a64ec7068159de0846abe75fccd71cf596ac03a071183a5481c98321aeb2be97 WatchSource:0}: Error finding container a64ec7068159de0846abe75fccd71cf596ac03a071183a5481c98321aeb2be97: Status 404 returned error can't find the container with id a64ec7068159de0846abe75fccd71cf596ac03a071183a5481c98321aeb2be97 May 27 17:43:33.695692 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.695508 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:33.695692 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.695668 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:33.695813 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.695733 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs podName:e08b8fd2-9f51-4877-9809-f07df56538d9 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:34.695712423 +0000 UTC m=+4.101686901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs") pod "network-metrics-daemon-77w6f" (UID: "e08b8fd2-9f51-4877-9809-f07df56538d9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:33.696110 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.696084 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode301669c_cc1e_4e8a_8863_23b563c25e50.slice/crio-6e45edf5e1e6603ee389ead2040057172c4d753b7bf0f666a1395889626aa4ff WatchSource:0}: Error finding container 6e45edf5e1e6603ee389ead2040057172c4d753b7bf0f666a1395889626aa4ff: Status 404 returned error can't find the container with id 6e45edf5e1e6603ee389ead2040057172c4d753b7bf0f666a1395889626aa4ff May 27 17:43:33.698031 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.697969 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755f2b1a_6a7a_4ec8_9cf9_7d1a37b7cebb.slice/crio-d1f5707bb01ab73c3bd437d4ae0b0b8a7822e7bb01e14873ccb8e967791c4dd2 WatchSource:0}: Error finding container d1f5707bb01ab73c3bd437d4ae0b0b8a7822e7bb01e14873ccb8e967791c4dd2: Status 404 returned error can't find the container with id d1f5707bb01ab73c3bd437d4ae0b0b8a7822e7bb01e14873ccb8e967791c4dd2 May 27 17:43:33.700395 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.700354 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97814507_19fa_46d3_802e_9e82582b6819.slice/crio-fdaac57a86ff6e5b35bf6462a48088e835a3c92dd5e674d06db87373331b26a6 WatchSource:0}: Error finding container fdaac57a86ff6e5b35bf6462a48088e835a3c92dd5e674d06db87373331b26a6: Status 404 returned error can't find the container with id fdaac57a86ff6e5b35bf6462a48088e835a3c92dd5e674d06db87373331b26a6 May 27 17:43:33.701121 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.700989 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1ae8d7_ef2f_49c4_a7ab_24c423252380.slice/crio-490a221f1b22b4dfaf9bff9f112ba6d5c50e40b6fe08531a8fb62906c3ae4b2f WatchSource:0}: Error finding container 490a221f1b22b4dfaf9bff9f112ba6d5c50e40b6fe08531a8fb62906c3ae4b2f: Status 404 returned error can't find the container with id 490a221f1b22b4dfaf9bff9f112ba6d5c50e40b6fe08531a8fb62906c3ae4b2f May 27 17:43:33.702192 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.702169 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd81c84_6744_493e_8a7d_e8b05fb3601e.slice/crio-6b0abbcaa4dcf1b47953ac9469b2ef62e3da25761697d9484405ad2181aa1901 WatchSource:0}: Error finding container 6b0abbcaa4dcf1b47953ac9469b2ef62e3da25761697d9484405ad2181aa1901: Status 404 returned error can't find the container with id 6b0abbcaa4dcf1b47953ac9469b2ef62e3da25761697d9484405ad2181aa1901 May 27 17:43:33.703904 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.703841 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01195a32_58bc_44eb_989d_1f67b8045e43.slice/crio-545f17792ebe8b75f52ebddfa8de30e8ef5a6124b4be2c459ccbbc56246f5c85 WatchSource:0}: Error finding container 545f17792ebe8b75f52ebddfa8de30e8ef5a6124b4be2c459ccbbc56246f5c85: Status 404 returned error can't find the container with id 545f17792ebe8b75f52ebddfa8de30e8ef5a6124b4be2c459ccbbc56246f5c85 May 27 17:43:33.704566 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:33.704545 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff15a6c_30d2_4672_a595_4d67dd6435a9.slice/crio-41abc76add4d8c662348fc9cb02c1bb1bd0da545174e96d851eb064f2a3ad553 WatchSource:0}: Error finding container 41abc76add4d8c662348fc9cb02c1bb1bd0da545174e96d851eb064f2a3ad553: Status 404 returned error can't find the container with id 41abc76add4d8c662348fc9cb02c1bb1bd0da545174e96d851eb064f2a3ad553 May 27 17:43:33.796423 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:33.796263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:33.796538 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.796401 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:33.796538 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.796515 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:33.796538 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.796530 2566 projected.go:194] Error preparing data for projected volume kube-api-access-rl9kw for pod openshift-network-diagnostics/network-check-target-llc8f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:33.796675 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:33.796582 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw podName:31944c76-f6be-45b0-a1b1-db6389b3c992 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:34.796562163 +0000 UTC m=+4.202536640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl9kw" (UniqueName: "kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw") pod "network-check-target-llc8f" (UID: "31944c76-f6be-45b0-a1b1-db6389b3c992") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:34.141467 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.141423 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 17:38:32 +0000 UTC" deadline="2027-12-05 11:39:54.764400822 +0000 UTC" May 27 17:43:34.141467 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.141464 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13361h56m20.622940331s" May 27 17:43:34.188270 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.188194 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wdf5c" event={"ID":"6b1ae8d7-ef2f-49c4-a7ab-24c423252380","Type":"ContainerStarted","Data":"490a221f1b22b4dfaf9bff9f112ba6d5c50e40b6fe08531a8fb62906c3ae4b2f"} May 27 17:43:34.189765 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.189738 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vh78" event={"ID":"97814507-19fa-46d3-802e-9e82582b6819","Type":"ContainerStarted","Data":"fdaac57a86ff6e5b35bf6462a48088e835a3c92dd5e674d06db87373331b26a6"} May 27 17:43:34.191364 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.191314 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" event={"ID":"e301669c-cc1e-4e8a-8863-23b563c25e50","Type":"ContainerStarted","Data":"6e45edf5e1e6603ee389ead2040057172c4d753b7bf0f666a1395889626aa4ff"} May 27 17:43:34.192816 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.192796 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6k8p7" event={"ID":"9e400806-f86f-4510-b251-9605f4ca87d7","Type":"ContainerStarted","Data":"a64ec7068159de0846abe75fccd71cf596ac03a071183a5481c98321aeb2be97"} May 27 17:43:34.200440 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.200413 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerStarted","Data":"41abc76add4d8c662348fc9cb02c1bb1bd0da545174e96d851eb064f2a3ad553"} May 27 17:43:34.210367 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.210341 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqtnw" event={"ID":"01195a32-58bc-44eb-989d-1f67b8045e43","Type":"ContainerStarted","Data":"545f17792ebe8b75f52ebddfa8de30e8ef5a6124b4be2c459ccbbc56246f5c85"} May 27 17:43:34.225738 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.225653 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"6b0abbcaa4dcf1b47953ac9469b2ef62e3da25761697d9484405ad2181aa1901"} May 27 17:43:34.227075 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.227029 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" event={"ID":"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb","Type":"ContainerStarted","Data":"d1f5707bb01ab73c3bd437d4ae0b0b8a7822e7bb01e14873ccb8e967791c4dd2"} May 27 17:43:34.236239 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.236060 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" event={"ID":"37e6a25318b0f22f07f4382756ed2e48","Type":"ContainerStarted","Data":"150a2c92245bf5456dc68c789f212756559e77d26b4c0fea5bb56c9afe9d5b8e"} May 27 17:43:34.240235 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.240207 2566 generic.go:358] "Generic (PLEG): container finished" podID="9fc5dba69328e341ab1f7999a9c4499e" containerID="0cc92f8a3c303ea90dd35886252527a7fa4d54e4d311560798dbcbf9f9424a6f" exitCode=0 May 27 17:43:34.240338 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.240246 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" event={"ID":"9fc5dba69328e341ab1f7999a9c4499e","Type":"ContainerDied","Data":"0cc92f8a3c303ea90dd35886252527a7fa4d54e4d311560798dbcbf9f9424a6f"} May 27 17:43:34.252714 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.252588 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-245.ec2.internal" podStartSLOduration=2.252572602 podStartE2EDuration="2.252572602s" podCreationTimestamp="2026-05-27 17:43:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:34.25175683 +0000 UTC m=+3.657731312" watchObservedRunningTime="2026-05-27 17:43:34.252572602 +0000 UTC m=+3.658547084" May 27 17:43:34.704297 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.704212 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:34.704501 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:34.704364 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:34.704501 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:34.704430 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs podName:e08b8fd2-9f51-4877-9809-f07df56538d9 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:36.704410946 +0000 UTC m=+6.110385428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs") pod "network-metrics-daemon-77w6f" (UID: "e08b8fd2-9f51-4877-9809-f07df56538d9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:34.804673 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:34.804565 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:34.804839 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:34.804744 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:34.804839 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:34.804781 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:34.804839 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:34.804795 2566 projected.go:194] Error preparing data for projected volume kube-api-access-rl9kw for pod openshift-network-diagnostics/network-check-target-llc8f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:34.805009 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:34.804852 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw podName:31944c76-f6be-45b0-a1b1-db6389b3c992 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:36.804833066 +0000 UTC m=+6.210807541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl9kw" (UniqueName: "kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw") pod "network-check-target-llc8f" (UID: "31944c76-f6be-45b0-a1b1-db6389b3c992") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:35.178376 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:35.178291 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:35.178837 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:35.178436 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:35.178837 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:35.178622 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:35.178837 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:35.178718 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:35.262228 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:35.262194 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" event={"ID":"9fc5dba69328e341ab1f7999a9c4499e","Type":"ContainerStarted","Data":"d98a4948a20022d7ee58af7ebbd809d6c7cec4fea5a27155ab09ee4c0051d367"} May 27 17:43:35.284445 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:35.284375 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-245.ec2.internal" podStartSLOduration=3.284344531 podStartE2EDuration="3.284344531s" podCreationTimestamp="2026-05-27 17:43:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:35.283961954 +0000 UTC m=+4.689936435" watchObservedRunningTime="2026-05-27 17:43:35.284344531 +0000 UTC m=+4.690319013" May 27 17:43:36.719231 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:36.718661 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:36.719231 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:36.718825 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:36.719231 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:36.718891 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs podName:e08b8fd2-9f51-4877-9809-f07df56538d9 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:40.718871571 +0000 UTC m=+10.124846045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs") pod "network-metrics-daemon-77w6f" (UID: "e08b8fd2-9f51-4877-9809-f07df56538d9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:36.819964 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:36.819926 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:36.820164 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:36.820123 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:36.820164 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:36.820152 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:36.820164 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:36.820165 2566 projected.go:194] Error preparing data for projected volume kube-api-access-rl9kw for pod openshift-network-diagnostics/network-check-target-llc8f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:36.820349 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:36.820231 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw podName:31944c76-f6be-45b0-a1b1-db6389b3c992 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:40.820210637 +0000 UTC m=+10.226185102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl9kw" (UniqueName: "kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw") pod "network-check-target-llc8f" (UID: "31944c76-f6be-45b0-a1b1-db6389b3c992") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:37.179284 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:37.178930 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:37.179284 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:37.179065 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:37.179502 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:37.179480 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:37.179627 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:37.179570 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:39.178346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:39.178306 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:39.178779 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:39.178460 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:39.178853 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:39.178843 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:39.178969 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:39.178946 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:40.756428 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:40.756388 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:40.756897 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:40.756548 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:40.756897 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:40.756652 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs podName:e08b8fd2-9f51-4877-9809-f07df56538d9 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:48.756629523 +0000 UTC m=+18.162603995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs") pod "network-metrics-daemon-77w6f" (UID: "e08b8fd2-9f51-4877-9809-f07df56538d9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:40.857360 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:40.857314 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:40.857522 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:40.857498 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:40.857522 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:40.857517 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:40.857689 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:40.857530 2566 projected.go:194] Error preparing data for projected volume kube-api-access-rl9kw for pod openshift-network-diagnostics/network-check-target-llc8f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:40.857689 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:40.857590 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw podName:31944c76-f6be-45b0-a1b1-db6389b3c992 nodeName:}" failed. No retries permitted until 2026-05-27 17:43:48.857570251 +0000 UTC m=+18.263544729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl9kw" (UniqueName: "kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw") pod "network-check-target-llc8f" (UID: "31944c76-f6be-45b0-a1b1-db6389b3c992") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:41.179528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:41.179497 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:41.179753 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:41.179646 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:41.179985 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:41.179960 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:41.180167 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:41.180140 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:43.178594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.178557 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:43.179050 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.178617 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:43.179050 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:43.178726 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:43.179050 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:43.178807 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:43.714305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.714265 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wdw59"] May 27 17:43:43.718532 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.718507 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.721061 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.720793 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 17:43:43.721061 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.720869 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nw96n\"" May 27 17:43:43.721264 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.721176 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 17:43:43.777674 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.777631 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjp5j\" (UniqueName: \"kubernetes.io/projected/0ca916c1-318a-4953-b38a-1438fc8096a5-kube-api-access-fjp5j\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.777837 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.777762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ca916c1-318a-4953-b38a-1438fc8096a5-hosts-file\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.777837 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.777820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca916c1-318a-4953-b38a-1438fc8096a5-tmp-dir\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.878340 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.878308 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjp5j\" (UniqueName: \"kubernetes.io/projected/0ca916c1-318a-4953-b38a-1438fc8096a5-kube-api-access-fjp5j\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.878499 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.878379 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ca916c1-318a-4953-b38a-1438fc8096a5-hosts-file\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.878499 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.878417 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca916c1-318a-4953-b38a-1438fc8096a5-tmp-dir\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.878648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.878527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ca916c1-318a-4953-b38a-1438fc8096a5-hosts-file\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.879494 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.879471 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca916c1-318a-4953-b38a-1438fc8096a5-tmp-dir\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:43.890642 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:43.890618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjp5j\" (UniqueName: \"kubernetes.io/projected/0ca916c1-318a-4953-b38a-1438fc8096a5-kube-api-access-fjp5j\") pod \"node-resolver-wdw59\" (UID: \"0ca916c1-318a-4953-b38a-1438fc8096a5\") " pod="openshift-dns/node-resolver-wdw59" May 27 17:43:44.031501 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:44.031414 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdw59" May 27 17:43:45.178411 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:45.178384 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:45.178904 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:45.178495 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:45.178904 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:45.178565 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:45.178904 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:45.178696 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:47.178853 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:47.178821 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:47.179296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:47.178822 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:47.179296 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:47.178968 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:47.179296 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:47.179025 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:48.812331 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:48.812301 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:48.812835 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:48.812466 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:48.812835 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:48.812546 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs podName:e08b8fd2-9f51-4877-9809-f07df56538d9 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:04.812522379 +0000 UTC m=+34.218496861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs") pod "network-metrics-daemon-77w6f" (UID: "e08b8fd2-9f51-4877-9809-f07df56538d9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 17:43:48.913320 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:48.913278 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:48.913496 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:48.913461 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 17:43:48.913496 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:48.913480 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 17:43:48.913496 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:48.913490 2566 projected.go:194] Error preparing data for projected volume kube-api-access-rl9kw for pod openshift-network-diagnostics/network-check-target-llc8f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:48.913661 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:48.913555 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw podName:31944c76-f6be-45b0-a1b1-db6389b3c992 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:04.913539104 +0000 UTC m=+34.319513564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rl9kw" (UniqueName: "kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw") pod "network-check-target-llc8f" (UID: "31944c76-f6be-45b0-a1b1-db6389b3c992") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 17:43:49.178388 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:49.178308 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:49.178550 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:49.178432 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:49.178550 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:49.178490 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:49.178666 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:49.178595 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:51.074767 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:43:51.074590 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca916c1_318a_4953_b38a_1438fc8096a5.slice/crio-00ed467be7004d2bebcc847e2ba76d7e2b974afcff7a5d8b3c7af091ff990123 WatchSource:0}: Error finding container 00ed467be7004d2bebcc847e2ba76d7e2b974afcff7a5d8b3c7af091ff990123: Status 404 returned error can't find the container with id 00ed467be7004d2bebcc847e2ba76d7e2b974afcff7a5d8b3c7af091ff990123 May 27 17:43:51.181555 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:51.180954 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:51.181555 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:51.181244 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:51.181555 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:51.181494 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:51.181773 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:51.181593 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:51.290551 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:51.290511 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" event={"ID":"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb","Type":"ContainerStarted","Data":"5bab8cbbc8d25452f1dd2f53e4f3457378e83590c49fab2e779bf0c4385225fc"} May 27 17:43:51.291418 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:51.291394 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdw59" event={"ID":"0ca916c1-318a-4953-b38a-1438fc8096a5","Type":"ContainerStarted","Data":"00ed467be7004d2bebcc847e2ba76d7e2b974afcff7a5d8b3c7af091ff990123"} May 27 17:43:51.292703 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:51.292678 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerStarted","Data":"ef2f7f6956532bddc388f923a5aef0db1a4b48ce85b73f14fa1272d76214e3ed"} May 27 17:43:51.293841 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:51.293822 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqtnw" event={"ID":"01195a32-58bc-44eb-989d-1f67b8045e43","Type":"ContainerStarted","Data":"2a1243e421e5b655652ecacf8716eb0bd935544a6c5f7acf0ce373168c4cd198"} May 27 17:43:51.331058 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:51.331009 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pqtnw" podStartSLOduration=2.96739214 podStartE2EDuration="20.330995475s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.70627823 +0000 UTC m=+3.112252689" lastFinishedPulling="2026-05-27 17:43:51.069881553 +0000 UTC m=+20.475856024" observedRunningTime="2026-05-27 17:43:51.33071564 +0000 UTC m=+20.736690121" watchObservedRunningTime="2026-05-27 17:43:51.330995475 +0000 UTC m=+20.736969956" May 27 17:43:52.028171 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.027959 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:52.296450 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.296376 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wdf5c" event={"ID":"6b1ae8d7-ef2f-49c4-a7ab-24c423252380","Type":"ContainerStarted","Data":"4bedeaac3645af20d6342f45ea8f5a83fb40474f76bb10480c000e393e1a99fe"} May 27 17:43:52.297686 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.297666 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" event={"ID":"e301669c-cc1e-4e8a-8863-23b563c25e50","Type":"ContainerStarted","Data":"3adcdc78dd99d54da4bee194a86490d5cf92e7093013c6692c47c91e4616d201"} May 27 17:43:52.298874 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.298852 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6k8p7" event={"ID":"9e400806-f86f-4510-b251-9605f4ca87d7","Type":"ContainerStarted","Data":"86f9b1ce4ce426491b60686257fb8aadb1fb373a1ca8da7f4ca0502dd48e1991"} May 27 17:43:52.300101 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.300082 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdw59" event={"ID":"0ca916c1-318a-4953-b38a-1438fc8096a5","Type":"ContainerStarted","Data":"610678dc8230a61279d3f612b632942b04ab5c193f5fa50ed5c5878dea53cd19"} May 27 17:43:52.301291 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.301273 2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff15a6c-30d2-4672-a595-4d67dd6435a9" containerID="ef2f7f6956532bddc388f923a5aef0db1a4b48ce85b73f14fa1272d76214e3ed" exitCode=0 May 27 17:43:52.301377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.301328 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerDied","Data":"ef2f7f6956532bddc388f923a5aef0db1a4b48ce85b73f14fa1272d76214e3ed"} May 27 17:43:52.303739 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.303722 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:43:52.304063 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.304046 2566 generic.go:358] "Generic (PLEG): container finished" podID="3dd81c84-6744-493e-8a7d-e8b05fb3601e" containerID="22974f2a962b79f7f8296ea8a40e2f1fcabb860f314ee0736443daedd7ff42b5" exitCode=1 May 27 17:43:52.304128 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.304113 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"aaf8bd130647a8735937d4b66499c8be8c3f4f318958592faba28a17d359988f"} May 27 17:43:52.304170 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.304136 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"5498836bc6dfd5a100e6d63d9c0120b625f8805f8e583aa80816747fbe94713e"} May 27 17:43:52.304170 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.304145 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"2df266e6baf5fccb96ced995bb2b06cde04782920336a6425c28bdf981bee9f8"} May 27 17:43:52.304170 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.304153 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"635f615faf39fa0c23f4e371c42a08d3f592db67bc3692c62c02716ea5db2f9a"} May 27 17:43:52.304170 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.304161 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerDied","Data":"22974f2a962b79f7f8296ea8a40e2f1fcabb860f314ee0736443daedd7ff42b5"} May 27 17:43:52.304170 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.304171 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"e726fa52b8a405daa11a1aff8e681c4f3a013c55d9b34965702332a22fa3f17f"} May 27 17:43:52.311150 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.311120 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wdf5c" podStartSLOduration=4.009415661 podStartE2EDuration="21.311110074s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.703246282 +0000 UTC m=+3.109220755" lastFinishedPulling="2026-05-27 17:43:51.004940707 +0000 UTC m=+20.410915168" observedRunningTime="2026-05-27 17:43:52.311019693 +0000 UTC m=+21.716994174" watchObservedRunningTime="2026-05-27 17:43:52.311110074 +0000 UTC m=+21.717084595" May 27 17:43:52.336558 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.336521 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h2pg8" podStartSLOduration=3.962758241 podStartE2EDuration="21.336511254s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.69792074 +0000 UTC m=+3.103895200" lastFinishedPulling="2026-05-27 17:43:51.07167375 +0000 UTC m=+20.477648213" observedRunningTime="2026-05-27 17:43:52.336084512 +0000 UTC m=+21.742058993" watchObservedRunningTime="2026-05-27 17:43:52.336511254 +0000 UTC m=+21.742485734" May 27 17:43:52.372558 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.372522 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wdw59" podStartSLOduration=9.372511927 podStartE2EDuration="9.372511927s" podCreationTimestamp="2026-05-27 17:43:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:43:52.372182551 +0000 UTC m=+21.778157044" watchObservedRunningTime="2026-05-27 17:43:52.372511927 +0000 UTC m=+21.778486407" May 27 17:43:52.396018 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.395980 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6k8p7" podStartSLOduration=3.669217791 podStartE2EDuration="21.395970586s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.696838489 +0000 UTC m=+3.102812947" lastFinishedPulling="2026-05-27 17:43:51.423591265 +0000 UTC m=+20.829565742" observedRunningTime="2026-05-27 17:43:52.395723125 +0000 UTC m=+21.801697616" watchObservedRunningTime="2026-05-27 17:43:52.395970586 +0000 UTC m=+21.801945066" May 27 17:43:52.592698 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:52.592517 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 17:43:53.150373 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.150249 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T17:43:52.592688783Z","UUID":"a3197c5e-ab5a-4459-9b9d-e08bc7bcf8f2","Handler":null,"Name":"","Endpoint":""} May 27 17:43:53.152547 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.152522 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 17:43:53.152682 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.152557 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 17:43:53.178165 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.178138 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:53.178286 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.178172 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:53.178336 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:53.178285 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:53.178448 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:53.178422 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:53.308251 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.308217 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" event={"ID":"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb","Type":"ContainerStarted","Data":"29d165c62c58ca14e93d6126f838ef5a6ad89bef4281af4746c9f01e92e7d486"} May 27 17:43:53.310099 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.309695 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vh78" event={"ID":"97814507-19fa-46d3-802e-9e82582b6819","Type":"ContainerStarted","Data":"4da9fcd0cda4eb5738c05758c94ae4dae03cff05287ec8cec2ae3b54911425c2"} May 27 17:43:53.324819 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:53.324778 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2vh78" podStartSLOduration=4.958408503 podStartE2EDuration="22.324760374s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.703175218 +0000 UTC m=+3.109149686" lastFinishedPulling="2026-05-27 17:43:51.069527096 +0000 UTC m=+20.475501557" observedRunningTime="2026-05-27 17:43:53.324646644 +0000 UTC m=+22.730621130" watchObservedRunningTime="2026-05-27 17:43:53.324760374 +0000 UTC m=+22.730734857" May 27 17:43:54.314792 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:54.314708 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:43:54.315286 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:54.315163 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"6e01fceec15cc956f00c35c5840fe0632ef489b6efee871471248a132240c088"} May 27 17:43:54.317142 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:54.317106 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" event={"ID":"755f2b1a-6a7a-4ec8-9cf9-7d1a37b7cebb","Type":"ContainerStarted","Data":"be68932b09550acaa233cbfb4b4274585cb74be525a32a2cbf3f4dc42176581c"} May 27 17:43:55.179018 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:55.178847 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:55.179018 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:55.178861 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:55.179018 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:55.179001 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:55.179290 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:55.179052 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:56.016593 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:56.016552 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:56.017635 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:56.017597 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:56.033948 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:56.033891 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9b9b" podStartSLOduration=5.226756099 podStartE2EDuration="25.033872772s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.700520742 +0000 UTC m=+3.106495200" lastFinishedPulling="2026-05-27 17:43:53.5076374 +0000 UTC m=+22.913611873" observedRunningTime="2026-05-27 17:43:54.336541498 +0000 UTC m=+23.742515979" watchObservedRunningTime="2026-05-27 17:43:56.033872772 +0000 UTC m=+25.439847465" May 27 17:43:56.322056 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:56.321981 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pqtnw" May 27 17:43:57.178444 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.178270 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:57.178873 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.178307 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:57.178873 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:57.178541 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:57.178873 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:57.178588 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:57.324552 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.324516 2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff15a6c-30d2-4672-a595-4d67dd6435a9" containerID="0b1e63a5cf5e6fd03e7aaf2e754c3a84855f724288b56ba752bdca41a6c8ba1d" exitCode=0 May 27 17:43:57.324706 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.324617 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerDied","Data":"0b1e63a5cf5e6fd03e7aaf2e754c3a84855f724288b56ba752bdca41a6c8ba1d"} May 27 17:43:57.327627 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.327591 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:43:57.327970 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.327943 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"e14c54588ace920540812c998564c4d6a0cf86b43d2cbdd63d860e115a584f93"} May 27 17:43:57.328203 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.328184 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:57.328269 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.328213 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:57.328471 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.328456 2566 scope.go:117] "RemoveContainer" containerID="22974f2a962b79f7f8296ea8a40e2f1fcabb860f314ee0736443daedd7ff42b5" May 27 17:43:57.344434 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:57.344415 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:58.333932 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.333907 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:43:58.334464 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.334253 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" event={"ID":"3dd81c84-6744-493e-8a7d-e8b05fb3601e","Type":"ContainerStarted","Data":"fd06b93268b774268643863f6d494cd27798c74c45bf7a0102e5da2b9da4dcb0"} May 27 17:43:58.334745 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.334718 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:58.350854 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.350830 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:43:58.370873 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.370835 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" podStartSLOduration=9.962404923 podStartE2EDuration="27.370823248s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.704779077 +0000 UTC m=+3.110753535" lastFinishedPulling="2026-05-27 17:43:51.113197397 +0000 UTC m=+20.519171860" observedRunningTime="2026-05-27 17:43:58.370161174 +0000 UTC m=+27.776135654" watchObservedRunningTime="2026-05-27 17:43:58.370823248 +0000 UTC m=+27.776797707" May 27 17:43:58.814927 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.814726 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-llc8f"] May 27 17:43:58.815087 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.815024 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:43:58.815133 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:58.815110 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:43:58.817589 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.817563 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77w6f"] May 27 17:43:58.817729 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:58.817707 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:43:58.817799 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:43:58.817783 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:43:59.337920 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:59.337883 2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff15a6c-30d2-4672-a595-4d67dd6435a9" containerID="5687b950a2111974b0fc53e04206b36e8449b0a6861f6cdfc1022d3c5066bb61" exitCode=0 May 27 17:43:59.338365 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:43:59.337963 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerDied","Data":"5687b950a2111974b0fc53e04206b36e8449b0a6861f6cdfc1022d3c5066bb61"} May 27 17:44:00.178425 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:00.178392 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:00.178591 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:00.178396 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:44:00.178591 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:00.178497 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:44:00.178591 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:00.178566 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:44:01.344058 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:01.343973 2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff15a6c-30d2-4672-a595-4d67dd6435a9" containerID="27ef65a573ea4497cbecc45f6a560949337bef9a93bbf7522783cbf659296a76" exitCode=0 May 27 17:44:01.344058 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:01.344033 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerDied","Data":"27ef65a573ea4497cbecc45f6a560949337bef9a93bbf7522783cbf659296a76"} May 27 17:44:02.178859 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:02.178827 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:44:02.179015 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:02.178827 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:02.179015 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:02.178964 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77w6f" podUID="e08b8fd2-9f51-4877-9809-f07df56538d9" May 27 17:44:02.179015 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:02.178993 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llc8f" podUID="31944c76-f6be-45b0-a1b1-db6389b3c992" May 27 17:44:03.493504 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.493475 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdw59_0ca916c1-318a-4953-b38a-1438fc8096a5/dns-node-resolver/0.log" May 27 17:44:03.855472 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.855441 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-245.ec2.internal" event="NodeReady" May 27 17:44:03.855644 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.855582 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 17:44:03.905039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.905007 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jlvz6"] May 27 17:44:03.925080 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.925050 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mzpbb"] May 27 17:44:03.925266 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.925223 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jlvz6" May 27 17:44:03.927426 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.927404 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 17:44:03.927545 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.927453 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 17:44:03.927695 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.927681 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tv9xv\"" May 27 17:44:03.943922 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.943900 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jlvz6"] May 27 17:44:03.943922 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.943923 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzpbb"] May 27 17:44:03.944080 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.944008 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:03.946307 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.946287 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 17:44:03.946307 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.946295 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-prtm9\"" May 27 17:44:03.946307 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.946287 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 17:44:03.946533 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:03.946301 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 17:44:04.027997 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.027965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b96f52b5-59c4-46eb-aa07-bfbd0504b263-tmp-dir\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.028191 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.028006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqlmn\" (UniqueName: \"kubernetes.io/projected/5a2b684c-86a1-46da-86c4-1ecde261bf62-kube-api-access-pqlmn\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:04.028191 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.028032 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b96f52b5-59c4-46eb-aa07-bfbd0504b263-config-volume\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.028191 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.028055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:04.028191 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.028143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.028191 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.028179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs9b9\" (UniqueName: \"kubernetes.io/projected/b96f52b5-59c4-46eb-aa07-bfbd0504b263-kube-api-access-xs9b9\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.129479 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.129441 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b96f52b5-59c4-46eb-aa07-bfbd0504b263-tmp-dir\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.129479 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.129490 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqlmn\" (UniqueName: \"kubernetes.io/projected/5a2b684c-86a1-46da-86c4-1ecde261bf62-kube-api-access-pqlmn\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:04.129773 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.129524 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b96f52b5-59c4-46eb-aa07-bfbd0504b263-config-volume\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.129773 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.129726 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:04.129875 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.129783 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.129875 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.129816 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs9b9\" (UniqueName: \"kubernetes.io/projected/b96f52b5-59c4-46eb-aa07-bfbd0504b263-kube-api-access-xs9b9\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.129986 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.129874 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:44:04.129986 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.129881 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:44:04.129986 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.129881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b96f52b5-59c4-46eb-aa07-bfbd0504b263-tmp-dir\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.129986 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.129957 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls podName:b96f52b5-59c4-46eb-aa07-bfbd0504b263 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:04.629936617 +0000 UTC m=+34.035911093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls") pod "dns-default-jlvz6" (UID: "b96f52b5-59c4-46eb-aa07-bfbd0504b263") : secret "dns-default-metrics-tls" not found May 27 17:44:04.130177 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.129992 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert podName:5a2b684c-86a1-46da-86c4-1ecde261bf62 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:04.62997328 +0000 UTC m=+34.035947742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert") pod "ingress-canary-mzpbb" (UID: "5a2b684c-86a1-46da-86c4-1ecde261bf62") : secret "canary-serving-cert" not found May 27 17:44:04.130228 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.130192 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b96f52b5-59c4-46eb-aa07-bfbd0504b263-config-volume\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.143900 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.143778 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs9b9\" (UniqueName: \"kubernetes.io/projected/b96f52b5-59c4-46eb-aa07-bfbd0504b263-kube-api-access-xs9b9\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.144032 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.143975 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqlmn\" (UniqueName: \"kubernetes.io/projected/5a2b684c-86a1-46da-86c4-1ecde261bf62-kube-api-access-pqlmn\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:04.178160 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.178131 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:04.178357 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.178336 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:44:04.181016 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.180995 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frs9q\"" May 27 17:44:04.181297 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.181274 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 17:44:04.182039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.182018 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 17:44:04.182322 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.182293 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln5rr\"" May 27 17:44:04.182425 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.182321 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 17:44:04.478828 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.478724 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wdf5c_6b1ae8d7-ef2f-49c4-a7ab-24c423252380/node-ca/0.log" May 27 17:44:04.633145 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.633106 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:04.633687 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.633209 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:04.633687 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.633264 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:44:04.633687 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.633315 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:44:04.633687 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.633340 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls podName:b96f52b5-59c4-46eb-aa07-bfbd0504b263 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:05.633317865 +0000 UTC m=+35.039292325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls") pod "dns-default-jlvz6" (UID: "b96f52b5-59c4-46eb-aa07-bfbd0504b263") : secret "dns-default-metrics-tls" not found May 27 17:44:04.633687 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.633364 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert podName:5a2b684c-86a1-46da-86c4-1ecde261bf62 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:05.633348751 +0000 UTC m=+35.039323219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert") pod "ingress-canary-mzpbb" (UID: "5a2b684c-86a1-46da-86c4-1ecde261bf62") : secret "canary-serving-cert" not found May 27 17:44:04.835468 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.835435 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:44:04.835881 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.835595 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 17:44:04.835881 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:04.835684 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs podName:e08b8fd2-9f51-4877-9809-f07df56538d9 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:36.835668317 +0000 UTC m=+66.241642776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs") pod "network-metrics-daemon-77w6f" (UID: "e08b8fd2-9f51-4877-9809-f07df56538d9") : secret "metrics-daemon-secret" not found May 27 17:44:04.936247 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.936208 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:04.939414 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:04.939388 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9kw\" (UniqueName: \"kubernetes.io/projected/31944c76-f6be-45b0-a1b1-db6389b3c992-kube-api-access-rl9kw\") pod \"network-check-target-llc8f\" (UID: \"31944c76-f6be-45b0-a1b1-db6389b3c992\") " pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:05.089916 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:05.089831 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:05.276696 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:05.276666 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-llc8f"] May 27 17:44:05.281655 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:05.281623 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31944c76_f6be_45b0_a1b1_db6389b3c992.slice/crio-965abfd4bb1dd5854396eac31bf596bb24913973cd63c7bf239b30817fb45c1e WatchSource:0}: Error finding container 965abfd4bb1dd5854396eac31bf596bb24913973cd63c7bf239b30817fb45c1e: Status 404 returned error can't find the container with id 965abfd4bb1dd5854396eac31bf596bb24913973cd63c7bf239b30817fb45c1e May 27 17:44:05.354153 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:05.354075 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-llc8f" event={"ID":"31944c76-f6be-45b0-a1b1-db6389b3c992","Type":"ContainerStarted","Data":"965abfd4bb1dd5854396eac31bf596bb24913973cd63c7bf239b30817fb45c1e"} May 27 17:44:05.640895 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:05.640810 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:05.640895 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:05.640858 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:05.641404 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:05.640963 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:44:05.641404 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:05.640963 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:44:05.641404 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:05.641040 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls podName:b96f52b5-59c4-46eb-aa07-bfbd0504b263 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:07.641016342 +0000 UTC m=+37.046990815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls") pod "dns-default-jlvz6" (UID: "b96f52b5-59c4-46eb-aa07-bfbd0504b263") : secret "dns-default-metrics-tls" not found May 27 17:44:05.641404 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:05.641060 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert podName:5a2b684c-86a1-46da-86c4-1ecde261bf62 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:07.6410522 +0000 UTC m=+37.047026659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert") pod "ingress-canary-mzpbb" (UID: "5a2b684c-86a1-46da-86c4-1ecde261bf62") : secret "canary-serving-cert" not found May 27 17:44:07.657659 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:07.657587 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:07.658193 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:07.657680 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:07.658193 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:07.657756 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:44:07.658193 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:07.657818 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:44:07.658193 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:07.657846 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert podName:5a2b684c-86a1-46da-86c4-1ecde261bf62 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:11.657823184 +0000 UTC m=+41.063797644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert") pod "ingress-canary-mzpbb" (UID: "5a2b684c-86a1-46da-86c4-1ecde261bf62") : secret "canary-serving-cert" not found May 27 17:44:07.658193 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:07.657868 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls podName:b96f52b5-59c4-46eb-aa07-bfbd0504b263 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:11.657854991 +0000 UTC m=+41.063829469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls") pod "dns-default-jlvz6" (UID: "b96f52b5-59c4-46eb-aa07-bfbd0504b263") : secret "dns-default-metrics-tls" not found May 27 17:44:10.366017 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:10.365976 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-llc8f" event={"ID":"31944c76-f6be-45b0-a1b1-db6389b3c992","Type":"ContainerStarted","Data":"0eee9be9b2bb2427ef86c08962a114eb0fbc7400208a6dd08f3e8fd8ffe27db2"} May 27 17:44:10.366482 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:10.366075 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:10.368466 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:10.368445 2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff15a6c-30d2-4672-a595-4d67dd6435a9" containerID="296aa18ffc8c39477fd3b2122d0ae41c17c6d50d9395fa2ccccb22ea0d292b8a" exitCode=0 May 27 17:44:10.368580 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:10.368490 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerDied","Data":"296aa18ffc8c39477fd3b2122d0ae41c17c6d50d9395fa2ccccb22ea0d292b8a"} May 27 17:44:10.389333 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:10.389279 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-llc8f" podStartSLOduration=35.070115589 podStartE2EDuration="39.389261834s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:44:05.284075508 +0000 UTC m=+34.690049989" lastFinishedPulling="2026-05-27 17:44:09.603221775 +0000 UTC m=+39.009196234" observedRunningTime="2026-05-27 17:44:10.389102455 +0000 UTC m=+39.795076936" watchObservedRunningTime="2026-05-27 17:44:10.389261834 +0000 UTC m=+39.795236314" May 27 17:44:11.373355 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:11.373317 2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff15a6c-30d2-4672-a595-4d67dd6435a9" containerID="3c364836e164b9b49ab572204245e5701dc3ec01a47684e0da04f19f9ba1ade6" exitCode=0 May 27 17:44:11.373745 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:11.373398 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerDied","Data":"3c364836e164b9b49ab572204245e5701dc3ec01a47684e0da04f19f9ba1ade6"} May 27 17:44:11.688666 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:11.688541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:11.688666 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:11.688662 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:11.688858 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:11.688695 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 17:44:11.688858 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:11.688743 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 17:44:11.688858 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:11.688763 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls podName:b96f52b5-59c4-46eb-aa07-bfbd0504b263 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:19.68874659 +0000 UTC m=+49.094721049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls") pod "dns-default-jlvz6" (UID: "b96f52b5-59c4-46eb-aa07-bfbd0504b263") : secret "dns-default-metrics-tls" not found May 27 17:44:11.688858 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:11.688786 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert podName:5a2b684c-86a1-46da-86c4-1ecde261bf62 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:19.688774726 +0000 UTC m=+49.094749185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert") pod "ingress-canary-mzpbb" (UID: "5a2b684c-86a1-46da-86c4-1ecde261bf62") : secret "canary-serving-cert" not found May 27 17:44:12.377801 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:12.377766 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" event={"ID":"9ff15a6c-30d2-4672-a595-4d67dd6435a9","Type":"ContainerStarted","Data":"826dc29cecc8fd02a6f32175bdf7d764d1e03cd73af5431a7517f2b60459608b"} May 27 17:44:12.404344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:12.404296 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kbc5x" podStartSLOduration=5.495541626 podStartE2EDuration="41.404280378s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:43:33.706344323 +0000 UTC m=+3.112318782" lastFinishedPulling="2026-05-27 17:44:09.615083072 +0000 UTC m=+39.021057534" observedRunningTime="2026-05-27 17:44:12.403350803 +0000 UTC m=+41.809325284" watchObservedRunningTime="2026-05-27 17:44:12.404280378 +0000 UTC m=+41.810254858" May 27 17:44:19.739381 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.739348 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:19.739844 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.739388 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:19.742560 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.742524 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b96f52b5-59c4-46eb-aa07-bfbd0504b263-metrics-tls\") pod \"dns-default-jlvz6\" (UID: \"b96f52b5-59c4-46eb-aa07-bfbd0504b263\") " pod="openshift-dns/dns-default-jlvz6" May 27 17:44:19.742691 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.742563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a2b684c-86a1-46da-86c4-1ecde261bf62-cert\") pod \"ingress-canary-mzpbb\" (UID: \"5a2b684c-86a1-46da-86c4-1ecde261bf62\") " pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:19.835665 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.835637 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jlvz6" May 27 17:44:19.852453 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.852433 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzpbb" May 27 17:44:19.985867 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.985835 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jlvz6"] May 27 17:44:19.990877 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:19.990738 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzpbb"] May 27 17:44:19.994347 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:19.994304 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2b684c_86a1_46da_86c4_1ecde261bf62.slice/crio-3e7dd3d0d362d699031818f4767c815d8256b946607c52904fbba62b459a91f8 WatchSource:0}: Error finding container 3e7dd3d0d362d699031818f4767c815d8256b946607c52904fbba62b459a91f8: Status 404 returned error can't find the container with id 3e7dd3d0d362d699031818f4767c815d8256b946607c52904fbba62b459a91f8 May 27 17:44:20.394197 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:20.394159 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzpbb" event={"ID":"5a2b684c-86a1-46da-86c4-1ecde261bf62","Type":"ContainerStarted","Data":"3e7dd3d0d362d699031818f4767c815d8256b946607c52904fbba62b459a91f8"} May 27 17:44:20.395089 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:20.395064 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jlvz6" event={"ID":"b96f52b5-59c4-46eb-aa07-bfbd0504b263","Type":"ContainerStarted","Data":"5fd1d731de962eaa50bbb4d27c94d2f020db7ce6cb04bb05614c9aab32f8912c"} May 27 17:44:23.402147 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:23.402102 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzpbb" event={"ID":"5a2b684c-86a1-46da-86c4-1ecde261bf62","Type":"ContainerStarted","Data":"2d5be0cbaaef11da0174bcff322a6f082689a392d1924045bc385299affc0e91"} May 27 17:44:23.403759 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:23.403735 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jlvz6" event={"ID":"b96f52b5-59c4-46eb-aa07-bfbd0504b263","Type":"ContainerStarted","Data":"89a581d5e2daed08d2d5e08c1553cb1877cf1861a600769a588fcd37a7741363"} May 27 17:44:23.403854 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:23.403765 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jlvz6" event={"ID":"b96f52b5-59c4-46eb-aa07-bfbd0504b263","Type":"ContainerStarted","Data":"393cd030e208c26f8453a5240deaead8582c74da12bdc811bec51965fd08b053"} May 27 17:44:23.403899 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:23.403874 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jlvz6" May 27 17:44:23.422541 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:23.422500 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mzpbb" podStartSLOduration=17.886931909 podStartE2EDuration="20.422488921s" podCreationTimestamp="2026-05-27 17:44:03 +0000 UTC" firstStartedPulling="2026-05-27 17:44:19.996396882 +0000 UTC m=+49.402371341" lastFinishedPulling="2026-05-27 17:44:22.531953881 +0000 UTC m=+51.937928353" observedRunningTime="2026-05-27 17:44:23.42147489 +0000 UTC m=+52.827449372" watchObservedRunningTime="2026-05-27 17:44:23.422488921 +0000 UTC m=+52.828463402" May 27 17:44:23.440987 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:23.440944 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jlvz6" podStartSLOduration=17.896014062 podStartE2EDuration="20.440931904s" podCreationTimestamp="2026-05-27 17:44:03 +0000 UTC" firstStartedPulling="2026-05-27 17:44:19.990348924 +0000 UTC m=+49.396323383" lastFinishedPulling="2026-05-27 17:44:22.535266766 +0000 UTC m=+51.941241225" observedRunningTime="2026-05-27 17:44:23.440306916 +0000 UTC m=+52.846281396" watchObservedRunningTime="2026-05-27 17:44:23.440931904 +0000 UTC m=+52.846906366" May 27 17:44:25.830620 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.830580 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bzbwc"] May 27 17:44:25.864470 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.864441 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bzbwc"] May 27 17:44:25.864633 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.864597 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:25.866994 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.866971 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 17:44:25.867705 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.867689 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 17:44:25.867705 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.867697 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 17:44:25.867848 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.867712 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 17:44:25.867848 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.867781 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-99xjw\"" May 27 17:44:25.886476 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.886452 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx"] May 27 17:44:25.910444 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.910426 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx"] May 27 17:44:25.910553 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.910539 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:25.912695 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.912679 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rbdz4\"" May 27 17:44:25.913040 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.913022 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 27 17:44:25.913128 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.913107 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 27 17:44:25.976588 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.976560 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7875d865db-q8mpl"] May 27 17:44:25.983022 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.983001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07b3815c-0d25-467d-b3e9-4861bef3ac9e-crio-socket\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:25.983098 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.983034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b3815c-0d25-467d-b3e9-4861bef3ac9e-data-volume\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:25.983098 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.983069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07b3815c-0d25-467d-b3e9-4861bef3ac9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:25.983208 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.983121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2wsd\" (UniqueName: \"kubernetes.io/projected/07b3815c-0d25-467d-b3e9-4861bef3ac9e-kube-api-access-n2wsd\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:25.983208 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.983185 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07b3815c-0d25-467d-b3e9-4861bef3ac9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:25.996353 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.996335 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7875d865db-q8mpl"] May 27 17:44:25.996429 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:25.996419 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.000556 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.000535 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 17:44:26.000908 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.000889 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 17:44:26.001094 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.001078 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 17:44:26.001162 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.001102 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp774\"" May 27 17:44:26.006576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.006557 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 17:44:26.084120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084062 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07b3815c-0d25-467d-b3e9-4861bef3ac9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.084120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2wsd\" (UniqueName: \"kubernetes.io/projected/07b3815c-0d25-467d-b3e9-4861bef3ac9e-kube-api-access-n2wsd\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.084120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084117 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07b3815c-0d25-467d-b3e9-4861bef3ac9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.084305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084139 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07b3815c-0d25-467d-b3e9-4861bef3ac9e-crio-socket\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.084305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084170 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b3815c-0d25-467d-b3e9-4861bef3ac9e-data-volume\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.084305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2f989bbe-59ad-4070-9d9e-74d097937772-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q5djx\" (UID: \"2f989bbe-59ad-4070-9d9e-74d097937772\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:26.084305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084206 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f989bbe-59ad-4070-9d9e-74d097937772-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q5djx\" (UID: \"2f989bbe-59ad-4070-9d9e-74d097937772\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:26.084305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084289 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07b3815c-0d25-467d-b3e9-4861bef3ac9e-crio-socket\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.084548 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084524 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b3815c-0d25-467d-b3e9-4861bef3ac9e-data-volume\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.084675 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.084656 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07b3815c-0d25-467d-b3e9-4861bef3ac9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.086369 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.086352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07b3815c-0d25-467d-b3e9-4861bef3ac9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.094365 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.094342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2wsd\" (UniqueName: \"kubernetes.io/projected/07b3815c-0d25-467d-b3e9-4861bef3ac9e-kube-api-access-n2wsd\") pod \"insights-runtime-extractor-bzbwc\" (UID: \"07b3815c-0d25-467d-b3e9-4861bef3ac9e\") " pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.175434 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.175406 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bzbwc" May 27 17:44:26.184767 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.184734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-bound-sa-token\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.184875 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.184794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b847a58-1ba3-4d41-873e-845983456a2b-image-registry-private-configuration\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.184956 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.184931 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2f989bbe-59ad-4070-9d9e-74d097937772-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q5djx\" (UID: \"2f989bbe-59ad-4070-9d9e-74d097937772\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:26.185062 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.184966 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f989bbe-59ad-4070-9d9e-74d097937772-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q5djx\" (UID: \"2f989bbe-59ad-4070-9d9e-74d097937772\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:26.185062 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.184999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b847a58-1ba3-4d41-873e-845983456a2b-ca-trust-extracted\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.185062 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.185027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b847a58-1ba3-4d41-873e-845983456a2b-registry-certificates\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.185062 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.185052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b847a58-1ba3-4d41-873e-845983456a2b-trusted-ca\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.185279 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.185099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-registry-tls\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.185279 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.185118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b847a58-1ba3-4d41-873e-845983456a2b-installation-pull-secrets\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.185279 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.185149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqgb4\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-kube-api-access-sqgb4\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.185784 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.185749 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2f989bbe-59ad-4070-9d9e-74d097937772-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q5djx\" (UID: \"2f989bbe-59ad-4070-9d9e-74d097937772\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:26.187345 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.187327 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f989bbe-59ad-4070-9d9e-74d097937772-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q5djx\" (UID: \"2f989bbe-59ad-4070-9d9e-74d097937772\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:26.218014 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.217987 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" May 27 17:44:26.286188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286109 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b847a58-1ba3-4d41-873e-845983456a2b-ca-trust-extracted\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286163 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b847a58-1ba3-4d41-873e-845983456a2b-registry-certificates\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286379 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286195 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b847a58-1ba3-4d41-873e-845983456a2b-trusted-ca\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286379 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286256 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-registry-tls\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286379 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286286 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b847a58-1ba3-4d41-873e-845983456a2b-installation-pull-secrets\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286379 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286312 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqgb4\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-kube-api-access-sqgb4\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286379 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286342 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-bound-sa-token\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286662 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286382 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b847a58-1ba3-4d41-873e-845983456a2b-image-registry-private-configuration\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.286662 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.286433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b847a58-1ba3-4d41-873e-845983456a2b-ca-trust-extracted\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.287139 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.287087 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b847a58-1ba3-4d41-873e-845983456a2b-registry-certificates\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.288466 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.288441 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b847a58-1ba3-4d41-873e-845983456a2b-trusted-ca\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.289667 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.289633 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b847a58-1ba3-4d41-873e-845983456a2b-installation-pull-secrets\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.289789 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.289755 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-registry-tls\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.289966 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.289945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b847a58-1ba3-4d41-873e-845983456a2b-image-registry-private-configuration\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.296730 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.296706 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqgb4\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-kube-api-access-sqgb4\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.296978 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.296960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b847a58-1ba3-4d41-873e-845983456a2b-bound-sa-token\") pod \"image-registry-7875d865db-q8mpl\" (UID: \"0b847a58-1ba3-4d41-873e-845983456a2b\") " pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.301734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.301713 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bzbwc"] May 27 17:44:26.305202 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:26.305176 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b3815c_0d25_467d_b3e9_4861bef3ac9e.slice/crio-5c8156161f8afce673e4dcbb0fc2a29ead18a10d0351f9f47ef84c247d444688 WatchSource:0}: Error finding container 5c8156161f8afce673e4dcbb0fc2a29ead18a10d0351f9f47ef84c247d444688: Status 404 returned error can't find the container with id 5c8156161f8afce673e4dcbb0fc2a29ead18a10d0351f9f47ef84c247d444688 May 27 17:44:26.305266 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.305256 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:26.368598 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.368571 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx"] May 27 17:44:26.371656 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:26.371592 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f989bbe_59ad_4070_9d9e_74d097937772.slice/crio-49d669a9f693462432c4ce47bb16c23d8b910891116f8abd324f5d6380a8f3b6 WatchSource:0}: Error finding container 49d669a9f693462432c4ce47bb16c23d8b910891116f8abd324f5d6380a8f3b6: Status 404 returned error can't find the container with id 49d669a9f693462432c4ce47bb16c23d8b910891116f8abd324f5d6380a8f3b6 May 27 17:44:26.417065 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.417035 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" event={"ID":"2f989bbe-59ad-4070-9d9e-74d097937772","Type":"ContainerStarted","Data":"49d669a9f693462432c4ce47bb16c23d8b910891116f8abd324f5d6380a8f3b6"} May 27 17:44:26.418437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.418414 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzbwc" event={"ID":"07b3815c-0d25-467d-b3e9-4861bef3ac9e","Type":"ContainerStarted","Data":"d1b69ecd377c8b72da67c24ba5e3097dd0932cff698594a68f10ccf9b6713c81"} May 27 17:44:26.418437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.418441 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzbwc" event={"ID":"07b3815c-0d25-467d-b3e9-4861bef3ac9e","Type":"ContainerStarted","Data":"5c8156161f8afce673e4dcbb0fc2a29ead18a10d0351f9f47ef84c247d444688"} May 27 17:44:26.444244 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:26.444200 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7875d865db-q8mpl"] May 27 17:44:26.447561 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:26.447534 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b847a58_1ba3_4d41_873e_845983456a2b.slice/crio-5050701159b262cbd1cbbd47bc0d97f76ef78640e0a0e9389446b2c2986b8ed0 WatchSource:0}: Error finding container 5050701159b262cbd1cbbd47bc0d97f76ef78640e0a0e9389446b2c2986b8ed0: Status 404 returned error can't find the container with id 5050701159b262cbd1cbbd47bc0d97f76ef78640e0a0e9389446b2c2986b8ed0 May 27 17:44:27.422377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:27.422341 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875d865db-q8mpl" event={"ID":"0b847a58-1ba3-4d41-873e-845983456a2b","Type":"ContainerStarted","Data":"272f36ea3924571008eac4c7a1b497916b78df181bded5adb33c3e6bf94368d1"} May 27 17:44:27.422377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:27.422384 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875d865db-q8mpl" event={"ID":"0b847a58-1ba3-4d41-873e-845983456a2b","Type":"ContainerStarted","Data":"5050701159b262cbd1cbbd47bc0d97f76ef78640e0a0e9389446b2c2986b8ed0"} May 27 17:44:27.422858 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:27.422426 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:27.445304 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:27.445242 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7875d865db-q8mpl" podStartSLOduration=2.445220481 podStartE2EDuration="2.445220481s" podCreationTimestamp="2026-05-27 17:44:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:44:27.443542972 +0000 UTC m=+56.849517452" watchObservedRunningTime="2026-05-27 17:44:27.445220481 +0000 UTC m=+56.851194964" May 27 17:44:28.426695 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:28.426650 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzbwc" event={"ID":"07b3815c-0d25-467d-b3e9-4861bef3ac9e","Type":"ContainerStarted","Data":"0bbbd66913939a716464d73274f9d1be08f1472213098d8bda1db4b1f913a9b0"} May 27 17:44:28.428289 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:28.428258 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" event={"ID":"2f989bbe-59ad-4070-9d9e-74d097937772","Type":"ContainerStarted","Data":"38ac23b5ed2e3830480896c1cb69d83737a17e919ae730b726b09b3422f12b12"} May 27 17:44:28.453618 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:28.453542 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q5djx" podStartSLOduration=1.888172552 podStartE2EDuration="3.453522996s" podCreationTimestamp="2026-05-27 17:44:25 +0000 UTC" firstStartedPulling="2026-05-27 17:44:26.37346441 +0000 UTC m=+55.779438870" lastFinishedPulling="2026-05-27 17:44:27.938814855 +0000 UTC m=+57.344789314" observedRunningTime="2026-05-27 17:44:28.45333579 +0000 UTC m=+57.859310283" watchObservedRunningTime="2026-05-27 17:44:28.453522996 +0000 UTC m=+57.859497533" May 27 17:44:30.354141 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:30.354112 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f2lpm" May 27 17:44:30.435616 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:30.435570 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzbwc" event={"ID":"07b3815c-0d25-467d-b3e9-4861bef3ac9e","Type":"ContainerStarted","Data":"0e1cdef66e1cec6d0fb480fbf76e4d616a0dbeec9145eb3da77dc30328b6bfe6"} May 27 17:44:30.457314 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:30.457271 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bzbwc" podStartSLOduration=2.414131542 podStartE2EDuration="5.457258169s" podCreationTimestamp="2026-05-27 17:44:25 +0000 UTC" firstStartedPulling="2026-05-27 17:44:26.411248392 +0000 UTC m=+55.817222866" lastFinishedPulling="2026-05-27 17:44:29.454375034 +0000 UTC m=+58.860349493" observedRunningTime="2026-05-27 17:44:30.456776288 +0000 UTC m=+59.862750768" watchObservedRunningTime="2026-05-27 17:44:30.457258169 +0000 UTC m=+59.863232650" May 27 17:44:33.407752 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:33.407714 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jlvz6" May 27 17:44:36.862825 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:36.862772 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:44:36.865142 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:36.865109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b8fd2-9f51-4877-9809-f07df56538d9-metrics-certs\") pod \"network-metrics-daemon-77w6f\" (UID: \"e08b8fd2-9f51-4877-9809-f07df56538d9\") " pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:44:36.897421 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:36.897388 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln5rr\"" May 27 17:44:36.905188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:36.905163 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77w6f" May 27 17:44:37.033933 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:37.033903 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77w6f"] May 27 17:44:37.037081 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:37.037048 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08b8fd2_9f51_4877_9809_f07df56538d9.slice/crio-4ea2744db0df36a190a5e9be4882b61b37bbb6961da53f87cd72e4a46afa31b2 WatchSource:0}: Error finding container 4ea2744db0df36a190a5e9be4882b61b37bbb6961da53f87cd72e4a46afa31b2: Status 404 returned error can't find the container with id 4ea2744db0df36a190a5e9be4882b61b37bbb6961da53f87cd72e4a46afa31b2 May 27 17:44:37.452011 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:37.451974 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77w6f" event={"ID":"e08b8fd2-9f51-4877-9809-f07df56538d9","Type":"ContainerStarted","Data":"4ea2744db0df36a190a5e9be4882b61b37bbb6961da53f87cd72e4a46afa31b2"} May 27 17:44:38.456747 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:38.456706 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77w6f" event={"ID":"e08b8fd2-9f51-4877-9809-f07df56538d9","Type":"ContainerStarted","Data":"080a52f4964cc144c0bddcd646eb2048c42658a4cbd39d234a5aafec1a71b20d"} May 27 17:44:38.456747 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:38.456746 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77w6f" event={"ID":"e08b8fd2-9f51-4877-9809-f07df56538d9","Type":"ContainerStarted","Data":"5a1e25031d0a80896b51b482a963549098cd0c31c2658e33b5689576d0f82ed9"} May 27 17:44:38.515060 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:38.514969 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-77w6f" podStartSLOduration=66.315595217 podStartE2EDuration="1m7.514957016s" podCreationTimestamp="2026-05-27 17:43:31 +0000 UTC" firstStartedPulling="2026-05-27 17:44:37.038953964 +0000 UTC m=+66.444928424" lastFinishedPulling="2026-05-27 17:44:38.238315764 +0000 UTC m=+67.644290223" observedRunningTime="2026-05-27 17:44:38.514318799 +0000 UTC m=+67.920293280" watchObservedRunningTime="2026-05-27 17:44:38.514957016 +0000 UTC m=+67.920931496" May 27 17:44:41.376259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:41.376228 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-llc8f" May 27 17:44:48.432729 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:48.432622 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7875d865db-q8mpl" May 27 17:44:50.110377 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.110343 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9"] May 27 17:44:50.112663 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.112643 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:50.114953 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.114913 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 27 17:44:50.115076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.115033 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tjqth\"" May 27 17:44:50.126577 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.126536 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9"] May 27 17:44:50.150736 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.150697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-67wx9\" (UID: \"33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:50.251478 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.251404 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-67wx9\" (UID: \"33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:50.251714 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:50.251567 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 27 17:44:50.251714 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:50.251662 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb-tls-certificates podName:33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb nodeName:}" failed. No retries permitted until 2026-05-27 17:44:50.751644613 +0000 UTC m=+80.157619072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" (UID: "33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb") : secret "prometheus-operator-admission-webhook-tls" not found May 27 17:44:50.755187 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.755137 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-67wx9\" (UID: \"33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:50.757706 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:50.757680 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-67wx9\" (UID: \"33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:51.022018 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:51.021924 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:51.148346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:51.148320 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9"] May 27 17:44:51.150858 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:51.150830 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33532f2f_a4c1_4cbf_bb8a_d6af503ae0eb.slice/crio-83b064d618c1c01a039a45bf42dd89cb857fb954b304db2c7a7fc9908acb5b39 WatchSource:0}: Error finding container 83b064d618c1c01a039a45bf42dd89cb857fb954b304db2c7a7fc9908acb5b39: Status 404 returned error can't find the container with id 83b064d618c1c01a039a45bf42dd89cb857fb954b304db2c7a7fc9908acb5b39 May 27 17:44:51.490001 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:51.489966 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" event={"ID":"33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb","Type":"ContainerStarted","Data":"83b064d618c1c01a039a45bf42dd89cb857fb954b304db2c7a7fc9908acb5b39"} May 27 17:44:52.494451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:52.494375 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" event={"ID":"33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb","Type":"ContainerStarted","Data":"373a5a5866c01788519bb5e92788004155e65e3a5c4d99b6b1e0eba300747410"} May 27 17:44:52.494819 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:52.494573 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:52.499477 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:52.499454 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" May 27 17:44:52.580110 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:52.580058 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-67wx9" podStartSLOduration=1.642646179 podStartE2EDuration="2.5800406s" podCreationTimestamp="2026-05-27 17:44:50 +0000 UTC" firstStartedPulling="2026-05-27 17:44:51.153055461 +0000 UTC m=+80.559029923" lastFinishedPulling="2026-05-27 17:44:52.090449885 +0000 UTC m=+81.496424344" observedRunningTime="2026-05-27 17:44:52.579267688 +0000 UTC m=+81.985242161" watchObservedRunningTime="2026-05-27 17:44:52.5800406 +0000 UTC m=+81.986015083" May 27 17:44:54.676417 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.676380 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-f92mp"] May 27 17:44:54.680698 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.680678 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-f92mp" May 27 17:44:54.684797 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.684772 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 17:44:54.684926 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.684811 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 17:44:54.684926 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.684878 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qdhs4\"" May 27 17:44:54.699256 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.699235 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-f92mp"] May 27 17:44:54.781697 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.781662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9txh\" (UniqueName: \"kubernetes.io/projected/4b6f792d-33cc-4abc-a0f7-c210909d0e71-kube-api-access-t9txh\") pod \"downloads-57bd96b888-f92mp\" (UID: \"4b6f792d-33cc-4abc-a0f7-c210909d0e71\") " pod="openshift-console/downloads-57bd96b888-f92mp" May 27 17:44:54.882669 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.882627 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9txh\" (UniqueName: \"kubernetes.io/projected/4b6f792d-33cc-4abc-a0f7-c210909d0e71-kube-api-access-t9txh\") pod \"downloads-57bd96b888-f92mp\" (UID: \"4b6f792d-33cc-4abc-a0f7-c210909d0e71\") " pod="openshift-console/downloads-57bd96b888-f92mp" May 27 17:44:54.892100 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.892066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9txh\" (UniqueName: \"kubernetes.io/projected/4b6f792d-33cc-4abc-a0f7-c210909d0e71-kube-api-access-t9txh\") pod \"downloads-57bd96b888-f92mp\" (UID: \"4b6f792d-33cc-4abc-a0f7-c210909d0e71\") " pod="openshift-console/downloads-57bd96b888-f92mp" May 27 17:44:54.989642 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:54.989527 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-f92mp" May 27 17:44:55.115724 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:55.115635 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-f92mp"] May 27 17:44:55.117751 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:55.117718 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6f792d_33cc_4abc_a0f7_c210909d0e71.slice/crio-69b78dd87082a98809d9ab96675253c0b2491f48cf6ff1ebf5aa87847d4cc5c9 WatchSource:0}: Error finding container 69b78dd87082a98809d9ab96675253c0b2491f48cf6ff1ebf5aa87847d4cc5c9: Status 404 returned error can't find the container with id 69b78dd87082a98809d9ab96675253c0b2491f48cf6ff1ebf5aa87847d4cc5c9 May 27 17:44:55.502705 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:55.502666 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-f92mp" event={"ID":"4b6f792d-33cc-4abc-a0f7-c210909d0e71","Type":"ContainerStarted","Data":"69b78dd87082a98809d9ab96675253c0b2491f48cf6ff1ebf5aa87847d4cc5c9"} May 27 17:44:57.573178 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.573132 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6"] May 27 17:44:57.576734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.576708 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.578920 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.578869 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 27 17:44:57.579063 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.578976 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 27 17:44:57.579393 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.579374 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 17:44:57.579519 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.579391 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 17:44:57.579519 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.579411 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 17:44:57.580729 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.580683 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tr5jq\"" May 27 17:44:57.590279 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.590228 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6"] May 27 17:44:57.602993 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.602958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.603167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.603011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c746c2cd-37ca-43fe-b804-4a95415d1835-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.603167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.603053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glpm5\" (UniqueName: \"kubernetes.io/projected/c746c2cd-37ca-43fe-b804-4a95415d1835-kube-api-access-glpm5\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.603167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.603132 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.610995 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.610962 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ztqh4"] May 27 17:44:57.614667 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.614637 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.616947 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.616671 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 17:44:57.616947 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.616695 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 17:44:57.616947 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.616799 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 17:44:57.617215 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.617016 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4klfq\"" May 27 17:44:57.703565 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-sys\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.703565 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knb59\" (UniqueName: \"kubernetes.io/projected/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-kube-api-access-knb59\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.703812 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-metrics-client-ca\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.703812 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703696 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.703812 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703748 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-textfile\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.703812 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703791 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c746c2cd-37ca-43fe-b804-4a95415d1835-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.704070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703836 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glpm5\" (UniqueName: \"kubernetes.io/projected/c746c2cd-37ca-43fe-b804-4a95415d1835-kube-api-access-glpm5\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.704070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703871 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-root\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.704070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-tls\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.704070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703928 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-wtmp\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.704070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.703961 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.704070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.704016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.704070 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.704064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.704430 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:57.704218 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 27 17:44:57.704430 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:44:57.704278 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-tls podName:c746c2cd-37ca-43fe-b804-4a95415d1835 nodeName:}" failed. No retries permitted until 2026-05-27 17:44:58.204257538 +0000 UTC m=+87.610232006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-m8kf6" (UID: "c746c2cd-37ca-43fe-b804-4a95415d1835") : secret "openshift-state-metrics-tls" not found May 27 17:44:57.704592 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.704562 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c746c2cd-37ca-43fe-b804-4a95415d1835-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.706504 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.706479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.713693 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.713666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glpm5\" (UniqueName: \"kubernetes.io/projected/c746c2cd-37ca-43fe-b804-4a95415d1835-kube-api-access-glpm5\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:57.804877 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.804834 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.804877 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.804878 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-sys\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805096 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.804939 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-sys\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805096 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knb59\" (UniqueName: \"kubernetes.io/projected/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-kube-api-access-knb59\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805096 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805042 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-metrics-client-ca\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805096 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805071 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-textfile\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805268 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805122 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-root\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805268 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805151 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-tls\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805268 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805185 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-wtmp\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805268 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-root\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805448 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805284 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805448 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-wtmp\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805621 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805577 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-textfile\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805767 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805747 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-metrics-client-ca\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.805845 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.805827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.807341 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.807318 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.807504 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.807484 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-node-exporter-tls\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.812953 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.812927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knb59\" (UniqueName: \"kubernetes.io/projected/8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434-kube-api-access-knb59\") pod \"node-exporter-ztqh4\" (UID: \"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434\") " pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.925897 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:57.925700 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztqh4" May 27 17:44:57.936389 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:57.936348 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3d3fb4_6f0f_46cd_a0e1_fdcb20bf6434.slice/crio-bf399342a0ab5e584c49774480cc07f42a4a0408f7eec62a5d1d1b18ebda0e80 WatchSource:0}: Error finding container bf399342a0ab5e584c49774480cc07f42a4a0408f7eec62a5d1d1b18ebda0e80: Status 404 returned error can't find the container with id bf399342a0ab5e584c49774480cc07f42a4a0408f7eec62a5d1d1b18ebda0e80 May 27 17:44:58.208930 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.208839 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:58.211858 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.211821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c746c2cd-37ca-43fe-b804-4a95415d1835-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m8kf6\" (UID: \"c746c2cd-37ca-43fe-b804-4a95415d1835\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:58.488646 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.488541 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" May 27 17:44:58.512166 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.512129 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztqh4" event={"ID":"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434","Type":"ContainerStarted","Data":"bf399342a0ab5e584c49774480cc07f42a4a0408f7eec62a5d1d1b18ebda0e80"} May 27 17:44:58.647275 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.647238 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6"] May 27 17:44:58.650860 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:58.650825 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc746c2cd_37ca_43fe_b804_4a95415d1835.slice/crio-83640185d94499e37dd80ec4451d1e7c575e2e1a3a9ebaf77b578b2dc109a901 WatchSource:0}: Error finding container 83640185d94499e37dd80ec4451d1e7c575e2e1a3a9ebaf77b578b2dc109a901: Status 404 returned error can't find the container with id 83640185d94499e37dd80ec4451d1e7c575e2e1a3a9ebaf77b578b2dc109a901 May 27 17:44:58.698273 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.698245 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:44:58.702681 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.702657 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.706308 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.706159 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 17:44:58.706308 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.706175 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 17:44:58.706308 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.706210 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 17:44:58.706528 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.706464 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 17:44:58.706695 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.706679 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 17:44:58.706780 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.706699 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 17:44:58.706836 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.706681 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sj54q\"" May 27 17:44:58.707728 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.707111 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 17:44:58.707728 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.707340 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 17:44:58.707728 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.707552 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 17:44:58.724381 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.724355 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:44:58.813680 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.813646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.813861 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.813707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.813861 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.813786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.813861 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.813827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814028 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.813870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-out\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814028 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.813906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814028 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.813979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814028 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.814013 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814217 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.814051 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814217 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.814082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814217 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.814114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-web-config\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814217 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.814143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-volume\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.814217 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.814169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphvm\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-kube-api-access-wphvm\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915411 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915370 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915418 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915450 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915491 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-out\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915526 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915556 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915575 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.915594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.915596 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.916069 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.916043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.916782 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.916361 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.916782 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.916409 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-web-config\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.916782 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.916448 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-volume\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.916782 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.916480 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wphvm\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-kube-api-access-wphvm\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.916782 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.916517 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.917087 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.917009 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.917646 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.917622 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.920617 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.920569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.921194 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.921149 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.921194 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.921163 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.921637 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.921575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-out\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.921637 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.921592 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.922542 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.922042 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-volume\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.922542 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.922132 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.922542 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.922499 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.923449 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.923387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-web-config\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:58.927332 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:58.927307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphvm\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-kube-api-access-wphvm\") pod \"alertmanager-main-0\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:59.031415 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.031382 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 17:44:59.220302 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.220274 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:44:59.223285 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:44:59.223247 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb66db9_d49d_4f49_ade9_df0d36eaf932.slice/crio-74177f0d065f0d062161c8cbe041bb5211be48e31147c3c144fcdc98ecfa1ca3 WatchSource:0}: Error finding container 74177f0d065f0d062161c8cbe041bb5211be48e31147c3c144fcdc98ecfa1ca3: Status 404 returned error can't find the container with id 74177f0d065f0d062161c8cbe041bb5211be48e31147c3c144fcdc98ecfa1ca3 May 27 17:44:59.516733 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.516627 2566 generic.go:358] "Generic (PLEG): container finished" podID="8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434" containerID="79acece533a87656d7bf89f61daea10cac1d8d61bd74d1ff2a6ba893d57b41f5" exitCode=0 May 27 17:44:59.516733 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.516707 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztqh4" event={"ID":"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434","Type":"ContainerDied","Data":"79acece533a87656d7bf89f61daea10cac1d8d61bd74d1ff2a6ba893d57b41f5"} May 27 17:44:59.518116 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.518082 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerStarted","Data":"74177f0d065f0d062161c8cbe041bb5211be48e31147c3c144fcdc98ecfa1ca3"} May 27 17:44:59.520442 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.520402 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" event={"ID":"c746c2cd-37ca-43fe-b804-4a95415d1835","Type":"ContainerStarted","Data":"46d4031766f4ae8f0aa680dafa18933cb88f489aa79d0818e0073bc0f6e2afe7"} May 27 17:44:59.520442 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.520436 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" event={"ID":"c746c2cd-37ca-43fe-b804-4a95415d1835","Type":"ContainerStarted","Data":"43a6d7e3b07e1c92dcb921e34ed9f4a5071ee3597460ed035346edd957cee6e8"} May 27 17:44:59.520622 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:44:59.520452 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" event={"ID":"c746c2cd-37ca-43fe-b804-4a95415d1835","Type":"ContainerStarted","Data":"83640185d94499e37dd80ec4451d1e7c575e2e1a3a9ebaf77b578b2dc109a901"} May 27 17:45:00.525831 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:00.525789 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztqh4" event={"ID":"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434","Type":"ContainerStarted","Data":"e859720ff1ae5de7f0091adb30225ad18b9480b27e4cafc8536eb788a0f94680"} May 27 17:45:00.526177 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:00.525842 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztqh4" event={"ID":"8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434","Type":"ContainerStarted","Data":"5f1da6b634187245e970d779bbc0fd5b88eefddd596405fad17d4a90a2d29fff"} May 27 17:45:00.551211 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:00.551047 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ztqh4" podStartSLOduration=2.491279973 podStartE2EDuration="3.551029853s" podCreationTimestamp="2026-05-27 17:44:57 +0000 UTC" firstStartedPulling="2026-05-27 17:44:57.938616937 +0000 UTC m=+87.344591411" lastFinishedPulling="2026-05-27 17:44:58.998366817 +0000 UTC m=+88.404341291" observedRunningTime="2026-05-27 17:45:00.550276298 +0000 UTC m=+89.956250782" watchObservedRunningTime="2026-05-27 17:45:00.551029853 +0000 UTC m=+89.957004335" May 27 17:45:01.530064 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:01.529950 2566 generic.go:358] "Generic (PLEG): container finished" podID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerID="7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897" exitCode=0 May 27 17:45:01.530064 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:01.530026 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897"} May 27 17:45:01.532201 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:01.532144 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" event={"ID":"c746c2cd-37ca-43fe-b804-4a95415d1835","Type":"ContainerStarted","Data":"c8d65511a0081c838c6c5d35ef554d5a847084cdb1edde0823c1c3fad4750c6a"} May 27 17:45:01.578290 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:01.578238 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m8kf6" podStartSLOduration=3.145083218 podStartE2EDuration="4.578223426s" podCreationTimestamp="2026-05-27 17:44:57 +0000 UTC" firstStartedPulling="2026-05-27 17:44:59.012134586 +0000 UTC m=+88.418109047" lastFinishedPulling="2026-05-27 17:45:00.445274794 +0000 UTC m=+89.851249255" observedRunningTime="2026-05-27 17:45:01.576706518 +0000 UTC m=+90.982680999" watchObservedRunningTime="2026-05-27 17:45:01.578223426 +0000 UTC m=+90.984197907" May 27 17:45:02.025756 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.025719 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5fc487485f-9zcs5"] May 27 17:45:02.029305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.029281 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.031591 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.031563 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 27 17:45:02.031744 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.031618 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 27 17:45:02.031744 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.031682 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dckvx\"" May 27 17:45:02.032199 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.032177 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bpbdcfi9c2l1b\"" May 27 17:45:02.032199 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.032184 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 27 17:45:02.032384 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.032223 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 27 17:45:02.042000 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.041979 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fc487485f-9zcs5"] May 27 17:45:02.142939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.142910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-secret-metrics-server-tls\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.143127 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.142955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/99b02d8d-020c-4dad-a50a-d85c4eaf7204-audit-log\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.143127 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.143048 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99b02d8d-020c-4dad-a50a-d85c4eaf7204-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.143127 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.143109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-secret-metrics-server-client-certs\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.143264 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.143147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/99b02d8d-020c-4dad-a50a-d85c4eaf7204-metrics-server-audit-profiles\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.143264 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.143192 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-client-ca-bundle\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.143264 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.143233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k852\" (UniqueName: \"kubernetes.io/projected/99b02d8d-020c-4dad-a50a-d85c4eaf7204-kube-api-access-7k852\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.244573 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.244529 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-secret-metrics-server-client-certs\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.244745 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.244581 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/99b02d8d-020c-4dad-a50a-d85c4eaf7204-metrics-server-audit-profiles\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.244745 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.244649 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-client-ca-bundle\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.244745 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.244687 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k852\" (UniqueName: \"kubernetes.io/projected/99b02d8d-020c-4dad-a50a-d85c4eaf7204-kube-api-access-7k852\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.244745 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.244727 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-secret-metrics-server-tls\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.244937 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.244762 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/99b02d8d-020c-4dad-a50a-d85c4eaf7204-audit-log\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.244937 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.244813 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99b02d8d-020c-4dad-a50a-d85c4eaf7204-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.245649 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.245616 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/99b02d8d-020c-4dad-a50a-d85c4eaf7204-audit-log\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.246072 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.246014 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/99b02d8d-020c-4dad-a50a-d85c4eaf7204-metrics-server-audit-profiles\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.246685 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.246639 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99b02d8d-020c-4dad-a50a-d85c4eaf7204-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.247973 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.247946 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-secret-metrics-server-client-certs\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.248412 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.248389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-client-ca-bundle\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.249041 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.248999 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/99b02d8d-020c-4dad-a50a-d85c4eaf7204-secret-metrics-server-tls\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.259965 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.259943 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k852\" (UniqueName: \"kubernetes.io/projected/99b02d8d-020c-4dad-a50a-d85c4eaf7204-kube-api-access-7k852\") pod \"metrics-server-5fc487485f-9zcs5\" (UID: \"99b02d8d-020c-4dad-a50a-d85c4eaf7204\") " pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.340506 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.340470 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:02.383386 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.382334 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-454dn"] May 27 17:45:02.387742 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.387593 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:02.389982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.389958 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 27 17:45:02.390168 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.390152 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-g4sq5\"" May 27 17:45:02.402119 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.401563 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-454dn"] May 27 17:45:02.446619 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.446574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecbf4483-ba06-4da3-953d-4b8b1941204a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-454dn\" (UID: \"ecbf4483-ba06-4da3-953d-4b8b1941204a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:02.496514 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.496479 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fc487485f-9zcs5"] May 27 17:45:02.500156 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:45:02.500116 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b02d8d_020c_4dad_a50a_d85c4eaf7204.slice/crio-d81be11f40a26b136224ecfe66c2c626ecac9086396af78e86059befb92fae37 WatchSource:0}: Error finding container d81be11f40a26b136224ecfe66c2c626ecac9086396af78e86059befb92fae37: Status 404 returned error can't find the container with id d81be11f40a26b136224ecfe66c2c626ecac9086396af78e86059befb92fae37 May 27 17:45:02.537161 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.537130 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" event={"ID":"99b02d8d-020c-4dad-a50a-d85c4eaf7204","Type":"ContainerStarted","Data":"d81be11f40a26b136224ecfe66c2c626ecac9086396af78e86059befb92fae37"} May 27 17:45:02.547891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:02.547866 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecbf4483-ba06-4da3-953d-4b8b1941204a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-454dn\" (UID: \"ecbf4483-ba06-4da3-953d-4b8b1941204a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:02.548035 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:45:02.548017 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 27 17:45:02.548114 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:45:02.548104 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbf4483-ba06-4da3-953d-4b8b1941204a-monitoring-plugin-cert podName:ecbf4483-ba06-4da3-953d-4b8b1941204a nodeName:}" failed. No retries permitted until 2026-05-27 17:45:03.04808124 +0000 UTC m=+92.454055704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ecbf4483-ba06-4da3-953d-4b8b1941204a-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-454dn" (UID: "ecbf4483-ba06-4da3-953d-4b8b1941204a") : secret "monitoring-plugin-cert" not found May 27 17:45:03.053243 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.053203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecbf4483-ba06-4da3-953d-4b8b1941204a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-454dn\" (UID: \"ecbf4483-ba06-4da3-953d-4b8b1941204a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:03.056249 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.056224 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ecbf4483-ba06-4da3-953d-4b8b1941204a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-454dn\" (UID: \"ecbf4483-ba06-4da3-953d-4b8b1941204a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:03.157230 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.157203 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5cf49bf-lvksv"] May 27 17:45:03.160912 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.160840 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.163031 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.162881 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 17:45:03.163324 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.163303 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 17:45:03.164430 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.164406 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 17:45:03.164820 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.164800 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bcfvf\"" May 27 17:45:03.164919 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.164841 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 17:45:03.164919 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.164860 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 17:45:03.172445 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.172423 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5cf49bf-lvksv"] May 27 17:45:03.255226 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.254901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-oauth-serving-cert\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.255226 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.254944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f6m4\" (UniqueName: \"kubernetes.io/projected/914a4fe5-c126-4f32-a482-831ecd05e00a-kube-api-access-6f6m4\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.255226 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.254995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-console-config\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.255226 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.255022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-service-ca\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.255226 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.255050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-serving-cert\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.255226 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.255083 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-oauth-config\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.304200 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.303856 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:03.356568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.356394 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-oauth-serving-cert\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.356568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.356451 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6f6m4\" (UniqueName: \"kubernetes.io/projected/914a4fe5-c126-4f32-a482-831ecd05e00a-kube-api-access-6f6m4\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.356568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.356501 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-console-config\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.356568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.356527 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-service-ca\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.356568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.356558 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-serving-cert\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.356941 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.356592 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-oauth-config\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.357321 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.357153 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-oauth-serving-cert\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.358432 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.358025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-service-ca\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.358432 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.358396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-console-config\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.361294 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.361232 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-serving-cert\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.362164 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.362139 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-oauth-config\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.365766 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.365739 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f6m4\" (UniqueName: \"kubernetes.io/projected/914a4fe5-c126-4f32-a482-831ecd05e00a-kube-api-access-6f6m4\") pod \"console-7f5cf49bf-lvksv\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.473946 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.473904 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:03.474355 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.474311 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-454dn"] May 27 17:45:03.478532 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:45:03.478484 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbf4483_ba06_4da3_953d_4b8b1941204a.slice/crio-2b66754fa8c566ff2143a3d8b7b73ca2d07619634268f28f8e8ea28cae36ef59 WatchSource:0}: Error finding container 2b66754fa8c566ff2143a3d8b7b73ca2d07619634268f28f8e8ea28cae36ef59: Status 404 returned error can't find the container with id 2b66754fa8c566ff2143a3d8b7b73ca2d07619634268f28f8e8ea28cae36ef59 May 27 17:45:03.552376 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.552331 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerStarted","Data":"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2"} May 27 17:45:03.552856 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.552417 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerStarted","Data":"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8"} May 27 17:45:03.552856 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.552449 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerStarted","Data":"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f"} May 27 17:45:03.552856 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.552466 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerStarted","Data":"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a"} May 27 17:45:03.552856 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.552480 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerStarted","Data":"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272"} May 27 17:45:03.553700 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.553668 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" event={"ID":"ecbf4483-ba06-4da3-953d-4b8b1941204a","Type":"ContainerStarted","Data":"2b66754fa8c566ff2143a3d8b7b73ca2d07619634268f28f8e8ea28cae36ef59"} May 27 17:45:03.649837 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.649794 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5cf49bf-lvksv"] May 27 17:45:03.653997 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:45:03.653965 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914a4fe5_c126_4f32_a482_831ecd05e00a.slice/crio-98edb4c631e177576713aa5537af275d39e2f782cb4c96d4f1d121c1ae1b2c4b WatchSource:0}: Error finding container 98edb4c631e177576713aa5537af275d39e2f782cb4c96d4f1d121c1ae1b2c4b: Status 404 returned error can't find the container with id 98edb4c631e177576713aa5537af275d39e2f782cb4c96d4f1d121c1ae1b2c4b May 27 17:45:03.958212 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.958069 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:45:03.962877 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.962854 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:03.966106 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.965814 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 17:45:03.966106 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.965824 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 17:45:03.966106 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.965841 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 17:45:03.966106 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.965897 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 17:45:03.966106 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.965949 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 17:45:03.966426 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.966217 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8blafgamhva7u\"" May 27 17:45:03.966758 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.966721 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 17:45:03.966919 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.966899 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 17:45:03.967037 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.967021 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 17:45:03.967683 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.967294 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 17:45:03.967683 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.967304 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 17:45:03.967683 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.967546 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-22rdx\"" May 27 17:45:03.970498 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.970333 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 17:45:03.974096 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.974079 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 17:45:03.977556 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:03.977532 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:45:04.063784 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.063746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-config\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.063959 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.063797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.063959 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.063830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.063959 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.063854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.063959 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.063949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064160 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4bmj\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-kube-api-access-w4bmj\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064160 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064160 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064160 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064160 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064160 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064148 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-web-config\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064273 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-config-out\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.064451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.064438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165108 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165068 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165132 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-config\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165163 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165189 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165217 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165248 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165307 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4bmj\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-kube-api-access-w4bmj\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165336 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165365 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165392 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165417 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165453 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-web-config\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165488 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165514 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165542 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.165576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165577 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.166039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.166039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.165648 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-config-out\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.166039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.166017 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.166658 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.166632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.167034 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.166858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.167034 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.166888 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.167214 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.167042 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.169918 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.169874 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.170230 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.170171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.171977 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.171936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-web-config\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.172401 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.172358 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-config\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.172732 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.172551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.173347 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.172967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.173347 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.173067 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.173347 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.173221 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.173347 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.173302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.173586 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.173429 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.173974 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.173947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-config-out\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.174706 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.174657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.175686 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.175640 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4bmj\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-kube-api-access-w4bmj\") pod \"prometheus-k8s-0\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.275300 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.275224 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:04.561843 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.561786 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cf49bf-lvksv" event={"ID":"914a4fe5-c126-4f32-a482-831ecd05e00a","Type":"ContainerStarted","Data":"98edb4c631e177576713aa5537af275d39e2f782cb4c96d4f1d121c1ae1b2c4b"} May 27 17:45:04.650027 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:04.649991 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:45:04.653354 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:45:04.653314 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f50a60_361d_4eab_b8be_d0e260cebaaf.slice/crio-a65b05ab532698f3d6dbadc9e37eb03e83e2c2755afd57cffe272101ad397476 WatchSource:0}: Error finding container a65b05ab532698f3d6dbadc9e37eb03e83e2c2755afd57cffe272101ad397476: Status 404 returned error can't find the container with id a65b05ab532698f3d6dbadc9e37eb03e83e2c2755afd57cffe272101ad397476 May 27 17:45:05.569971 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:05.569937 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerStarted","Data":"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3"} May 27 17:45:05.571901 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:05.571833 2566 generic.go:358] "Generic (PLEG): container finished" podID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" exitCode=0 May 27 17:45:05.572021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:05.571921 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b"} May 27 17:45:05.572021 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:05.571953 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerStarted","Data":"a65b05ab532698f3d6dbadc9e37eb03e83e2c2755afd57cffe272101ad397476"} May 27 17:45:05.573942 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:05.573915 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" event={"ID":"99b02d8d-020c-4dad-a50a-d85c4eaf7204","Type":"ContainerStarted","Data":"caaa604168f4ff6a141273fa024d68047514adab33ccc811eab4391d621dc395"} May 27 17:45:05.602158 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:05.602104 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.356387539 podStartE2EDuration="7.602086838s" podCreationTimestamp="2026-05-27 17:44:58 +0000 UTC" firstStartedPulling="2026-05-27 17:44:59.225157754 +0000 UTC m=+88.631132217" lastFinishedPulling="2026-05-27 17:45:04.470857041 +0000 UTC m=+93.876831516" observedRunningTime="2026-05-27 17:45:05.599363748 +0000 UTC m=+95.005338228" watchObservedRunningTime="2026-05-27 17:45:05.602086838 +0000 UTC m=+95.008061321" May 27 17:45:05.624904 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:05.624275 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" podStartSLOduration=1.656596998 podStartE2EDuration="3.624258131s" podCreationTimestamp="2026-05-27 17:45:02 +0000 UTC" firstStartedPulling="2026-05-27 17:45:02.502834854 +0000 UTC m=+91.908809316" lastFinishedPulling="2026-05-27 17:45:04.47049599 +0000 UTC m=+93.876470449" observedRunningTime="2026-05-27 17:45:05.622529864 +0000 UTC m=+95.028504398" watchObservedRunningTime="2026-05-27 17:45:05.624258131 +0000 UTC m=+95.030232613" May 27 17:45:06.600741 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:06.600710 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzpbb_5a2b684c-86a1-46da-86c4-1ecde261bf62/serve-healthcheck-canary/0.log" May 27 17:45:13.607453 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.607415 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-f92mp" event={"ID":"4b6f792d-33cc-4abc-a0f7-c210909d0e71","Type":"ContainerStarted","Data":"d2c70926a7a7227945e03710b4e984c4b8867c6ed669ef0530105d7222929d56"} May 27 17:45:13.607891 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.607642 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-f92mp" May 27 17:45:13.609080 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.609029 2566 patch_prober.go:28] interesting pod/downloads-57bd96b888-f92mp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" start-of-body= May 27 17:45:13.609203 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.609101 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-f92mp" podUID="4b6f792d-33cc-4abc-a0f7-c210909d0e71" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" May 27 17:45:13.609435 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.609409 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cf49bf-lvksv" event={"ID":"914a4fe5-c126-4f32-a482-831ecd05e00a","Type":"ContainerStarted","Data":"ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02"} May 27 17:45:13.611036 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.611009 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" event={"ID":"ecbf4483-ba06-4da3-953d-4b8b1941204a","Type":"ContainerStarted","Data":"7128d89f02801dd2647682b2c24befccdefe0f1b1fb46eaa2debaeebf8521588"} May 27 17:45:13.611270 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.611251 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:13.616165 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.616146 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" May 27 17:45:13.645638 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.645562 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-f92mp" podStartSLOduration=1.238217913 podStartE2EDuration="19.645545305s" podCreationTimestamp="2026-05-27 17:44:54 +0000 UTC" firstStartedPulling="2026-05-27 17:44:55.119667255 +0000 UTC m=+84.525641728" lastFinishedPulling="2026-05-27 17:45:13.526994657 +0000 UTC m=+102.932969120" observedRunningTime="2026-05-27 17:45:13.642399524 +0000 UTC m=+103.048374024" watchObservedRunningTime="2026-05-27 17:45:13.645545305 +0000 UTC m=+103.051519787" May 27 17:45:13.665202 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.665153 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f5cf49bf-lvksv" podStartSLOduration=0.849388556 podStartE2EDuration="10.665137224s" podCreationTimestamp="2026-05-27 17:45:03 +0000 UTC" firstStartedPulling="2026-05-27 17:45:03.656494688 +0000 UTC m=+93.062469151" lastFinishedPulling="2026-05-27 17:45:13.472243356 +0000 UTC m=+102.878217819" observedRunningTime="2026-05-27 17:45:13.663249718 +0000 UTC m=+103.069224199" watchObservedRunningTime="2026-05-27 17:45:13.665137224 +0000 UTC m=+103.071111706" May 27 17:45:13.679091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:13.679042 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-454dn" podStartSLOduration=1.699039443 podStartE2EDuration="11.679026344s" podCreationTimestamp="2026-05-27 17:45:02 +0000 UTC" firstStartedPulling="2026-05-27 17:45:03.483930167 +0000 UTC m=+92.889904641" lastFinishedPulling="2026-05-27 17:45:13.463917068 +0000 UTC m=+102.869891542" observedRunningTime="2026-05-27 17:45:13.678280453 +0000 UTC m=+103.084254937" watchObservedRunningTime="2026-05-27 17:45:13.679026344 +0000 UTC m=+103.085000850" May 27 17:45:14.627777 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:14.627741 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-f92mp" May 27 17:45:16.625024 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:16.624951 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerStarted","Data":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} May 27 17:45:16.625024 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:16.624994 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerStarted","Data":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} May 27 17:45:19.640257 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:19.640220 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerStarted","Data":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} May 27 17:45:19.640715 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:19.640264 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerStarted","Data":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} May 27 17:45:19.640715 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:19.640279 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerStarted","Data":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} May 27 17:45:19.640715 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:19.640293 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerStarted","Data":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} May 27 17:45:19.676366 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:19.676301 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.721649867 podStartE2EDuration="16.676281471s" podCreationTimestamp="2026-05-27 17:45:03 +0000 UTC" firstStartedPulling="2026-05-27 17:45:05.573281081 +0000 UTC m=+94.979255553" lastFinishedPulling="2026-05-27 17:45:18.527912687 +0000 UTC m=+107.933887157" observedRunningTime="2026-05-27 17:45:19.67437369 +0000 UTC m=+109.080348172" watchObservedRunningTime="2026-05-27 17:45:19.676281471 +0000 UTC m=+109.082255982" May 27 17:45:22.341582 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:22.341538 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:22.342067 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:22.341635 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:22.716388 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:22.716311 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5cf49bf-lvksv"] May 27 17:45:23.474772 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:23.474731 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:24.275712 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:24.275671 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:45:42.346851 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:42.346820 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:42.350514 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:42.350488 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5fc487485f-9zcs5" May 27 17:45:47.734999 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:47.734932 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f5cf49bf-lvksv" podUID="914a4fe5-c126-4f32-a482-831ecd05e00a" containerName="console" containerID="cri-o://ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02" gracePeriod=15 May 27 17:45:48.000928 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.000901 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f5cf49bf-lvksv_914a4fe5-c126-4f32-a482-831ecd05e00a/console/0.log" May 27 17:45:48.001058 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.000984 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:48.051046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051015 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-console-config\") pod \"914a4fe5-c126-4f32-a482-831ecd05e00a\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " May 27 17:45:48.051221 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051060 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-serving-cert\") pod \"914a4fe5-c126-4f32-a482-831ecd05e00a\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " May 27 17:45:48.051221 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051120 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f6m4\" (UniqueName: \"kubernetes.io/projected/914a4fe5-c126-4f32-a482-831ecd05e00a-kube-api-access-6f6m4\") pod \"914a4fe5-c126-4f32-a482-831ecd05e00a\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " May 27 17:45:48.051221 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051147 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-service-ca\") pod \"914a4fe5-c126-4f32-a482-831ecd05e00a\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " May 27 17:45:48.051399 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051288 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-oauth-config\") pod \"914a4fe5-c126-4f32-a482-831ecd05e00a\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " May 27 17:45:48.051399 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051380 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-oauth-serving-cert\") pod \"914a4fe5-c126-4f32-a482-831ecd05e00a\" (UID: \"914a4fe5-c126-4f32-a482-831ecd05e00a\") " May 27 17:45:48.051501 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051376 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-console-config" (OuterVolumeSpecName: "console-config") pod "914a4fe5-c126-4f32-a482-831ecd05e00a" (UID: "914a4fe5-c126-4f32-a482-831ecd05e00a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:45:48.051501 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051489 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-service-ca" (OuterVolumeSpecName: "service-ca") pod "914a4fe5-c126-4f32-a482-831ecd05e00a" (UID: "914a4fe5-c126-4f32-a482-831ecd05e00a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:45:48.051742 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051722 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "914a4fe5-c126-4f32-a482-831ecd05e00a" (UID: "914a4fe5-c126-4f32-a482-831ecd05e00a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:45:48.051824 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051725 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-console-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:45:48.051824 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.051787 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-service-ca\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:45:48.053378 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.053349 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "914a4fe5-c126-4f32-a482-831ecd05e00a" (UID: "914a4fe5-c126-4f32-a482-831ecd05e00a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:45:48.053481 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.053405 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "914a4fe5-c126-4f32-a482-831ecd05e00a" (UID: "914a4fe5-c126-4f32-a482-831ecd05e00a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:45:48.053481 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.053418 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914a4fe5-c126-4f32-a482-831ecd05e00a-kube-api-access-6f6m4" (OuterVolumeSpecName: "kube-api-access-6f6m4") pod "914a4fe5-c126-4f32-a482-831ecd05e00a" (UID: "914a4fe5-c126-4f32-a482-831ecd05e00a"). InnerVolumeSpecName "kube-api-access-6f6m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:45:48.153100 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.153068 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f6m4\" (UniqueName: \"kubernetes.io/projected/914a4fe5-c126-4f32-a482-831ecd05e00a-kube-api-access-6f6m4\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:45:48.153100 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.153095 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-oauth-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:45:48.153100 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.153105 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/914a4fe5-c126-4f32-a482-831ecd05e00a-oauth-serving-cert\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:45:48.153284 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.153114 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/914a4fe5-c126-4f32-a482-831ecd05e00a-console-serving-cert\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:45:48.726239 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.726212 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f5cf49bf-lvksv_914a4fe5-c126-4f32-a482-831ecd05e00a/console/0.log" May 27 17:45:48.726390 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.726250 2566 generic.go:358] "Generic (PLEG): container finished" podID="914a4fe5-c126-4f32-a482-831ecd05e00a" containerID="ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02" exitCode=2 May 27 17:45:48.726390 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.726282 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cf49bf-lvksv" event={"ID":"914a4fe5-c126-4f32-a482-831ecd05e00a","Type":"ContainerDied","Data":"ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02"} May 27 17:45:48.726390 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.726314 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cf49bf-lvksv" May 27 17:45:48.726390 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.726323 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cf49bf-lvksv" event={"ID":"914a4fe5-c126-4f32-a482-831ecd05e00a","Type":"ContainerDied","Data":"98edb4c631e177576713aa5537af275d39e2f782cb4c96d4f1d121c1ae1b2c4b"} May 27 17:45:48.726390 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.726339 2566 scope.go:117] "RemoveContainer" containerID="ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02" May 27 17:45:48.734832 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.734818 2566 scope.go:117] "RemoveContainer" containerID="ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02" May 27 17:45:48.735063 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:45:48.735043 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02\": container with ID starting with ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02 not found: ID does not exist" containerID="ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02" May 27 17:45:48.735298 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.735070 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02"} err="failed to get container status \"ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02\": rpc error: code = NotFound desc = could not find container \"ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02\": container with ID starting with ab66b652542df2e685c551f4bebf9bbf75133d4b9665bb48b31ce9a198ec3f02 not found: ID does not exist" May 27 17:45:48.747889 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.747869 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5cf49bf-lvksv"] May 27 17:45:48.752382 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:48.752362 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5cf49bf-lvksv"] May 27 17:45:49.182302 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:45:49.182269 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="914a4fe5-c126-4f32-a482-831ecd05e00a" path="/var/lib/kubelet/pods/914a4fe5-c126-4f32-a482-831ecd05e00a/volumes" May 27 17:46:04.275493 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:04.275450 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:04.295055 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:04.295025 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:04.788978 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:04.788947 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:18.071219 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.071132 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:46:18.071802 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.071744 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="alertmanager" containerID="cri-o://96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272" gracePeriod=120 May 27 17:46:18.071889 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.071797 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-metric" containerID="cri-o://650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2" gracePeriod=120 May 27 17:46:18.071889 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.071844 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy" containerID="cri-o://d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8" gracePeriod=120 May 27 17:46:18.072000 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.071872 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="config-reloader" containerID="cri-o://6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a" gracePeriod=120 May 27 17:46:18.072000 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.071879 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="prom-label-proxy" containerID="cri-o://3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3" gracePeriod=120 May 27 17:46:18.072000 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.071847 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-web" containerID="cri-o://a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f" gracePeriod=120 May 27 17:46:18.817438 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817395 2566 generic.go:358] "Generic (PLEG): container finished" podID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerID="3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3" exitCode=0 May 27 17:46:18.817438 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817431 2566 generic.go:358] "Generic (PLEG): container finished" podID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerID="d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8" exitCode=0 May 27 17:46:18.817438 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817439 2566 generic.go:358] "Generic (PLEG): container finished" podID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerID="6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a" exitCode=0 May 27 17:46:18.817438 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817447 2566 generic.go:358] "Generic (PLEG): container finished" podID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerID="96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272" exitCode=0 May 27 17:46:18.817803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817500 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3"} May 27 17:46:18.817803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817527 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8"} May 27 17:46:18.817803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817543 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a"} May 27 17:46:18.817803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:18.817555 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272"} May 27 17:46:19.325871 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.325845 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:19.419893 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.419825 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-out\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.419893 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.419871 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-volume\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.419896 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-trusted-ca-bundle\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.419916 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-web\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.419941 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-tls-assets\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.419958 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.419981 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420013 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-main-db\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420037 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wphvm\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-kube-api-access-wphvm\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420068 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-main-tls\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420094 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-metrics-client-ca\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420130 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-cluster-tls-config\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420168 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-web-config\") pod \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\" (UID: \"dcb66db9-d49d-4f49-ade9-df0d36eaf932\") " May 27 17:46:19.420594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420301 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:46:19.420594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420456 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.421174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.420924 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:46:19.421174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.421059 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:46:19.422898 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.422868 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:46:19.423836 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.423553 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-out" (OuterVolumeSpecName: "config-out") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:46:19.423836 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.423547 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-volume" (OuterVolumeSpecName: "config-volume") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:19.423836 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.423791 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:19.423836 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.423803 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:19.424028 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.423926 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:19.424144 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.424126 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:19.424424 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.424407 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-kube-api-access-wphvm" (OuterVolumeSpecName: "kube-api-access-wphvm") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "kube-api-access-wphvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:46:19.428343 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.428112 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:19.434295 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.434268 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-web-config" (OuterVolumeSpecName: "web-config") pod "dcb66db9-d49d-4f49-ade9-df0d36eaf932" (UID: "dcb66db9-d49d-4f49-ade9-df0d36eaf932"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:19.520829 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520804 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-cluster-tls-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520829 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520825 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-web-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520835 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-out\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520844 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-config-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520853 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520861 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-tls-assets\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520870 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520879 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520888 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcb66db9-d49d-4f49-ade9-df0d36eaf932-alertmanager-main-db\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520897 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wphvm\" (UniqueName: \"kubernetes.io/projected/dcb66db9-d49d-4f49-ade9-df0d36eaf932-kube-api-access-wphvm\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520906 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcb66db9-d49d-4f49-ade9-df0d36eaf932-secret-alertmanager-main-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.520975 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.520914 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcb66db9-d49d-4f49-ade9-df0d36eaf932-metrics-client-ca\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:19.823334 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.823301 2566 generic.go:358] "Generic (PLEG): container finished" podID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerID="650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2" exitCode=0 May 27 17:46:19.823334 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.823331 2566 generic.go:358] "Generic (PLEG): container finished" podID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerID="a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f" exitCode=0 May 27 17:46:19.823558 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.823390 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2"} May 27 17:46:19.823558 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.823431 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f"} May 27 17:46:19.823558 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.823443 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcb66db9-d49d-4f49-ade9-df0d36eaf932","Type":"ContainerDied","Data":"74177f0d065f0d062161c8cbe041bb5211be48e31147c3c144fcdc98ecfa1ca3"} May 27 17:46:19.823558 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.823443 2566 scope.go:117] "RemoveContainer" containerID="3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3" May 27 17:46:19.823558 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.823430 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:19.830451 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.830428 2566 scope.go:117] "RemoveContainer" containerID="650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2" May 27 17:46:19.836889 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.836869 2566 scope.go:117] "RemoveContainer" containerID="d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8" May 27 17:46:19.843085 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.843070 2566 scope.go:117] "RemoveContainer" containerID="a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f" May 27 17:46:19.849121 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.849100 2566 scope.go:117] "RemoveContainer" containerID="6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a" May 27 17:46:19.855450 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.855398 2566 scope.go:117] "RemoveContainer" containerID="96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272" May 27 17:46:19.856934 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.856911 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:46:19.859287 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.859266 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:46:19.862374 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.862359 2566 scope.go:117] "RemoveContainer" containerID="7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897" May 27 17:46:19.868318 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.868297 2566 scope.go:117] "RemoveContainer" containerID="3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3" May 27 17:46:19.868554 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:19.868536 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3\": container with ID starting with 3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3 not found: ID does not exist" containerID="3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3" May 27 17:46:19.868594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.868561 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3"} err="failed to get container status \"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3\": rpc error: code = NotFound desc = could not find container \"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3\": container with ID starting with 3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3 not found: ID does not exist" May 27 17:46:19.868594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.868582 2566 scope.go:117] "RemoveContainer" containerID="650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2" May 27 17:46:19.868831 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:19.868811 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2\": container with ID starting with 650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2 not found: ID does not exist" containerID="650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2" May 27 17:46:19.868874 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.868836 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2"} err="failed to get container status \"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2\": rpc error: code = NotFound desc = could not find container \"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2\": container with ID starting with 650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2 not found: ID does not exist" May 27 17:46:19.868874 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.868853 2566 scope.go:117] "RemoveContainer" containerID="d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8" May 27 17:46:19.869079 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:19.869059 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8\": container with ID starting with d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8 not found: ID does not exist" containerID="d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8" May 27 17:46:19.869127 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869084 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8"} err="failed to get container status \"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8\": rpc error: code = NotFound desc = could not find container \"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8\": container with ID starting with d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8 not found: ID does not exist" May 27 17:46:19.869127 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869100 2566 scope.go:117] "RemoveContainer" containerID="a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f" May 27 17:46:19.869323 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:19.869308 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f\": container with ID starting with a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f not found: ID does not exist" containerID="a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f" May 27 17:46:19.869372 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869326 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f"} err="failed to get container status \"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f\": rpc error: code = NotFound desc = could not find container \"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f\": container with ID starting with a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f not found: ID does not exist" May 27 17:46:19.869372 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869340 2566 scope.go:117] "RemoveContainer" containerID="6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a" May 27 17:46:19.869537 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:19.869523 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a\": container with ID starting with 6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a not found: ID does not exist" containerID="6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a" May 27 17:46:19.869582 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869539 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a"} err="failed to get container status \"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a\": rpc error: code = NotFound desc = could not find container \"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a\": container with ID starting with 6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a not found: ID does not exist" May 27 17:46:19.869582 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869552 2566 scope.go:117] "RemoveContainer" containerID="96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272" May 27 17:46:19.869801 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:19.869785 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272\": container with ID starting with 96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272 not found: ID does not exist" containerID="96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272" May 27 17:46:19.869841 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869806 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272"} err="failed to get container status \"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272\": rpc error: code = NotFound desc = could not find container \"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272\": container with ID starting with 96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272 not found: ID does not exist" May 27 17:46:19.869841 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.869819 2566 scope.go:117] "RemoveContainer" containerID="7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897" May 27 17:46:19.870044 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:19.870028 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897\": container with ID starting with 7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897 not found: ID does not exist" containerID="7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897" May 27 17:46:19.870085 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870049 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897"} err="failed to get container status \"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897\": rpc error: code = NotFound desc = could not find container \"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897\": container with ID starting with 7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897 not found: ID does not exist" May 27 17:46:19.870085 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870064 2566 scope.go:117] "RemoveContainer" containerID="3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3" May 27 17:46:19.870262 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870242 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3"} err="failed to get container status \"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3\": rpc error: code = NotFound desc = could not find container \"3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3\": container with ID starting with 3b1006d1d8a8954c0933e11d48e86e6a03c1ede576b0af1683001f51b80ff9d3 not found: ID does not exist" May 27 17:46:19.870331 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870264 2566 scope.go:117] "RemoveContainer" containerID="650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2" May 27 17:46:19.870467 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870449 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2"} err="failed to get container status \"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2\": rpc error: code = NotFound desc = could not find container \"650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2\": container with ID starting with 650899dcd9c900548382675c718f64c58741c5012e88a8ad3fae730ce74a76c2 not found: ID does not exist" May 27 17:46:19.870509 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870469 2566 scope.go:117] "RemoveContainer" containerID="d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8" May 27 17:46:19.870670 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870655 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8"} err="failed to get container status \"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8\": rpc error: code = NotFound desc = could not find container \"d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8\": container with ID starting with d2a6e1536030461094f36ae5ca11eeff52abb7a4429249ad806beefcaf3d06d8 not found: ID does not exist" May 27 17:46:19.870726 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870670 2566 scope.go:117] "RemoveContainer" containerID="a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f" May 27 17:46:19.870872 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870855 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f"} err="failed to get container status \"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f\": rpc error: code = NotFound desc = could not find container \"a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f\": container with ID starting with a8510ecef6ea2ff275212428f364773f3dd52c2e009f881bee147d6a49bf3c1f not found: ID does not exist" May 27 17:46:19.870941 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.870874 2566 scope.go:117] "RemoveContainer" containerID="6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a" May 27 17:46:19.871111 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.871094 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a"} err="failed to get container status \"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a\": rpc error: code = NotFound desc = could not find container \"6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a\": container with ID starting with 6a0ac1c0733faf8a86ce27f8754c8b7edbf37332b75be114050f72b354a8246a not found: ID does not exist" May 27 17:46:19.871156 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.871112 2566 scope.go:117] "RemoveContainer" containerID="96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272" May 27 17:46:19.871305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.871286 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272"} err="failed to get container status \"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272\": rpc error: code = NotFound desc = could not find container \"96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272\": container with ID starting with 96601f3fe57d2e050540323155026f6962c729c4bb0305c7689f3254c6289272 not found: ID does not exist" May 27 17:46:19.871376 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.871307 2566 scope.go:117] "RemoveContainer" containerID="7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897" May 27 17:46:19.871501 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.871485 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897"} err="failed to get container status \"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897\": rpc error: code = NotFound desc = could not find container \"7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897\": container with ID starting with 7c533bdc1cc77c5dd8e0bab37f57a1c356ecd65950d940b3f3184ac9e6e07897 not found: ID does not exist" May 27 17:46:19.902619 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902574 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:46:19.902879 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902866 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="config-reloader" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902888 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="config-reloader" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902896 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914a4fe5-c126-4f32-a482-831ecd05e00a" containerName="console" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902902 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="914a4fe5-c126-4f32-a482-831ecd05e00a" containerName="console" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902911 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902916 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902921 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-metric" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902927 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-metric" May 27 17:46:19.902939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902938 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="prom-label-proxy" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902946 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="prom-label-proxy" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902956 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-web" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902962 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-web" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902969 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="init-config-reloader" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902975 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="init-config-reloader" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902981 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="alertmanager" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.902986 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="alertmanager" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.903036 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="prom-label-proxy" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.903044 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.903051 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="config-reloader" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.903057 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-metric" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.903064 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="914a4fe5-c126-4f32-a482-831ecd05e00a" containerName="console" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.903070 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="alertmanager" May 27 17:46:19.903167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.903076 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" containerName="kube-rbac-proxy-web" May 27 17:46:19.906704 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.906689 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:19.909322 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909299 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 17:46:19.909404 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909299 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 17:46:19.909560 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909546 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sj54q\"" May 27 17:46:19.909650 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909628 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 17:46:19.909741 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909723 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 17:46:19.909814 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909800 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 17:46:19.909860 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909819 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 17:46:19.909917 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.909817 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 17:46:19.910033 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.910017 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 17:46:19.919969 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.919948 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 17:46:19.927061 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:19.927042 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:46:20.025617 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/948ef229-a86f-4a94-977a-46822f16a0ba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025785 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025785 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/948ef229-a86f-4a94-977a-46822f16a0ba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025785 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025785 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025785 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7s8r\" (UniqueName: \"kubernetes.io/projected/948ef229-a86f-4a94-977a-46822f16a0ba-kube-api-access-d7s8r\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/948ef229-a86f-4a94-977a-46822f16a0ba-config-out\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/948ef229-a86f-4a94-977a-46822f16a0ba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948ef229-a86f-4a94-977a-46822f16a0ba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-config-volume\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.025982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.025984 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-web-config\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127020 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.126923 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948ef229-a86f-4a94-977a-46822f16a0ba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127020 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.126966 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-config-volume\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127020 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.126986 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127020 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127001 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-web-config\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127035 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/948ef229-a86f-4a94-977a-46822f16a0ba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127058 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127076 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/948ef229-a86f-4a94-977a-46822f16a0ba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127101 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127132 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127177 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7s8r\" (UniqueName: \"kubernetes.io/projected/948ef229-a86f-4a94-977a-46822f16a0ba-kube-api-access-d7s8r\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127200 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/948ef229-a86f-4a94-977a-46822f16a0ba-config-out\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127233 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.127346 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127258 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/948ef229-a86f-4a94-977a-46822f16a0ba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.128236 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.127979 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948ef229-a86f-4a94-977a-46822f16a0ba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.128236 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.128042 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/948ef229-a86f-4a94-977a-46822f16a0ba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.128236 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.128090 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/948ef229-a86f-4a94-977a-46822f16a0ba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.130044 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.130022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-config-volume\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.130424 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.130405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-web-config\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.130503 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.130405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.130503 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.130405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.130764 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.130743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/948ef229-a86f-4a94-977a-46822f16a0ba-config-out\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.130764 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.130764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.130890 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.130791 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/948ef229-a86f-4a94-977a-46822f16a0ba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.131046 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.131026 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.132141 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.132123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/948ef229-a86f-4a94-977a-46822f16a0ba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.136711 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.136695 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7s8r\" (UniqueName: \"kubernetes.io/projected/948ef229-a86f-4a94-977a-46822f16a0ba-kube-api-access-d7s8r\") pod \"alertmanager-main-0\" (UID: \"948ef229-a86f-4a94-977a-46822f16a0ba\") " pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.216264 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.216240 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 17:46:20.351025 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.350994 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 17:46:20.828073 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.828036 2566 generic.go:358] "Generic (PLEG): container finished" podID="948ef229-a86f-4a94-977a-46822f16a0ba" containerID="1d48393949ce9462e4f68e2f7cffd714d6ae9fa581d053153e2b1cbb1a5133c5" exitCode=0 May 27 17:46:20.828259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.828079 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerDied","Data":"1d48393949ce9462e4f68e2f7cffd714d6ae9fa581d053153e2b1cbb1a5133c5"} May 27 17:46:20.828259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:20.828107 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerStarted","Data":"daebf00c3c4189badc1833eda256e9913abd963fc1a8ed357e11a8d4d89e8df0"} May 27 17:46:21.181897 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.181868 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcb66db9-d49d-4f49-ade9-df0d36eaf932" path="/var/lib/kubelet/pods/dcb66db9-d49d-4f49-ade9-df0d36eaf932/volumes" May 27 17:46:21.834559 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.834523 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerStarted","Data":"75ac92fb11c86da0fc1354de05c17d44c865e783dda240666fcd1f738961d572"} May 27 17:46:21.834559 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.834557 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerStarted","Data":"ad38febe2cbc9a5d955296cfc21c07a04d4d373c96050a5fee7290787d2e0b43"} May 27 17:46:21.834559 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.834567 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerStarted","Data":"1423f04f8e6b852ca858bea2b4337ca1dc9684553e29e0310b58d50196a057b9"} May 27 17:46:21.835026 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.834577 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerStarted","Data":"4e755c9493e66375c07424dc8021d0f58da03203abf93d914ba768151fae405c"} May 27 17:46:21.835026 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.834585 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerStarted","Data":"c646733ae4d7767b49e6522607b6c51b8be6121776511d91192821201a407576"} May 27 17:46:21.835026 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.834593 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"948ef229-a86f-4a94-977a-46822f16a0ba","Type":"ContainerStarted","Data":"cd37ad71e6b70c739f2e325a881509ce67ecc600c770697452987f9b488fced5"} May 27 17:46:21.866416 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:21.866368 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8663508540000002 podStartE2EDuration="2.866350854s" podCreationTimestamp="2026-05-27 17:46:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:46:21.865990361 +0000 UTC m=+171.271964841" watchObservedRunningTime="2026-05-27 17:46:21.866350854 +0000 UTC m=+171.272325336" May 27 17:46:22.395348 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.395308 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:46:22.395982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.395918 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="prometheus" containerID="cri-o://1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" gracePeriod=600 May 27 17:46:22.395982 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.395929 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy" containerID="cri-o://7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" gracePeriod=600 May 27 17:46:22.396154 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.395974 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="config-reloader" containerID="cri-o://f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" gracePeriod=600 May 27 17:46:22.396154 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.395960 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="thanos-sidecar" containerID="cri-o://f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" gracePeriod=600 May 27 17:46:22.396154 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.395959 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-web" containerID="cri-o://829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" gracePeriod=600 May 27 17:46:22.396154 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.395965 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" gracePeriod=600 May 27 17:46:22.640694 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.640669 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.749148 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749049 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-rulefiles-0\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749148 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749093 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-tls\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749387 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749250 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-kubelet-serving-ca-bundle\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749387 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749322 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-metrics-client-certs\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749387 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749352 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-web-config\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749387 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749383 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-tls-assets\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749412 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-config-out\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749458 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-db\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749732 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749700 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:46:22.749841 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749824 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4bmj\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-kube-api-access-w4bmj\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.749914 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.749899 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-serving-certs-ca-bundle\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.750030 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.750016 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-metrics-client-ca\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.750137 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.750124 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-grpc-tls\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.750244 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.750229 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-kube-rbac-proxy\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.750359 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.750346 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-config\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.751062 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.750344 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:46:22.751062 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.750979 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:46:22.751246 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751125 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:46:22.751246 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751153 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:46:22.751353 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751289 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.751353 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751328 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-thanos-prometheus-http-client-file\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.751455 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751365 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-trusted-ca-bundle\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.751455 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751398 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"93f50a60-361d-4eab-b8be-d0e260cebaaf\" (UID: \"93f50a60-361d-4eab-b8be-d0e260cebaaf\") " May 27 17:46:22.751985 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751705 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-db\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.751985 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751732 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.751985 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751751 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-metrics-client-ca\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.751985 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751766 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.751985 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.751781 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.752315 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.752288 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 17:46:22.752409 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.752387 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.752470 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.752453 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.752532 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.752511 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-config-out" (OuterVolumeSpecName: "config-out") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:46:22.752888 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.752860 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:46:22.753794 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.753764 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-kube-api-access-w4bmj" (OuterVolumeSpecName: "kube-api-access-w4bmj") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "kube-api-access-w4bmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:46:22.753894 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.753859 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-config" (OuterVolumeSpecName: "config") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.754182 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.754156 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.754308 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.754290 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.754720 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.754685 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.754936 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.754912 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.755109 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.755093 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.762711 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.762686 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-web-config" (OuterVolumeSpecName: "web-config") pod "93f50a60-361d-4eab-b8be-d0e260cebaaf" (UID: "93f50a60-361d-4eab-b8be-d0e260cebaaf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:46:22.841176 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841141 2566 generic.go:358] "Generic (PLEG): container finished" podID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" exitCode=0 May 27 17:46:22.841176 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841166 2566 generic.go:358] "Generic (PLEG): container finished" podID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" exitCode=0 May 27 17:46:22.841176 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841174 2566 generic.go:358] "Generic (PLEG): container finished" podID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" exitCode=0 May 27 17:46:22.841176 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841183 2566 generic.go:358] "Generic (PLEG): container finished" podID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" exitCode=0 May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841190 2566 generic.go:358] "Generic (PLEG): container finished" podID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" exitCode=0 May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841199 2566 generic.go:358] "Generic (PLEG): container finished" podID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" exitCode=0 May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841220 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841260 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841261 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841271 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841281 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841289 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841298 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841307 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93f50a60-361d-4eab-b8be-d0e260cebaaf","Type":"ContainerDied","Data":"a65b05ab532698f3d6dbadc9e37eb03e83e2c2755afd57cffe272101ad397476"} May 27 17:46:22.841701 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.841315 2566 scope.go:117] "RemoveContainer" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.848724 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.848706 2566 scope.go:117] "RemoveContainer" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.853814 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.853691 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-grpc-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.853814 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.853716 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-kube-rbac-proxy\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.853814 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.853758 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.853891 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.853951 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.853988 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f50a60-361d-4eab-b8be-d0e260cebaaf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.854007 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.854031 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854228 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.854045 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-secret-metrics-client-certs\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854228 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.854060 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93f50a60-361d-4eab-b8be-d0e260cebaaf-web-config\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854228 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.854075 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-tls-assets\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854228 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.854088 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93f50a60-361d-4eab-b8be-d0e260cebaaf-config-out\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.854228 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.854101 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4bmj\" (UniqueName: \"kubernetes.io/projected/93f50a60-361d-4eab-b8be-d0e260cebaaf-kube-api-access-w4bmj\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:46:22.856215 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.856195 2566 scope.go:117] "RemoveContainer" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.862769 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.862749 2566 scope.go:117] "RemoveContainer" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.867067 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.867045 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:46:22.869551 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.869532 2566 scope.go:117] "RemoveContainer" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.875715 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.875695 2566 scope.go:117] "RemoveContainer" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.878044 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.878023 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:46:22.882928 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.882907 2566 scope.go:117] "RemoveContainer" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.889343 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.889322 2566 scope.go:117] "RemoveContainer" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.890743 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:22.890715 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": container with ID starting with 3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934 not found: ID does not exist" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.890838 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.890756 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} err="failed to get container status \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": rpc error: code = NotFound desc = could not find container \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": container with ID starting with 3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934 not found: ID does not exist" May 27 17:46:22.890838 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.890785 2566 scope.go:117] "RemoveContainer" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.892203 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:22.892175 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": container with ID starting with 7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779 not found: ID does not exist" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.892280 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.892203 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} err="failed to get container status \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": rpc error: code = NotFound desc = could not find container \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": container with ID starting with 7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779 not found: ID does not exist" May 27 17:46:22.892280 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.892222 2566 scope.go:117] "RemoveContainer" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.892491 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:22.892471 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": container with ID starting with 829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46 not found: ID does not exist" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.892553 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.892501 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} err="failed to get container status \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": rpc error: code = NotFound desc = could not find container \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": container with ID starting with 829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46 not found: ID does not exist" May 27 17:46:22.892553 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.892528 2566 scope.go:117] "RemoveContainer" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.892784 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:22.892767 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": container with ID starting with f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270 not found: ID does not exist" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.892853 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.892793 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} err="failed to get container status \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": rpc error: code = NotFound desc = could not find container \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": container with ID starting with f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270 not found: ID does not exist" May 27 17:46:22.892853 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.892815 2566 scope.go:117] "RemoveContainer" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.893057 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:22.893040 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": container with ID starting with f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8 not found: ID does not exist" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.893091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893062 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} err="failed to get container status \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": rpc error: code = NotFound desc = could not find container \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": container with ID starting with f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8 not found: ID does not exist" May 27 17:46:22.893091 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893079 2566 scope.go:117] "RemoveContainer" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.893302 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:22.893285 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": container with ID starting with 1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4 not found: ID does not exist" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.893364 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893309 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} err="failed to get container status \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": rpc error: code = NotFound desc = could not find container \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": container with ID starting with 1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4 not found: ID does not exist" May 27 17:46:22.893364 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893328 2566 scope.go:117] "RemoveContainer" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.893550 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:46:22.893532 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": container with ID starting with 3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b not found: ID does not exist" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.893584 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893553 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b"} err="failed to get container status \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": rpc error: code = NotFound desc = could not find container \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": container with ID starting with 3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b not found: ID does not exist" May 27 17:46:22.893584 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893567 2566 scope.go:117] "RemoveContainer" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.893789 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893774 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} err="failed to get container status \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": rpc error: code = NotFound desc = could not find container \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": container with ID starting with 3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934 not found: ID does not exist" May 27 17:46:22.893834 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893790 2566 scope.go:117] "RemoveContainer" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.893976 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893958 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} err="failed to get container status \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": rpc error: code = NotFound desc = could not find container \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": container with ID starting with 7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779 not found: ID does not exist" May 27 17:46:22.894043 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.893978 2566 scope.go:117] "RemoveContainer" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.894186 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894169 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} err="failed to get container status \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": rpc error: code = NotFound desc = could not find container \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": container with ID starting with 829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46 not found: ID does not exist" May 27 17:46:22.894242 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894186 2566 scope.go:117] "RemoveContainer" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.894419 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894398 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} err="failed to get container status \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": rpc error: code = NotFound desc = could not find container \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": container with ID starting with f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270 not found: ID does not exist" May 27 17:46:22.894464 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894420 2566 scope.go:117] "RemoveContainer" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.894640 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894622 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} err="failed to get container status \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": rpc error: code = NotFound desc = could not find container \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": container with ID starting with f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8 not found: ID does not exist" May 27 17:46:22.894683 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894640 2566 scope.go:117] "RemoveContainer" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.894839 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894818 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} err="failed to get container status \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": rpc error: code = NotFound desc = could not find container \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": container with ID starting with 1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4 not found: ID does not exist" May 27 17:46:22.894889 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.894839 2566 scope.go:117] "RemoveContainer" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.895038 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895023 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b"} err="failed to get container status \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": rpc error: code = NotFound desc = could not find container \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": container with ID starting with 3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b not found: ID does not exist" May 27 17:46:22.895072 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895039 2566 scope.go:117] "RemoveContainer" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.895242 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895225 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} err="failed to get container status \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": rpc error: code = NotFound desc = could not find container \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": container with ID starting with 3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934 not found: ID does not exist" May 27 17:46:22.895288 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895242 2566 scope.go:117] "RemoveContainer" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.895427 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895410 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} err="failed to get container status \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": rpc error: code = NotFound desc = could not find container \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": container with ID starting with 7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779 not found: ID does not exist" May 27 17:46:22.895474 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895426 2566 scope.go:117] "RemoveContainer" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.895637 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895622 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} err="failed to get container status \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": rpc error: code = NotFound desc = could not find container \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": container with ID starting with 829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46 not found: ID does not exist" May 27 17:46:22.895637 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895637 2566 scope.go:117] "RemoveContainer" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.895834 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895818 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} err="failed to get container status \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": rpc error: code = NotFound desc = could not find container \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": container with ID starting with f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270 not found: ID does not exist" May 27 17:46:22.895834 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895833 2566 scope.go:117] "RemoveContainer" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.895996 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895980 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} err="failed to get container status \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": rpc error: code = NotFound desc = could not find container \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": container with ID starting with f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8 not found: ID does not exist" May 27 17:46:22.896036 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.895996 2566 scope.go:117] "RemoveContainer" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.896146 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896130 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} err="failed to get container status \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": rpc error: code = NotFound desc = could not find container \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": container with ID starting with 1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4 not found: ID does not exist" May 27 17:46:22.896183 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896146 2566 scope.go:117] "RemoveContainer" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.896313 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896297 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b"} err="failed to get container status \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": rpc error: code = NotFound desc = could not find container \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": container with ID starting with 3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b not found: ID does not exist" May 27 17:46:22.896356 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896313 2566 scope.go:117] "RemoveContainer" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.896504 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896488 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} err="failed to get container status \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": rpc error: code = NotFound desc = could not find container \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": container with ID starting with 3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934 not found: ID does not exist" May 27 17:46:22.896553 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896503 2566 scope.go:117] "RemoveContainer" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.896733 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896717 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} err="failed to get container status \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": rpc error: code = NotFound desc = could not find container \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": container with ID starting with 7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779 not found: ID does not exist" May 27 17:46:22.896783 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896732 2566 scope.go:117] "RemoveContainer" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.896929 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896914 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} err="failed to get container status \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": rpc error: code = NotFound desc = could not find container \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": container with ID starting with 829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46 not found: ID does not exist" May 27 17:46:22.896929 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.896929 2566 scope.go:117] "RemoveContainer" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.897108 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897087 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} err="failed to get container status \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": rpc error: code = NotFound desc = could not find container \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": container with ID starting with f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270 not found: ID does not exist" May 27 17:46:22.897150 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897110 2566 scope.go:117] "RemoveContainer" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.897296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897279 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} err="failed to get container status \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": rpc error: code = NotFound desc = could not find container \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": container with ID starting with f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8 not found: ID does not exist" May 27 17:46:22.897296 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897295 2566 scope.go:117] "RemoveContainer" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.897455 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897439 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} err="failed to get container status \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": rpc error: code = NotFound desc = could not find container \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": container with ID starting with 1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4 not found: ID does not exist" May 27 17:46:22.897495 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897454 2566 scope.go:117] "RemoveContainer" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.897630 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897594 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b"} err="failed to get container status \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": rpc error: code = NotFound desc = could not find container \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": container with ID starting with 3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b not found: ID does not exist" May 27 17:46:22.897678 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897632 2566 scope.go:117] "RemoveContainer" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.897814 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897798 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} err="failed to get container status \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": rpc error: code = NotFound desc = could not find container \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": container with ID starting with 3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934 not found: ID does not exist" May 27 17:46:22.897854 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897814 2566 scope.go:117] "RemoveContainer" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.897988 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897972 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} err="failed to get container status \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": rpc error: code = NotFound desc = could not find container \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": container with ID starting with 7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779 not found: ID does not exist" May 27 17:46:22.897988 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.897987 2566 scope.go:117] "RemoveContainer" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.898153 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898138 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} err="failed to get container status \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": rpc error: code = NotFound desc = could not find container \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": container with ID starting with 829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46 not found: ID does not exist" May 27 17:46:22.898153 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898152 2566 scope.go:117] "RemoveContainer" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.898311 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898296 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} err="failed to get container status \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": rpc error: code = NotFound desc = could not find container \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": container with ID starting with f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270 not found: ID does not exist" May 27 17:46:22.898348 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898310 2566 scope.go:117] "RemoveContainer" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.898473 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898458 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} err="failed to get container status \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": rpc error: code = NotFound desc = could not find container \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": container with ID starting with f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8 not found: ID does not exist" May 27 17:46:22.898508 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898473 2566 scope.go:117] "RemoveContainer" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.898645 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898627 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} err="failed to get container status \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": rpc error: code = NotFound desc = could not find container \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": container with ID starting with 1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4 not found: ID does not exist" May 27 17:46:22.898692 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898645 2566 scope.go:117] "RemoveContainer" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.898825 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898807 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b"} err="failed to get container status \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": rpc error: code = NotFound desc = could not find container \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": container with ID starting with 3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b not found: ID does not exist" May 27 17:46:22.898864 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898826 2566 scope.go:117] "RemoveContainer" containerID="3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934" May 27 17:46:22.898995 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898978 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934"} err="failed to get container status \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": rpc error: code = NotFound desc = could not find container \"3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934\": container with ID starting with 3325dc9c953195340e3c5940351650a2a3834ff6036d2fd605481b2d0545a934 not found: ID does not exist" May 27 17:46:22.899036 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.898998 2566 scope.go:117] "RemoveContainer" containerID="7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779" May 27 17:46:22.899192 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899177 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779"} err="failed to get container status \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": rpc error: code = NotFound desc = could not find container \"7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779\": container with ID starting with 7b1fc12891223b407d8acdf3ef5618dfa64bb5af0cc84b717853a87b2b1eb779 not found: ID does not exist" May 27 17:46:22.899238 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899193 2566 scope.go:117] "RemoveContainer" containerID="829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46" May 27 17:46:22.899383 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899367 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46"} err="failed to get container status \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": rpc error: code = NotFound desc = could not find container \"829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46\": container with ID starting with 829eb117857f9c7d3c7746226e676bdc340a144f51ed1d3f6e8cc9d29fd81d46 not found: ID does not exist" May 27 17:46:22.899428 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899384 2566 scope.go:117] "RemoveContainer" containerID="f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270" May 27 17:46:22.899555 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899540 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270"} err="failed to get container status \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": rpc error: code = NotFound desc = could not find container \"f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270\": container with ID starting with f1c6043fb3d4d3bf36bf9d6e82fbfa27b89fb33c6dd2d12ed499b380c7742270 not found: ID does not exist" May 27 17:46:22.899594 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899554 2566 scope.go:117] "RemoveContainer" containerID="f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8" May 27 17:46:22.899754 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899737 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8"} err="failed to get container status \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": rpc error: code = NotFound desc = could not find container \"f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8\": container with ID starting with f7f834571c96e051333def6fa487ee6ece457da939e66e204c35c9209e8b03d8 not found: ID does not exist" May 27 17:46:22.899791 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899755 2566 scope.go:117] "RemoveContainer" containerID="1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4" May 27 17:46:22.899930 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899914 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4"} err="failed to get container status \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": rpc error: code = NotFound desc = could not find container \"1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4\": container with ID starting with 1317772d8d332df85a1b808b399443ad1b3b9a4fca8cc419289e11a3e8ffaeb4 not found: ID does not exist" May 27 17:46:22.899978 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.899932 2566 scope.go:117] "RemoveContainer" containerID="3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b" May 27 17:46:22.900117 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.900102 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b"} err="failed to get container status \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": rpc error: code = NotFound desc = could not find container \"3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b\": container with ID starting with 3a5c421efd41ca4d17d0d2f2915b2ccb5e60abbda25ac8f47df2615913fb265b not found: ID does not exist" May 27 17:46:22.937120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937081 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:46:22.937385 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937373 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="init-config-reloader" May 27 17:46:22.937437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937387 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="init-config-reloader" May 27 17:46:22.937437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937401 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy" May 27 17:46:22.937437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937406 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy" May 27 17:46:22.937437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937413 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-thanos" May 27 17:46:22.937437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937418 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-thanos" May 27 17:46:22.937437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937430 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-web" May 27 17:46:22.937437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937435 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-web" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937444 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="config-reloader" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937449 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="config-reloader" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937455 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="thanos-sidecar" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937461 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="thanos-sidecar" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937467 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="prometheus" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937472 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="prometheus" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937517 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="thanos-sidecar" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937525 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-web" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937531 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy-thanos" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937537 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="kube-rbac-proxy" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937543 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="config-reloader" May 27 17:46:22.937648 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.937550 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" containerName="prometheus" May 27 17:46:22.941434 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.941417 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.954480 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954456 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 17:46:22.954787 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.954869 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.954869 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954815 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck7z7\" (UniqueName: \"kubernetes.io/projected/137f4f92-d652-45c7-bc20-26ed3f1702cd-kube-api-access-ck7z7\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.954991 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954866 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 17:46:22.954991 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/137f4f92-d652-45c7-bc20-26ed3f1702cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.954991 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.954991 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.954990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-config\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955174 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955358 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955224 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955358 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955358 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955358 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/137f4f92-d652-45c7-bc20-26ed3f1702cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955358 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955323 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.955358 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.955338 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:22.956061 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.956045 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 17:46:22.956557 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.956544 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-22rdx\"" May 27 17:46:22.959533 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.959514 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 17:46:22.959633 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.959539 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 17:46:22.959633 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.959552 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8blafgamhva7u\"" May 27 17:46:22.959633 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.959552 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 17:46:22.959633 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.959564 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 17:46:22.959633 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.959588 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 17:46:22.959924 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.959910 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 17:46:22.962743 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:22.962729 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 17:46:23.020421 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.020346 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 17:46:23.027039 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.027016 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 17:46:23.035250 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.035218 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:46:23.055766 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.055732 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/137f4f92-d652-45c7-bc20-26ed3f1702cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.055766 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.055764 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.055951 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.055779 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.056081 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056058 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.056165 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056106 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.056165 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056138 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.056289 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056191 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-config\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.056289 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056216 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.056289 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056282 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.056591 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056562 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056834 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056880 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056917 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056937 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.056960 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/137f4f92-d652-45c7-bc20-26ed3f1702cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.057002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.057034 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.057079 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.057118 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.057145 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7z7\" (UniqueName: \"kubernetes.io/projected/137f4f92-d652-45c7-bc20-26ed3f1702cd-kube-api-access-ck7z7\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.057796 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.057229 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.058935 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.057870 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.058935 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.058820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.059581 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.059158 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/137f4f92-d652-45c7-bc20-26ed3f1702cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.059581 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.059325 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-config\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.059581 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.059539 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.059837 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.059786 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.060475 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.060447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/137f4f92-d652-45c7-bc20-26ed3f1702cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.060817 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.060783 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.060817 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.060799 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.061017 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.060995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.061156 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.061141 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.061677 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.061657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/137f4f92-d652-45c7-bc20-26ed3f1702cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.061930 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.061913 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.061966 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.061937 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/137f4f92-d652-45c7-bc20-26ed3f1702cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.065655 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.065583 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck7z7\" (UniqueName: \"kubernetes.io/projected/137f4f92-d652-45c7-bc20-26ed3f1702cd-kube-api-access-ck7z7\") pod \"prometheus-k8s-0\" (UID: \"137f4f92-d652-45c7-bc20-26ed3f1702cd\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.182947 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.182914 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f50a60-361d-4eab-b8be-d0e260cebaaf" path="/var/lib/kubelet/pods/93f50a60-361d-4eab-b8be-d0e260cebaaf/volumes" May 27 17:46:23.250586 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.250536 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:46:23.396737 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.396706 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 17:46:23.399195 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:46:23.399152 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137f4f92_d652_45c7_bc20_26ed3f1702cd.slice/crio-d1942cc528f20a0ac99f7b6366077129f8f78a368be8e41dc706cb1e7140c123 WatchSource:0}: Error finding container d1942cc528f20a0ac99f7b6366077129f8f78a368be8e41dc706cb1e7140c123: Status 404 returned error can't find the container with id d1942cc528f20a0ac99f7b6366077129f8f78a368be8e41dc706cb1e7140c123 May 27 17:46:23.847374 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.847337 2566 generic.go:358] "Generic (PLEG): container finished" podID="137f4f92-d652-45c7-bc20-26ed3f1702cd" containerID="028f0e60b1049e8d00aaf87f35259a3e2f70cba66b6f70f28801f43bac05611f" exitCode=0 May 27 17:46:23.847776 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.847405 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerDied","Data":"028f0e60b1049e8d00aaf87f35259a3e2f70cba66b6f70f28801f43bac05611f"} May 27 17:46:23.847776 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:23.847433 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerStarted","Data":"d1942cc528f20a0ac99f7b6366077129f8f78a368be8e41dc706cb1e7140c123"} May 27 17:46:24.853259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:24.853221 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerStarted","Data":"39e90acc401e6d6ce12976dee7d32be124363d61070c1ebb81b67808badb03d8"} May 27 17:46:24.853259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:24.853257 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerStarted","Data":"27552f5a3f352263d2756d2ef39a0f12abc6b91957ddaab43f73e928b3f6c3b2"} May 27 17:46:24.853259 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:24.853267 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerStarted","Data":"80918775ab4966ca5b31e6459c7c7c7f604555387b36db023f949cf44ac2f77e"} May 27 17:46:24.853849 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:24.853277 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerStarted","Data":"cfa5f24e49ffe5be3ce71a7679a270af5829b9fbe63e61bcbfb8aa9bba1cc7e5"} May 27 17:46:24.853849 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:24.853284 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerStarted","Data":"294087452d762b537142f49d4c390283309ec822b38364d004dd8b9af6b3c088"} May 27 17:46:24.853849 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:24.853292 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"137f4f92-d652-45c7-bc20-26ed3f1702cd","Type":"ContainerStarted","Data":"a2bbda44ea2a47d8777ac1102cd65c7fece6b3817e0639d3ff8305e98a213493"} May 27 17:46:24.887814 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:24.887761 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.88774673 podStartE2EDuration="2.88774673s" podCreationTimestamp="2026-05-27 17:46:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:46:24.885807904 +0000 UTC m=+174.291782386" watchObservedRunningTime="2026-05-27 17:46:24.88774673 +0000 UTC m=+174.293721211" May 27 17:46:28.251432 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:46:28.251371 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:47:23.250687 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:47:23.250654 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:47:23.265782 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:47:23.265757 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:47:24.038459 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:47:24.038428 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 17:48:14.696806 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.696766 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qwfqv"] May 27 17:48:14.699010 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.698988 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.701122 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.701102 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 17:48:14.704489 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.704468 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qwfqv"] May 27 17:48:14.856938 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.856899 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-dbus\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.856938 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.856937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-original-pull-secret\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.857170 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.856969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-kubelet-config\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.957775 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.957686 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-kubelet-config\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.957775 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.957773 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-dbus\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.957967 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.957796 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-original-pull-secret\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.957967 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.957811 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-kubelet-config\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.957967 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.957934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-dbus\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:14.960034 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:14.960007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6-original-pull-secret\") pod \"global-pull-secret-syncer-qwfqv\" (UID: \"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6\") " pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:15.008946 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:15.008906 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwfqv" May 27 17:48:15.139828 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:15.139743 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qwfqv"] May 27 17:48:15.142647 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:48:15.142612 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7f61e6_6cb1_4a32_a0c7_b7ca124625c6.slice/crio-b09ac4ac14e9dc6b447f752d9ab96fe22aa0f37ca204d5d65aaeb77d394646dd WatchSource:0}: Error finding container b09ac4ac14e9dc6b447f752d9ab96fe22aa0f37ca204d5d65aaeb77d394646dd: Status 404 returned error can't find the container with id b09ac4ac14e9dc6b447f752d9ab96fe22aa0f37ca204d5d65aaeb77d394646dd May 27 17:48:15.164927 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:15.164895 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qwfqv" event={"ID":"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6","Type":"ContainerStarted","Data":"b09ac4ac14e9dc6b447f752d9ab96fe22aa0f37ca204d5d65aaeb77d394646dd"} May 27 17:48:19.177445 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:19.177409 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qwfqv" event={"ID":"ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6","Type":"ContainerStarted","Data":"ba27717941e2478c50adf544dc6d1a32342fe3be7ed87e71bc07aa9d3e8eb6a7"} May 27 17:48:19.193785 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:19.193722 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qwfqv" podStartSLOduration=1.301834337 podStartE2EDuration="5.193702985s" podCreationTimestamp="2026-05-27 17:48:14 +0000 UTC" firstStartedPulling="2026-05-27 17:48:15.144291195 +0000 UTC m=+284.550265655" lastFinishedPulling="2026-05-27 17:48:19.036159844 +0000 UTC m=+288.442134303" observedRunningTime="2026-05-27 17:48:19.192846825 +0000 UTC m=+288.598821306" watchObservedRunningTime="2026-05-27 17:48:19.193702985 +0000 UTC m=+288.599677467" May 27 17:48:31.097120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:31.097088 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:48:31.097572 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:31.097442 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:48:31.101718 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:48:31.101699 2566 kubelet.go:1628] "Image garbage collection succeeded" May 27 17:49:38.809289 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.809196 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7"] May 27 17:49:38.812396 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.812381 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:38.817637 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.817589 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ngn6g\"" May 27 17:49:38.817774 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.817624 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 17:49:38.817774 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.817621 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 17:49:38.817774 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.817632 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 17:49:38.818069 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.818053 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 17:49:38.823619 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.823587 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7"] May 27 17:49:38.932723 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.932693 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd97641b-8749-4b60-8872-a149bff31a02-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:38.932852 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.932739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrgz\" (UniqueName: \"kubernetes.io/projected/dd97641b-8749-4b60-8872-a149bff31a02-kube-api-access-zzrgz\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:38.932852 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:38.932773 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd97641b-8749-4b60-8872-a149bff31a02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.033563 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.033537 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd97641b-8749-4b60-8872-a149bff31a02-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.033699 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.033578 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrgz\" (UniqueName: \"kubernetes.io/projected/dd97641b-8749-4b60-8872-a149bff31a02-kube-api-access-zzrgz\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.033699 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.033598 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd97641b-8749-4b60-8872-a149bff31a02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.035822 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.035802 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd97641b-8749-4b60-8872-a149bff31a02-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.035916 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.035839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd97641b-8749-4b60-8872-a149bff31a02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.042357 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.042336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrgz\" (UniqueName: \"kubernetes.io/projected/dd97641b-8749-4b60-8872-a149bff31a02-kube-api-access-zzrgz\") pod \"opendatahub-operator-controller-manager-6bc4cc6548-8nzp7\" (UID: \"dd97641b-8749-4b60-8872-a149bff31a02\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.122574 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.122535 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:39.259800 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.259567 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7"] May 27 17:49:39.263217 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:49:39.263185 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd97641b_8749_4b60_8872_a149bff31a02.slice/crio-2a79c59872ef9d5e37502dea6d7a57f50d8a6daeab91db0a694774ce620fc8b2 WatchSource:0}: Error finding container 2a79c59872ef9d5e37502dea6d7a57f50d8a6daeab91db0a694774ce620fc8b2: Status 404 returned error can't find the container with id 2a79c59872ef9d5e37502dea6d7a57f50d8a6daeab91db0a694774ce620fc8b2 May 27 17:49:39.264805 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.264782 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 17:49:39.391726 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:39.391631 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" event={"ID":"dd97641b-8749-4b60-8872-a149bff31a02","Type":"ContainerStarted","Data":"2a79c59872ef9d5e37502dea6d7a57f50d8a6daeab91db0a694774ce620fc8b2"} May 27 17:49:42.401851 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:42.401810 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" event={"ID":"dd97641b-8749-4b60-8872-a149bff31a02","Type":"ContainerStarted","Data":"5179d70f936d13fcc07e711a5bf28b3765d02b026fc502aa0a22b6f53ef6b864"} May 27 17:49:42.402244 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:42.401910 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:42.427619 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:42.427562 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" podStartSLOduration=1.944124318 podStartE2EDuration="4.427547262s" podCreationTimestamp="2026-05-27 17:49:38 +0000 UTC" firstStartedPulling="2026-05-27 17:49:39.264976896 +0000 UTC m=+368.670951370" lastFinishedPulling="2026-05-27 17:49:41.748399855 +0000 UTC m=+371.154374314" observedRunningTime="2026-05-27 17:49:42.42685218 +0000 UTC m=+371.832826662" watchObservedRunningTime="2026-05-27 17:49:42.427547262 +0000 UTC m=+371.833521815" May 27 17:49:44.179145 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.179110 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs"] May 27 17:49:44.182178 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.182158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.184824 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.184790 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 17:49:44.184824 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.184813 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xmggl\"" May 27 17:49:44.184996 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.184847 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 17:49:44.184996 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.184864 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 17:49:44.184996 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.184879 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 17:49:44.184996 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.184814 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 17:49:44.192912 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.192890 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs"] May 27 17:49:44.277874 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.277843 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b46c5321-0219-4ea5-a523-8a134248de40-metrics-cert\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.278019 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.277890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b46c5321-0219-4ea5-a523-8a134248de40-cert\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.278019 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.277939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b46c5321-0219-4ea5-a523-8a134248de40-manager-config\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.278019 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.277956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrv4g\" (UniqueName: \"kubernetes.io/projected/b46c5321-0219-4ea5-a523-8a134248de40-kube-api-access-wrv4g\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.378750 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.378706 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b46c5321-0219-4ea5-a523-8a134248de40-metrics-cert\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.378750 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.378759 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b46c5321-0219-4ea5-a523-8a134248de40-cert\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.378938 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.378785 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b46c5321-0219-4ea5-a523-8a134248de40-manager-config\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.378938 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.378804 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrv4g\" (UniqueName: \"kubernetes.io/projected/b46c5321-0219-4ea5-a523-8a134248de40-kube-api-access-wrv4g\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.379468 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.379445 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b46c5321-0219-4ea5-a523-8a134248de40-manager-config\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.381201 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.381177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b46c5321-0219-4ea5-a523-8a134248de40-metrics-cert\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.381302 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.381234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b46c5321-0219-4ea5-a523-8a134248de40-cert\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.389994 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.389968 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrv4g\" (UniqueName: \"kubernetes.io/projected/b46c5321-0219-4ea5-a523-8a134248de40-kube-api-access-wrv4g\") pod \"lws-controller-manager-78df8cc544-8xnrs\" (UID: \"b46c5321-0219-4ea5-a523-8a134248de40\") " pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.492000 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.491926 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:44.615542 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:44.615502 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs"] May 27 17:49:44.621896 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:49:44.621867 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46c5321_0219_4ea5_a523_8a134248de40.slice/crio-126a37273f20648b2c5d1409e844b9be0b7d89735c7fdbb6ce229bc4b5e91b63 WatchSource:0}: Error finding container 126a37273f20648b2c5d1409e844b9be0b7d89735c7fdbb6ce229bc4b5e91b63: Status 404 returned error can't find the container with id 126a37273f20648b2c5d1409e844b9be0b7d89735c7fdbb6ce229bc4b5e91b63 May 27 17:49:45.411658 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:45.411624 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" event={"ID":"b46c5321-0219-4ea5-a523-8a134248de40","Type":"ContainerStarted","Data":"126a37273f20648b2c5d1409e844b9be0b7d89735c7fdbb6ce229bc4b5e91b63"} May 27 17:49:48.424906 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:48.424864 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" event={"ID":"b46c5321-0219-4ea5-a523-8a134248de40","Type":"ContainerStarted","Data":"bbb7dfabe206a54373635234315aec36e5f5057f9d81160bef715c53ea90766b"} May 27 17:49:48.425298 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:48.424985 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:49:48.441896 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:48.441821 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" podStartSLOduration=1.405791418 podStartE2EDuration="4.441805117s" podCreationTimestamp="2026-05-27 17:49:44 +0000 UTC" firstStartedPulling="2026-05-27 17:49:44.623446596 +0000 UTC m=+374.029421055" lastFinishedPulling="2026-05-27 17:49:47.65946028 +0000 UTC m=+377.065434754" observedRunningTime="2026-05-27 17:49:48.441630089 +0000 UTC m=+377.847604569" watchObservedRunningTime="2026-05-27 17:49:48.441805117 +0000 UTC m=+377.847779598" May 27 17:49:53.407411 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:53.407378 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc4cc6548-8nzp7" May 27 17:49:56.442576 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.442546 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b"] May 27 17:49:56.446167 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.446143 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.449561 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.449539 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 17:49:56.449787 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.449769 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 17:49:56.449871 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.449790 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 17:49:56.450205 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.450186 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2hxhc\"" May 27 17:49:56.450307 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.450219 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 17:49:56.460986 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.460964 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b"] May 27 17:49:56.584902 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.584863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4c16c18-1f1a-48be-a0a5-499582b20826-tmp\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.584902 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.584902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4c16c18-1f1a-48be-a0a5-499582b20826-tls-certs\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.585109 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.584992 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4tn\" (UniqueName: \"kubernetes.io/projected/c4c16c18-1f1a-48be-a0a5-499582b20826-kube-api-access-hf4tn\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.685724 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.685682 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4tn\" (UniqueName: \"kubernetes.io/projected/c4c16c18-1f1a-48be-a0a5-499582b20826-kube-api-access-hf4tn\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.685912 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.685803 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4c16c18-1f1a-48be-a0a5-499582b20826-tmp\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.685912 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.685831 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4c16c18-1f1a-48be-a0a5-499582b20826-tls-certs\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.688108 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.688080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4c16c18-1f1a-48be-a0a5-499582b20826-tmp\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.688407 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.688386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4c16c18-1f1a-48be-a0a5-499582b20826-tls-certs\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.701847 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.701788 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4tn\" (UniqueName: \"kubernetes.io/projected/c4c16c18-1f1a-48be-a0a5-499582b20826-kube-api-access-hf4tn\") pod \"kube-auth-proxy-695c6f7b6-2fb5b\" (UID: \"c4c16c18-1f1a-48be-a0a5-499582b20826\") " pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.756616 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.756550 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" May 27 17:49:56.899376 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:56.899342 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b"] May 27 17:49:56.902312 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:49:56.902279 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c16c18_1f1a_48be_a0a5_499582b20826.slice/crio-e46364e5eb973c0fa674e71cd98308d66edcf94e6c12511eacb620ee0353f4ab WatchSource:0}: Error finding container e46364e5eb973c0fa674e71cd98308d66edcf94e6c12511eacb620ee0353f4ab: Status 404 returned error can't find the container with id e46364e5eb973c0fa674e71cd98308d66edcf94e6c12511eacb620ee0353f4ab May 27 17:49:57.452895 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:57.452858 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" event={"ID":"c4c16c18-1f1a-48be-a0a5-499582b20826","Type":"ContainerStarted","Data":"e46364e5eb973c0fa674e71cd98308d66edcf94e6c12511eacb620ee0353f4ab"} May 27 17:49:59.430079 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:49:59.430053 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78df8cc544-8xnrs" May 27 17:50:01.475124 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:50:01.475089 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" event={"ID":"c4c16c18-1f1a-48be-a0a5-499582b20826","Type":"ContainerStarted","Data":"690e77c8a1872a2db3df8f15e734d97e505e62701cca55fe5c2829a18b6a0f07"} May 27 17:50:01.494657 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:50:01.494582 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-695c6f7b6-2fb5b" podStartSLOduration=1.7528518979999999 podStartE2EDuration="5.4945651s" podCreationTimestamp="2026-05-27 17:49:56 +0000 UTC" firstStartedPulling="2026-05-27 17:49:56.903965137 +0000 UTC m=+386.309939595" lastFinishedPulling="2026-05-27 17:50:00.64567832 +0000 UTC m=+390.051652797" observedRunningTime="2026-05-27 17:50:01.493132082 +0000 UTC m=+390.899106563" watchObservedRunningTime="2026-05-27 17:50:01.4945651 +0000 UTC m=+390.900539581" May 27 17:51:38.342496 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.342459 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92"] May 27 17:51:38.346773 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.346748 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.349939 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.349919 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 17:51:38.350159 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.350143 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h2nww\"" May 27 17:51:38.350678 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.350659 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 17:51:38.368635 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.368597 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92"] May 27 17:51:38.458127 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.458092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed6c81b-7219-4cc5-a9de-096481ad55ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.458277 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.458151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bckv\" (UniqueName: \"kubernetes.io/projected/2ed6c81b-7219-4cc5-a9de-096481ad55ea-kube-api-access-7bckv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.559171 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.559135 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed6c81b-7219-4cc5-a9de-096481ad55ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.559338 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.559203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bckv\" (UniqueName: \"kubernetes.io/projected/2ed6c81b-7219-4cc5-a9de-096481ad55ea-kube-api-access-7bckv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.559491 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.559467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed6c81b-7219-4cc5-a9de-096481ad55ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.566837 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.566818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bckv\" (UniqueName: \"kubernetes.io/projected/2ed6c81b-7219-4cc5-a9de-096481ad55ea-kube-api-access-7bckv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.656928 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.656858 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:38.784951 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:38.784916 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92"] May 27 17:51:38.788495 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:51:38.788467 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed6c81b_7219_4cc5_a9de_096481ad55ea.slice/crio-c5242e481feef428b32665b6bbdea49c2395ef7d5fbce4b867e761fc824f9375 WatchSource:0}: Error finding container c5242e481feef428b32665b6bbdea49c2395ef7d5fbce4b867e761fc824f9375: Status 404 returned error can't find the container with id c5242e481feef428b32665b6bbdea49c2395ef7d5fbce4b867e761fc824f9375 May 27 17:51:39.782513 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:39.782475 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" event={"ID":"2ed6c81b-7219-4cc5-a9de-096481ad55ea","Type":"ContainerStarted","Data":"c5242e481feef428b32665b6bbdea49c2395ef7d5fbce4b867e761fc824f9375"} May 27 17:51:44.799923 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:44.799827 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" event={"ID":"2ed6c81b-7219-4cc5-a9de-096481ad55ea","Type":"ContainerStarted","Data":"43c052c74891da89b619e4f012d4e12cebe4966d537058fe93c11b5bd3c05f7e"} May 27 17:51:44.800293 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:44.799980 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:44.820579 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:44.820526 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" podStartSLOduration=1.07129757 podStartE2EDuration="6.820511596s" podCreationTimestamp="2026-05-27 17:51:38 +0000 UTC" firstStartedPulling="2026-05-27 17:51:38.793649105 +0000 UTC m=+488.199623564" lastFinishedPulling="2026-05-27 17:51:44.542863128 +0000 UTC m=+493.948837590" observedRunningTime="2026-05-27 17:51:44.818597739 +0000 UTC m=+494.224572219" watchObservedRunningTime="2026-05-27 17:51:44.820511596 +0000 UTC m=+494.226486077" May 27 17:51:55.805201 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:55.805167 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:57.614507 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.614472 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92"] May 27 17:51:57.614928 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.614692 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" containerName="manager" containerID="cri-o://43c052c74891da89b619e4f012d4e12cebe4966d537058fe93c11b5bd3c05f7e" gracePeriod=2 May 27 17:51:57.619254 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.619226 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92"] May 27 17:51:57.640118 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.640088 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9"] May 27 17:51:57.640486 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.640466 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" containerName="manager" May 27 17:51:57.640486 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.640486 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" containerName="manager" May 27 17:51:57.640677 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.640554 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" containerName="manager" May 27 17:51:57.643781 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.643760 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:57.651817 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.651793 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9"] May 27 17:51:57.670990 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.670953 2566 status_manager.go:895] "Failed to get status for pod" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" May 27 17:51:57.728947 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.728908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tp6s9\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:57.729114 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.729045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbckf\" (UniqueName: \"kubernetes.io/projected/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-kube-api-access-qbckf\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tp6s9\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:57.830316 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.830276 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tp6s9\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:57.830511 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.830379 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbckf\" (UniqueName: \"kubernetes.io/projected/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-kube-api-access-qbckf\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tp6s9\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:57.830837 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.830810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tp6s9\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:57.839350 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.839314 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbckf\" (UniqueName: \"kubernetes.io/projected/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-kube-api-access-qbckf\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tp6s9\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:57.845144 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.845116 2566 generic.go:358] "Generic (PLEG): container finished" podID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" containerID="43c052c74891da89b619e4f012d4e12cebe4966d537058fe93c11b5bd3c05f7e" exitCode=0 May 27 17:51:57.859677 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.859647 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:57.861657 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.861630 2566 status_manager.go:895] "Failed to get status for pod" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" May 27 17:51:57.931008 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.930916 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed6c81b-7219-4cc5-a9de-096481ad55ea-extensions-socket-volume\") pod \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " May 27 17:51:57.931008 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.930980 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bckv\" (UniqueName: \"kubernetes.io/projected/2ed6c81b-7219-4cc5-a9de-096481ad55ea-kube-api-access-7bckv\") pod \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\" (UID: \"2ed6c81b-7219-4cc5-a9de-096481ad55ea\") " May 27 17:51:57.931461 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.931439 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ed6c81b-7219-4cc5-a9de-096481ad55ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2ed6c81b-7219-4cc5-a9de-096481ad55ea" (UID: "2ed6c81b-7219-4cc5-a9de-096481ad55ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:51:57.933201 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.933181 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ed6c81b-7219-4cc5-a9de-096481ad55ea-kube-api-access-7bckv" (OuterVolumeSpecName: "kube-api-access-7bckv") pod "2ed6c81b-7219-4cc5-a9de-096481ad55ea" (UID: "2ed6c81b-7219-4cc5-a9de-096481ad55ea"). InnerVolumeSpecName "kube-api-access-7bckv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:51:57.988438 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:57.988399 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:58.031799 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.031761 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed6c81b-7219-4cc5-a9de-096481ad55ea-extensions-socket-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:51:58.031799 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.031796 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bckv\" (UniqueName: \"kubernetes.io/projected/2ed6c81b-7219-4cc5-a9de-096481ad55ea-kube-api-access-7bckv\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:51:58.120725 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.120689 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9"] May 27 17:51:58.124548 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:51:58.124517 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a5a1ff_8fc8_4a30_9018_f1943e39a6b6.slice/crio-21d7889beab60c74d367a8d763f59ffc09080081978d149654537abd2ab69bc5 WatchSource:0}: Error finding container 21d7889beab60c74d367a8d763f59ffc09080081978d149654537abd2ab69bc5: Status 404 returned error can't find the container with id 21d7889beab60c74d367a8d763f59ffc09080081978d149654537abd2ab69bc5 May 27 17:51:58.849299 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.849265 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" May 27 17:51:58.849299 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.849285 2566 scope.go:117] "RemoveContainer" containerID="43c052c74891da89b619e4f012d4e12cebe4966d537058fe93c11b5bd3c05f7e" May 27 17:51:58.850908 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.850882 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" event={"ID":"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6","Type":"ContainerStarted","Data":"6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e"} May 27 17:51:58.851018 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.850919 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" event={"ID":"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6","Type":"ContainerStarted","Data":"21d7889beab60c74d367a8d763f59ffc09080081978d149654537abd2ab69bc5"} May 27 17:51:58.851069 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.851021 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:51:58.851344 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.851317 2566 status_manager.go:895] "Failed to get status for pod" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" May 27 17:51:58.853007 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.852979 2566 status_manager.go:895] "Failed to get status for pod" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" May 27 17:51:58.876081 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.876058 2566 status_manager.go:895] "Failed to get status for pod" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bhb92" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bhb92\" is forbidden: User \"system:node:ip-10-0-141-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-245.ec2.internal' and this object" May 27 17:51:58.876283 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:58.876250 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" podStartSLOduration=1.876238795 podStartE2EDuration="1.876238795s" podCreationTimestamp="2026-05-27 17:51:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:51:58.874470664 +0000 UTC m=+508.280445145" watchObservedRunningTime="2026-05-27 17:51:58.876238795 +0000 UTC m=+508.282213335" May 27 17:51:59.187903 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:51:59.187823 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed6c81b-7219-4cc5-a9de-096481ad55ea" path="/var/lib/kubelet/pods/2ed6c81b-7219-4cc5-a9de-096481ad55ea/volumes" May 27 17:52:09.857692 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:09.857659 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:52:28.180721 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.180643 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9"] May 27 17:52:28.181065 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.180887 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" podUID="13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" containerName="manager" containerID="cri-o://6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e" gracePeriod=10 May 27 17:52:28.426031 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.426004 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58"] May 27 17:52:28.427420 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.427399 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:52:28.428313 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.428297 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.444507 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.444479 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58"] May 27 17:52:28.588010 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.587980 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbckf\" (UniqueName: \"kubernetes.io/projected/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-kube-api-access-qbckf\") pod \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " May 27 17:52:28.588181 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.588036 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-extensions-socket-volume\") pod \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\" (UID: \"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6\") " May 27 17:52:28.588181 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.588163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjsv8\" (UniqueName: \"kubernetes.io/projected/423b335b-c458-49db-a849-4786e2c7a245-kube-api-access-vjsv8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tn58\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.588310 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.588186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423b335b-c458-49db-a849-4786e2c7a245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tn58\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.588477 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.588454 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" (UID: "13a5a1ff-8fc8-4a30-9018-f1943e39a6b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 17:52:28.590195 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.590175 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-kube-api-access-qbckf" (OuterVolumeSpecName: "kube-api-access-qbckf") pod "13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" (UID: "13a5a1ff-8fc8-4a30-9018-f1943e39a6b6"). InnerVolumeSpecName "kube-api-access-qbckf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:52:28.689134 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.689065 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjsv8\" (UniqueName: \"kubernetes.io/projected/423b335b-c458-49db-a849-4786e2c7a245-kube-api-access-vjsv8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tn58\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.689134 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.689097 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423b335b-c458-49db-a849-4786e2c7a245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tn58\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.689134 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.689133 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbckf\" (UniqueName: \"kubernetes.io/projected/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-kube-api-access-qbckf\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:52:28.689364 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.689148 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6-extensions-socket-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:52:28.689437 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.689422 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423b335b-c458-49db-a849-4786e2c7a245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tn58\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.696866 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.696843 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjsv8\" (UniqueName: \"kubernetes.io/projected/423b335b-c458-49db-a849-4786e2c7a245-kube-api-access-vjsv8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tn58\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.738362 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.738336 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.861502 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.861452 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58"] May 27 17:52:28.863819 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:52:28.863790 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423b335b_c458_49db_a849_4786e2c7a245.slice/crio-21c2628ddcbb3b6cb8a092d9588ebc0189e90bc25b335ae0cff8c92ec5d00527 WatchSource:0}: Error finding container 21c2628ddcbb3b6cb8a092d9588ebc0189e90bc25b335ae0cff8c92ec5d00527: Status 404 returned error can't find the container with id 21c2628ddcbb3b6cb8a092d9588ebc0189e90bc25b335ae0cff8c92ec5d00527 May 27 17:52:28.944636 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.944555 2566 generic.go:358] "Generic (PLEG): container finished" podID="13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" containerID="6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e" exitCode=0 May 27 17:52:28.944636 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.944630 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" May 27 17:52:28.944808 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.944641 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" event={"ID":"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6","Type":"ContainerDied","Data":"6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e"} May 27 17:52:28.944808 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.944671 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9" event={"ID":"13a5a1ff-8fc8-4a30-9018-f1943e39a6b6","Type":"ContainerDied","Data":"21d7889beab60c74d367a8d763f59ffc09080081978d149654537abd2ab69bc5"} May 27 17:52:28.944808 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.944687 2566 scope.go:117] "RemoveContainer" containerID="6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e" May 27 17:52:28.946221 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.946199 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" event={"ID":"423b335b-c458-49db-a849-4786e2c7a245","Type":"ContainerStarted","Data":"f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c"} May 27 17:52:28.946315 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.946225 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" event={"ID":"423b335b-c458-49db-a849-4786e2c7a245","Type":"ContainerStarted","Data":"21c2628ddcbb3b6cb8a092d9588ebc0189e90bc25b335ae0cff8c92ec5d00527"} May 27 17:52:28.946389 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.946315 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:28.952257 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.952104 2566 scope.go:117] "RemoveContainer" containerID="6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e" May 27 17:52:28.952536 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:52:28.952513 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e\": container with ID starting with 6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e not found: ID does not exist" containerID="6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e" May 27 17:52:28.952624 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.952547 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e"} err="failed to get container status \"6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e\": rpc error: code = NotFound desc = could not find container \"6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e\": container with ID starting with 6a59c5f33a66481303e624b03c63db95eff6a426caacd5b656f877bb34d82c7e not found: ID does not exist" May 27 17:52:28.966211 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.966162 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" podStartSLOduration=0.966147536 podStartE2EDuration="966.147536ms" podCreationTimestamp="2026-05-27 17:52:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:52:28.964705648 +0000 UTC m=+538.370680153" watchObservedRunningTime="2026-05-27 17:52:28.966147536 +0000 UTC m=+538.372122018" May 27 17:52:28.983583 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.983559 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9"] May 27 17:52:28.990071 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:28.990050 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tp6s9"] May 27 17:52:29.182565 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:29.182530 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" path="/var/lib/kubelet/pods/13a5a1ff-8fc8-4a30-9018-f1943e39a6b6/volumes" May 27 17:52:39.952731 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:39.952699 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 17:52:49.404215 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.404179 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-l9hzk"] May 27 17:52:49.404651 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.404541 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" containerName="manager" May 27 17:52:49.404651 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.404552 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" containerName="manager" May 27 17:52:49.404651 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.404596 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="13a5a1ff-8fc8-4a30-9018-f1943e39a6b6" containerName="manager" May 27 17:52:49.407421 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.407405 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" May 27 17:52:49.409412 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.409381 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pxfd4\"" May 27 17:52:49.415146 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.415123 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-l9hzk"] May 27 17:52:49.459079 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.459046 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szcz4\" (UniqueName: \"kubernetes.io/projected/c25d8b63-2fbf-4890-b86d-318c2156311d-kube-api-access-szcz4\") pod \"authorino-f99f4b5cd-l9hzk\" (UID: \"c25d8b63-2fbf-4890-b86d-318c2156311d\") " pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" May 27 17:52:49.559753 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.559712 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szcz4\" (UniqueName: \"kubernetes.io/projected/c25d8b63-2fbf-4890-b86d-318c2156311d-kube-api-access-szcz4\") pod \"authorino-f99f4b5cd-l9hzk\" (UID: \"c25d8b63-2fbf-4890-b86d-318c2156311d\") " pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" May 27 17:52:49.567217 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.567188 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szcz4\" (UniqueName: \"kubernetes.io/projected/c25d8b63-2fbf-4890-b86d-318c2156311d-kube-api-access-szcz4\") pod \"authorino-f99f4b5cd-l9hzk\" (UID: \"c25d8b63-2fbf-4890-b86d-318c2156311d\") " pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" May 27 17:52:49.611436 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.611402 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-wf9zm"] May 27 17:52:49.614767 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.614750 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wf9zm" May 27 17:52:49.622538 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.622513 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wf9zm"] May 27 17:52:49.661126 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.661059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klbtb\" (UniqueName: \"kubernetes.io/projected/f7c70e7c-9004-4055-b36f-0d78e9dda545-kube-api-access-klbtb\") pod \"authorino-7498df8756-wf9zm\" (UID: \"f7c70e7c-9004-4055-b36f-0d78e9dda545\") " pod="kuadrant-system/authorino-7498df8756-wf9zm" May 27 17:52:49.729407 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.729380 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" May 27 17:52:49.762493 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.762462 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klbtb\" (UniqueName: \"kubernetes.io/projected/f7c70e7c-9004-4055-b36f-0d78e9dda545-kube-api-access-klbtb\") pod \"authorino-7498df8756-wf9zm\" (UID: \"f7c70e7c-9004-4055-b36f-0d78e9dda545\") " pod="kuadrant-system/authorino-7498df8756-wf9zm" May 27 17:52:49.770719 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.770698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klbtb\" (UniqueName: \"kubernetes.io/projected/f7c70e7c-9004-4055-b36f-0d78e9dda545-kube-api-access-klbtb\") pod \"authorino-7498df8756-wf9zm\" (UID: \"f7c70e7c-9004-4055-b36f-0d78e9dda545\") " pod="kuadrant-system/authorino-7498df8756-wf9zm" May 27 17:52:49.852479 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.852455 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-l9hzk"] May 27 17:52:49.855088 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:52:49.855057 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc25d8b63_2fbf_4890_b86d_318c2156311d.slice/crio-f77d17cc8828f3b27d9b0d7b62e34cb8b540ea0e0ecf38b592c2f8a49634a30d WatchSource:0}: Error finding container f77d17cc8828f3b27d9b0d7b62e34cb8b540ea0e0ecf38b592c2f8a49634a30d: Status 404 returned error can't find the container with id f77d17cc8828f3b27d9b0d7b62e34cb8b540ea0e0ecf38b592c2f8a49634a30d May 27 17:52:49.924566 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:49.924507 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wf9zm" May 27 17:52:50.021873 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:50.021839 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" event={"ID":"c25d8b63-2fbf-4890-b86d-318c2156311d","Type":"ContainerStarted","Data":"f77d17cc8828f3b27d9b0d7b62e34cb8b540ea0e0ecf38b592c2f8a49634a30d"} May 27 17:52:50.043727 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:50.043696 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wf9zm"] May 27 17:52:50.046772 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:52:50.046745 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7c70e7c_9004_4055_b36f_0d78e9dda545.slice/crio-f6c3b08d7dfb2012d85e7f4c4b0119002233a8122a5862f7a2d183df999c63bf WatchSource:0}: Error finding container f6c3b08d7dfb2012d85e7f4c4b0119002233a8122a5862f7a2d183df999c63bf: Status 404 returned error can't find the container with id f6c3b08d7dfb2012d85e7f4c4b0119002233a8122a5862f7a2d183df999c63bf May 27 17:52:51.033744 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:51.033672 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wf9zm" event={"ID":"f7c70e7c-9004-4055-b36f-0d78e9dda545","Type":"ContainerStarted","Data":"f6c3b08d7dfb2012d85e7f4c4b0119002233a8122a5862f7a2d183df999c63bf"} May 27 17:52:54.045849 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:54.045814 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wf9zm" event={"ID":"f7c70e7c-9004-4055-b36f-0d78e9dda545","Type":"ContainerStarted","Data":"d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16"} May 27 17:52:54.047150 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:54.047124 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" event={"ID":"c25d8b63-2fbf-4890-b86d-318c2156311d","Type":"ContainerStarted","Data":"34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0"} May 27 17:52:54.063334 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:54.063293 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-wf9zm" podStartSLOduration=1.66284315 podStartE2EDuration="5.063280402s" podCreationTimestamp="2026-05-27 17:52:49 +0000 UTC" firstStartedPulling="2026-05-27 17:52:50.048015491 +0000 UTC m=+559.453989949" lastFinishedPulling="2026-05-27 17:52:53.448452735 +0000 UTC m=+562.854427201" observedRunningTime="2026-05-27 17:52:54.061756392 +0000 UTC m=+563.467730876" watchObservedRunningTime="2026-05-27 17:52:54.063280402 +0000 UTC m=+563.469254883" May 27 17:52:54.079803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:54.079764 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" podStartSLOduration=1.477646735 podStartE2EDuration="5.079750672s" podCreationTimestamp="2026-05-27 17:52:49 +0000 UTC" firstStartedPulling="2026-05-27 17:52:49.856688621 +0000 UTC m=+559.262663080" lastFinishedPulling="2026-05-27 17:52:53.458792558 +0000 UTC m=+562.864767017" observedRunningTime="2026-05-27 17:52:54.078018412 +0000 UTC m=+563.483992894" watchObservedRunningTime="2026-05-27 17:52:54.079750672 +0000 UTC m=+563.485725152" May 27 17:52:54.126154 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:54.126123 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-l9hzk"] May 27 17:52:56.054257 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:56.054213 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" podUID="c25d8b63-2fbf-4890-b86d-318c2156311d" containerName="authorino" containerID="cri-o://34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0" gracePeriod=30 May 27 17:52:56.300216 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:56.300190 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" May 27 17:52:56.425578 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:56.425542 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szcz4\" (UniqueName: \"kubernetes.io/projected/c25d8b63-2fbf-4890-b86d-318c2156311d-kube-api-access-szcz4\") pod \"c25d8b63-2fbf-4890-b86d-318c2156311d\" (UID: \"c25d8b63-2fbf-4890-b86d-318c2156311d\") " May 27 17:52:56.427561 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:56.427536 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c25d8b63-2fbf-4890-b86d-318c2156311d-kube-api-access-szcz4" (OuterVolumeSpecName: "kube-api-access-szcz4") pod "c25d8b63-2fbf-4890-b86d-318c2156311d" (UID: "c25d8b63-2fbf-4890-b86d-318c2156311d"). InnerVolumeSpecName "kube-api-access-szcz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:52:56.526913 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:56.526879 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szcz4\" (UniqueName: \"kubernetes.io/projected/c25d8b63-2fbf-4890-b86d-318c2156311d-kube-api-access-szcz4\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:52:57.058445 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.058407 2566 generic.go:358] "Generic (PLEG): container finished" podID="c25d8b63-2fbf-4890-b86d-318c2156311d" containerID="34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0" exitCode=0 May 27 17:52:57.058924 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.058460 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" May 27 17:52:57.058924 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.058492 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" event={"ID":"c25d8b63-2fbf-4890-b86d-318c2156311d","Type":"ContainerDied","Data":"34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0"} May 27 17:52:57.058924 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.058537 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-l9hzk" event={"ID":"c25d8b63-2fbf-4890-b86d-318c2156311d","Type":"ContainerDied","Data":"f77d17cc8828f3b27d9b0d7b62e34cb8b540ea0e0ecf38b592c2f8a49634a30d"} May 27 17:52:57.058924 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.058557 2566 scope.go:117] "RemoveContainer" containerID="34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0" May 27 17:52:57.066776 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.066757 2566 scope.go:117] "RemoveContainer" containerID="34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0" May 27 17:52:57.067018 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:52:57.067002 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0\": container with ID starting with 34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0 not found: ID does not exist" containerID="34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0" May 27 17:52:57.067055 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.067027 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0"} err="failed to get container status \"34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0\": rpc error: code = NotFound desc = could not find container \"34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0\": container with ID starting with 34808a66f411ed9365f3c2129c0c90021a2dc1bc546a65b8e5713a08696274f0 not found: ID does not exist" May 27 17:52:57.078824 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.078795 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-l9hzk"] May 27 17:52:57.082998 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.082974 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-l9hzk"] May 27 17:52:57.183960 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:52:57.183930 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c25d8b63-2fbf-4890-b86d-318c2156311d" path="/var/lib/kubelet/pods/c25d8b63-2fbf-4890-b86d-318c2156311d/volumes" May 27 17:53:16.512790 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.512756 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mx9cv"] May 27 17:53:16.513238 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.513060 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c25d8b63-2fbf-4890-b86d-318c2156311d" containerName="authorino" May 27 17:53:16.513238 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.513071 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c25d8b63-2fbf-4890-b86d-318c2156311d" containerName="authorino" May 27 17:53:16.513238 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.513137 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="c25d8b63-2fbf-4890-b86d-318c2156311d" containerName="authorino" May 27 17:53:16.515803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.515786 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mx9cv" May 27 17:53:16.522145 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.522119 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mx9cv"] May 27 17:53:16.601642 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.601588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8kdg\" (UniqueName: \"kubernetes.io/projected/bfbcd6c7-6844-422e-9bf8-3fcee311ace8-kube-api-access-v8kdg\") pod \"authorino-8b475cf9f-mx9cv\" (UID: \"bfbcd6c7-6844-422e-9bf8-3fcee311ace8\") " pod="kuadrant-system/authorino-8b475cf9f-mx9cv" May 27 17:53:16.695764 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.695733 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mx9cv"] May 27 17:53:16.696000 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:53:16.695963 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-v8kdg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-mx9cv" podUID="bfbcd6c7-6844-422e-9bf8-3fcee311ace8" May 27 17:53:16.702382 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.702349 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8kdg\" (UniqueName: \"kubernetes.io/projected/bfbcd6c7-6844-422e-9bf8-3fcee311ace8-kube-api-access-v8kdg\") pod \"authorino-8b475cf9f-mx9cv\" (UID: \"bfbcd6c7-6844-422e-9bf8-3fcee311ace8\") " pod="kuadrant-system/authorino-8b475cf9f-mx9cv" May 27 17:53:16.715121 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.715095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8kdg\" (UniqueName: \"kubernetes.io/projected/bfbcd6c7-6844-422e-9bf8-3fcee311ace8-kube-api-access-v8kdg\") pod \"authorino-8b475cf9f-mx9cv\" (UID: \"bfbcd6c7-6844-422e-9bf8-3fcee311ace8\") " pod="kuadrant-system/authorino-8b475cf9f-mx9cv" May 27 17:53:16.721775 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.721750 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-lbxsw"] May 27 17:53:16.725023 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.725007 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:16.727742 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.727726 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 27 17:53:16.737170 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.737150 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-lbxsw"] May 27 17:53:16.774148 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.774094 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-lbxsw"] May 27 17:53:16.774328 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:53:16.774310 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7f4ll tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-7f4ll tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-lbxsw" podUID="8b7c488e-cf2b-4609-82a4-eeb34e9944c7" May 27 17:53:16.806753 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.806728 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54c8776977-6wwqw"] May 27 17:53:16.809938 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.809923 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:16.816753 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.816730 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c8776977-6wwqw"] May 27 17:53:16.903969 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.903937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c355166-eee3-4f2c-b90c-f0905192ac1f-tls-cert\") pod \"authorino-54c8776977-6wwqw\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:16.904109 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.903983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-tls-cert\") pod \"authorino-56fdd757f5-lbxsw\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:16.904109 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.904006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f4ll\" (UniqueName: \"kubernetes.io/projected/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-kube-api-access-7f4ll\") pod \"authorino-56fdd757f5-lbxsw\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:16.904109 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:16.904086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkl8k\" (UniqueName: \"kubernetes.io/projected/4c355166-eee3-4f2c-b90c-f0905192ac1f-kube-api-access-xkl8k\") pod \"authorino-54c8776977-6wwqw\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:17.005279 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.005237 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkl8k\" (UniqueName: \"kubernetes.io/projected/4c355166-eee3-4f2c-b90c-f0905192ac1f-kube-api-access-xkl8k\") pod \"authorino-54c8776977-6wwqw\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:17.005459 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.005359 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c355166-eee3-4f2c-b90c-f0905192ac1f-tls-cert\") pod \"authorino-54c8776977-6wwqw\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:17.005459 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.005410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-tls-cert\") pod \"authorino-56fdd757f5-lbxsw\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:17.005572 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.005526 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7f4ll\" (UniqueName: \"kubernetes.io/projected/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-kube-api-access-7f4ll\") pod \"authorino-56fdd757f5-lbxsw\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:17.007885 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.007864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-tls-cert\") pod \"authorino-56fdd757f5-lbxsw\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:17.007991 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.007890 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c355166-eee3-4f2c-b90c-f0905192ac1f-tls-cert\") pod \"authorino-54c8776977-6wwqw\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:17.013924 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.013896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkl8k\" (UniqueName: \"kubernetes.io/projected/4c355166-eee3-4f2c-b90c-f0905192ac1f-kube-api-access-xkl8k\") pod \"authorino-54c8776977-6wwqw\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:17.013924 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.013911 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f4ll\" (UniqueName: \"kubernetes.io/projected/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-kube-api-access-7f4ll\") pod \"authorino-56fdd757f5-lbxsw\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:17.119900 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.119870 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:53:17.133003 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.132978 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mx9cv" May 27 17:53:17.133102 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.132978 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:17.143905 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.143884 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mx9cv" May 27 17:53:17.147350 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.147331 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:17.249573 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.249554 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c8776977-6wwqw"] May 27 17:53:17.251815 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:53:17.251789 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c355166_eee3_4f2c_b90c_f0905192ac1f.slice/crio-cc8cbffdcbe41640e7eaa91f9d4d79adb01d212366d4e37375ecd14d795098dc WatchSource:0}: Error finding container cc8cbffdcbe41640e7eaa91f9d4d79adb01d212366d4e37375ecd14d795098dc: Status 404 returned error can't find the container with id cc8cbffdcbe41640e7eaa91f9d4d79adb01d212366d4e37375ecd14d795098dc May 27 17:53:17.308463 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.308442 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-tls-cert\") pod \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " May 27 17:53:17.308580 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.308474 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f4ll\" (UniqueName: \"kubernetes.io/projected/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-kube-api-access-7f4ll\") pod \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\" (UID: \"8b7c488e-cf2b-4609-82a4-eeb34e9944c7\") " May 27 17:53:17.308580 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.308510 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8kdg\" (UniqueName: \"kubernetes.io/projected/bfbcd6c7-6844-422e-9bf8-3fcee311ace8-kube-api-access-v8kdg\") pod \"bfbcd6c7-6844-422e-9bf8-3fcee311ace8\" (UID: \"bfbcd6c7-6844-422e-9bf8-3fcee311ace8\") " May 27 17:53:17.310486 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.310455 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbcd6c7-6844-422e-9bf8-3fcee311ace8-kube-api-access-v8kdg" (OuterVolumeSpecName: "kube-api-access-v8kdg") pod "bfbcd6c7-6844-422e-9bf8-3fcee311ace8" (UID: "bfbcd6c7-6844-422e-9bf8-3fcee311ace8"). InnerVolumeSpecName "kube-api-access-v8kdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:53:17.310572 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.310497 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8b7c488e-cf2b-4609-82a4-eeb34e9944c7" (UID: "8b7c488e-cf2b-4609-82a4-eeb34e9944c7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:53:17.310572 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.310497 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-kube-api-access-7f4ll" (OuterVolumeSpecName: "kube-api-access-7f4ll") pod "8b7c488e-cf2b-4609-82a4-eeb34e9944c7" (UID: "8b7c488e-cf2b-4609-82a4-eeb34e9944c7"). InnerVolumeSpecName "kube-api-access-7f4ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:53:17.409895 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.409818 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8kdg\" (UniqueName: \"kubernetes.io/projected/bfbcd6c7-6844-422e-9bf8-3fcee311ace8-kube-api-access-v8kdg\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:53:17.409895 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.409851 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-tls-cert\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:53:17.409895 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:17.409867 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f4ll\" (UniqueName: \"kubernetes.io/projected/8b7c488e-cf2b-4609-82a4-eeb34e9944c7-kube-api-access-7f4ll\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:53:18.137533 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.137497 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8776977-6wwqw" event={"ID":"4c355166-eee3-4f2c-b90c-f0905192ac1f","Type":"ContainerStarted","Data":"11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b"} May 27 17:53:18.137533 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.137522 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-lbxsw" May 27 17:53:18.137533 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.137531 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mx9cv" May 27 17:53:18.137533 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.137538 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8776977-6wwqw" event={"ID":"4c355166-eee3-4f2c-b90c-f0905192ac1f","Type":"ContainerStarted","Data":"cc8cbffdcbe41640e7eaa91f9d4d79adb01d212366d4e37375ecd14d795098dc"} May 27 17:53:18.169204 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.169157 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-54c8776977-6wwqw" podStartSLOduration=1.863101591 podStartE2EDuration="2.169144347s" podCreationTimestamp="2026-05-27 17:53:16 +0000 UTC" firstStartedPulling="2026-05-27 17:53:17.253034991 +0000 UTC m=+586.659009450" lastFinishedPulling="2026-05-27 17:53:17.559077745 +0000 UTC m=+586.965052206" observedRunningTime="2026-05-27 17:53:18.168920413 +0000 UTC m=+587.574894896" watchObservedRunningTime="2026-05-27 17:53:18.169144347 +0000 UTC m=+587.575118826" May 27 17:53:18.193767 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.193737 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-lbxsw"] May 27 17:53:18.201229 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.201205 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wf9zm"] May 27 17:53:18.201482 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.201451 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-wf9zm" podUID="f7c70e7c-9004-4055-b36f-0d78e9dda545" containerName="authorino" containerID="cri-o://d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16" gracePeriod=30 May 27 17:53:18.203645 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.203623 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-lbxsw"] May 27 17:53:18.243120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.243084 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mx9cv"] May 27 17:53:18.246983 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.246956 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mx9cv"] May 27 17:53:18.447450 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.447425 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wf9zm" May 27 17:53:18.620857 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.620827 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klbtb\" (UniqueName: \"kubernetes.io/projected/f7c70e7c-9004-4055-b36f-0d78e9dda545-kube-api-access-klbtb\") pod \"f7c70e7c-9004-4055-b36f-0d78e9dda545\" (UID: \"f7c70e7c-9004-4055-b36f-0d78e9dda545\") " May 27 17:53:18.622869 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.622843 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c70e7c-9004-4055-b36f-0d78e9dda545-kube-api-access-klbtb" (OuterVolumeSpecName: "kube-api-access-klbtb") pod "f7c70e7c-9004-4055-b36f-0d78e9dda545" (UID: "f7c70e7c-9004-4055-b36f-0d78e9dda545"). InnerVolumeSpecName "kube-api-access-klbtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:53:18.721450 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:18.721368 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klbtb\" (UniqueName: \"kubernetes.io/projected/f7c70e7c-9004-4055-b36f-0d78e9dda545-kube-api-access-klbtb\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:53:19.141361 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.141325 2566 generic.go:358] "Generic (PLEG): container finished" podID="f7c70e7c-9004-4055-b36f-0d78e9dda545" containerID="d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16" exitCode=0 May 27 17:53:19.141810 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.141367 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wf9zm" May 27 17:53:19.141810 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.141397 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wf9zm" event={"ID":"f7c70e7c-9004-4055-b36f-0d78e9dda545","Type":"ContainerDied","Data":"d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16"} May 27 17:53:19.141810 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.141423 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wf9zm" event={"ID":"f7c70e7c-9004-4055-b36f-0d78e9dda545","Type":"ContainerDied","Data":"f6c3b08d7dfb2012d85e7f4c4b0119002233a8122a5862f7a2d183df999c63bf"} May 27 17:53:19.141810 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.141438 2566 scope.go:117] "RemoveContainer" containerID="d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16" May 27 17:53:19.149312 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.149293 2566 scope.go:117] "RemoveContainer" containerID="d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16" May 27 17:53:19.149559 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:53:19.149542 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16\": container with ID starting with d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16 not found: ID does not exist" containerID="d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16" May 27 17:53:19.149827 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.149567 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16"} err="failed to get container status \"d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16\": rpc error: code = NotFound desc = could not find container \"d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16\": container with ID starting with d7cc8a3b5fecdb724d9e3782d2140cba7d80ef5a61020f6a8600b41c8dae9c16 not found: ID does not exist" May 27 17:53:19.159970 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.159948 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wf9zm"] May 27 17:53:19.163877 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.163857 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-wf9zm"] May 27 17:53:19.188464 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.188429 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b7c488e-cf2b-4609-82a4-eeb34e9944c7" path="/var/lib/kubelet/pods/8b7c488e-cf2b-4609-82a4-eeb34e9944c7/volumes" May 27 17:53:19.188814 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.188801 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfbcd6c7-6844-422e-9bf8-3fcee311ace8" path="/var/lib/kubelet/pods/bfbcd6c7-6844-422e-9bf8-3fcee311ace8/volumes" May 27 17:53:19.189053 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:19.189039 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7c70e7c-9004-4055-b36f-0d78e9dda545" path="/var/lib/kubelet/pods/f7c70e7c-9004-4055-b36f-0d78e9dda545/volumes" May 27 17:53:31.118772 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:31.118740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:53:31.120351 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:53:31.120329 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:54:19.011125 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.011074 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h"] May 27 17:54:19.011568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.011427 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c70e7c-9004-4055-b36f-0d78e9dda545" containerName="authorino" May 27 17:54:19.011568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.011438 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c70e7c-9004-4055-b36f-0d78e9dda545" containerName="authorino" May 27 17:54:19.011568 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.011499 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7c70e7c-9004-4055-b36f-0d78e9dda545" containerName="authorino" May 27 17:54:19.014517 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.014500 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.017165 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.017145 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 17:54:19.017767 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.017749 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8lks5\"" May 27 17:54:19.017767 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.017759 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 17:54:19.017887 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.017755 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 27 17:54:19.027972 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.027941 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h"] May 27 17:54:19.035038 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.035011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.035185 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.035062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9d5q\" (UniqueName: \"kubernetes.io/projected/931418c2-16a2-43a8-a922-8ff007d603cb-kube-api-access-r9d5q\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.035185 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.035109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.035185 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.035134 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.035185 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.035181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.035403 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.035255 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931418c2-16a2-43a8-a922-8ff007d603cb-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.136405 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.136364 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931418c2-16a2-43a8-a922-8ff007d603cb-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.136591 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.136417 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.136591 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.136471 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9d5q\" (UniqueName: \"kubernetes.io/projected/931418c2-16a2-43a8-a922-8ff007d603cb-kube-api-access-r9d5q\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.136591 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.136500 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.136591 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.136528 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.136824 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.136593 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.137005 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.136985 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.137076 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.137028 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.137127 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.137065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.138832 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.138813 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931418c2-16a2-43a8-a922-8ff007d603cb-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.139120 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.139103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931418c2-16a2-43a8-a922-8ff007d603cb-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.145728 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.145708 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9d5q\" (UniqueName: \"kubernetes.io/projected/931418c2-16a2-43a8-a922-8ff007d603cb-kube-api-access-r9d5q\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h\" (UID: \"931418c2-16a2-43a8-a922-8ff007d603cb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.324806 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.324773 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:19.459822 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:19.459796 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h"] May 27 17:54:19.461650 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:54:19.461622 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931418c2_16a2_43a8_a922_8ff007d603cb.slice/crio-5b8e5a6bafbfffffc15ea76b06e5b9c43486bdb24a972355a1286828d32b7882 WatchSource:0}: Error finding container 5b8e5a6bafbfffffc15ea76b06e5b9c43486bdb24a972355a1286828d32b7882: Status 404 returned error can't find the container with id 5b8e5a6bafbfffffc15ea76b06e5b9c43486bdb24a972355a1286828d32b7882 May 27 17:54:20.343347 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:20.343309 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" event={"ID":"931418c2-16a2-43a8-a922-8ff007d603cb","Type":"ContainerStarted","Data":"5b8e5a6bafbfffffc15ea76b06e5b9c43486bdb24a972355a1286828d32b7882"} May 27 17:54:26.367899 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:26.367858 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" event={"ID":"931418c2-16a2-43a8-a922-8ff007d603cb","Type":"ContainerStarted","Data":"dcf5e675cdf0f56633a1507ec2842a10b98e5b8469cb36a1c205926966d8c761"} May 27 17:54:32.393051 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:32.393014 2566 generic.go:358] "Generic (PLEG): container finished" podID="931418c2-16a2-43a8-a922-8ff007d603cb" containerID="dcf5e675cdf0f56633a1507ec2842a10b98e5b8469cb36a1c205926966d8c761" exitCode=0 May 27 17:54:32.393413 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:32.393086 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" event={"ID":"931418c2-16a2-43a8-a922-8ff007d603cb","Type":"ContainerDied","Data":"dcf5e675cdf0f56633a1507ec2842a10b98e5b8469cb36a1c205926966d8c761"} May 27 17:54:34.401544 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:34.401509 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" event={"ID":"931418c2-16a2-43a8-a922-8ff007d603cb","Type":"ContainerStarted","Data":"4219819be1aaf8e4cbf062a14672e0d32d0a14b64c9746955e0bebd798b8c65a"} May 27 17:54:34.401943 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:34.401750 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:34.424921 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:34.424869 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" podStartSLOduration=2.3634364359999998 podStartE2EDuration="16.424853607s" podCreationTimestamp="2026-05-27 17:54:18 +0000 UTC" firstStartedPulling="2026-05-27 17:54:19.465886803 +0000 UTC m=+648.871861262" lastFinishedPulling="2026-05-27 17:54:33.527303974 +0000 UTC m=+662.933278433" observedRunningTime="2026-05-27 17:54:34.423788527 +0000 UTC m=+663.829763008" watchObservedRunningTime="2026-05-27 17:54:34.424853607 +0000 UTC m=+663.830828089" May 27 17:54:41.373456 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.373419 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc"] May 27 17:54:41.377207 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.377188 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.379406 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.379386 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 27 17:54:41.387367 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.387344 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc"] May 27 17:54:41.544734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.544699 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.544908 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.544780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.544908 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.544803 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.544908 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.544820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh8gw\" (UniqueName: \"kubernetes.io/projected/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-kube-api-access-sh8gw\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.544908 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.544840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.544908 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.544898 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646248 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646138 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646248 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646231 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646484 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646252 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646484 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646268 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8gw\" (UniqueName: \"kubernetes.io/projected/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-kube-api-access-sh8gw\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646484 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646291 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646484 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646312 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646728 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646728 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.646826 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.646772 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.648579 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.648551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.648744 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.648726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.654305 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.654285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh8gw\" (UniqueName: \"kubernetes.io/projected/a4f2ffb1-c7c5-4e55-9855-66376445ddeb-kube-api-access-sh8gw\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc\" (UID: \"a4f2ffb1-c7c5-4e55-9855-66376445ddeb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.686371 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.686332 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:41.825253 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:54:41.825215 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f2ffb1_c7c5_4e55_9855_66376445ddeb.slice/crio-6752da95fd37c095c9624317c549a1edc4f1b70c6bfe964306b41e64bb28c0ed WatchSource:0}: Error finding container 6752da95fd37c095c9624317c549a1edc4f1b70c6bfe964306b41e64bb28c0ed: Status 404 returned error can't find the container with id 6752da95fd37c095c9624317c549a1edc4f1b70c6bfe964306b41e64bb28c0ed May 27 17:54:41.826931 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.826912 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 17:54:41.828797 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:41.828777 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc"] May 27 17:54:42.429309 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:42.429262 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" event={"ID":"a4f2ffb1-c7c5-4e55-9855-66376445ddeb","Type":"ContainerStarted","Data":"3069c99aba3be60a960428667b079bd7e5576cd81e419ccc7ff3bfafc1e9a63d"} May 27 17:54:42.429309 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:42.429311 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" event={"ID":"a4f2ffb1-c7c5-4e55-9855-66376445ddeb","Type":"ContainerStarted","Data":"6752da95fd37c095c9624317c549a1edc4f1b70c6bfe964306b41e64bb28c0ed"} May 27 17:54:45.417707 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:45.417674 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h" May 27 17:54:50.461194 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:50.461157 2566 generic.go:358] "Generic (PLEG): container finished" podID="a4f2ffb1-c7c5-4e55-9855-66376445ddeb" containerID="3069c99aba3be60a960428667b079bd7e5576cd81e419ccc7ff3bfafc1e9a63d" exitCode=0 May 27 17:54:50.461623 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:50.461198 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" event={"ID":"a4f2ffb1-c7c5-4e55-9855-66376445ddeb","Type":"ContainerDied","Data":"3069c99aba3be60a960428667b079bd7e5576cd81e419ccc7ff3bfafc1e9a63d"} May 27 17:54:51.466159 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:51.466125 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" event={"ID":"a4f2ffb1-c7c5-4e55-9855-66376445ddeb","Type":"ContainerStarted","Data":"0791a36f833ab1429dd96085cb94c376618860eb4f254e4ae37240afc3941c00"} May 27 17:54:51.466554 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:51.466327 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:54:51.487871 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:54:51.487827 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" podStartSLOduration=10.295401718 podStartE2EDuration="10.487813624s" podCreationTimestamp="2026-05-27 17:54:41 +0000 UTC" firstStartedPulling="2026-05-27 17:54:50.461809836 +0000 UTC m=+679.867784295" lastFinishedPulling="2026-05-27 17:54:50.654221738 +0000 UTC m=+680.060196201" observedRunningTime="2026-05-27 17:54:51.486488042 +0000 UTC m=+680.892462523" watchObservedRunningTime="2026-05-27 17:54:51.487813624 +0000 UTC m=+680.893788104" May 27 17:55:02.482256 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:02.482225 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc" May 27 17:55:40.174661 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.174567 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v"] May 27 17:55:40.177169 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.177154 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.179466 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.179446 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 27 17:55:40.188856 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.188830 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v"] May 27 17:55:40.266156 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.266121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.266314 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.266179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2lcb\" (UniqueName: \"kubernetes.io/projected/bb1e5d6f-4312-4096-879b-cb3584ac2f76-kube-api-access-l2lcb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.266314 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.266225 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.266392 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.266305 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.266392 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.266368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.266463 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.266414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1e5d6f-4312-4096-879b-cb3584ac2f76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.366988 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.366948 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1e5d6f-4312-4096-879b-cb3584ac2f76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367004 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367033 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2lcb\" (UniqueName: \"kubernetes.io/projected/bb1e5d6f-4312-4096-879b-cb3584ac2f76-kube-api-access-l2lcb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367061 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367115 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367188 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367160 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367560 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367560 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367529 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.367749 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.367631 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.369444 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.369413 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb1e5d6f-4312-4096-879b-cb3584ac2f76-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.369586 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.369569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb1e5d6f-4312-4096-879b-cb3584ac2f76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.374474 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.374450 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2lcb\" (UniqueName: \"kubernetes.io/projected/bb1e5d6f-4312-4096-879b-cb3584ac2f76-kube-api-access-l2lcb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v\" (UID: \"bb1e5d6f-4312-4096-879b-cb3584ac2f76\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.487803 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.487712 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:40.629383 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:40.629352 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v"] May 27 17:55:40.630684 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:55:40.630657 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1e5d6f_4312_4096_879b_cb3584ac2f76.slice/crio-168e7bb7c07f379803e230f688c11d5cae24a4518844b042279264d9d7264ccf WatchSource:0}: Error finding container 168e7bb7c07f379803e230f688c11d5cae24a4518844b042279264d9d7264ccf: Status 404 returned error can't find the container with id 168e7bb7c07f379803e230f688c11d5cae24a4518844b042279264d9d7264ccf May 27 17:55:41.631234 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:41.631196 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" event={"ID":"bb1e5d6f-4312-4096-879b-cb3584ac2f76","Type":"ContainerStarted","Data":"5a0c6e9e858d2be1cf3a0e7f0ad426e4fafa38f65f5d42ee42d9a34e64fdeb82"} May 27 17:55:41.631234 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:41.631236 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" event={"ID":"bb1e5d6f-4312-4096-879b-cb3584ac2f76","Type":"ContainerStarted","Data":"168e7bb7c07f379803e230f688c11d5cae24a4518844b042279264d9d7264ccf"} May 27 17:55:46.651003 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:46.650967 2566 generic.go:358] "Generic (PLEG): container finished" podID="bb1e5d6f-4312-4096-879b-cb3584ac2f76" containerID="5a0c6e9e858d2be1cf3a0e7f0ad426e4fafa38f65f5d42ee42d9a34e64fdeb82" exitCode=0 May 27 17:55:46.651397 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:46.651043 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" event={"ID":"bb1e5d6f-4312-4096-879b-cb3584ac2f76","Type":"ContainerDied","Data":"5a0c6e9e858d2be1cf3a0e7f0ad426e4fafa38f65f5d42ee42d9a34e64fdeb82"} May 27 17:55:47.655886 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:47.655850 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" event={"ID":"bb1e5d6f-4312-4096-879b-cb3584ac2f76","Type":"ContainerStarted","Data":"62df83bb55bdebef55c78ecbb9749580491d12e07046d9b69c4794f5912bccf5"} May 27 17:55:47.656275 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:47.656063 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:55:47.677146 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:47.677100 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" podStartSLOduration=7.474276034 podStartE2EDuration="7.677086999s" podCreationTimestamp="2026-05-27 17:55:40 +0000 UTC" firstStartedPulling="2026-05-27 17:55:46.65170471 +0000 UTC m=+736.057679169" lastFinishedPulling="2026-05-27 17:55:46.854515674 +0000 UTC m=+736.260490134" observedRunningTime="2026-05-27 17:55:47.676110628 +0000 UTC m=+737.082085109" watchObservedRunningTime="2026-05-27 17:55:47.677086999 +0000 UTC m=+737.083061482" May 27 17:55:58.672593 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:55:58.672559 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v" May 27 17:56:00.005283 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.005246 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-644557f77b-cw9jt"] May 27 17:56:00.007793 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.007772 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.015409 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.015386 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-644557f77b-cw9jt"] May 27 17:56:00.155172 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.155122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f9e776bc-11d9-4b04-96f1-1ef602b14b2c-tls-cert\") pod \"authorino-644557f77b-cw9jt\" (UID: \"f9e776bc-11d9-4b04-96f1-1ef602b14b2c\") " pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.155347 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.155227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96llg\" (UniqueName: \"kubernetes.io/projected/f9e776bc-11d9-4b04-96f1-1ef602b14b2c-kube-api-access-96llg\") pod \"authorino-644557f77b-cw9jt\" (UID: \"f9e776bc-11d9-4b04-96f1-1ef602b14b2c\") " pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.256561 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.256488 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f9e776bc-11d9-4b04-96f1-1ef602b14b2c-tls-cert\") pod \"authorino-644557f77b-cw9jt\" (UID: \"f9e776bc-11d9-4b04-96f1-1ef602b14b2c\") " pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.256671 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.256570 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96llg\" (UniqueName: \"kubernetes.io/projected/f9e776bc-11d9-4b04-96f1-1ef602b14b2c-kube-api-access-96llg\") pod \"authorino-644557f77b-cw9jt\" (UID: \"f9e776bc-11d9-4b04-96f1-1ef602b14b2c\") " pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.258951 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.258922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f9e776bc-11d9-4b04-96f1-1ef602b14b2c-tls-cert\") pod \"authorino-644557f77b-cw9jt\" (UID: \"f9e776bc-11d9-4b04-96f1-1ef602b14b2c\") " pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.265074 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.265044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96llg\" (UniqueName: \"kubernetes.io/projected/f9e776bc-11d9-4b04-96f1-1ef602b14b2c-kube-api-access-96llg\") pod \"authorino-644557f77b-cw9jt\" (UID: \"f9e776bc-11d9-4b04-96f1-1ef602b14b2c\") " pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.317479 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.317443 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-644557f77b-cw9jt" May 27 17:56:00.449443 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.449417 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-644557f77b-cw9jt"] May 27 17:56:00.451538 ip-10-0-141-245 kubenswrapper[2566]: W0527 17:56:00.451510 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9e776bc_11d9_4b04_96f1_1ef602b14b2c.slice/crio-8ce3e9f6362c98ed2b1a89714f7455eaf069d705dbdd565308bdb494b720ba40 WatchSource:0}: Error finding container 8ce3e9f6362c98ed2b1a89714f7455eaf069d705dbdd565308bdb494b720ba40: Status 404 returned error can't find the container with id 8ce3e9f6362c98ed2b1a89714f7455eaf069d705dbdd565308bdb494b720ba40 May 27 17:56:00.700082 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:00.700049 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-644557f77b-cw9jt" event={"ID":"f9e776bc-11d9-4b04-96f1-1ef602b14b2c","Type":"ContainerStarted","Data":"8ce3e9f6362c98ed2b1a89714f7455eaf069d705dbdd565308bdb494b720ba40"} May 27 17:56:01.705849 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:01.705784 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-644557f77b-cw9jt" event={"ID":"f9e776bc-11d9-4b04-96f1-1ef602b14b2c","Type":"ContainerStarted","Data":"7cd1c566c3f3096d69c436bb43217905eb3f564bd2b2792a56378cb18f42b4ad"} May 27 17:56:01.723468 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:01.723397 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-644557f77b-cw9jt" podStartSLOduration=2.326013793 podStartE2EDuration="2.723373253s" podCreationTimestamp="2026-05-27 17:55:59 +0000 UTC" firstStartedPulling="2026-05-27 17:56:00.452928356 +0000 UTC m=+749.858902831" lastFinishedPulling="2026-05-27 17:56:00.850287812 +0000 UTC m=+750.256262291" observedRunningTime="2026-05-27 17:56:01.721172953 +0000 UTC m=+751.127147434" watchObservedRunningTime="2026-05-27 17:56:01.723373253 +0000 UTC m=+751.129347795" May 27 17:56:01.760207 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:01.760168 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c8776977-6wwqw"] May 27 17:56:01.760453 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:01.760427 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-54c8776977-6wwqw" podUID="4c355166-eee3-4f2c-b90c-f0905192ac1f" containerName="authorino" containerID="cri-o://11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b" gracePeriod=30 May 27 17:56:02.017749 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.017725 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:56:02.174031 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.173994 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkl8k\" (UniqueName: \"kubernetes.io/projected/4c355166-eee3-4f2c-b90c-f0905192ac1f-kube-api-access-xkl8k\") pod \"4c355166-eee3-4f2c-b90c-f0905192ac1f\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " May 27 17:56:02.174200 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.174081 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c355166-eee3-4f2c-b90c-f0905192ac1f-tls-cert\") pod \"4c355166-eee3-4f2c-b90c-f0905192ac1f\" (UID: \"4c355166-eee3-4f2c-b90c-f0905192ac1f\") " May 27 17:56:02.176143 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.176116 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c355166-eee3-4f2c-b90c-f0905192ac1f-kube-api-access-xkl8k" (OuterVolumeSpecName: "kube-api-access-xkl8k") pod "4c355166-eee3-4f2c-b90c-f0905192ac1f" (UID: "4c355166-eee3-4f2c-b90c-f0905192ac1f"). InnerVolumeSpecName "kube-api-access-xkl8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 17:56:02.185472 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.185447 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c355166-eee3-4f2c-b90c-f0905192ac1f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4c355166-eee3-4f2c-b90c-f0905192ac1f" (UID: "4c355166-eee3-4f2c-b90c-f0905192ac1f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 17:56:02.274944 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.274914 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkl8k\" (UniqueName: \"kubernetes.io/projected/4c355166-eee3-4f2c-b90c-f0905192ac1f-kube-api-access-xkl8k\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:56:02.274944 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.274940 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4c355166-eee3-4f2c-b90c-f0905192ac1f-tls-cert\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 17:56:02.709734 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.709700 2566 generic.go:358] "Generic (PLEG): container finished" podID="4c355166-eee3-4f2c-b90c-f0905192ac1f" containerID="11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b" exitCode=0 May 27 17:56:02.710159 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.709754 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8776977-6wwqw" May 27 17:56:02.710159 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.709787 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8776977-6wwqw" event={"ID":"4c355166-eee3-4f2c-b90c-f0905192ac1f","Type":"ContainerDied","Data":"11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b"} May 27 17:56:02.710159 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.709829 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8776977-6wwqw" event={"ID":"4c355166-eee3-4f2c-b90c-f0905192ac1f","Type":"ContainerDied","Data":"cc8cbffdcbe41640e7eaa91f9d4d79adb01d212366d4e37375ecd14d795098dc"} May 27 17:56:02.710159 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.709852 2566 scope.go:117] "RemoveContainer" containerID="11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b" May 27 17:56:02.719617 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.719588 2566 scope.go:117] "RemoveContainer" containerID="11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b" May 27 17:56:02.719890 ip-10-0-141-245 kubenswrapper[2566]: E0527 17:56:02.719872 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b\": container with ID starting with 11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b not found: ID does not exist" containerID="11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b" May 27 17:56:02.719940 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.719896 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b"} err="failed to get container status \"11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b\": rpc error: code = NotFound desc = could not find container \"11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b\": container with ID starting with 11c731aa0a25fd54c2a62e835906595eb9587c09fa862d9cace63a1ac34c4f3b not found: ID does not exist" May 27 17:56:02.732133 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.732101 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c8776977-6wwqw"] May 27 17:56:02.734330 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:02.734308 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54c8776977-6wwqw"] May 27 17:56:03.184322 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:56:03.184280 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c355166-eee3-4f2c-b90c-f0905192ac1f" path="/var/lib/kubelet/pods/4c355166-eee3-4f2c-b90c-f0905192ac1f/volumes" May 27 17:58:31.143311 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:58:31.143280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 17:58:31.146156 ip-10-0-141-245 kubenswrapper[2566]: I0527 17:58:31.146136 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:03:31.167343 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:03:31.167315 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:03:31.171596 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:03:31.171574 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:07:46.539825 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:46.539735 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58"] May 27 18:07:46.542171 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:46.540023 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" podUID="423b335b-c458-49db-a849-4786e2c7a245" containerName="manager" containerID="cri-o://f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c" gracePeriod=10 May 27 18:07:47.291374 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:47.291348 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 18:07:47.389692 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:47.389618 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjsv8\" (UniqueName: \"kubernetes.io/projected/423b335b-c458-49db-a849-4786e2c7a245-kube-api-access-vjsv8\") pod \"423b335b-c458-49db-a849-4786e2c7a245\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " May 27 18:07:47.389692 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:47.389682 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423b335b-c458-49db-a849-4786e2c7a245-extensions-socket-volume\") pod \"423b335b-c458-49db-a849-4786e2c7a245\" (UID: \"423b335b-c458-49db-a849-4786e2c7a245\") " May 27 18:07:47.390060 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:47.390022 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423b335b-c458-49db-a849-4786e2c7a245-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "423b335b-c458-49db-a849-4786e2c7a245" (UID: "423b335b-c458-49db-a849-4786e2c7a245"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:07:47.391470 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:47.391450 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423b335b-c458-49db-a849-4786e2c7a245-kube-api-access-vjsv8" (OuterVolumeSpecName: "kube-api-access-vjsv8") pod "423b335b-c458-49db-a849-4786e2c7a245" (UID: "423b335b-c458-49db-a849-4786e2c7a245"). InnerVolumeSpecName "kube-api-access-vjsv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:07:47.491126 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:47.491098 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjsv8\" (UniqueName: \"kubernetes.io/projected/423b335b-c458-49db-a849-4786e2c7a245-kube-api-access-vjsv8\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 18:07:47.491126 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:47.491123 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/423b335b-c458-49db-a849-4786e2c7a245-extensions-socket-volume\") on node \"ip-10-0-141-245.ec2.internal\" DevicePath \"\"" May 27 18:07:48.092589 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.092553 2566 generic.go:358] "Generic (PLEG): container finished" podID="423b335b-c458-49db-a849-4786e2c7a245" containerID="f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c" exitCode=0 May 27 18:07:48.093035 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.092628 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" May 27 18:07:48.093035 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.092641 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" event={"ID":"423b335b-c458-49db-a849-4786e2c7a245","Type":"ContainerDied","Data":"f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c"} May 27 18:07:48.093035 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.092680 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58" event={"ID":"423b335b-c458-49db-a849-4786e2c7a245","Type":"ContainerDied","Data":"21c2628ddcbb3b6cb8a092d9588ebc0189e90bc25b335ae0cff8c92ec5d00527"} May 27 18:07:48.093035 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.092694 2566 scope.go:117] "RemoveContainer" containerID="f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c" May 27 18:07:48.103630 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.103595 2566 scope.go:117] "RemoveContainer" containerID="f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c" May 27 18:07:48.103901 ip-10-0-141-245 kubenswrapper[2566]: E0527 18:07:48.103882 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c\": container with ID starting with f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c not found: ID does not exist" containerID="f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c" May 27 18:07:48.103959 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.103908 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c"} err="failed to get container status \"f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c\": rpc error: code = NotFound desc = could not find container \"f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c\": container with ID starting with f912c5facab62549729fc90158e08f629aae2d45392404aa7426b855c8c0f74c not found: ID does not exist" May 27 18:07:48.116141 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.116110 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58"] May 27 18:07:48.120374 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:48.120351 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tn58"] May 27 18:07:49.183580 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:07:49.183547 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="423b335b-c458-49db-a849-4786e2c7a245" path="/var/lib/kubelet/pods/423b335b-c458-49db-a849-4786e2c7a245/volumes" May 27 18:08:31.194726 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:31.194695 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:08:31.197985 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:31.197968 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:08:52.636428 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.636347 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs"] May 27 18:08:52.636885 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.636697 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c355166-eee3-4f2c-b90c-f0905192ac1f" containerName="authorino" May 27 18:08:52.636885 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.636709 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c355166-eee3-4f2c-b90c-f0905192ac1f" containerName="authorino" May 27 18:08:52.636885 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.636724 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423b335b-c458-49db-a849-4786e2c7a245" containerName="manager" May 27 18:08:52.636885 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.636730 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="423b335b-c458-49db-a849-4786e2c7a245" containerName="manager" May 27 18:08:52.636885 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.636784 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c355166-eee3-4f2c-b90c-f0905192ac1f" containerName="authorino" May 27 18:08:52.636885 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.636796 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="423b335b-c458-49db-a849-4786e2c7a245" containerName="manager" May 27 18:08:52.639788 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.639771 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:52.641904 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.641882 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h2nww\"" May 27 18:08:52.649792 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.649767 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs"] May 27 18:08:52.758558 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.758500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hkqk\" (UniqueName: \"kubernetes.io/projected/81762704-78e5-4fc2-96b9-d9c18ed562c8-kube-api-access-8hkqk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9phvs\" (UID: \"81762704-78e5-4fc2-96b9-d9c18ed562c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:52.758801 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.758686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81762704-78e5-4fc2-96b9-d9c18ed562c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9phvs\" (UID: \"81762704-78e5-4fc2-96b9-d9c18ed562c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:52.859902 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.859851 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81762704-78e5-4fc2-96b9-d9c18ed562c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9phvs\" (UID: \"81762704-78e5-4fc2-96b9-d9c18ed562c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:52.860071 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.859940 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hkqk\" (UniqueName: \"kubernetes.io/projected/81762704-78e5-4fc2-96b9-d9c18ed562c8-kube-api-access-8hkqk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9phvs\" (UID: \"81762704-78e5-4fc2-96b9-d9c18ed562c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:52.860250 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.860229 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81762704-78e5-4fc2-96b9-d9c18ed562c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9phvs\" (UID: \"81762704-78e5-4fc2-96b9-d9c18ed562c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:52.868018 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.867984 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hkqk\" (UniqueName: \"kubernetes.io/projected/81762704-78e5-4fc2-96b9-d9c18ed562c8-kube-api-access-8hkqk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9phvs\" (UID: \"81762704-78e5-4fc2-96b9-d9c18ed562c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:52.950050 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:52.949950 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:53.094753 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:53.094722 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs"] May 27 18:08:53.096733 ip-10-0-141-245 kubenswrapper[2566]: W0527 18:08:53.096708 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81762704_78e5_4fc2_96b9_d9c18ed562c8.slice/crio-70cc800729eefadd21e6b5322f394f20de34064c3f7970dbcd812880c129376e WatchSource:0}: Error finding container 70cc800729eefadd21e6b5322f394f20de34064c3f7970dbcd812880c129376e: Status 404 returned error can't find the container with id 70cc800729eefadd21e6b5322f394f20de34064c3f7970dbcd812880c129376e May 27 18:08:53.099008 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:53.098989 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:08:53.302555 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:53.302463 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" event={"ID":"81762704-78e5-4fc2-96b9-d9c18ed562c8","Type":"ContainerStarted","Data":"bba3af3234fdff71bd49c98007d12646d434e141984e853fad2c86d6a1669161"} May 27 18:08:53.302555 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:53.302500 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" event={"ID":"81762704-78e5-4fc2-96b9-d9c18ed562c8","Type":"ContainerStarted","Data":"70cc800729eefadd21e6b5322f394f20de34064c3f7970dbcd812880c129376e"} May 27 18:08:53.302764 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:53.302584 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:08:53.323078 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:08:53.323029 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" podStartSLOduration=1.323013556 podStartE2EDuration="1.323013556s" podCreationTimestamp="2026-05-27 18:08:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:08:53.321150864 +0000 UTC m=+1522.727125344" watchObservedRunningTime="2026-05-27 18:08:53.323013556 +0000 UTC m=+1522.728988036" May 27 18:09:04.308166 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:09:04.308133 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9phvs" May 27 18:13:31.217467 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:13:31.217439 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:13:31.227039 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:13:31.227017 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:18:31.240889 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:31.240861 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:18:31.251748 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:31.251723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:18:33.415757 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:33.415729 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-644557f77b-cw9jt_f9e776bc-11d9-4b04-96f1-1ef602b14b2c/authorino/0.log" May 27 18:18:38.566707 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:38.566675 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc4cc6548-8nzp7_dd97641b-8749-4b60-8872-a149bff31a02/manager/0.log" May 27 18:18:40.204028 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:40.203978 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-644557f77b-cw9jt_f9e776bc-11d9-4b04-96f1-1ef602b14b2c/authorino/0.log" May 27 18:18:40.805761 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:40.805728 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9phvs_81762704-78e5-4fc2-96b9-d9c18ed562c8/manager/0.log" May 27 18:18:41.600614 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:41.600586 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695c6f7b6-2fb5b_c4c16c18-1f1a-48be-a0a5-499582b20826/kube-auth-proxy/0.log" May 27 18:18:42.512313 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:42.512280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h_931418c2-16a2-43a8-a922-8ff007d603cb/storage-initializer/0.log" May 27 18:18:42.519611 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:42.519582 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-sp45h_931418c2-16a2-43a8-a922-8ff007d603cb/main/0.log" May 27 18:18:42.856460 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:42.856430 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v_bb1e5d6f-4312-4096-879b-cb3584ac2f76/storage-initializer/0.log" May 27 18:18:42.862584 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:42.862564 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fzh2v_bb1e5d6f-4312-4096-879b-cb3584ac2f76/main/0.log" May 27 18:18:42.969564 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:42.969536 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc_a4f2ffb1-c7c5-4e55-9855-66376445ddeb/storage-initializer/0.log" May 27 18:18:42.975222 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:42.975205 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-7jdwc_a4f2ffb1-c7c5-4e55-9855-66376445ddeb/main/0.log" May 27 18:18:49.521908 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:49.521875 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qwfqv_ae7f61e6-6cb1-4a32-a0c7-b7ca124625c6/global-pull-secret-syncer/0.log" May 27 18:18:49.628895 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:49.628865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pqtnw_01195a32-58bc-44eb-989d-1f67b8045e43/konnectivity-agent/0.log" May 27 18:18:49.691030 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:49.691003 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-245.ec2.internal_37e6a25318b0f22f07f4382756ed2e48/haproxy/0.log" May 27 18:18:54.127444 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:54.127342 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-644557f77b-cw9jt_f9e776bc-11d9-4b04-96f1-1ef602b14b2c/authorino/0.log" May 27 18:18:54.310880 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:54.310852 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9phvs_81762704-78e5-4fc2-96b9-d9c18ed562c8/manager/0.log" May 27 18:18:55.842917 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:55.842885 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_948ef229-a86f-4a94-977a-46822f16a0ba/alertmanager/0.log" May 27 18:18:55.867339 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:55.867310 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_948ef229-a86f-4a94-977a-46822f16a0ba/config-reloader/0.log" May 27 18:18:55.888616 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:55.888579 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_948ef229-a86f-4a94-977a-46822f16a0ba/kube-rbac-proxy-web/0.log" May 27 18:18:55.909232 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:55.909201 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_948ef229-a86f-4a94-977a-46822f16a0ba/kube-rbac-proxy/0.log" May 27 18:18:55.931000 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:55.930973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_948ef229-a86f-4a94-977a-46822f16a0ba/kube-rbac-proxy-metric/0.log" May 27 18:18:55.954366 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:55.954346 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_948ef229-a86f-4a94-977a-46822f16a0ba/prom-label-proxy/0.log" May 27 18:18:55.984196 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:55.984177 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_948ef229-a86f-4a94-977a-46822f16a0ba/init-config-reloader/0.log" May 27 18:18:56.123877 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.123797 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5fc487485f-9zcs5_99b02d8d-020c-4dad-a50a-d85c4eaf7204/metrics-server/0.log" May 27 18:18:56.153473 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.153450 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-454dn_ecbf4483-ba06-4da3-953d-4b8b1941204a/monitoring-plugin/0.log" May 27 18:18:56.323580 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.323537 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztqh4_8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434/node-exporter/0.log" May 27 18:18:56.343696 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.343668 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztqh4_8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434/kube-rbac-proxy/0.log" May 27 18:18:56.364380 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.364351 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztqh4_8e3d3fb4-6f0f-46cd-a0e1-fdcb20bf6434/init-textfile/0.log" May 27 18:18:56.390988 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.390914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-m8kf6_c746c2cd-37ca-43fe-b804-4a95415d1835/kube-rbac-proxy-main/0.log" May 27 18:18:56.412315 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.412285 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-m8kf6_c746c2cd-37ca-43fe-b804-4a95415d1835/kube-rbac-proxy-self/0.log" May 27 18:18:56.433977 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.433947 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-m8kf6_c746c2cd-37ca-43fe-b804-4a95415d1835/openshift-state-metrics/0.log" May 27 18:18:56.469037 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.469008 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_137f4f92-d652-45c7-bc20-26ed3f1702cd/prometheus/0.log" May 27 18:18:56.493875 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.493820 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_137f4f92-d652-45c7-bc20-26ed3f1702cd/config-reloader/0.log" May 27 18:18:56.513873 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.513822 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_137f4f92-d652-45c7-bc20-26ed3f1702cd/thanos-sidecar/0.log" May 27 18:18:56.533229 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.533196 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_137f4f92-d652-45c7-bc20-26ed3f1702cd/kube-rbac-proxy-web/0.log" May 27 18:18:56.553459 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.553435 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_137f4f92-d652-45c7-bc20-26ed3f1702cd/kube-rbac-proxy/0.log" May 27 18:18:56.573078 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.573022 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_137f4f92-d652-45c7-bc20-26ed3f1702cd/kube-rbac-proxy-thanos/0.log" May 27 18:18:56.594102 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.594078 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_137f4f92-d652-45c7-bc20-26ed3f1702cd/init-config-reloader/0.log" May 27 18:18:56.678191 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:56.678098 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-67wx9_33532f2f-a4c1-4cbf-bb8a-d6af503ae0eb/prometheus-operator-admission-webhook/0.log" May 27 18:18:57.936796 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:57.936767 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-q5djx_2f989bbe-59ad-4070-9d9e-74d097937772/networking-console-plugin/0.log" May 27 18:18:58.035280 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.035247 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5"] May 27 18:18:58.039178 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.039157 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.041386 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.041366 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d9xm9\"/\"kube-root-ca.crt\"" May 27 18:18:58.041801 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.041785 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d9xm9\"/\"openshift-service-ca.crt\"" May 27 18:18:58.041902 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.041802 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d9xm9\"/\"default-dockercfg-z8mxt\"" May 27 18:18:58.044302 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.044281 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5"] May 27 18:18:58.190118 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.190022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-lib-modules\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.190118 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.190098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9dsd\" (UniqueName: \"kubernetes.io/projected/53c3b25a-06b8-4df6-a87a-96d5c71082f4-kube-api-access-b9dsd\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.190313 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.190131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-podres\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.190313 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.190170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-sys\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.190313 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.190257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-proc\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291346 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291305 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-podres\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291509 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291378 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-sys\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291509 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291427 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-proc\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291509 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291471 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-lib-modules\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291630 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-podres\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291630 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-sys\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291630 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291622 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-lib-modules\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291731 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53c3b25a-06b8-4df6-a87a-96d5c71082f4-proc\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.291731 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.291643 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9dsd\" (UniqueName: \"kubernetes.io/projected/53c3b25a-06b8-4df6-a87a-96d5c71082f4-kube-api-access-b9dsd\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.299049 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.299029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9dsd\" (UniqueName: \"kubernetes.io/projected/53c3b25a-06b8-4df6-a87a-96d5c71082f4-kube-api-access-b9dsd\") pod \"perf-node-gather-daemonset-mgzz5\" (UID: \"53c3b25a-06b8-4df6-a87a-96d5c71082f4\") " pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.350832 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.350800 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:58.485028 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.485001 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5"] May 27 18:18:58.487408 ip-10-0-141-245 kubenswrapper[2566]: W0527 18:18:58.487380 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod53c3b25a_06b8_4df6_a87a_96d5c71082f4.slice/crio-0d59582754bee6c107a2182b2b84a88f38b006873ff35a5b1f812cee58872693 WatchSource:0}: Error finding container 0d59582754bee6c107a2182b2b84a88f38b006873ff35a5b1f812cee58872693: Status 404 returned error can't find the container with id 0d59582754bee6c107a2182b2b84a88f38b006873ff35a5b1f812cee58872693 May 27 18:18:58.489105 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:58.489082 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:18:59.003355 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:59.003319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-f92mp_4b6f792d-33cc-4abc-a0f7-c210909d0e71/download-server/0.log" May 27 18:18:59.363477 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:59.363435 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" event={"ID":"53c3b25a-06b8-4df6-a87a-96d5c71082f4","Type":"ContainerStarted","Data":"bea499ba93f9d89a56085f5a880c6b2ad380bf230d086b63c1626e932a298742"} May 27 18:18:59.363477 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:59.363481 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" event={"ID":"53c3b25a-06b8-4df6-a87a-96d5c71082f4","Type":"ContainerStarted","Data":"0d59582754bee6c107a2182b2b84a88f38b006873ff35a5b1f812cee58872693"} May 27 18:18:59.363756 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:59.363557 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:18:59.380769 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:18:59.380717 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" podStartSLOduration=1.380702685 podStartE2EDuration="1.380702685s" podCreationTimestamp="2026-05-27 18:18:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:18:59.379332445 +0000 UTC m=+2128.785306927" watchObservedRunningTime="2026-05-27 18:18:59.380702685 +0000 UTC m=+2128.786677224" May 27 18:19:00.377120 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:00.377094 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jlvz6_b96f52b5-59c4-46eb-aa07-bfbd0504b263/dns/0.log" May 27 18:19:00.408772 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:00.408745 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jlvz6_b96f52b5-59c4-46eb-aa07-bfbd0504b263/kube-rbac-proxy/0.log" May 27 18:19:00.548476 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:00.548450 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdw59_0ca916c1-318a-4953-b38a-1438fc8096a5/dns-node-resolver/0.log" May 27 18:19:00.995534 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:00.995507 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7875d865db-q8mpl_0b847a58-1ba3-4d41-873e-845983456a2b/registry/0.log" May 27 18:19:01.052952 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:01.052922 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wdf5c_6b1ae8d7-ef2f-49c4-a7ab-24c423252380/node-ca/0.log" May 27 18:19:01.971882 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:01.971851 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695c6f7b6-2fb5b_c4c16c18-1f1a-48be-a0a5-499582b20826/kube-auth-proxy/0.log" May 27 18:19:02.692500 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:02.692468 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzpbb_5a2b684c-86a1-46da-86c4-1ecde261bf62/serve-healthcheck-canary/0.log" May 27 18:19:03.221051 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:03.221021 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bzbwc_07b3815c-0d25-467d-b3e9-4861bef3ac9e/kube-rbac-proxy/0.log" May 27 18:19:03.240803 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:03.240773 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bzbwc_07b3815c-0d25-467d-b3e9-4861bef3ac9e/exporter/0.log" May 27 18:19:03.260491 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:03.260462 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bzbwc_07b3815c-0d25-467d-b3e9-4861bef3ac9e/extractor/0.log" May 27 18:19:05.376927 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:05.376886 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d9xm9/perf-node-gather-daemonset-mgzz5" May 27 18:19:05.471056 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:05.471026 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc4cc6548-8nzp7_dd97641b-8749-4b60-8872-a149bff31a02/manager/0.log" May 27 18:19:06.780317 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:06.780245 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78df8cc544-8xnrs_b46c5321-0219-4ea5-a523-8a134248de40/manager/0.log" May 27 18:19:12.673764 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.673684 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6k8p7_9e400806-f86f-4510-b251-9605f4ca87d7/kube-multus/0.log" May 27 18:19:12.693746 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.693715 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbc5x_9ff15a6c-30d2-4672-a595-4d67dd6435a9/kube-multus-additional-cni-plugins/0.log" May 27 18:19:12.712493 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.712466 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbc5x_9ff15a6c-30d2-4672-a595-4d67dd6435a9/egress-router-binary-copy/0.log" May 27 18:19:12.731902 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.731873 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbc5x_9ff15a6c-30d2-4672-a595-4d67dd6435a9/cni-plugins/0.log" May 27 18:19:12.751727 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.751695 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbc5x_9ff15a6c-30d2-4672-a595-4d67dd6435a9/bond-cni-plugin/0.log" May 27 18:19:12.770277 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.770255 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbc5x_9ff15a6c-30d2-4672-a595-4d67dd6435a9/routeoverride-cni/0.log" May 27 18:19:12.789105 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.789080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbc5x_9ff15a6c-30d2-4672-a595-4d67dd6435a9/whereabouts-cni-bincopy/0.log" May 27 18:19:12.807498 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:12.807469 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbc5x_9ff15a6c-30d2-4672-a595-4d67dd6435a9/whereabouts-cni/0.log" May 27 18:19:13.164052 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:13.164023 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77w6f_e08b8fd2-9f51-4877-9809-f07df56538d9/network-metrics-daemon/0.log" May 27 18:19:13.181768 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:13.181732 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77w6f_e08b8fd2-9f51-4877-9809-f07df56538d9/kube-rbac-proxy/0.log" May 27 18:19:14.075956 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.075927 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-controller/0.log" May 27 18:19:14.092972 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.092946 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/0.log" May 27 18:19:14.102323 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.102303 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovn-acl-logging/1.log" May 27 18:19:14.117467 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.117451 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/kube-rbac-proxy-node/0.log" May 27 18:19:14.135987 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.135971 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/kube-rbac-proxy-ovn-metrics/0.log" May 27 18:19:14.156727 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.156702 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/northd/0.log" May 27 18:19:14.175357 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.175342 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/nbdb/0.log" May 27 18:19:14.193987 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.193968 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/sbdb/0.log" May 27 18:19:14.290545 ip-10-0-141-245 kubenswrapper[2566]: I0527 18:19:14.290481 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f2lpm_3dd81c84-6744-493e-8a7d-e8b05fb3601e/ovnkube-controller/0.log"