May 27 18:33:30.344857 ip-10-0-141-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 18:33:30.344868 ip-10-0-141-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 18:33:30.344875 ip-10-0-141-244 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 18:33:30.345175 ip-10-0-141-244 systemd[1]: Failed to start Kubernetes Kubelet. May 27 18:33:40.558786 ip-10-0-141-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 18:33:40.558809 ip-10-0-141-244 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 55fc1bbe273040cbaa92501de74156f0 -- May 27 18:35:56.972670 ip-10-0-141-244 systemd[1]: Starting Kubernetes Kubelet... May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.485897 2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492000 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492012 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492016 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492019 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492022 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492025 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492028 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 18:35:57.656134 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492031 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492041 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492046 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492049 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492052 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492055 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492057 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492060 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492063 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492066 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492069 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492071 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492074 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492077 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492079 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492082 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492085 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492087 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492090 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492092 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 18:35:57.657558 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492096 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 18:35:57.609565 ip-10-0-141-244 systemd[1]: Started Kubernetes Kubelet. May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492098 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492101 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492104 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492107 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492110 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492112 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492115 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492132 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492136 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492139 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492142 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492144 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492147 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492150 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492153 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492155 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492158 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492160 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492163 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 18:35:57.658268 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492166 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492168 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492172 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492176 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492179 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492182 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492184 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492187 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492190 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492193 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492195 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492198 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492200 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492204 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492206 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492209 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492212 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492214 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 18:35:57.659126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492217 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492219 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492222 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492226 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492229 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492231 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492234 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492237 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492239 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492242 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492244 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492247 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492249 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492252 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492254 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492257 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492260 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492263 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492266 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492269 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 18:35:57.659703 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492271 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492662 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492667 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492669 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492672 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492675 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492678 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492680 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492683 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492686 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492688 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492691 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492694 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492696 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492699 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492702 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492705 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492708 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492711 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492713 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 18:35:57.660502 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492716 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492719 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492721 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492724 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492727 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492729 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492732 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492734 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492737 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492741 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492745 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492747 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492751 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492754 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492756 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492761 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492767 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492769 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492772 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 18:35:57.661116 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492774 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492777 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492781 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492783 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492786 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492789 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492791 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492794 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492797 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492800 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492803 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492806 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492808 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492811 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492813 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492816 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492818 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492821 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492823 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492826 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 18:35:57.661861 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492829 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492833 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492836 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492839 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492842 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492844 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492847 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492849 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492853 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492856 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492858 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492861 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492863 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492866 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492868 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492870 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492873 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492876 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492878 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492881 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 18:35:57.662576 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492884 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492886 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492889 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492892 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492896 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492899 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492901 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.492904 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494302 2556 flags.go:64] FLAG: --address="0.0.0.0" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494312 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494318 2556 flags.go:64] FLAG: --anonymous-auth="true" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494322 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494326 2556 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494329 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494333 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494337 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494341 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494344 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494347 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494351 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494355 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494358 2556 flags.go:64] FLAG: --cgroup-root="" May 27 18:35:57.663818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494361 2556 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494364 2556 flags.go:64] FLAG: --client-ca-file="" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494367 2556 flags.go:64] FLAG: --cloud-config="" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494370 2556 flags.go:64] FLAG: --cloud-provider="external" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494373 2556 flags.go:64] FLAG: --cluster-dns="[]" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494379 2556 flags.go:64] FLAG: --cluster-domain="" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494382 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494385 2556 flags.go:64] FLAG: --config-dir="" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494388 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494403 2556 flags.go:64] FLAG: --container-log-max-files="5" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494407 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494410 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494413 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494417 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494420 2556 flags.go:64] FLAG: --contention-profiling="false" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494423 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494426 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494429 2556 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494432 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494436 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494439 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494443 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494445 2556 flags.go:64] FLAG: --enable-load-reader="false" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494448 2556 flags.go:64] FLAG: --enable-server="true" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494451 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 18:35:57.665001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494456 2556 flags.go:64] FLAG: --event-burst="100" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494459 2556 flags.go:64] FLAG: --event-qps="50" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494462 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494465 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494468 2556 flags.go:64] FLAG: --eviction-hard="" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494473 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494476 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494479 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494482 2556 flags.go:64] FLAG: --eviction-soft="" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494485 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494488 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494491 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494494 2556 flags.go:64] FLAG: --experimental-mounter-path="" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494497 2556 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494500 2556 flags.go:64] FLAG: --fail-swap-on="true" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494502 2556 flags.go:64] FLAG: --feature-gates="" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494506 2556 flags.go:64] FLAG: --file-check-frequency="20s" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494510 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494513 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494516 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494519 2556 flags.go:64] FLAG: --healthz-port="10248" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494523 2556 flags.go:64] FLAG: --help="false" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494526 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-141-244.ec2.internal" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494529 2556 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 18:35:57.870022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494532 2556 flags.go:64] FLAG: --http-check-frequency="20s" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494535 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494539 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494542 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494545 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494548 2556 flags.go:64] FLAG: --image-service-endpoint="" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494550 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494553 2556 flags.go:64] FLAG: --kube-api-burst="100" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494556 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494559 2556 flags.go:64] FLAG: --kube-api-qps="50" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494562 2556 flags.go:64] FLAG: --kube-reserved="" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494565 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494568 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494572 2556 flags.go:64] FLAG: --kubelet-cgroups="" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494575 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494578 2556 flags.go:64] FLAG: --lock-file="" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494581 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494584 2556 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494587 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494592 2556 flags.go:64] FLAG: --log-json-split-stream="false" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494595 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494597 2556 flags.go:64] FLAG: --log-text-split-stream="false" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494600 2556 flags.go:64] FLAG: --logging-format="text" May 27 18:35:57.888659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494603 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494606 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494609 2556 flags.go:64] FLAG: --manifest-url="" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494612 2556 flags.go:64] FLAG: --manifest-url-header="" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494616 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494619 2556 flags.go:64] FLAG: --max-open-files="1000000" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494623 2556 flags.go:64] FLAG: --max-pods="110" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494626 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494629 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494632 2556 flags.go:64] FLAG: --memory-manager-policy="None" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494635 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494638 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494641 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494644 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494651 2556 flags.go:64] FLAG: --node-status-max-images="50" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494654 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494657 2556 flags.go:64] FLAG: --oom-score-adj="-999" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494660 2556 flags.go:64] FLAG: --pod-cidr="" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494663 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494669 2556 flags.go:64] FLAG: --pod-manifest-path="" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494672 2556 flags.go:64] FLAG: --pod-max-pids="-1" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494678 2556 flags.go:64] FLAG: --pods-per-core="0" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494683 2556 flags.go:64] FLAG: --port="10250" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494686 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 18:35:57.889593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494689 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01c9f65b49bc6b5d5" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494692 2556 flags.go:64] FLAG: --qos-reserved="" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494695 2556 flags.go:64] FLAG: --read-only-port="10255" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494698 2556 flags.go:64] FLAG: --register-node="true" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494701 2556 flags.go:64] FLAG: --register-schedulable="true" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494704 2556 flags.go:64] FLAG: --register-with-taints="" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494708 2556 flags.go:64] FLAG: --registry-burst="10" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494711 2556 flags.go:64] FLAG: --registry-qps="5" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494713 2556 flags.go:64] FLAG: --reserved-cpus="" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494716 2556 flags.go:64] FLAG: --reserved-memory="" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494720 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494723 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494726 2556 flags.go:64] FLAG: --rotate-certificates="false" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494729 2556 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494732 2556 flags.go:64] FLAG: --runonce="false" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494735 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494738 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494741 2556 flags.go:64] FLAG: --seccomp-default="false" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494744 2556 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494747 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494750 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494753 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494756 2556 flags.go:64] FLAG: --storage-driver-password="root" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494759 2556 flags.go:64] FLAG: --storage-driver-secure="false" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494761 2556 flags.go:64] FLAG: --storage-driver-table="stats" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494764 2556 flags.go:64] FLAG: --storage-driver-user="root" May 27 18:35:57.890345 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494767 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494771 2556 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494773 2556 flags.go:64] FLAG: --system-cgroups="" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494777 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494784 2556 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494787 2556 flags.go:64] FLAG: --tls-cert-file="" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494790 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494794 2556 flags.go:64] FLAG: --tls-min-version="" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494797 2556 flags.go:64] FLAG: --tls-private-key-file="" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494800 2556 flags.go:64] FLAG: --topology-manager-policy="none" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494803 2556 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494806 2556 flags.go:64] FLAG: --topology-manager-scope="container" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494809 2556 flags.go:64] FLAG: --v="2" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494813 2556 flags.go:64] FLAG: --version="false" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494817 2556 flags.go:64] FLAG: --vmodule="" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494821 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.494824 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494916 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494920 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494923 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494926 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494929 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494931 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494934 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 18:35:57.891250 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494937 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494940 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494942 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494945 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494947 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494950 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494953 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494956 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494958 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494961 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494963 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494967 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494971 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494974 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494976 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494979 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494981 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494984 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494986 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494989 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 18:35:57.891936 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494991 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494994 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494997 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.494999 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495002 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495005 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495007 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495010 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495013 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495015 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495018 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495020 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495023 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495026 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495029 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495031 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495034 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495037 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495039 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 18:35:57.892820 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495042 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495046 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495049 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495052 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495056 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495061 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495063 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495066 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495069 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495073 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495076 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495079 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495082 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495084 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495087 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495089 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495092 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495095 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495097 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 18:35:57.893421 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495099 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495102 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495104 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495107 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495109 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495112 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495115 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495118 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495120 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495123 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495126 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495130 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495133 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495135 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495138 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495140 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495143 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495147 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495151 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495154 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 18:35:57.894258 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.495156 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.495955 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.503869 2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.503884 2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503930 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503935 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503939 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503942 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503946 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503949 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503952 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503955 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503957 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503960 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503963 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503966 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 18:35:57.894839 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503968 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503971 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503973 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503976 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503979 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503981 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503984 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503987 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503991 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503995 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.503998 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504001 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504003 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504007 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504009 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504012 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504015 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504018 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504021 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504023 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 18:35:57.895329 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504026 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504028 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504031 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504034 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504037 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504040 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504042 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504045 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504048 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504051 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504053 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504056 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504059 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504062 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504064 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504067 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504070 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504073 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504075 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 18:35:57.896177 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504078 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504080 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504083 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504085 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504088 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504091 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504094 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504097 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504103 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504106 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504109 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504112 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504115 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504118 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504120 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504131 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504137 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504142 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.504146 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506759 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 18:35:57.896760 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506763 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506766 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506769 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506772 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506775 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506780 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506782 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506785 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506788 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506791 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506793 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506796 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506798 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506801 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506804 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.506809 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 18:35:57.897336 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506903 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506908 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506911 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506914 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506917 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506919 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506922 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506925 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506928 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506932 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506938 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506943 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506947 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506950 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506953 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506956 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506959 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506962 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506964 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 18:35:58.168041 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506967 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506970 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506972 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506975 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506978 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506981 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506983 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506986 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506988 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506991 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506994 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506996 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.506999 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507002 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507004 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507006 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507009 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507012 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507014 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507017 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 18:35:58.169291 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507019 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507022 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507024 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507028 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507032 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507035 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507038 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507040 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507043 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507046 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507048 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507051 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507053 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507056 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507058 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507060 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507063 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507066 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507069 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507072 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 18:35:58.170286 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507074 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507077 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507079 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507082 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507084 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507087 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507089 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507092 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507095 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507097 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507100 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507102 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507105 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507107 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507110 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507113 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507117 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507120 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507122 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 18:35:58.170924 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507125 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507127 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507130 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507133 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507135 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507138 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507140 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.507143 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.507148 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.509123 2556 server.go:962] "Client rotation is on, will bootstrap in background" May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.514484 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.515498 2556 server.go:1019] "Starting client certificate rotation" May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.515597 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.515631 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 18:35:58.449522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.544962 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 18:35:58.449989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.546820 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 18:35:58.449989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.564805 2556 log.go:25] "Validated CRI v1 runtime API" May 27 18:35:58.449989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.570730 2556 log.go:25] "Validated CRI v1 image API" May 27 18:35:58.449989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.576916 2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 18:35:58.449989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.581777 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 18:35:58.449989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.582424 2556 fs.go:135] Filesystem UUIDs: map[53cf2d13-c2ae-4328-96c7-7a690f25673f:/dev/nvme0n1p3 761f9e9c-bc51-49ef-9636-722f0e3810fd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 27 18:35:58.449989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.582439 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.587539 2556 manager.go:217] Machine: {Timestamp:2026-05-27 18:35:57.587041835 +0000 UTC m=+0.487103260 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099236 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21c8fc00bb4eca888a80edb245c0a8 SystemUUID:ec21c8fc-00bb-4eca-888a-80edb245c0a8 BootID:55fc1bbe-2730-40cb-aa92-501de74156f0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:b2:06:24:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:b2:06:24:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:bb:4e:91:6a:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.587637 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.587707 2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.590069 2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.590100 2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.590278 2556 topology_manager.go:138] "Creating topology manager with none policy" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.590287 2556 container_manager_linux.go:306] "Creating device plugin manager" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.590294 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.590314 2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.591676 2556 state_mem.go:36] "Initialized new in-memory state store" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.591777 2556 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.594226 2556 kubelet.go:491] "Attempting to sync node with API server" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.594237 2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.594840 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.594850 2556 kubelet.go:397] "Adding apiserver pod source" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.594860 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.595860 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 18:35:58.451729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.595884 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.597713 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qnsbr" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.599107 2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.601774 2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602858 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602874 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602880 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602885 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602894 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602899 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602905 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602911 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602918 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602924 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.602934 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.603507 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.605707 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.605716 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.606489 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.606587 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.607801 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qnsbr" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.608788 2556 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.608814 2556 server.go:1295] "Started kubelet" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.608928 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.608919 2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.608982 2556 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.609778 2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.610691 2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.612019 2556 server.go:317] "Adding debug handlers to kubelet server" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.617140 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.617715 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.617761 2556 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.617771 2556 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.617809 2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.617906 2556 reconstruct.go:97] "Volume reconstruction finished" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.617917 2556 reconciler.go:26] "Reconciler: start to sync state" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.618565 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619168 2556 factory.go:153] Registering CRI-O factory May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619195 2556 factory.go:223] Registration of the crio container factory successfully May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619245 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619253 2556 factory.go:55] Registering systemd factory May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619260 2556 factory.go:223] Registration of the systemd container factory successfully May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619276 2556 factory.go:103] Registering Raw factory May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619289 2556 manager.go:1196] Started watching for new ooms in manager May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.619472 2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.619702 2556 manager.go:319] Starting recovery of all containers May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.626356 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 18:35:58.452330 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.627816 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-244.ec2.internal\" not found" node="ip-10-0-141-244.ec2.internal" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:57.629835 2556 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.swap.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.swap.max: no such device May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.634816 2556 manager.go:324] Recovery completed May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.638528 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.640165 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientMemory" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.640188 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasNoDiskPressure" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.640198 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientPID" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.640731 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.640742 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.640756 2556 state_mem.go:36] "Initialized new in-memory state store" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.643242 2556 policy_none.go:49] "None policy: Start" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.643255 2556 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.643264 2556 state_mem.go:35] "Initializing new in-memory state store" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.685112 2556 manager.go:341] "Starting Device Plugin manager" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.686021 2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.686038 2556 server.go:85] "Starting device plugin registration server" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.686275 2556 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.686289 2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.686470 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.686538 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.686548 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.687073 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.687110 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.731664 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.732758 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.732781 2556 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.732798 2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.732804 2556 kubelet.go:2451] "Starting kubelet main sync loop" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.732835 2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.735216 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.787310 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.788362 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientMemory" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.788386 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasNoDiskPressure" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.788409 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientPID" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.788431 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-244.ec2.internal" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.798262 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-244.ec2.internal" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.798284 2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-244.ec2.internal\": node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.806826 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.833577 2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal"] May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.833646 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.834374 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientMemory" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.834415 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasNoDiskPressure" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.834428 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientPID" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.836001 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.836166 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.836190 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 18:35:58.453848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.836631 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientMemory" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.836653 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasNoDiskPressure" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.836676 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientPID" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.837014 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientMemory" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.837037 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasNoDiskPressure" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.837045 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientPID" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.838008 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.838037 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.838622 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientMemory" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.838648 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasNoDiskPressure" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:57.838662 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeHasSufficientPID" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.859910 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-244.ec2.internal\" not found" node="ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.864268 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-244.ec2.internal\" not found" node="ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:57.907108 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.007371 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.018567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed9d8c8514b7c793bd1e601435a5829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal\" (UID: \"4ed9d8c8514b7c793bd1e601435a5829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.018620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed9d8c8514b7c793bd1e601435a5829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal\" (UID: \"4ed9d8c8514b7c793bd1e601435a5829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.018637 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b41983331afe86ebb89c18c24a89355-config\") pod \"kube-apiserver-proxy-ip-10-0-141-244.ec2.internal\" (UID: \"7b41983331afe86ebb89c18c24a89355\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.107945 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.119221 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed9d8c8514b7c793bd1e601435a5829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal\" (UID: \"4ed9d8c8514b7c793bd1e601435a5829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.119231 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed9d8c8514b7c793bd1e601435a5829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal\" (UID: \"4ed9d8c8514b7c793bd1e601435a5829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.119261 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed9d8c8514b7c793bd1e601435a5829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal\" (UID: \"4ed9d8c8514b7c793bd1e601435a5829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.119276 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b41983331afe86ebb89c18c24a89355-config\") pod \"kube-apiserver-proxy-ip-10-0-141-244.ec2.internal\" (UID: \"7b41983331afe86ebb89c18c24a89355\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.119298 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b41983331afe86ebb89c18c24a89355-config\") pod \"kube-apiserver-proxy-ip-10-0-141-244.ec2.internal\" (UID: \"7b41983331afe86ebb89c18c24a89355\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.119320 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed9d8c8514b7c793bd1e601435a5829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal\" (UID: \"4ed9d8c8514b7c793bd1e601435a5829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.163314 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.167387 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" May 27 18:35:58.455968 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.208022 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.455968 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.308480 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.455968 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.408935 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.509981 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.515116 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.515268 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.515287 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.609985 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 18:30:57 +0000 UTC" deadline="2028-01-20 23:48:08.838298748 +0000 UTC" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.610016 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14477h12m10.228287574s" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.610045 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.618849 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 18:35:58.632765 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.629791 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 18:35:58.664098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.664074 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j7qsz" May 27 18:35:58.669521 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.669505 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j7qsz" May 27 18:35:58.680509 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:58.680483 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed9d8c8514b7c793bd1e601435a5829.slice/crio-c560ef7dbe53793f3e77efe188690f76ae3685b7605e3ac6a369d55e51cb4c79 WatchSource:0}: Error finding container c560ef7dbe53793f3e77efe188690f76ae3685b7605e3ac6a369d55e51cb4c79: Status 404 returned error can't find the container with id c560ef7dbe53793f3e77efe188690f76ae3685b7605e3ac6a369d55e51cb4c79 May 27 18:35:58.680784 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:35:58.680767 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b41983331afe86ebb89c18c24a89355.slice/crio-144a15cc1c5ef05619e42a1043fff522fdc1e1d78b98caa386b5b9e5695a3135 WatchSource:0}: Error finding container 144a15cc1c5ef05619e42a1043fff522fdc1e1d78b98caa386b5b9e5695a3135: Status 404 returned error can't find the container with id 144a15cc1c5ef05619e42a1043fff522fdc1e1d78b98caa386b5b9e5695a3135 May 27 18:35:58.683938 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.683923 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:35:58.710196 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:58.710147 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-244.ec2.internal\" not found" May 27 18:35:58.735577 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.735528 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" event={"ID":"7b41983331afe86ebb89c18c24a89355","Type":"ContainerStarted","Data":"144a15cc1c5ef05619e42a1043fff522fdc1e1d78b98caa386b5b9e5695a3135"} May 27 18:35:58.736522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.736503 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" event={"ID":"4ed9d8c8514b7c793bd1e601435a5829","Type":"ContainerStarted","Data":"c560ef7dbe53793f3e77efe188690f76ae3685b7605e3ac6a369d55e51cb4c79"} May 27 18:35:58.763144 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.763123 2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 18:35:58.818987 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.818969 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" May 27 18:35:58.832031 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.832016 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 18:35:58.834002 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.833990 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" May 27 18:35:58.843210 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.843199 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 18:35:58.891916 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:58.891899 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 18:35:59.596515 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.596449 2556 apiserver.go:52] "Watching apiserver" May 27 18:35:59.604313 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.604294 2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 18:35:59.606277 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.606250 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-jnssx","openshift-dns/node-resolver-kkhq8","openshift-image-registry/node-ca-mncsf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal","openshift-multus/network-metrics-daemon-5sk84","openshift-network-diagnostics/network-check-target-ww928","openshift-network-operator/iptables-alerter-ljv2r","kube-system/konnectivity-agent-45wck","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52","openshift-multus/multus-additional-cni-plugins-ksdlz","openshift-multus/multus-t6dpz","openshift-ovn-kubernetes/ovnkube-node-dchzc","kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal"] May 27 18:35:59.609239 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.609220 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.609344 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.609330 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.610736 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.610717 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.611812 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.611787 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 18:35:59.612212 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612190 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 18:35:59.612309 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612252 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 18:35:59.612438 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612421 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 18:35:59.612528 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612510 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6rpc\"" May 27 18:35:59.612629 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612611 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 18:35:59.612701 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612611 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7k8n\"" May 27 18:35:59.612941 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612926 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 18:35:59.613026 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.612928 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 18:35:59.613376 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.613357 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:35:59.613483 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.613443 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:35:59.613714 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.613694 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 18:35:59.613814 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.613716 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 18:35:59.613814 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.613762 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 18:35:59.613917 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.613873 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfqk5\"" May 27 18:35:59.614659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.614586 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:35:59.614763 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.614658 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:35:59.614763 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.614686 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.616958 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.616192 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.616958 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.616942 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 18:35:59.617771 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.617746 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 18:35:59.618278 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.618257 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-js89b\"" May 27 18:35:59.618633 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.618571 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 18:35:59.619061 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.619043 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 18:35:59.619381 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.619361 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7h8cq\"" May 27 18:35:59.619677 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.619657 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 18:35:59.621427 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.621385 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.621517 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.621496 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.622916 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.622898 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6dpz" May 27 18:35:59.623606 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.623587 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 18:35:59.623721 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.623710 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 18:35:59.623921 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.623900 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 18:35:59.624040 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.624027 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hk4sv\"" May 27 18:35:59.624185 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.624166 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 18:35:59.624289 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.624207 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 18:35:59.624635 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.624480 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9ptpb\"" May 27 18:35:59.624734 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.624636 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.625102 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.625083 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 18:35:59.625710 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.625677 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8h5jk\"" May 27 18:35:59.626768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.626664 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 18:35:59.626768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.626723 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 18:35:59.627921 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.627904 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c5t7q\"" May 27 18:35:59.628009 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.627997 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 18:35:59.628075 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628018 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 18:35:59.628075 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628044 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 18:35:59.628196 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628119 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 18:35:59.628251 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cnibin\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.628354 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:35:59.628354 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.628482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf628f60-16d3-49fd-b183-1e160fde9be3-agent-certs\") pod \"konnectivity-agent-45wck\" (UID: \"bf628f60-16d3-49fd-b183-1e160fde9be3\") " pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.628482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628385 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvqvz\" (UniqueName: \"kubernetes.io/projected/f059d50d-2639-4edf-94ad-f940e7f89866-kube-api-access-nvqvz\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.628482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628431 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6eba6a8f-1888-4e15-8b65-bb341623b061-iptables-alerter-script\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.628482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0fc65dd-a9f4-4371-a240-8deb8db9d999-host\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.628482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf628f60-16d3-49fd-b183-1e160fde9be3-konnectivity-ca\") pod \"konnectivity-agent-45wck\" (UID: \"bf628f60-16d3-49fd-b183-1e160fde9be3\") " pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.628725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-sys-fs\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.628725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-os-release\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.628725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628586 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.628725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628610 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-hosts-file\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.628725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-tmp-dir\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.628725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628690 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkzt4\" (UniqueName: \"kubernetes.io/projected/e0fc65dd-a9f4-4371-a240-8deb8db9d999-kube-api-access-nkzt4\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.628725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-socket-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-registration-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628758 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tpdh\" (UniqueName: \"kubernetes.io/projected/fac32ff4-f58e-40c1-bd76-560d7e7f9016-kube-api-access-4tpdh\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp2q2\" (UniqueName: \"kubernetes.io/projected/6eba6a8f-1888-4e15-8b65-bb341623b061-kube-api-access-xp2q2\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6eba6a8f-1888-4e15-8b65-bb341623b061-host-slash\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-system-cni-dir\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndhm\" (UniqueName: \"kubernetes.io/projected/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-kube-api-access-fndhm\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.628965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-device-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.629008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.629023 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0fc65dd-a9f4-4371-a240-8deb8db9d999-serviceca\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.629045 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.629049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.629661 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.629080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhbx8\" (UniqueName: \"kubernetes.io/projected/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-kube-api-access-vhbx8\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.670235 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.670211 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 18:30:58 +0000 UTC" deadline="2027-12-08 16:05:08.109593845 +0000 UTC" May 27 18:35:59.670235 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.670235 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13437h29m8.439361344s" May 27 18:35:59.719407 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.719376 2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 18:35:59.730288 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730259 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-registration-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.730384 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730299 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp2q2\" (UniqueName: \"kubernetes.io/projected/6eba6a8f-1888-4e15-8b65-bb341623b061-kube-api-access-xp2q2\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.730384 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-cni-bin\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.730384 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-run\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.730560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvrp\" (UniqueName: \"kubernetes.io/projected/1ad71334-83c7-4d27-94d5-42b0510331b5-kube-api-access-qdvrp\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.730560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-etc-kubernetes\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.730560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-systemd-units\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.730560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730486 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-registration-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.730560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730491 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6eba6a8f-1888-4e15-8b65-bb341623b061-host-slash\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.730560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730533 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6eba6a8f-1888-4e15-8b65-bb341623b061-host-slash\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730554 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-log-socket\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-cni-bin\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-ovnkube-config\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730687 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fndhm\" (UniqueName: \"kubernetes.io/projected/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-kube-api-access-fndhm\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730713 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-device-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-cni-binary-copy\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730762 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-hostroot\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-var-lib-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730821 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-device-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.730865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730856 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0fc65dd-a9f4-4371-a240-8deb8db9d999-serviceca\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730887 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhbx8\" (UniqueName: \"kubernetes.io/projected/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-kube-api-access-vhbx8\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs9pz\" (UniqueName: \"kubernetes.io/projected/6790af77-dfb0-483a-bc34-991c3913b85c-kube-api-access-hs9pz\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-var-lib-kubelet\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.730993 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731017 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-cnibin\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-conf-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.731112 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731152 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-systemd\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731152 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.731192 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:00.231156832 +0000 UTC m=+3.131218263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysconfig\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-kubernetes\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731303 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvqvz\" (UniqueName: \"kubernetes.io/projected/f059d50d-2639-4edf-94ad-f940e7f89866-kube-api-access-nvqvz\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731332 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6eba6a8f-1888-4e15-8b65-bb341623b061-iptables-alerter-script\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731324 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0fc65dd-a9f4-4371-a240-8deb8db9d999-serviceca\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.731372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ccs9\" (UniqueName: \"kubernetes.io/projected/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-kube-api-access-6ccs9\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731383 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-k8s-cni-cncf-io\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysctl-conf\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-netns\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-ovn\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731528 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-tuned\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731549 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-hosts-file\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731589 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkzt4\" (UniqueName: \"kubernetes.io/projected/e0fc65dd-a9f4-4371-a240-8deb8db9d999-kube-api-access-nkzt4\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731622 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tpdh\" (UniqueName: \"kubernetes.io/projected/fac32ff4-f58e-40c1-bd76-560d7e7f9016-kube-api-access-4tpdh\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731634 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-hosts-file\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731655 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-socket-dir-parent\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-cni-multus\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-env-overrides\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-sys\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-daemon-config\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731823 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731849 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-system-cni-dir\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731879 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6eba6a8f-1888-4e15-8b65-bb341623b061-iptables-alerter-script\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-modprobe-d\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731906 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-systemd\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731942 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-system-cni-dir\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731953 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.731994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-cni-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-slash\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732066 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-run-netns\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-lib-modules\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732130 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-kubelet\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.732884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-cni-netd\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732231 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732264 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6790af77-dfb0-483a-bc34-991c3913b85c-ovn-node-metrics-cert\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732293 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cnibin\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732313 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732320 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732351 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-cnibin\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-system-cni-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-os-release\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732442 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732447 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732468 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ad71334-83c7-4d27-94d5-42b0510331b5-tmp\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732496 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf628f60-16d3-49fd-b183-1e160fde9be3-agent-certs\") pod \"konnectivity-agent-45wck\" (UID: \"bf628f60-16d3-49fd-b183-1e160fde9be3\") " pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-node-log\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732544 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0fc65dd-a9f4-4371-a240-8deb8db9d999-host\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732572 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf628f60-16d3-49fd-b183-1e160fde9be3-konnectivity-ca\") pod \"konnectivity-agent-45wck\" (UID: \"bf628f60-16d3-49fd-b183-1e160fde9be3\") " pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732590 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0fc65dd-a9f4-4371-a240-8deb8db9d999-host\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.733574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732597 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-sys-fs\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732627 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-os-release\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-kubelet\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732674 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-os-release\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-ovnkube-script-lib\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-sys-fs\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysctl-d\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-host\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-etc-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-multus-certs\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732820 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-tmp-dir\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732863 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-socket-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.732882 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.733001 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f059d50d-2639-4edf-94ad-f940e7f89866-socket-dir\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.733040 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-tmp-dir\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.734340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.733111 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf628f60-16d3-49fd-b183-1e160fde9be3-konnectivity-ca\") pod \"konnectivity-agent-45wck\" (UID: \"bf628f60-16d3-49fd-b183-1e160fde9be3\") " pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.736614 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.736595 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf628f60-16d3-49fd-b183-1e160fde9be3-agent-certs\") pod \"konnectivity-agent-45wck\" (UID: \"bf628f60-16d3-49fd-b183-1e160fde9be3\") " pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.738642 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.738623 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 18:35:59.738756 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.738647 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 18:35:59.738756 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.738659 2556 projected.go:194] Error preparing data for projected volume kube-api-access-b2hnh for pod openshift-network-diagnostics/network-check-target-ww928: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:35:59.738756 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:35:59.738714 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh podName:b803fe79-e60c-4096-acd4-215cc6419e36 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:00.238699197 +0000 UTC m=+3.138760630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b2hnh" (UniqueName: "kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh") pod "network-check-target-ww928" (UID: "b803fe79-e60c-4096-acd4-215cc6419e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:35:59.741322 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.741299 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkzt4\" (UniqueName: \"kubernetes.io/projected/e0fc65dd-a9f4-4371-a240-8deb8db9d999-kube-api-access-nkzt4\") pod \"node-ca-mncsf\" (UID: \"e0fc65dd-a9f4-4371-a240-8deb8db9d999\") " pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.742078 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.742059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp2q2\" (UniqueName: \"kubernetes.io/projected/6eba6a8f-1888-4e15-8b65-bb341623b061-kube-api-access-xp2q2\") pod \"iptables-alerter-ljv2r\" (UID: \"6eba6a8f-1888-4e15-8b65-bb341623b061\") " pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.742186 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.742164 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhbx8\" (UniqueName: \"kubernetes.io/projected/16b382be-b6de-434d-b4c9-f6fdd9bd81e3-kube-api-access-vhbx8\") pod \"multus-additional-cni-plugins-ksdlz\" (UID: \"16b382be-b6de-434d-b4c9-f6fdd9bd81e3\") " pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.742645 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.742600 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvqvz\" (UniqueName: \"kubernetes.io/projected/f059d50d-2639-4edf-94ad-f940e7f89866-kube-api-access-nvqvz\") pod \"aws-ebs-csi-driver-node-b6d52\" (UID: \"f059d50d-2639-4edf-94ad-f940e7f89866\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.742787 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.742647 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndhm\" (UniqueName: \"kubernetes.io/projected/fb2efac6-d4e5-4ea2-9401-f85e21b4d58e-kube-api-access-fndhm\") pod \"node-resolver-kkhq8\" (UID: \"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e\") " pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.742787 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.742649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tpdh\" (UniqueName: \"kubernetes.io/projected/fac32ff4-f58e-40c1-bd76-560d7e7f9016-kube-api-access-4tpdh\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:35:59.763036 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.763017 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 18:35:59.834083 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834039 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-cni-bin\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834083 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834081 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-run\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834098 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvrp\" (UniqueName: \"kubernetes.io/projected/1ad71334-83c7-4d27-94d5-42b0510331b5-kube-api-access-qdvrp\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834113 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-etc-kubernetes\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834129 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-systemd-units\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834153 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-log-socket\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834156 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-cni-bin\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834175 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-cni-bin\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834185 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-etc-kubernetes\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834199 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-systemd-units\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834212 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-cni-bin\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834215 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-ovnkube-config\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834245 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-log-socket\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834257 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-run\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.834295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834265 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-cni-binary-copy\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834310 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-hostroot\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834338 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-var-lib-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834366 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834419 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834418 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-var-lib-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834455 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hs9pz\" (UniqueName: \"kubernetes.io/projected/6790af77-dfb0-483a-bc34-991c3913b85c-kube-api-access-hs9pz\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-hostroot\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834484 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-var-lib-kubelet\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834530 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-cnibin\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-var-lib-kubelet\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834574 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-conf-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834603 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-cnibin\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834601 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-systemd\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834641 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-systemd\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834645 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysconfig\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834671 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-kubernetes\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834684 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-conf-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.834943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834696 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysconfig\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834701 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ccs9\" (UniqueName: \"kubernetes.io/projected/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-kube-api-access-6ccs9\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834729 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-k8s-cni-cncf-io\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834743 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-kubernetes\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834755 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysctl-conf\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834780 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-netns\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834786 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-cni-binary-copy\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834793 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-k8s-cni-cncf-io\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834804 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-ovn\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834819 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-ovnkube-config\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834828 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-netns\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834826 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-tuned\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834869 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-ovn\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834898 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-socket-dir-parent\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834925 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-cni-multus\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834949 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-env-overrides\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834973 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-cni-multus\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834925 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysctl-conf\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.835760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.834992 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-socket-dir-parent\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835016 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-sys\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835046 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-daemon-config\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835101 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-sys\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835153 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-modprobe-d\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835188 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-systemd\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835217 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-cni-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835245 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-slash\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835273 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-run-netns\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835298 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-lib-modules\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835304 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-modprobe-d\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835328 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-kubelet\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835358 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835300 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-env-overrides\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835374 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-run-netns\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835410 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-cni-netd\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835433 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-slash\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835438 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6790af77-dfb0-483a-bc34-991c3913b85c-ovn-node-metrics-cert\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.836626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835431 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-cni-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835359 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-systemd\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835469 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-run-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835473 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-system-cni-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835478 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-lib-modules\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835499 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-multus-daemon-config\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835511 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-var-lib-kubelet\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835514 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-os-release\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-cni-netd\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835632 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-system-cni-dir\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835648 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-os-release\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835683 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ad71334-83c7-4d27-94d5-42b0510331b5-tmp\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835696 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835733 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-node-log\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835788 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-node-log\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835793 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-kubelet\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835829 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-host-kubelet\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.837432 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835847 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-ovnkube-script-lib\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835882 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysctl-d\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835904 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-host\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835936 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-etc-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.835960 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-multus-certs\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.836026 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-sysctl-d\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.836480 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ad71334-83c7-4d27-94d5-42b0510331b5-host\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.836541 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6790af77-dfb0-483a-bc34-991c3913b85c-etc-openvswitch\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.836599 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-host-run-multus-certs\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.837005 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6790af77-dfb0-483a-bc34-991c3913b85c-ovnkube-script-lib\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.837223 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ad71334-83c7-4d27-94d5-42b0510331b5-etc-tuned\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.838325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.837874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6790af77-dfb0-483a-bc34-991c3913b85c-ovn-node-metrics-cert\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.840288 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.840075 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ad71334-83c7-4d27-94d5-42b0510331b5-tmp\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.845442 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.845415 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs9pz\" (UniqueName: \"kubernetes.io/projected/6790af77-dfb0-483a-bc34-991c3913b85c-kube-api-access-hs9pz\") pod \"ovnkube-node-dchzc\" (UID: \"6790af77-dfb0-483a-bc34-991c3913b85c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.845527 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.845511 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvrp\" (UniqueName: \"kubernetes.io/projected/1ad71334-83c7-4d27-94d5-42b0510331b5-kube-api-access-qdvrp\") pod \"tuned-jnssx\" (UID: \"1ad71334-83c7-4d27-94d5-42b0510331b5\") " pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.845579 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.845546 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ccs9\" (UniqueName: \"kubernetes.io/projected/8ce79359-2523-4c6e-89a6-36d6b66e7e9a-kube-api-access-6ccs9\") pod \"multus-t6dpz\" (UID: \"8ce79359-2523-4c6e-89a6-36d6b66e7e9a\") " pod="openshift-multus/multus-t6dpz" May 27 18:35:59.922613 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.922558 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" May 27 18:35:59.930545 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.930523 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kkhq8" May 27 18:35:59.938173 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.938154 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mncsf" May 27 18:35:59.943682 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.943661 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ljv2r" May 27 18:35:59.949142 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.949121 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45wck" May 27 18:35:59.955716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.955700 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" May 27 18:35:59.963255 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.963235 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnssx" May 27 18:35:59.968859 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.968841 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6dpz" May 27 18:35:59.973493 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.973468 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:35:59.979700 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:35:59.979683 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 18:36:00.239126 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.239096 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:00.239282 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.239150 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:00.239282 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:00.239247 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:00.239383 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:00.239287 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 18:36:00.239383 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:00.239307 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 18:36:00.239383 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:00.239314 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:01.239294555 +0000 UTC m=+4.139355967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:00.239383 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:00.239320 2556 projected.go:194] Error preparing data for projected volume kube-api-access-b2hnh for pod openshift-network-diagnostics/network-check-target-ww928: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:00.239383 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:00.239374 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh podName:b803fe79-e60c-4096-acd4-215cc6419e36 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:01.239357007 +0000 UTC m=+4.139418425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2hnh" (UniqueName: "kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh") pod "network-check-target-ww928" (UID: "b803fe79-e60c-4096-acd4-215cc6419e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:00.295810 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.295772 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2efac6_d4e5_4ea2_9401_f85e21b4d58e.slice/crio-58457ce90517aff213e736710f2599cb89002f1cc71b328effdf80dccd1c7b61 WatchSource:0}: Error finding container 58457ce90517aff213e736710f2599cb89002f1cc71b328effdf80dccd1c7b61: Status 404 returned error can't find the container with id 58457ce90517aff213e736710f2599cb89002f1cc71b328effdf80dccd1c7b61 May 27 18:36:00.296938 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.296910 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eba6a8f_1888_4e15_8b65_bb341623b061.slice/crio-3fff167d21354c0f92bccb0ccba1f1b24bfa8857bd145352e9df2d432cbbd10c WatchSource:0}: Error finding container 3fff167d21354c0f92bccb0ccba1f1b24bfa8857bd145352e9df2d432cbbd10c: Status 404 returned error can't find the container with id 3fff167d21354c0f92bccb0ccba1f1b24bfa8857bd145352e9df2d432cbbd10c May 27 18:36:00.300362 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.300344 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b382be_b6de_434d_b4c9_f6fdd9bd81e3.slice/crio-f272b8f57d8d8bc4ee76aaff32a874b7b7aa272e29ce1fa413cb35432696c0df WatchSource:0}: Error finding container f272b8f57d8d8bc4ee76aaff32a874b7b7aa272e29ce1fa413cb35432696c0df: Status 404 returned error can't find the container with id f272b8f57d8d8bc4ee76aaff32a874b7b7aa272e29ce1fa413cb35432696c0df May 27 18:36:00.301192 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.301174 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad71334_83c7_4d27_94d5_42b0510331b5.slice/crio-c34de382f547caa447ae335aac412634f71f58bdd464a8213d7fbd08f84d409a WatchSource:0}: Error finding container c34de382f547caa447ae335aac412634f71f58bdd464a8213d7fbd08f84d409a: Status 404 returned error can't find the container with id c34de382f547caa447ae335aac412634f71f58bdd464a8213d7fbd08f84d409a May 27 18:36:00.302025 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.302003 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf628f60_16d3_49fd_b183_1e160fde9be3.slice/crio-e18aaf4c9b4122655a70ba7359286ff051ff82c8c1881ac5c50244e6d768f3e3 WatchSource:0}: Error finding container e18aaf4c9b4122655a70ba7359286ff051ff82c8c1881ac5c50244e6d768f3e3: Status 404 returned error can't find the container with id e18aaf4c9b4122655a70ba7359286ff051ff82c8c1881ac5c50244e6d768f3e3 May 27 18:36:00.302734 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.302714 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce79359_2523_4c6e_89a6_36d6b66e7e9a.slice/crio-4f706ac3b086aeecbfb1dc793da0ad06dc59ca3d11852d9f85794024b8501190 WatchSource:0}: Error finding container 4f706ac3b086aeecbfb1dc793da0ad06dc59ca3d11852d9f85794024b8501190: Status 404 returned error can't find the container with id 4f706ac3b086aeecbfb1dc793da0ad06dc59ca3d11852d9f85794024b8501190 May 27 18:36:00.304763 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.304426 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fc65dd_a9f4_4371_a240_8deb8db9d999.slice/crio-00aecaa80221df2216919905ddec9840d38997c83e587b26044544279ffaa9ae WatchSource:0}: Error finding container 00aecaa80221df2216919905ddec9840d38997c83e587b26044544279ffaa9ae: Status 404 returned error can't find the container with id 00aecaa80221df2216919905ddec9840d38997c83e587b26044544279ffaa9ae May 27 18:36:00.305019 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.304928 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6790af77_dfb0_483a_bc34_991c3913b85c.slice/crio-dc594ca537febf740b8bb8fa1fb2971f57bccd7698b11761e4b9afcf00f4f204 WatchSource:0}: Error finding container dc594ca537febf740b8bb8fa1fb2971f57bccd7698b11761e4b9afcf00f4f204: Status 404 returned error can't find the container with id dc594ca537febf740b8bb8fa1fb2971f57bccd7698b11761e4b9afcf00f4f204 May 27 18:36:00.306100 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:00.305953 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf059d50d_2639_4edf_94ad_f940e7f89866.slice/crio-3ffc6e4bfc27a1558f4508280044fe66e78648474c11cc780bc1fc816c447481 WatchSource:0}: Error finding container 3ffc6e4bfc27a1558f4508280044fe66e78648474c11cc780bc1fc816c447481: Status 404 returned error can't find the container with id 3ffc6e4bfc27a1558f4508280044fe66e78648474c11cc780bc1fc816c447481 May 27 18:36:00.670989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.670950 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 18:30:58 +0000 UTC" deadline="2028-01-06 20:56:01.147536174 +0000 UTC" May 27 18:36:00.670989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.670986 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14138h20m0.476553785s" May 27 18:36:00.734225 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.733726 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:00.734225 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:00.733870 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:00.743566 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.743537 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" event={"ID":"f059d50d-2639-4edf-94ad-f940e7f89866","Type":"ContainerStarted","Data":"3ffc6e4bfc27a1558f4508280044fe66e78648474c11cc780bc1fc816c447481"} May 27 18:36:00.747116 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.747051 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"dc594ca537febf740b8bb8fa1fb2971f57bccd7698b11761e4b9afcf00f4f204"} May 27 18:36:00.748777 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.748720 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6dpz" event={"ID":"8ce79359-2523-4c6e-89a6-36d6b66e7e9a","Type":"ContainerStarted","Data":"4f706ac3b086aeecbfb1dc793da0ad06dc59ca3d11852d9f85794024b8501190"} May 27 18:36:00.751116 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.751004 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45wck" event={"ID":"bf628f60-16d3-49fd-b183-1e160fde9be3","Type":"ContainerStarted","Data":"e18aaf4c9b4122655a70ba7359286ff051ff82c8c1881ac5c50244e6d768f3e3"} May 27 18:36:00.754974 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.754912 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ljv2r" event={"ID":"6eba6a8f-1888-4e15-8b65-bb341623b061","Type":"ContainerStarted","Data":"3fff167d21354c0f92bccb0ccba1f1b24bfa8857bd145352e9df2d432cbbd10c"} May 27 18:36:00.759421 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.759283 2556 generic.go:358] "Generic (PLEG): container finished" podID="4ed9d8c8514b7c793bd1e601435a5829" containerID="4392c59bdc8c2a852724efcbecd4492a9499cf2eefaa1970602a9092261e7fba" exitCode=0 May 27 18:36:00.759421 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.759356 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" event={"ID":"4ed9d8c8514b7c793bd1e601435a5829","Type":"ContainerDied","Data":"4392c59bdc8c2a852724efcbecd4492a9499cf2eefaa1970602a9092261e7fba"} May 27 18:36:00.762033 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.761977 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mncsf" event={"ID":"e0fc65dd-a9f4-4371-a240-8deb8db9d999","Type":"ContainerStarted","Data":"00aecaa80221df2216919905ddec9840d38997c83e587b26044544279ffaa9ae"} May 27 18:36:00.766122 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.766078 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnssx" event={"ID":"1ad71334-83c7-4d27-94d5-42b0510331b5","Type":"ContainerStarted","Data":"c34de382f547caa447ae335aac412634f71f58bdd464a8213d7fbd08f84d409a"} May 27 18:36:00.785685 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.785639 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerStarted","Data":"f272b8f57d8d8bc4ee76aaff32a874b7b7aa272e29ce1fa413cb35432696c0df"} May 27 18:36:00.789342 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.789299 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kkhq8" event={"ID":"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e","Type":"ContainerStarted","Data":"58457ce90517aff213e736710f2599cb89002f1cc71b328effdf80dccd1c7b61"} May 27 18:36:00.796592 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:00.796567 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" event={"ID":"7b41983331afe86ebb89c18c24a89355","Type":"ContainerStarted","Data":"e5a0dfdc883c9fd764b029368d04df260727899106d4223bd970a148b03de5da"} May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:01.247993 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:01.248058 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:01.248209 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:01.248225 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:01.248239 2556 projected.go:194] Error preparing data for projected volume kube-api-access-b2hnh for pod openshift-network-diagnostics/network-check-target-ww928: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:01.248301 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh podName:b803fe79-e60c-4096-acd4-215cc6419e36 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:03.248280596 +0000 UTC m=+6.148342062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2hnh" (UniqueName: "kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh") pod "network-check-target-ww928" (UID: "b803fe79-e60c-4096-acd4-215cc6419e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:01.248778 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:01.248899 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:01.248860 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:03.248812803 +0000 UTC m=+6.148874221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:01.734833 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:01.734230 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:01.734833 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:01.734363 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:01.807842 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:01.807375 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" event={"ID":"4ed9d8c8514b7c793bd1e601435a5829","Type":"ContainerStarted","Data":"88204e1b7c2755af830fe3eb618e4145f98f4847d85383334c9a2e8c919031e2"} May 27 18:36:01.823903 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:01.823836 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-244.ec2.internal" podStartSLOduration=3.823807618 podStartE2EDuration="3.823807618s" podCreationTimestamp="2026-05-27 18:35:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:36:00.812560753 +0000 UTC m=+3.712622193" watchObservedRunningTime="2026-05-27 18:36:01.823807618 +0000 UTC m=+4.723869053" May 27 18:36:02.733585 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:02.733019 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:02.733585 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:02.733171 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:03.264442 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:03.264388 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:03.264895 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:03.264470 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:03.264895 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:03.264591 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:03.264895 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:03.264615 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 18:36:03.264895 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:03.264632 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 18:36:03.264895 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:03.264645 2556 projected.go:194] Error preparing data for projected volume kube-api-access-b2hnh for pod openshift-network-diagnostics/network-check-target-ww928: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:03.264895 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:03.264671 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:07.264654299 +0000 UTC m=+10.164715715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:03.264895 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:03.264695 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh podName:b803fe79-e60c-4096-acd4-215cc6419e36 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:07.264679123 +0000 UTC m=+10.164740564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2hnh" (UniqueName: "kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh") pod "network-check-target-ww928" (UID: "b803fe79-e60c-4096-acd4-215cc6419e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:03.736584 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:03.736543 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:03.736753 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:03.736667 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:04.733882 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:04.733849 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:04.734323 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:04.733989 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:05.733888 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:05.733668 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:05.733888 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:05.733798 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:06.733717 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:06.733677 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:06.733898 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:06.733826 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:07.296967 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:07.297048 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:07.297154 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:07.297163 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:07.297188 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:07.297201 2556 projected.go:194] Error preparing data for projected volume kube-api-access-b2hnh for pod openshift-network-diagnostics/network-check-target-ww928: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:07.297212 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:15.297192136 +0000 UTC m=+18.197253555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:07.297559 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:07.297254 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh podName:b803fe79-e60c-4096-acd4-215cc6419e36 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:15.297237364 +0000 UTC m=+18.197298782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2hnh" (UniqueName: "kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh") pod "network-check-target-ww928" (UID: "b803fe79-e60c-4096-acd4-215cc6419e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:07.734885 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:07.734850 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:07.735066 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:07.734965 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:08.733503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:08.733464 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:08.733921 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:08.733602 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:09.733195 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:09.733164 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:09.733374 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:09.733278 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:10.733793 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:10.733734 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:10.734078 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:10.733837 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:11.733983 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:11.733841 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:11.733983 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:11.733968 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:12.654389 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.654329 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-244.ec2.internal" podStartSLOduration=14.654315094 podStartE2EDuration="14.654315094s" podCreationTimestamp="2026-05-27 18:35:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:36:01.824538379 +0000 UTC m=+4.724599814" watchObservedRunningTime="2026-05-27 18:36:12.654315094 +0000 UTC m=+15.554376528" May 27 18:36:12.654590 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.654465 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zkdp5"] May 27 18:36:12.681866 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.681836 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.682011 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:12.681922 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:12.732757 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.732717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af1a7161-f90e-4801-83ef-059e2ea6cbe6-kubelet-config\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.732757 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.732760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af1a7161-f90e-4801-83ef-059e2ea6cbe6-dbus\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.732977 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.732831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.733032 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.732990 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:12.733142 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:12.733111 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:12.833470 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.833433 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af1a7161-f90e-4801-83ef-059e2ea6cbe6-kubelet-config\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.833470 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.833471 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af1a7161-f90e-4801-83ef-059e2ea6cbe6-dbus\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.833972 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.833510 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.833972 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.833536 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af1a7161-f90e-4801-83ef-059e2ea6cbe6-kubelet-config\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:12.833972 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:12.833632 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 18:36:12.833972 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:12.833683 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret podName:af1a7161-f90e-4801-83ef-059e2ea6cbe6 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:13.333669306 +0000 UTC m=+16.233730719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret") pod "global-pull-secret-syncer-zkdp5" (UID: "af1a7161-f90e-4801-83ef-059e2ea6cbe6") : object "kube-system"/"original-pull-secret" not registered May 27 18:36:12.833972 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:12.833688 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af1a7161-f90e-4801-83ef-059e2ea6cbe6-dbus\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:13.337453 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:13.337404 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:13.337630 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:13.337506 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 18:36:13.337630 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:13.337576 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret podName:af1a7161-f90e-4801-83ef-059e2ea6cbe6 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:14.337559616 +0000 UTC m=+17.237621028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret") pod "global-pull-secret-syncer-zkdp5" (UID: "af1a7161-f90e-4801-83ef-059e2ea6cbe6") : object "kube-system"/"original-pull-secret" not registered May 27 18:36:13.733363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:13.733312 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:13.733557 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:13.733462 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:14.347071 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:14.347028 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:14.347570 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:14.347218 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 18:36:14.347570 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:14.347303 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret podName:af1a7161-f90e-4801-83ef-059e2ea6cbe6 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:16.347282063 +0000 UTC m=+19.247343502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret") pod "global-pull-secret-syncer-zkdp5" (UID: "af1a7161-f90e-4801-83ef-059e2ea6cbe6") : object "kube-system"/"original-pull-secret" not registered May 27 18:36:14.733860 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:14.733825 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:14.734036 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:14.733825 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:14.734036 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:14.733931 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:14.734142 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:14.734050 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:15.353752 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:15.353709 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:15.354202 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:15.353777 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:15.354202 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:15.353884 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:15.354202 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:15.353928 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 18:36:15.354202 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:15.353945 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 18:36:15.354202 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:15.353957 2556 projected.go:194] Error preparing data for projected volume kube-api-access-b2hnh for pod openshift-network-diagnostics/network-check-target-ww928: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:15.354202 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:15.353959 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:31.353937575 +0000 UTC m=+34.253998990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:15.354202 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:15.354016 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh podName:b803fe79-e60c-4096-acd4-215cc6419e36 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:31.35400115 +0000 UTC m=+34.254062563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2hnh" (UniqueName: "kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh") pod "network-check-target-ww928" (UID: "b803fe79-e60c-4096-acd4-215cc6419e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:15.733653 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:15.733614 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:15.733831 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:15.733732 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:16.360267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:16.360230 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:16.360710 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:16.360410 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 18:36:16.360710 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:16.360492 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret podName:af1a7161-f90e-4801-83ef-059e2ea6cbe6 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:20.360469851 +0000 UTC m=+23.260531265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret") pod "global-pull-secret-syncer-zkdp5" (UID: "af1a7161-f90e-4801-83ef-059e2ea6cbe6") : object "kube-system"/"original-pull-secret" not registered May 27 18:36:16.733199 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:16.733166 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:16.733357 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:16.733166 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:16.733357 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:16.733300 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:16.733507 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:16.733359 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:17.734289 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:17.734258 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:17.734718 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:17.734357 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:18.733271 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:18.733245 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:18.733379 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:18.733245 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:18.733379 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:18.733367 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:18.733515 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:18.733414 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:19.734002 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.733704 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:19.734653 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:19.734118 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:19.843540 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.843510 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" event={"ID":"f059d50d-2639-4edf-94ad-f940e7f89866","Type":"ContainerStarted","Data":"a8342b6f4c6555221cfb7a45f8a00fc9443fec1a8d1806370ad2928b3600203d"} May 27 18:36:19.846081 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.846061 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"369a030c8b34699a36d6223a6ba26db9ec09bdeedd8b00c0100b2893ebd7378a"} May 27 18:36:19.846081 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.846087 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"5b077c70b59f55670957f4df06b8025ed7a25b53b0729ffa20ad12e87954751e"} May 27 18:36:19.846250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.846101 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"af3af330d8ec7f120ef0acdaeed3a33e0ada79e4dd4addc930cb7249218a03f7"} May 27 18:36:19.846250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.846114 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"61d431cfffe8b01edba052f7b84d21d97cc46f1f9653057ab2e4155018c05be7"} May 27 18:36:19.846250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.846127 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"d7ed470a912663564ccf64fbaf5030c23e2480188781b5d9784e48b233865094"} May 27 18:36:19.846250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.846139 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"030dc9b1757a4794a5e8944e80bc457ed8fd6f0bde26899b468501a6e0fadbb5"} May 27 18:36:19.847325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.847305 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6dpz" event={"ID":"8ce79359-2523-4c6e-89a6-36d6b66e7e9a","Type":"ContainerStarted","Data":"8aee27bac3014eb8da7061ee430e376cc5e15b5dd56e3e625d1ae84d6303e66a"} May 27 18:36:19.848748 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.848726 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45wck" event={"ID":"bf628f60-16d3-49fd-b183-1e160fde9be3","Type":"ContainerStarted","Data":"5a7f6c6542376d12e8dea0a2247de07c8a47be531eef04a90b7586186726f446"} May 27 18:36:19.849791 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.849772 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mncsf" event={"ID":"e0fc65dd-a9f4-4371-a240-8deb8db9d999","Type":"ContainerStarted","Data":"86fdb98bd081855a3b176f272d461ef7652c15f23a4eee388e516bbf8659aa98"} May 27 18:36:19.850940 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.850921 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnssx" event={"ID":"1ad71334-83c7-4d27-94d5-42b0510331b5","Type":"ContainerStarted","Data":"fd28477048a6bfc97599e714140166ca3a1b71740d62d8910c7e1cc717c79b62"} May 27 18:36:19.852088 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.852065 2556 generic.go:358] "Generic (PLEG): container finished" podID="16b382be-b6de-434d-b4c9-f6fdd9bd81e3" containerID="f356d0e7fcaff0f4450c3b8f51e321905b2b2272e671c7f664871ee128a47e3d" exitCode=0 May 27 18:36:19.852176 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.852143 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerDied","Data":"f356d0e7fcaff0f4450c3b8f51e321905b2b2272e671c7f664871ee128a47e3d"} May 27 18:36:19.853411 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.853374 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kkhq8" event={"ID":"fb2efac6-d4e5-4ea2-9401-f85e21b4d58e","Type":"ContainerStarted","Data":"7a6da5ec603c16d4ec2422be8bc4f3a435bab5051d79ea58b8ea804e20745dfd"} May 27 18:36:19.880545 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.880507 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-kkhq8" podStartSLOduration=8.254675761 podStartE2EDuration="22.880496817s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.298328924 +0000 UTC m=+3.198390337" lastFinishedPulling="2026-05-27 18:36:14.924149975 +0000 UTC m=+17.824211393" observedRunningTime="2026-05-27 18:36:19.880468331 +0000 UTC m=+22.780529777" watchObservedRunningTime="2026-05-27 18:36:19.880496817 +0000 UTC m=+22.780558251" May 27 18:36:19.880871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.880836 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t6dpz" podStartSLOduration=4.399932102 podStartE2EDuration="22.880832009s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.304664697 +0000 UTC m=+3.204726112" lastFinishedPulling="2026-05-27 18:36:18.7855646 +0000 UTC m=+21.685626019" observedRunningTime="2026-05-27 18:36:19.865384937 +0000 UTC m=+22.765446372" watchObservedRunningTime="2026-05-27 18:36:19.880832009 +0000 UTC m=+22.780893444" May 27 18:36:19.894676 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.894642 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-45wck" podStartSLOduration=4.658018157 podStartE2EDuration="22.89463218s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.304680688 +0000 UTC m=+3.204742112" lastFinishedPulling="2026-05-27 18:36:18.541294718 +0000 UTC m=+21.441356135" observedRunningTime="2026-05-27 18:36:19.894570308 +0000 UTC m=+22.794631745" watchObservedRunningTime="2026-05-27 18:36:19.89463218 +0000 UTC m=+22.794693615" May 27 18:36:19.895022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.895005 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 18:36:19.937460 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.937429 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mncsf" podStartSLOduration=12.579425783 podStartE2EDuration="22.937419846s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.306437073 +0000 UTC m=+3.206498487" lastFinishedPulling="2026-05-27 18:36:10.664431123 +0000 UTC m=+13.564492550" observedRunningTime="2026-05-27 18:36:19.937070394 +0000 UTC m=+22.837131829" watchObservedRunningTime="2026-05-27 18:36:19.937419846 +0000 UTC m=+22.837481281" May 27 18:36:19.959437 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:19.959386 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jnssx" podStartSLOduration=4.522416409 podStartE2EDuration="22.959377115s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.303192366 +0000 UTC m=+3.203253793" lastFinishedPulling="2026-05-27 18:36:18.740153073 +0000 UTC m=+21.640214499" observedRunningTime="2026-05-27 18:36:19.959194178 +0000 UTC m=+22.859255625" watchObservedRunningTime="2026-05-27 18:36:19.959377115 +0000 UTC m=+22.859438549" May 27 18:36:20.393042 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.393008 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:20.393221 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:20.393171 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 18:36:20.393282 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:20.393249 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret podName:af1a7161-f90e-4801-83ef-059e2ea6cbe6 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:28.393224386 +0000 UTC m=+31.293285809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret") pod "global-pull-secret-syncer-zkdp5" (UID: "af1a7161-f90e-4801-83ef-059e2ea6cbe6") : object "kube-system"/"original-pull-secret" not registered May 27 18:36:20.699906 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.699799 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T18:36:19.895019065Z","UUID":"c91568ed-22fd-408a-84e6-03dbf019f4ea","Handler":null,"Name":"","Endpoint":""} May 27 18:36:20.703236 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.703218 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 18:36:20.703236 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.703241 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 18:36:20.733265 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.733150 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:20.733265 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.733174 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:20.733265 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:20.733244 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:20.733493 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:20.733416 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:20.859773 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.859739 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" event={"ID":"f059d50d-2639-4edf-94ad-f940e7f89866","Type":"ContainerStarted","Data":"2ca15ca8cb21cbe73d2d36af588db1683acee190b9458136a5d0a8d8227c6f8c"} May 27 18:36:20.860151 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.859779 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" event={"ID":"f059d50d-2639-4edf-94ad-f940e7f89866","Type":"ContainerStarted","Data":"e850e4bb2d2663b7df74a2b66abdef0a472338bd3bc1dbcffeb7b7f7fda2c24a"} May 27 18:36:20.861238 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.861210 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ljv2r" event={"ID":"6eba6a8f-1888-4e15-8b65-bb341623b061","Type":"ContainerStarted","Data":"d5b6320f74842a30871580211817ce1ebac7af084d117b94c99d0428f2cc5ef9"} May 27 18:36:20.878563 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.878526 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6d52" podStartSLOduration=3.464810363 podStartE2EDuration="23.878514637s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.307740128 +0000 UTC m=+3.207801541" lastFinishedPulling="2026-05-27 18:36:20.721444393 +0000 UTC m=+23.621505815" observedRunningTime="2026-05-27 18:36:20.878336184 +0000 UTC m=+23.778397616" watchObservedRunningTime="2026-05-27 18:36:20.878514637 +0000 UTC m=+23.778576072" May 27 18:36:20.892713 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.892666 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ljv2r" podStartSLOduration=5.65026933 podStartE2EDuration="23.892654412s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.29887014 +0000 UTC m=+3.198931555" lastFinishedPulling="2026-05-27 18:36:18.54125521 +0000 UTC m=+21.441316637" observedRunningTime="2026-05-27 18:36:20.89255366 +0000 UTC m=+23.792615096" watchObservedRunningTime="2026-05-27 18:36:20.892654412 +0000 UTC m=+23.792715847" May 27 18:36:20.988845 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.988779 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-45wck" May 27 18:36:20.989819 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:20.989800 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-45wck" May 27 18:36:21.733322 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:21.733297 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:21.733499 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:21.733414 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:21.866370 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:21.866332 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"40b4dae7659e5f550f1df55491e01381ae8b7fb1df738da9cd1a9e99d7718487"} May 27 18:36:21.866900 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:21.866864 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-45wck" May 27 18:36:21.867327 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:21.867311 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-45wck" May 27 18:36:22.733549 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:22.733515 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:22.733717 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:22.733624 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:22.733717 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:22.733682 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:22.733817 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:22.733748 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:23.733521 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:23.733330 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:23.733893 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:23.733588 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:23.875100 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:23.874849 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" event={"ID":"6790af77-dfb0-483a-bc34-991c3913b85c","Type":"ContainerStarted","Data":"82ada870dcae094eabb569186ebc496c07769dddfa44d9a2b9fe781cec118ab8"} May 27 18:36:23.875100 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:23.875010 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:36:23.875333 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:23.875130 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:36:23.894572 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:23.894545 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:36:23.895658 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:23.895638 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:36:23.914307 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:23.914269 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" podStartSLOduration=8.285505069 podStartE2EDuration="26.9142587s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.307089215 +0000 UTC m=+3.207150629" lastFinishedPulling="2026-05-27 18:36:18.935842847 +0000 UTC m=+21.835904260" observedRunningTime="2026-05-27 18:36:23.913941071 +0000 UTC m=+26.814002507" watchObservedRunningTime="2026-05-27 18:36:23.9142587 +0000 UTC m=+26.814320135" May 27 18:36:24.733822 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:24.733648 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:24.734478 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:24.733648 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:24.734478 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:24.733897 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:24.734478 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:24.733956 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:24.877919 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:24.877894 2556 generic.go:358] "Generic (PLEG): container finished" podID="16b382be-b6de-434d-b4c9-f6fdd9bd81e3" containerID="f68560b2ef04ed1628360b877c91195b4caaf802091323c962248f6a81bbf13d" exitCode=0 May 27 18:36:24.878052 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:24.877977 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerDied","Data":"f68560b2ef04ed1628360b877c91195b4caaf802091323c962248f6a81bbf13d"} May 27 18:36:24.878052 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:24.878039 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 18:36:25.733736 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.733705 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:25.733830 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:25.733800 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:25.748344 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.748315 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkdp5"] May 27 18:36:25.748656 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.748455 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:25.748656 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:25.748560 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:25.752208 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.752181 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ww928"] May 27 18:36:25.752849 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.752831 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5sk84"] May 27 18:36:25.752928 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.752916 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:25.753038 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:25.753002 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:25.881865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.881809 2556 generic.go:358] "Generic (PLEG): container finished" podID="16b382be-b6de-434d-b4c9-f6fdd9bd81e3" containerID="f4c2a828a072cca8904ef0dae694d91279e64a8d5766c71807c912ebd3f9514a" exitCode=0 May 27 18:36:25.881970 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.881866 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerDied","Data":"f4c2a828a072cca8904ef0dae694d91279e64a8d5766c71807c912ebd3f9514a"} May 27 18:36:25.881970 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.881877 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:25.882060 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:25.881968 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:25.882147 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:25.882131 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 18:36:26.147352 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:26.147289 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:36:26.885526 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:26.885497 2556 generic.go:358] "Generic (PLEG): container finished" podID="16b382be-b6de-434d-b4c9-f6fdd9bd81e3" containerID="8917339b7ece02e94024439f4e9da420df089399c9037fd56b3548df800183fc" exitCode=0 May 27 18:36:26.885938 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:26.885577 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerDied","Data":"8917339b7ece02e94024439f4e9da420df089399c9037fd56b3548df800183fc"} May 27 18:36:27.734668 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:27.734635 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:27.734785 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:27.734683 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:27.734842 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:27.734823 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:27.734887 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:27.734847 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:27.734932 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:27.734908 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:27.734977 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:27.734941 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:28.455789 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:28.455581 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:28.456193 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:28.455723 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 18:36:28.456193 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:28.455896 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret podName:af1a7161-f90e-4801-83ef-059e2ea6cbe6 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:44.455875117 +0000 UTC m=+47.355936537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret") pod "global-pull-secret-syncer-zkdp5" (UID: "af1a7161-f90e-4801-83ef-059e2ea6cbe6") : object "kube-system"/"original-pull-secret" not registered May 27 18:36:29.733279 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:29.733248 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:29.733845 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:29.733248 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:29.733845 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:29.733371 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:36:29.733845 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:29.733248 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:29.733845 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:29.733460 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ww928" podUID="b803fe79-e60c-4096-acd4-215cc6419e36" May 27 18:36:29.733845 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:29.733506 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkdp5" podUID="af1a7161-f90e-4801-83ef-059e2ea6cbe6" May 27 18:36:31.376348 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.376316 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:31.376732 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.376375 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:31.376732 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.376477 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:31.376732 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.376516 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 18:36:31.376732 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.376532 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:37:03.376513956 +0000 UTC m=+66.276575387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 18:36:31.376732 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.376536 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 18:36:31.376732 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.376546 2556 projected.go:194] Error preparing data for projected volume kube-api-access-b2hnh for pod openshift-network-diagnostics/network-check-target-ww928: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:31.376732 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.376592 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh podName:b803fe79-e60c-4096-acd4-215cc6419e36 nodeName:}" failed. No retries permitted until 2026-05-27 18:37:03.376575474 +0000 UTC m=+66.276636914 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2hnh" (UniqueName: "kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh") pod "network-check-target-ww928" (UID: "b803fe79-e60c-4096-acd4-215cc6419e36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 18:36:31.409989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.409965 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-244.ec2.internal" event="NodeReady" May 27 18:36:31.410115 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.410074 2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 18:36:31.486650 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.486626 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lqgfx"] May 27 18:36:31.511583 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.511560 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gwl77"] May 27 18:36:31.511731 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.511713 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:31.514161 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.514139 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 18:36:31.514514 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.514496 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 18:36:31.514648 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.514528 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zv46l\"" May 27 18:36:31.514648 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.514569 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 18:36:31.536369 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.536347 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lqgfx"] May 27 18:36:31.536464 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.536377 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gwl77"] May 27 18:36:31.536519 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.536503 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.538791 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.538770 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s4chr\"" May 27 18:36:31.538886 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.538817 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 18:36:31.539137 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.539082 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 18:36:31.678043 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.678011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.678199 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.678103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rddhk\" (UniqueName: \"kubernetes.io/projected/166c076b-8d89-4736-b539-afcf8d064d76-kube-api-access-rddhk\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.678199 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.678177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q47vx\" (UniqueName: \"kubernetes.io/projected/bcfb1af4-05a5-4473-b348-804babdf33bf-kube-api-access-q47vx\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:31.678303 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.678212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166c076b-8d89-4736-b539-afcf8d064d76-tmp-dir\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.678303 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.678246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/166c076b-8d89-4736-b539-afcf8d064d76-config-volume\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.678303 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.678296 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:31.733611 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.733581 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:31.733611 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.733602 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:36:31.733799 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.733730 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:36:31.736505 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.736387 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 18:36:31.736505 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.736387 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9wtn\"" May 27 18:36:31.736505 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.736464 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 18:36:31.736505 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.736482 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 18:36:31.736773 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.736749 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 18:36:31.736872 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.736794 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zr9kw\"" May 27 18:36:31.779406 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.779371 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.779512 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.779435 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rddhk\" (UniqueName: \"kubernetes.io/projected/166c076b-8d89-4736-b539-afcf8d064d76-kube-api-access-rddhk\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.779573 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.779477 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q47vx\" (UniqueName: \"kubernetes.io/projected/bcfb1af4-05a5-4473-b348-804babdf33bf-kube-api-access-q47vx\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:31.779573 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.779525 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:36:31.779573 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.779543 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166c076b-8d89-4736-b539-afcf8d064d76-tmp-dir\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.779715 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.779583 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:32.279564352 +0000 UTC m=+35.179625765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:36:31.779715 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.779605 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/166c076b-8d89-4736-b539-afcf8d064d76-config-volume\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.779715 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.779663 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:31.783652 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.780053 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:36:31.783652 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:31.780144 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:36:32.280090861 +0000 UTC m=+35.180152274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:36:31.783652 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.780197 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166c076b-8d89-4736-b539-afcf8d064d76-tmp-dir\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.783652 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.780774 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/166c076b-8d89-4736-b539-afcf8d064d76-config-volume\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.790237 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.790189 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddhk\" (UniqueName: \"kubernetes.io/projected/166c076b-8d89-4736-b539-afcf8d064d76-kube-api-access-rddhk\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:31.790346 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:31.790326 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q47vx\" (UniqueName: \"kubernetes.io/projected/bcfb1af4-05a5-4473-b348-804babdf33bf-kube-api-access-q47vx\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:32.283347 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:32.283306 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:32.283563 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:32.283368 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:32.283563 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:32.283493 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:36:32.283563 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:32.283513 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:36:32.283731 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:32.283567 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:36:33.283547566 +0000 UTC m=+36.183608978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:36:32.283731 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:32.283586 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:33.283577197 +0000 UTC m=+36.183638615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:36:33.291136 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:33.291115 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:33.291595 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:33.291156 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:33.291595 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:33.291241 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:36:33.291595 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:33.291244 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:36:33.291595 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:33.291295 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:35.291281283 +0000 UTC m=+38.191342697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:36:33.291595 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:33.291308 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:36:35.291302583 +0000 UTC m=+38.191363995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:36:33.900990 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:33.900918 2556 generic.go:358] "Generic (PLEG): container finished" podID="16b382be-b6de-434d-b4c9-f6fdd9bd81e3" containerID="2c7edbe7b86091f26b7cd4d495db55ccbf32ff5a3459905dd2a0822046da69d5" exitCode=0 May 27 18:36:33.900990 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:33.900973 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerDied","Data":"2c7edbe7b86091f26b7cd4d495db55ccbf32ff5a3459905dd2a0822046da69d5"} May 27 18:36:34.905622 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:34.905590 2556 generic.go:358] "Generic (PLEG): container finished" podID="16b382be-b6de-434d-b4c9-f6fdd9bd81e3" containerID="5a9175693a2bc32bc0c08d19be00628cd6eb4bf8e9735f9a3e55186706a237a9" exitCode=0 May 27 18:36:34.906164 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:34.905629 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerDied","Data":"5a9175693a2bc32bc0c08d19be00628cd6eb4bf8e9735f9a3e55186706a237a9"} May 27 18:36:35.306003 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:35.305843 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:35.306105 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:35.306026 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:35.306105 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:35.305982 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:36:35.306173 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:35.306130 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:36:39.306112442 +0000 UTC m=+42.206173859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:36:35.306173 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:35.306144 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:36:35.306251 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:35.306184 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:39.306170674 +0000 UTC m=+42.206232086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:36:35.909814 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:35.909778 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" event={"ID":"16b382be-b6de-434d-b4c9-f6fdd9bd81e3","Type":"ContainerStarted","Data":"d9a231b14a09158caed573f3eb172077730d8e40de124c75a33d80213a224aba"} May 27 18:36:35.933722 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:35.933035 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ksdlz" podStartSLOduration=5.95234574 podStartE2EDuration="38.93301917s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:00.301913584 +0000 UTC m=+3.201975011" lastFinishedPulling="2026-05-27 18:36:33.282587019 +0000 UTC m=+36.182648441" observedRunningTime="2026-05-27 18:36:35.932622987 +0000 UTC m=+38.832684423" watchObservedRunningTime="2026-05-27 18:36:35.93301917 +0000 UTC m=+38.833080607" May 27 18:36:39.329776 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:39.329745 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:39.330166 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:39.329788 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:39.330166 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:39.329888 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:36:39.330166 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:39.329920 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:36:39.330166 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:39.329936 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:47.329923038 +0000 UTC m=+50.229984452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:36:39.330166 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:39.329982 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:36:47.329965129 +0000 UTC m=+50.230026559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:36:44.461877 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:44.461841 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:44.464617 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:44.464599 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af1a7161-f90e-4801-83ef-059e2ea6cbe6-original-pull-secret\") pod \"global-pull-secret-syncer-zkdp5\" (UID: \"af1a7161-f90e-4801-83ef-059e2ea6cbe6\") " pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:44.644185 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:44.644158 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkdp5" May 27 18:36:44.820714 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:44.820683 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkdp5"] May 27 18:36:44.824646 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:36:44.824607 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1a7161_f90e_4801_83ef_059e2ea6cbe6.slice/crio-c7ceee9c2aba62c76a5109835426f6e23bf76a23ba3491f00efd845119310c0e WatchSource:0}: Error finding container c7ceee9c2aba62c76a5109835426f6e23bf76a23ba3491f00efd845119310c0e: Status 404 returned error can't find the container with id c7ceee9c2aba62c76a5109835426f6e23bf76a23ba3491f00efd845119310c0e May 27 18:36:44.927137 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:44.927109 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkdp5" event={"ID":"af1a7161-f90e-4801-83ef-059e2ea6cbe6","Type":"ContainerStarted","Data":"c7ceee9c2aba62c76a5109835426f6e23bf76a23ba3491f00efd845119310c0e"} May 27 18:36:47.382573 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:47.382532 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:36:47.383065 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:47.382710 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:36:47.383065 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:47.382717 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:36:47.383065 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:47.382797 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:37:03.382777028 +0000 UTC m=+66.282838464 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:36:47.383065 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:47.382808 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:36:47.383065 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:36:47.382854 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:37:03.38283902 +0000 UTC m=+66.282900434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:36:49.937720 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:49.937680 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkdp5" event={"ID":"af1a7161-f90e-4801-83ef-059e2ea6cbe6","Type":"ContainerStarted","Data":"2e3fc253b8a91861e17cd3fcb673513c0eb908dba84225ff6bfe2995b6aceb1e"} May 27 18:36:56.907259 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:56.907228 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dchzc" May 27 18:36:56.939473 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:36:56.939424 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zkdp5" podStartSLOduration=40.833117274 podStartE2EDuration="44.939410934s" podCreationTimestamp="2026-05-27 18:36:12 +0000 UTC" firstStartedPulling="2026-05-27 18:36:44.826349613 +0000 UTC m=+47.726411039" lastFinishedPulling="2026-05-27 18:36:48.932643285 +0000 UTC m=+51.832704699" observedRunningTime="2026-05-27 18:36:49.96733251 +0000 UTC m=+52.867393946" watchObservedRunningTime="2026-05-27 18:36:56.939410934 +0000 UTC m=+59.839472363" May 27 18:37:03.391984 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.391952 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:37:03.391984 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.391988 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:37:03.392525 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.392008 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:37:03.392525 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.392051 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:37:03.392525 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:03.392106 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:37:03.392525 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:03.392135 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:37:03.392525 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:03.392173 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:37:35.39215874 +0000 UTC m=+98.292220153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:37:03.392525 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:03.392187 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:37:35.392181384 +0000 UTC m=+98.292242808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:37:03.394884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.394863 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 18:37:03.394994 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.394895 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 18:37:03.402336 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:03.402321 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 18:37:03.402447 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:03.402382 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:07.40236659 +0000 UTC m=+130.302428008 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : secret "metrics-daemon-secret" not found May 27 18:37:03.404673 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.404659 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 18:37:03.415174 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.415156 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2hnh\" (UniqueName: \"kubernetes.io/projected/b803fe79-e60c-4096-acd4-215cc6419e36-kube-api-access-b2hnh\") pod \"network-check-target-ww928\" (UID: \"b803fe79-e60c-4096-acd4-215cc6419e36\") " pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:37:03.553075 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.553052 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9wtn\"" May 27 18:37:03.561312 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.561291 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:37:03.674739 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.674676 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ww928"] May 27 18:37:03.678019 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:37:03.677995 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb803fe79_e60c_4096_acd4_215cc6419e36.slice/crio-3f1fdc6b330151722da11505721fcf56bc86304d067378a53b95ecf5093cd323 WatchSource:0}: Error finding container 3f1fdc6b330151722da11505721fcf56bc86304d067378a53b95ecf5093cd323: Status 404 returned error can't find the container with id 3f1fdc6b330151722da11505721fcf56bc86304d067378a53b95ecf5093cd323 May 27 18:37:03.963284 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:03.963235 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ww928" event={"ID":"b803fe79-e60c-4096-acd4-215cc6419e36","Type":"ContainerStarted","Data":"3f1fdc6b330151722da11505721fcf56bc86304d067378a53b95ecf5093cd323"} May 27 18:37:06.970405 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:06.970361 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ww928" event={"ID":"b803fe79-e60c-4096-acd4-215cc6419e36","Type":"ContainerStarted","Data":"c1b4ae44223d1749e9866bea753ad68be1e8a31d520800316c137b558cab68a8"} May 27 18:37:06.970697 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:06.970614 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:37:35.405922 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:35.405881 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:37:35.405922 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:35.405929 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:37:35.406379 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:35.406058 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 18:37:35.406379 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:35.406105 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 18:37:35.406379 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:35.406152 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert podName:bcfb1af4-05a5-4473-b348-804babdf33bf nodeName:}" failed. No retries permitted until 2026-05-27 18:38:39.406129703 +0000 UTC m=+162.306191136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert") pod "ingress-canary-lqgfx" (UID: "bcfb1af4-05a5-4473-b348-804babdf33bf") : secret "canary-serving-cert" not found May 27 18:37:35.406379 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:37:35.406174 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls podName:166c076b-8d89-4736-b539-afcf8d064d76 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:39.406163997 +0000 UTC m=+162.306225414 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls") pod "dns-default-gwl77" (UID: "166c076b-8d89-4736-b539-afcf8d064d76") : secret "dns-default-metrics-tls" not found May 27 18:37:37.975022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:37.974992 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ww928" May 27 18:37:37.992812 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:37:37.992773 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ww928" podStartSLOduration=97.846115895 podStartE2EDuration="1m40.992745661s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:37:03.680012722 +0000 UTC m=+66.580074135" lastFinishedPulling="2026-05-27 18:37:06.826642488 +0000 UTC m=+69.726703901" observedRunningTime="2026-05-27 18:37:06.986920516 +0000 UTC m=+69.886981951" watchObservedRunningTime="2026-05-27 18:37:37.992745661 +0000 UTC m=+100.892807097" May 27 18:38:07.408982 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:07.408937 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:38:07.409474 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:07.409087 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 18:38:07.409474 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:07.409170 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs podName:fac32ff4-f58e-40c1-bd76-560d7e7f9016 nodeName:}" failed. No retries permitted until 2026-05-27 18:40:09.409153393 +0000 UTC m=+252.309214806 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs") pod "network-metrics-daemon-5sk84" (UID: "fac32ff4-f58e-40c1-bd76-560d7e7f9016") : secret "metrics-daemon-secret" not found May 27 18:38:14.412486 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.412449 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-z5hbb"] May 27 18:38:14.414567 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.414551 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.416976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.416958 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nn6qj\"" May 27 18:38:14.417284 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.417268 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 27 18:38:14.418044 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.418024 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 18:38:14.418171 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.418148 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 27 18:38:14.418231 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.418172 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 18:38:14.426081 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.426062 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 27 18:38:14.426243 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.426225 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-z5hbb"] May 27 18:38:14.515075 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.515045 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-758ddf86b6-r9jvf"] May 27 18:38:14.516819 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.516805 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.519556 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.519540 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 27 18:38:14.519973 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.519957 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 27 18:38:14.520021 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.519959 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 18:38:14.520334 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.520318 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 27 18:38:14.520334 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.520328 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 18:38:14.520580 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.520567 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 27 18:38:14.520648 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.520635 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t84n7\"" May 27 18:38:14.543684 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.543665 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-758ddf86b6-r9jvf"] May 27 18:38:14.554195 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.554176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1a4f503-f531-47cb-913c-34fe87a34574-service-ca-bundle\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.554286 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.554222 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c1a4f503-f531-47cb-913c-34fe87a34574-snapshots\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.554341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.554322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhxp\" (UniqueName: \"kubernetes.io/projected/c1a4f503-f531-47cb-913c-34fe87a34574-kube-api-access-9dhxp\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.554387 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.554359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1a4f503-f531-47cb-913c-34fe87a34574-serving-cert\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.554387 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.554379 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1a4f503-f531-47cb-913c-34fe87a34574-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.554503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.554458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1a4f503-f531-47cb-913c-34fe87a34574-tmp\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.611374 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.611350 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd"] May 27 18:38:14.613333 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.613319 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" May 27 18:38:14.617062 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.617042 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 27 18:38:14.617062 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.617059 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 27 18:38:14.617062 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.617044 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rfl62\"" May 27 18:38:14.622085 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.622066 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd"] May 27 18:38:14.655599 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-default-certificate\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.655707 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655609 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c1a4f503-f531-47cb-913c-34fe87a34574-snapshots\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.655707 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-stats-auth\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.655707 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jdqz\" (UniqueName: \"kubernetes.io/projected/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-kube-api-access-7jdqz\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.655823 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655767 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhxp\" (UniqueName: \"kubernetes.io/projected/c1a4f503-f531-47cb-913c-34fe87a34574-kube-api-access-9dhxp\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.655868 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.655909 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655866 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.655909 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655897 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1a4f503-f531-47cb-913c-34fe87a34574-serving-cert\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.655991 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655919 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1a4f503-f531-47cb-913c-34fe87a34574-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.655991 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.655976 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1a4f503-f531-47cb-913c-34fe87a34574-tmp\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.656091 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.656001 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1a4f503-f531-47cb-913c-34fe87a34574-service-ca-bundle\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.656299 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.656281 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1a4f503-f531-47cb-913c-34fe87a34574-tmp\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.656361 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.656344 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c1a4f503-f531-47cb-913c-34fe87a34574-snapshots\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.656559 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.656543 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1a4f503-f531-47cb-913c-34fe87a34574-service-ca-bundle\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.656796 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.656780 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1a4f503-f531-47cb-913c-34fe87a34574-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.658065 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.658048 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1a4f503-f531-47cb-913c-34fe87a34574-serving-cert\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.664450 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.664385 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhxp\" (UniqueName: \"kubernetes.io/projected/c1a4f503-f531-47cb-913c-34fe87a34574-kube-api-access-9dhxp\") pod \"insights-operator-78bdfb888c-z5hbb\" (UID: \"c1a4f503-f531-47cb-913c-34fe87a34574\") " pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.722202 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.722176 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df"] May 27 18:38:14.724085 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.724070 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.724461 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.724441 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" May 27 18:38:14.726796 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.726782 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 27 18:38:14.727105 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.727091 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 27 18:38:14.727851 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.727826 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nfdvd\"" May 27 18:38:14.727979 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.727965 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 27 18:38:14.728651 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.728636 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 27 18:38:14.737919 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.737901 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df"] May 27 18:38:14.757194 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.757166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmc56\" (UniqueName: \"kubernetes.io/projected/d8b1a701-1f1e-4879-a924-5b06481b31c5-kube-api-access-gmc56\") pod \"volume-data-source-validator-5cf8c89d64-2dpnd\" (UID: \"d8b1a701-1f1e-4879-a924-5b06481b31c5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" May 27 18:38:14.757322 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.757208 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-default-certificate\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.757322 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.757231 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-stats-auth\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.757322 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.757247 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jdqz\" (UniqueName: \"kubernetes.io/projected/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-kube-api-access-7jdqz\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.757503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.757463 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.757503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.757487 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.757605 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:14.757571 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 18:38:14.757656 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:14.757631 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:15.257615546 +0000 UTC m=+138.157676975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : configmap references non-existent config key: service-ca.crt May 27 18:38:14.757656 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:14.757651 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:15.257644573 +0000 UTC m=+138.157705986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : secret "router-metrics-certs-default" not found May 27 18:38:14.759911 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.759885 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-stats-auth\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.760030 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.759952 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-default-certificate\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.771539 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.771481 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jdqz\" (UniqueName: \"kubernetes.io/projected/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-kube-api-access-7jdqz\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:14.843058 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.843029 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-z5hbb"] May 27 18:38:14.845870 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:14.845842 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a4f503_f531_47cb_913c_34fe87a34574.slice/crio-bb20538946ddb4a69ac94a4e7f7edb17745fdb0764fec7205a4504b92e29cad2 WatchSource:0}: Error finding container bb20538946ddb4a69ac94a4e7f7edb17745fdb0764fec7205a4504b92e29cad2: Status 404 returned error can't find the container with id bb20538946ddb4a69ac94a4e7f7edb17745fdb0764fec7205a4504b92e29cad2 May 27 18:38:14.858295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.858271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1d43051-f350-4305-bf97-1eb748a62917-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.858389 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.858339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkw6b\" (UniqueName: \"kubernetes.io/projected/b1d43051-f350-4305-bf97-1eb748a62917-kube-api-access-hkw6b\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.858389 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.858405 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmc56\" (UniqueName: \"kubernetes.io/projected/d8b1a701-1f1e-4879-a924-5b06481b31c5-kube-api-access-gmc56\") pod \"volume-data-source-validator-5cf8c89d64-2dpnd\" (UID: \"d8b1a701-1f1e-4879-a924-5b06481b31c5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" May 27 18:38:14.858528 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.858446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1d43051-f350-4305-bf97-1eb748a62917-config\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.867134 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.867116 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmc56\" (UniqueName: \"kubernetes.io/projected/d8b1a701-1f1e-4879-a924-5b06481b31c5-kube-api-access-gmc56\") pod \"volume-data-source-validator-5cf8c89d64-2dpnd\" (UID: \"d8b1a701-1f1e-4879-a924-5b06481b31c5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" May 27 18:38:14.922034 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.921988 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" May 27 18:38:14.959030 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.958998 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1d43051-f350-4305-bf97-1eb748a62917-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.959184 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.959050 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkw6b\" (UniqueName: \"kubernetes.io/projected/b1d43051-f350-4305-bf97-1eb748a62917-kube-api-access-hkw6b\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.959249 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.959174 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1d43051-f350-4305-bf97-1eb748a62917-config\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.959659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.959638 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1d43051-f350-4305-bf97-1eb748a62917-config\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.961083 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.961064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1d43051-f350-4305-bf97-1eb748a62917-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:14.968420 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:14.968378 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkw6b\" (UniqueName: \"kubernetes.io/projected/b1d43051-f350-4305-bf97-1eb748a62917-kube-api-access-hkw6b\") pod \"kube-storage-version-migrator-operator-565644f49-984df\" (UID: \"b1d43051-f350-4305-bf97-1eb748a62917\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:15.034384 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:15.034354 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd"] May 27 18:38:15.038824 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:15.038795 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b1a701_1f1e_4879_a924_5b06481b31c5.slice/crio-37929eee09aafea33e103bea69d54e8a725c34145e364ed0c7a3b20652128b54 WatchSource:0}: Error finding container 37929eee09aafea33e103bea69d54e8a725c34145e364ed0c7a3b20652128b54: Status 404 returned error can't find the container with id 37929eee09aafea33e103bea69d54e8a725c34145e364ed0c7a3b20652128b54 May 27 18:38:15.043059 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:15.043041 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" May 27 18:38:15.089150 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:15.089125 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" event={"ID":"d8b1a701-1f1e-4879-a924-5b06481b31c5","Type":"ContainerStarted","Data":"37929eee09aafea33e103bea69d54e8a725c34145e364ed0c7a3b20652128b54"} May 27 18:38:15.090405 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:15.090366 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" event={"ID":"c1a4f503-f531-47cb-913c-34fe87a34574","Type":"ContainerStarted","Data":"bb20538946ddb4a69ac94a4e7f7edb17745fdb0764fec7205a4504b92e29cad2"} May 27 18:38:15.156953 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:15.156923 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df"] May 27 18:38:15.159843 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:15.159809 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d43051_f350_4305_bf97_1eb748a62917.slice/crio-144e3706149ac8d375b4f7e48e90fcd05c07d90ad99bda0873135aefa77e0fef WatchSource:0}: Error finding container 144e3706149ac8d375b4f7e48e90fcd05c07d90ad99bda0873135aefa77e0fef: Status 404 returned error can't find the container with id 144e3706149ac8d375b4f7e48e90fcd05c07d90ad99bda0873135aefa77e0fef May 27 18:38:15.261639 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:15.261610 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:15.261639 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:15.261642 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:15.261839 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:15.261744 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 18:38:15.261839 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:15.261784 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:16.261760613 +0000 UTC m=+139.161822040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : configmap references non-existent config key: service-ca.crt May 27 18:38:15.261839 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:15.261813 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:16.261799817 +0000 UTC m=+139.161861231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : secret "router-metrics-certs-default" not found May 27 18:38:16.094106 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:16.094049 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" event={"ID":"b1d43051-f350-4305-bf97-1eb748a62917","Type":"ContainerStarted","Data":"144e3706149ac8d375b4f7e48e90fcd05c07d90ad99bda0873135aefa77e0fef"} May 27 18:38:16.269622 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:16.269583 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:16.269793 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:16.269628 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:16.269793 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:16.269752 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 18:38:16.269793 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:16.269772 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:18.269748704 +0000 UTC m=+141.169810128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : configmap references non-existent config key: service-ca.crt May 27 18:38:16.269947 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:16.269819 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:18.269800666 +0000 UTC m=+141.169862079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : secret "router-metrics-certs-default" not found May 27 18:38:18.099143 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.099099 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" event={"ID":"d8b1a701-1f1e-4879-a924-5b06481b31c5","Type":"ContainerStarted","Data":"1131964a47e66c808c5a6b0526f4bede418c07502c560507813fb51bc78b457e"} May 27 18:38:18.100452 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.100425 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" event={"ID":"c1a4f503-f531-47cb-913c-34fe87a34574","Type":"ContainerStarted","Data":"f17b0e67aff325a8294ff3fb766532d755fac6706ff6ba370a72b3d78c0f3a03"} May 27 18:38:18.101675 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.101654 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" event={"ID":"b1d43051-f350-4305-bf97-1eb748a62917","Type":"ContainerStarted","Data":"9eb25ab5fd931e145da5b40956b8c5c35b0d3f33eae45bcd6d1f2e3f1a6694cc"} May 27 18:38:18.114874 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.114825 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-2dpnd" podStartSLOduration=1.941335172 podStartE2EDuration="4.114812689s" podCreationTimestamp="2026-05-27 18:38:14 +0000 UTC" firstStartedPulling="2026-05-27 18:38:15.040641265 +0000 UTC m=+137.940702685" lastFinishedPulling="2026-05-27 18:38:17.214118775 +0000 UTC m=+140.114180202" observedRunningTime="2026-05-27 18:38:18.114407411 +0000 UTC m=+141.014468842" watchObservedRunningTime="2026-05-27 18:38:18.114812689 +0000 UTC m=+141.014874125" May 27 18:38:18.132482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.132445 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" podStartSLOduration=1.7619841410000001 podStartE2EDuration="4.132435945s" podCreationTimestamp="2026-05-27 18:38:14 +0000 UTC" firstStartedPulling="2026-05-27 18:38:14.847416808 +0000 UTC m=+137.747478220" lastFinishedPulling="2026-05-27 18:38:17.217868595 +0000 UTC m=+140.117930024" observedRunningTime="2026-05-27 18:38:18.131739169 +0000 UTC m=+141.031800605" watchObservedRunningTime="2026-05-27 18:38:18.132435945 +0000 UTC m=+141.032497380" May 27 18:38:18.148646 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.148604 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" podStartSLOduration=2.090541159 podStartE2EDuration="4.148593461s" podCreationTimestamp="2026-05-27 18:38:14 +0000 UTC" firstStartedPulling="2026-05-27 18:38:15.161431391 +0000 UTC m=+138.061492805" lastFinishedPulling="2026-05-27 18:38:17.219483674 +0000 UTC m=+140.119545107" observedRunningTime="2026-05-27 18:38:18.147681813 +0000 UTC m=+141.047743248" watchObservedRunningTime="2026-05-27 18:38:18.148593461 +0000 UTC m=+141.048654896" May 27 18:38:18.282628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.282596 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:18.282628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.282631 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:18.282801 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:18.282734 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 18:38:18.282801 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:18.282776 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:22.282755043 +0000 UTC m=+145.182816470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : configmap references non-existent config key: service-ca.crt May 27 18:38:18.282883 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:18.282804 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:22.28279411 +0000 UTC m=+145.182855531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : secret "router-metrics-certs-default" not found May 27 18:38:18.640433 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.640386 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr"] May 27 18:38:18.642613 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.642597 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" May 27 18:38:18.645543 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.645523 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 18:38:18.645667 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.645520 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 18:38:18.645667 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.645654 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6bqjr\"" May 27 18:38:18.651338 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.651314 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr"] May 27 18:38:18.787379 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.787352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsp8d\" (UniqueName: \"kubernetes.io/projected/700305a3-ac2c-4ee1-b740-2c5a82af90cf-kube-api-access-fsp8d\") pod \"migrator-b985f5d89-zfhlr\" (UID: \"700305a3-ac2c-4ee1-b740-2c5a82af90cf\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" May 27 18:38:18.888590 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.888566 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsp8d\" (UniqueName: \"kubernetes.io/projected/700305a3-ac2c-4ee1-b740-2c5a82af90cf-kube-api-access-fsp8d\") pod \"migrator-b985f5d89-zfhlr\" (UID: \"700305a3-ac2c-4ee1-b740-2c5a82af90cf\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" May 27 18:38:18.897189 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.897131 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsp8d\" (UniqueName: \"kubernetes.io/projected/700305a3-ac2c-4ee1-b740-2c5a82af90cf-kube-api-access-fsp8d\") pod \"migrator-b985f5d89-zfhlr\" (UID: \"700305a3-ac2c-4ee1-b740-2c5a82af90cf\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" May 27 18:38:18.952691 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:18.952671 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" May 27 18:38:19.073798 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:19.073772 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr"] May 27 18:38:19.076832 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:19.076795 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700305a3_ac2c_4ee1_b740_2c5a82af90cf.slice/crio-96fda2a4fa8b5cf4faa22207483a94c5ca50ee1efa980ba8edc76f9473a592f2 WatchSource:0}: Error finding container 96fda2a4fa8b5cf4faa22207483a94c5ca50ee1efa980ba8edc76f9473a592f2: Status 404 returned error can't find the container with id 96fda2a4fa8b5cf4faa22207483a94c5ca50ee1efa980ba8edc76f9473a592f2 May 27 18:38:19.104131 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:19.104104 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" event={"ID":"700305a3-ac2c-4ee1-b740-2c5a82af90cf","Type":"ContainerStarted","Data":"96fda2a4fa8b5cf4faa22207483a94c5ca50ee1efa980ba8edc76f9473a592f2"} May 27 18:38:20.555843 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:20.555823 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kkhq8_fb2efac6-d4e5-4ea2-9401-f85e21b4d58e/dns-node-resolver/0.log" May 27 18:38:21.109285 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.109251 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" event={"ID":"700305a3-ac2c-4ee1-b740-2c5a82af90cf","Type":"ContainerStarted","Data":"985db6c9ab090cf3f7f650a64ce6a46302e7a0ff3f75bc2c244da58a6fbddfdb"} May 27 18:38:21.109285 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.109285 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" event={"ID":"700305a3-ac2c-4ee1-b740-2c5a82af90cf","Type":"ContainerStarted","Data":"e6f9605f1f08b574b7d145a8e6fc00b46040ae7c49c939aacafe6f3fb61fa9b4"} May 27 18:38:21.127185 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.127138 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-zfhlr" podStartSLOduration=1.721048592 podStartE2EDuration="3.127126402s" podCreationTimestamp="2026-05-27 18:38:18 +0000 UTC" firstStartedPulling="2026-05-27 18:38:19.078637737 +0000 UTC m=+141.978699150" lastFinishedPulling="2026-05-27 18:38:20.484715537 +0000 UTC m=+143.384776960" observedRunningTime="2026-05-27 18:38:21.126252394 +0000 UTC m=+144.026313830" watchObservedRunningTime="2026-05-27 18:38:21.127126402 +0000 UTC m=+144.027187837" May 27 18:38:21.403368 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.403197 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rxrgm"] May 27 18:38:21.405671 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.405646 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.408066 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.408046 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 18:38:21.408242 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.408225 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 18:38:21.408310 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.408297 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 18:38:21.409306 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.409288 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gtspv\"" May 27 18:38:21.409376 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.409331 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 18:38:21.412466 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.412445 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rxrgm"] May 27 18:38:21.508311 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.508286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-signing-cabundle\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.508470 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.508330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-signing-key\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.508470 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.508452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8k99\" (UniqueName: \"kubernetes.io/projected/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-kube-api-access-d8k99\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.555631 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.555608 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mncsf_e0fc65dd-a9f4-4371-a240-8deb8db9d999/node-ca/0.log" May 27 18:38:21.609047 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.609023 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-signing-cabundle\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.609486 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.609061 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-signing-key\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.609486 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.609152 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8k99\" (UniqueName: \"kubernetes.io/projected/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-kube-api-access-d8k99\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.609617 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.609600 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-signing-cabundle\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.611457 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.611441 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-signing-key\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.617246 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.617222 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8k99\" (UniqueName: \"kubernetes.io/projected/ad6a53cf-8bd9-4f94-8076-92a1dcc226d4-kube-api-access-d8k99\") pod \"service-ca-67d667c7d-rxrgm\" (UID: \"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4\") " pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.714616 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.714596 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" May 27 18:38:21.831610 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:21.831578 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rxrgm"] May 27 18:38:21.834687 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:21.834658 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6a53cf_8bd9_4f94_8076_92a1dcc226d4.slice/crio-160ef2983776b3da0f6485fd8029d4ccf02e30d3e8685dc9021ddd9861e49135 WatchSource:0}: Error finding container 160ef2983776b3da0f6485fd8029d4ccf02e30d3e8685dc9021ddd9861e49135: Status 404 returned error can't find the container with id 160ef2983776b3da0f6485fd8029d4ccf02e30d3e8685dc9021ddd9861e49135 May 27 18:38:22.112830 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:22.112759 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" event={"ID":"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4","Type":"ContainerStarted","Data":"160ef2983776b3da0f6485fd8029d4ccf02e30d3e8685dc9021ddd9861e49135"} May 27 18:38:22.314653 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:22.314619 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:22.314653 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:22.314648 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:22.314830 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:22.314772 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:30.31475723 +0000 UTC m=+153.214818647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : configmap references non-existent config key: service-ca.crt May 27 18:38:22.314830 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:22.314816 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 18:38:22.314907 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:22.314868 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:30.31485405 +0000 UTC m=+153.214915462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : secret "router-metrics-certs-default" not found May 27 18:38:25.121656 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:25.121624 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" event={"ID":"ad6a53cf-8bd9-4f94-8076-92a1dcc226d4","Type":"ContainerStarted","Data":"d7caf12a158fda3818474087d0906c9a0956defeef59bef304f3ca4f745f350e"} May 27 18:38:25.139485 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:25.139432 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-rxrgm" podStartSLOduration=1.3087497639999999 podStartE2EDuration="4.139414975s" podCreationTimestamp="2026-05-27 18:38:21 +0000 UTC" firstStartedPulling="2026-05-27 18:38:21.836499865 +0000 UTC m=+144.736561277" lastFinishedPulling="2026-05-27 18:38:24.667165075 +0000 UTC m=+147.567226488" observedRunningTime="2026-05-27 18:38:25.13724409 +0000 UTC m=+148.037305526" watchObservedRunningTime="2026-05-27 18:38:25.139414975 +0000 UTC m=+148.039476408" May 27 18:38:30.372515 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:30.372478 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:30.372515 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:30.372515 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:30.372932 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:30.372631 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 18:38:30.372932 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:30.372639 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:46.372621937 +0000 UTC m=+169.272683379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : configmap references non-existent config key: service-ca.crt May 27 18:38:30.372932 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:30.372670 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs podName:bb199dc7-3b25-435e-9b4b-394a8c1f08a6 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:46.372658408 +0000 UTC m=+169.272719821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs") pod "router-default-758ddf86b6-r9jvf" (UID: "bb199dc7-3b25-435e-9b4b-394a8c1f08a6") : secret "router-metrics-certs-default" not found May 27 18:38:34.522201 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:34.522163 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-lqgfx" podUID="bcfb1af4-05a5-4473-b348-804babdf33bf" May 27 18:38:34.545519 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:34.545484 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gwl77" podUID="166c076b-8d89-4736-b539-afcf8d064d76" May 27 18:38:34.755380 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:34.755336 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5sk84" podUID="fac32ff4-f58e-40c1-bd76-560d7e7f9016" May 27 18:38:35.144621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:35.144592 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:38:39.436096 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:39.436062 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:38:39.436096 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:39.436102 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:38:39.438468 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:39.438442 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/166c076b-8d89-4736-b539-afcf8d064d76-metrics-tls\") pod \"dns-default-gwl77\" (UID: \"166c076b-8d89-4736-b539-afcf8d064d76\") " pod="openshift-dns/dns-default-gwl77" May 27 18:38:39.438581 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:39.438505 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfb1af4-05a5-4473-b348-804babdf33bf-cert\") pod \"ingress-canary-lqgfx\" (UID: \"bcfb1af4-05a5-4473-b348-804babdf33bf\") " pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:38:39.647873 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:39.647849 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zv46l\"" May 27 18:38:39.655968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:39.655940 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lqgfx" May 27 18:38:39.769908 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:39.769879 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lqgfx"] May 27 18:38:39.772832 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:39.772805 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfb1af4_05a5_4473_b348_804babdf33bf.slice/crio-4c34b656c2c2d117cfee24424a14214aced66b8a6fc9d31188cc96c6b5351c12 WatchSource:0}: Error finding container 4c34b656c2c2d117cfee24424a14214aced66b8a6fc9d31188cc96c6b5351c12: Status 404 returned error can't find the container with id 4c34b656c2c2d117cfee24424a14214aced66b8a6fc9d31188cc96c6b5351c12 May 27 18:38:40.156780 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:40.156705 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lqgfx" event={"ID":"bcfb1af4-05a5-4473-b348-804babdf33bf","Type":"ContainerStarted","Data":"4c34b656c2c2d117cfee24424a14214aced66b8a6fc9d31188cc96c6b5351c12"} May 27 18:38:42.162943 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.162867 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lqgfx" event={"ID":"bcfb1af4-05a5-4473-b348-804babdf33bf","Type":"ContainerStarted","Data":"7a0cb995fff2a8bea89cadd2d7e0b17aad91bf90afc0dbdb11d4847975284247"} May 27 18:38:42.189792 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.189748 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lqgfx" podStartSLOduration=129.160540628 podStartE2EDuration="2m11.18973361s" podCreationTimestamp="2026-05-27 18:36:31 +0000 UTC" firstStartedPulling="2026-05-27 18:38:39.774697148 +0000 UTC m=+162.674758563" lastFinishedPulling="2026-05-27 18:38:41.80389013 +0000 UTC m=+164.703951545" observedRunningTime="2026-05-27 18:38:42.189065357 +0000 UTC m=+165.089126793" watchObservedRunningTime="2026-05-27 18:38:42.18973361 +0000 UTC m=+165.089795045" May 27 18:38:42.235758 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.235735 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w6lzk"] May 27 18:38:42.251487 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.251458 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6lzk"] May 27 18:38:42.251611 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.251574 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.254259 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.254239 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z6wdj\"" May 27 18:38:42.254351 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.254236 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 18:38:42.254580 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.254559 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 18:38:42.359208 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.359176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkj5n\" (UniqueName: \"kubernetes.io/projected/d09d62da-3426-453a-b9ce-56e7e719ffef-kube-api-access-kkj5n\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.359208 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.359208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d09d62da-3426-453a-b9ce-56e7e719ffef-crio-socket\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.359371 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.359270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09d62da-3426-453a-b9ce-56e7e719ffef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.359371 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.359293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d09d62da-3426-453a-b9ce-56e7e719ffef-data-volume\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.359371 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.359309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09d62da-3426-453a-b9ce-56e7e719ffef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.459798 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.459773 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkj5n\" (UniqueName: \"kubernetes.io/projected/d09d62da-3426-453a-b9ce-56e7e719ffef-kube-api-access-kkj5n\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.459886 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.459806 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d09d62da-3426-453a-b9ce-56e7e719ffef-crio-socket\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.459886 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.459867 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09d62da-3426-453a-b9ce-56e7e719ffef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.459993 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.459893 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d09d62da-3426-453a-b9ce-56e7e719ffef-data-volume\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.459993 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.459916 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09d62da-3426-453a-b9ce-56e7e719ffef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.459993 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.459975 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d09d62da-3426-453a-b9ce-56e7e719ffef-crio-socket\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.460223 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.460205 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d09d62da-3426-453a-b9ce-56e7e719ffef-data-volume\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.460439 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.460420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09d62da-3426-453a-b9ce-56e7e719ffef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.462302 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.462285 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09d62da-3426-453a-b9ce-56e7e719ffef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.467593 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.467576 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkj5n\" (UniqueName: \"kubernetes.io/projected/d09d62da-3426-453a-b9ce-56e7e719ffef-kube-api-access-kkj5n\") pod \"insights-runtime-extractor-w6lzk\" (UID: \"d09d62da-3426-453a-b9ce-56e7e719ffef\") " pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.564543 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.564521 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6lzk" May 27 18:38:42.684968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:42.684917 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6lzk"] May 27 18:38:42.688441 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:42.688333 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09d62da_3426_453a_b9ce_56e7e719ffef.slice/crio-a3d7eb158aac08aba86898025919d9397a050aae6489c87a78c91a393b857436 WatchSource:0}: Error finding container a3d7eb158aac08aba86898025919d9397a050aae6489c87a78c91a393b857436: Status 404 returned error can't find the container with id a3d7eb158aac08aba86898025919d9397a050aae6489c87a78c91a393b857436 May 27 18:38:43.166258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:43.166180 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6lzk" event={"ID":"d09d62da-3426-453a-b9ce-56e7e719ffef","Type":"ContainerStarted","Data":"0339cd0533f899bf5333fb0bdb7d64b330dffbb51714a9afc9f00d058ff86232"} May 27 18:38:43.166258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:43.166223 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6lzk" event={"ID":"d09d62da-3426-453a-b9ce-56e7e719ffef","Type":"ContainerStarted","Data":"a3d7eb158aac08aba86898025919d9397a050aae6489c87a78c91a393b857436"} May 27 18:38:44.170702 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:44.170664 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6lzk" event={"ID":"d09d62da-3426-453a-b9ce-56e7e719ffef","Type":"ContainerStarted","Data":"2bbcc145cb558f9351f42f1ac79bfd302ab1797d9a1dfbfa15d463d8bbd7e5cd"} May 27 18:38:45.174707 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:45.174670 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6lzk" event={"ID":"d09d62da-3426-453a-b9ce-56e7e719ffef","Type":"ContainerStarted","Data":"c37c212042c934090c5cd9e8dd59ca5a797f093f82af151abe1e6030b5a9b5ee"} May 27 18:38:45.195895 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:45.195854 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w6lzk" podStartSLOduration=0.970595612 podStartE2EDuration="3.195841202s" podCreationTimestamp="2026-05-27 18:38:42 +0000 UTC" firstStartedPulling="2026-05-27 18:38:42.811197516 +0000 UTC m=+165.711258929" lastFinishedPulling="2026-05-27 18:38:45.036443093 +0000 UTC m=+167.936504519" observedRunningTime="2026-05-27 18:38:45.194139607 +0000 UTC m=+168.094201043" watchObservedRunningTime="2026-05-27 18:38:45.195841202 +0000 UTC m=+168.095902638" May 27 18:38:45.733274 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:45.733246 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:38:46.387912 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.387879 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:46.388248 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.387944 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:46.388597 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.388578 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-service-ca-bundle\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:46.390067 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.390045 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb199dc7-3b25-435e-9b4b-394a8c1f08a6-metrics-certs\") pod \"router-default-758ddf86b6-r9jvf\" (UID: \"bb199dc7-3b25-435e-9b4b-394a8c1f08a6\") " pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:46.625873 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.625842 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:46.733972 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.733927 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gwl77" May 27 18:38:46.736846 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.736827 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s4chr\"" May 27 18:38:46.745168 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.745150 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gwl77" May 27 18:38:46.766644 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.766621 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-758ddf86b6-r9jvf"] May 27 18:38:46.768966 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:46.768940 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb199dc7_3b25_435e_9b4b_394a8c1f08a6.slice/crio-b7f2b4f790fc1548f82ed86e7a3c32fefb3c49194ef44078009ac50e176afcc2 WatchSource:0}: Error finding container b7f2b4f790fc1548f82ed86e7a3c32fefb3c49194ef44078009ac50e176afcc2: Status 404 returned error can't find the container with id b7f2b4f790fc1548f82ed86e7a3c32fefb3c49194ef44078009ac50e176afcc2 May 27 18:38:46.873380 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:46.873313 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gwl77"] May 27 18:38:46.876983 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:46.876957 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166c076b_8d89_4736_b539_afcf8d064d76.slice/crio-3b432d4e05bea741d76aa53739a2c50a8e404cde849cf445f556808c5a52cec9 WatchSource:0}: Error finding container 3b432d4e05bea741d76aa53739a2c50a8e404cde849cf445f556808c5a52cec9: Status 404 returned error can't find the container with id 3b432d4e05bea741d76aa53739a2c50a8e404cde849cf445f556808c5a52cec9 May 27 18:38:47.180455 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:47.180417 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gwl77" event={"ID":"166c076b-8d89-4736-b539-afcf8d064d76","Type":"ContainerStarted","Data":"3b432d4e05bea741d76aa53739a2c50a8e404cde849cf445f556808c5a52cec9"} May 27 18:38:47.181644 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:47.181622 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" event={"ID":"bb199dc7-3b25-435e-9b4b-394a8c1f08a6","Type":"ContainerStarted","Data":"7d462958c21112e5b71c7778e588e8d84ef5874e5b61d5781337f6ef5229a7a7"} May 27 18:38:47.181711 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:47.181653 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" event={"ID":"bb199dc7-3b25-435e-9b4b-394a8c1f08a6","Type":"ContainerStarted","Data":"b7f2b4f790fc1548f82ed86e7a3c32fefb3c49194ef44078009ac50e176afcc2"} May 27 18:38:47.201827 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:47.201783 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" podStartSLOduration=33.201769594 podStartE2EDuration="33.201769594s" podCreationTimestamp="2026-05-27 18:38:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:38:47.201082537 +0000 UTC m=+170.101143973" watchObservedRunningTime="2026-05-27 18:38:47.201769594 +0000 UTC m=+170.101831028" May 27 18:38:47.626318 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:47.626289 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:47.629503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:47.629478 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:48.184658 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.184618 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:48.185931 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.185903 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-758ddf86b6-r9jvf" May 27 18:38:48.466850 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.466821 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f658b4b7-pttvp"] May 27 18:38:48.469682 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.469613 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.474505 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.474482 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sn8m5\"" May 27 18:38:48.474601 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.474578 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 18:38:48.474804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.474691 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 18:38:48.474804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.474697 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 18:38:48.474804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.474482 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 18:38:48.475766 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.475617 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 18:38:48.475967 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.475892 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 18:38:48.476544 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.476519 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 18:38:48.487269 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.487250 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f658b4b7-pttvp"] May 27 18:38:48.604899 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.604874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-serving-cert\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.605009 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.604909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxdjp\" (UniqueName: \"kubernetes.io/projected/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-kube-api-access-zxdjp\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.605009 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.604985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-oauth-config\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.605077 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.605022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-oauth-serving-cert\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.605077 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.605057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-service-ca\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.605135 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.605091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-config\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.706333 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.706263 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-serving-cert\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.706333 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.706305 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxdjp\" (UniqueName: \"kubernetes.io/projected/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-kube-api-access-zxdjp\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.706333 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.706331 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-oauth-config\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.706804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.706374 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-oauth-serving-cert\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.706804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.706419 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-service-ca\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.706804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.706442 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-config\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.707119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.707101 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-oauth-serving-cert\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.707191 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.707122 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-config\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.707191 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.707138 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-service-ca\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.708684 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.708665 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-oauth-config\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.708768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.708686 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-serving-cert\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.721988 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.721960 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxdjp\" (UniqueName: \"kubernetes.io/projected/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-kube-api-access-zxdjp\") pod \"console-84f658b4b7-pttvp\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.778929 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.778907 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:48.909209 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:48.908519 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f658b4b7-pttvp"] May 27 18:38:48.914473 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:48.914440 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b691b8d_fb2d_4ac4_b5fa_e3c4508f3c5a.slice/crio-e30ec2f5b241ec14c10aff277a25d9763b0b6783638f986a29c5fd1d8bcc163f WatchSource:0}: Error finding container e30ec2f5b241ec14c10aff277a25d9763b0b6783638f986a29c5fd1d8bcc163f: Status 404 returned error can't find the container with id e30ec2f5b241ec14c10aff277a25d9763b0b6783638f986a29c5fd1d8bcc163f May 27 18:38:49.028213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.028141 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w"] May 27 18:38:49.030631 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.030611 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:49.033040 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.033022 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 27 18:38:49.033165 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.033147 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zrtjm\"" May 27 18:38:49.042967 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.042946 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w"] May 27 18:38:49.188031 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.188003 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f658b4b7-pttvp" event={"ID":"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a","Type":"ContainerStarted","Data":"e30ec2f5b241ec14c10aff277a25d9763b0b6783638f986a29c5fd1d8bcc163f"} May 27 18:38:49.189600 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.189571 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gwl77" event={"ID":"166c076b-8d89-4736-b539-afcf8d064d76","Type":"ContainerStarted","Data":"46090a0eaf535e75dd47d0ad85a9165bef3f8d4d91179359fcd25f66d827b64f"} May 27 18:38:49.189690 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.189606 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gwl77" event={"ID":"166c076b-8d89-4736-b539-afcf8d064d76","Type":"ContainerStarted","Data":"99fc2b4f35ff605de2eb39bb21d56220ec7f8a8633369dbc3cd63c8a4c6a8561"} May 27 18:38:49.189790 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.189774 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gwl77" May 27 18:38:49.206578 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.206538 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gwl77" podStartSLOduration=136.680380079 podStartE2EDuration="2m18.206526538s" podCreationTimestamp="2026-05-27 18:36:31 +0000 UTC" firstStartedPulling="2026-05-27 18:38:46.878943785 +0000 UTC m=+169.779005199" lastFinishedPulling="2026-05-27 18:38:48.405090245 +0000 UTC m=+171.305151658" observedRunningTime="2026-05-27 18:38:49.205824921 +0000 UTC m=+172.105886357" watchObservedRunningTime="2026-05-27 18:38:49.206526538 +0000 UTC m=+172.106587973" May 27 18:38:49.211457 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.211431 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b407c031-a187-4fd9-ae2c-a411abadd228-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w\" (UID: \"b407c031-a187-4fd9-ae2c-a411abadd228\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:49.312444 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.312375 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b407c031-a187-4fd9-ae2c-a411abadd228-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w\" (UID: \"b407c031-a187-4fd9-ae2c-a411abadd228\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:49.312696 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:49.312678 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 27 18:38:49.312750 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:38:49.312740 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407c031-a187-4fd9-ae2c-a411abadd228-tls-certificates podName:b407c031-a187-4fd9-ae2c-a411abadd228 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:49.812721889 +0000 UTC m=+172.712783302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b407c031-a187-4fd9-ae2c-a411abadd228-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" (UID: "b407c031-a187-4fd9-ae2c-a411abadd228") : secret "prometheus-operator-admission-webhook-tls" not found May 27 18:38:49.816093 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.816056 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b407c031-a187-4fd9-ae2c-a411abadd228-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w\" (UID: \"b407c031-a187-4fd9-ae2c-a411abadd228\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:49.818842 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.818815 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b407c031-a187-4fd9-ae2c-a411abadd228-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w\" (UID: \"b407c031-a187-4fd9-ae2c-a411abadd228\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:49.939217 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:49.939189 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:50.074194 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:50.074125 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w"] May 27 18:38:50.077424 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:38:50.077372 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb407c031_a187_4fd9_ae2c_a411abadd228.slice/crio-bff511fc7096513245e868a14b4434f27fb8a337369fdfbdda6682ab6a70d254 WatchSource:0}: Error finding container bff511fc7096513245e868a14b4434f27fb8a337369fdfbdda6682ab6a70d254: Status 404 returned error can't find the container with id bff511fc7096513245e868a14b4434f27fb8a337369fdfbdda6682ab6a70d254 May 27 18:38:50.193358 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:50.193331 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" event={"ID":"b407c031-a187-4fd9-ae2c-a411abadd228","Type":"ContainerStarted","Data":"bff511fc7096513245e868a14b4434f27fb8a337369fdfbdda6682ab6a70d254"} May 27 18:38:52.201442 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:52.201362 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" event={"ID":"b407c031-a187-4fd9-ae2c-a411abadd228","Type":"ContainerStarted","Data":"0f05d5c1be3a55bb2cf0d13cae60cbe0d245ff080c287eaa0f9945458f42281c"} May 27 18:38:52.202009 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:52.201673 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:52.207334 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:52.207309 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" May 27 18:38:52.221408 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:52.221353 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w" podStartSLOduration=2.083442196 podStartE2EDuration="3.221341991s" podCreationTimestamp="2026-05-27 18:38:49 +0000 UTC" firstStartedPulling="2026-05-27 18:38:50.079516968 +0000 UTC m=+172.979578380" lastFinishedPulling="2026-05-27 18:38:51.217416749 +0000 UTC m=+174.117478175" observedRunningTime="2026-05-27 18:38:52.219549271 +0000 UTC m=+175.119610707" watchObservedRunningTime="2026-05-27 18:38:52.221341991 +0000 UTC m=+175.121403423" May 27 18:38:53.208086 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:53.208047 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f658b4b7-pttvp" event={"ID":"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a","Type":"ContainerStarted","Data":"6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9"} May 27 18:38:53.231135 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:53.231092 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84f658b4b7-pttvp" podStartSLOduration=1.5333191689999999 podStartE2EDuration="5.231079832s" podCreationTimestamp="2026-05-27 18:38:48 +0000 UTC" firstStartedPulling="2026-05-27 18:38:48.91633945 +0000 UTC m=+171.816400867" lastFinishedPulling="2026-05-27 18:38:52.614100112 +0000 UTC m=+175.514161530" observedRunningTime="2026-05-27 18:38:53.229358232 +0000 UTC m=+176.129419666" watchObservedRunningTime="2026-05-27 18:38:53.231079832 +0000 UTC m=+176.131141267" May 27 18:38:58.779708 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:58.779671 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:58.780139 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:58.779717 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:58.784388 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:58.784365 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:38:59.195516 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:59.195488 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gwl77" May 27 18:38:59.225975 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:38:59.225954 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:39:06.469541 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.469502 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql"] May 27 18:39:06.472673 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.472649 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.475529 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.475506 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 27 18:39:06.475706 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.475649 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 18:39:06.475820 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.475727 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 18:39:06.476739 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.476718 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 18:39:06.476739 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.476730 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 27 18:39:06.476976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.476732 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ctvsq\"" May 27 18:39:06.482065 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.482042 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql"] May 27 18:39:06.487736 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.487716 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-29r5j"] May 27 18:39:06.489974 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.489954 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.492421 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.492384 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 18:39:06.492631 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.492614 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 18:39:06.492631 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.492625 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 18:39:06.492879 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.492851 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kf6kq\"" May 27 18:39:06.496827 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.496808 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst"] May 27 18:39:06.498940 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.498923 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.501417 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.501379 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 27 18:39:06.501514 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.501476 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 27 18:39:06.501514 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.501502 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-srlk5\"" May 27 18:39:06.501619 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.501388 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 27 18:39:06.511478 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.511458 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst"] May 27 18:39:06.536956 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.536935 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.537070 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.536971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.537070 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/154bc42f-421f-49e9-93ab-0bc79c6679cc-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.537070 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzdcc\" (UniqueName: \"kubernetes.io/projected/154bc42f-421f-49e9-93ab-0bc79c6679cc-kube-api-access-dzdcc\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.537219 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537219 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-metrics-client-ca\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537219 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.537318 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-tls\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537318 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-root\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537318 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-wtmp\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537318 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.537477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p527z\" (UniqueName: \"kubernetes.io/projected/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-api-access-p527z\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.537477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kws8h\" (UniqueName: \"kubernetes.io/projected/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-kube-api-access-kws8h\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.537477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-textfile\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537502 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-sys\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.537621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537559 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.537621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.537580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.638147 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638114 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.638257 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638159 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-tls\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638257 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638191 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-root\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638257 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638217 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-wtmp\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638257 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638244 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.638494 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:39:06.638283 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 27 18:39:06.638494 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:39:06.638345 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-tls podName:e1a451b2-4353-47b5-bb0a-11ae1bcac1bf nodeName:}" failed. No retries permitted until 2026-05-27 18:39:07.138326032 +0000 UTC m=+190.038387461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-tls") pod "node-exporter-29r5j" (UID: "e1a451b2-4353-47b5-bb0a-11ae1bcac1bf") : secret "node-exporter-tls" not found May 27 18:39:06.638494 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638341 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p527z\" (UniqueName: \"kubernetes.io/projected/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-api-access-p527z\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.638494 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-wtmp\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638494 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638432 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kws8h\" (UniqueName: \"kubernetes.io/projected/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-kube-api-access-kws8h\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638494 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638489 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638518 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-textfile\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638519 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-root\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638547 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638574 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-sys\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638606 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638635 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638674 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638700 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638735 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/154bc42f-421f-49e9-93ab-0bc79c6679cc-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638763 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzdcc\" (UniqueName: \"kubernetes.io/projected/154bc42f-421f-49e9-93ab-0bc79c6679cc-kube-api-access-dzdcc\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.638805 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638793 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638823 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-metrics-client-ca\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.638878 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-textfile\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.639042 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.639106 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-sys\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.639137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:39:06.639180 2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:39:06.639225 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-tls podName:154bc42f-421f-49e9-93ab-0bc79c6679cc nodeName:}" failed. No retries permitted until 2026-05-27 18:39:07.139209849 +0000 UTC m=+190.039271262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-2h9ql" (UID: "154bc42f-421f-49e9-93ab-0bc79c6679cc") : secret "openshift-state-metrics-tls" not found May 27 18:39:06.639423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.639226 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.639823 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.639630 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/154bc42f-421f-49e9-93ab-0bc79c6679cc-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.639945 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.639920 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-metrics-client-ca\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.640518 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.640492 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.641660 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.641638 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.642051 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.642023 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.642150 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.642073 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.642190 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.642168 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.648146 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.648125 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kws8h\" (UniqueName: \"kubernetes.io/projected/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-kube-api-access-kws8h\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:06.648539 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.648516 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzdcc\" (UniqueName: \"kubernetes.io/projected/154bc42f-421f-49e9-93ab-0bc79c6679cc-kube-api-access-dzdcc\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:06.648915 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.648899 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p527z\" (UniqueName: \"kubernetes.io/projected/a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5-kube-api-access-p527z\") pod \"kube-state-metrics-54fd6bc5c4-42nst\" (UID: \"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.808423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.808346 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" May 27 18:39:06.936412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:06.936362 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst"] May 27 18:39:06.939469 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:39:06.939440 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64d4eb0_d775_47a2_a4d9_bbe1c12d61b5.slice/crio-5477c665be4fbba765f4a41f5c26b968ae025151d9920bbd5e6793e81f957149 WatchSource:0}: Error finding container 5477c665be4fbba765f4a41f5c26b968ae025151d9920bbd5e6793e81f957149: Status 404 returned error can't find the container with id 5477c665be4fbba765f4a41f5c26b968ae025151d9920bbd5e6793e81f957149 May 27 18:39:07.142341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.142259 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-tls\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:07.142341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.142323 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:07.144686 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.144656 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1a451b2-4353-47b5-bb0a-11ae1bcac1bf-node-exporter-tls\") pod \"node-exporter-29r5j\" (UID: \"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf\") " pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:07.144781 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.144715 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/154bc42f-421f-49e9-93ab-0bc79c6679cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-2h9ql\" (UID: \"154bc42f-421f-49e9-93ab-0bc79c6679cc\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:07.245038 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.245007 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" event={"ID":"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5","Type":"ContainerStarted","Data":"5477c665be4fbba765f4a41f5c26b968ae025151d9920bbd5e6793e81f957149"} May 27 18:39:07.384554 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.384530 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" May 27 18:39:07.399215 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.399163 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29r5j" May 27 18:39:07.523998 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.523966 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql"] May 27 18:39:07.527794 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:39:07.527761 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod154bc42f_421f_49e9_93ab_0bc79c6679cc.slice/crio-a16e245790f04fa07677059eae3b0472ffedfef9213b8584e5794ffce026f158 WatchSource:0}: Error finding container a16e245790f04fa07677059eae3b0472ffedfef9213b8584e5794ffce026f158: Status 404 returned error can't find the container with id a16e245790f04fa07677059eae3b0472ffedfef9213b8584e5794ffce026f158 May 27 18:39:07.562649 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.558323 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 18:39:07.563799 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.563774 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.566840 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.566816 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 18:39:07.566942 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.566873 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 18:39:07.567001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.566956 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 18:39:07.567001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.566874 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 18:39:07.567001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.566987 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gmndh\"" May 27 18:39:07.567149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.567020 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 18:39:07.567149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.566818 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 18:39:07.567149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.567134 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 18:39:07.567320 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.567260 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 18:39:07.567439 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.567418 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 18:39:07.580524 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.580502 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 18:39:07.646695 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.646804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646708 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.646804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.646924 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646802 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.646924 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.646924 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px99t\" (UniqueName: \"kubernetes.io/projected/d050bacb-1bce-40ee-982c-273edfe9386f-kube-api-access-px99t\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.647071 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646935 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d050bacb-1bce-40ee-982c-273edfe9386f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.647071 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d050bacb-1bce-40ee-982c-273edfe9386f-config-out\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.647071 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.646998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.647071 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.647031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.647071 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.647058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-web-config\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.647306 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.647110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-config-volume\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.647306 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.647145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.747712 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747685 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.747857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747720 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.747857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747752 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.747857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747771 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.747857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747796 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.747857 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:39:07.747844 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-trusted-ca-bundle podName:d050bacb-1bce-40ee-982c-273edfe9386f nodeName:}" failed. No retries permitted until 2026-05-27 18:39:08.247822836 +0000 UTC m=+191.147884249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d050bacb-1bce-40ee-982c-273edfe9386f") : configmap references non-existent config key: ca-bundle.crt May 27 18:39:07.748119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747878 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-px99t\" (UniqueName: \"kubernetes.io/projected/d050bacb-1bce-40ee-982c-273edfe9386f-kube-api-access-px99t\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747924 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d050bacb-1bce-40ee-982c-273edfe9386f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747950 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d050bacb-1bce-40ee-982c-273edfe9386f-config-out\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.747984 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.748012 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.748035 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-web-config\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748498 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.748130 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-config-volume\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748498 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.748192 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748498 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.748421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.748827 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.748800 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.751232 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.751209 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d050bacb-1bce-40ee-982c-273edfe9386f-config-out\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.751341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.751291 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.751922 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.751839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.751922 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.751889 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-config-volume\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.752321 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.752297 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.752415 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.752327 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.752415 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.752388 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.752681 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.752662 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d050bacb-1bce-40ee-982c-273edfe9386f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.753597 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.753576 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d050bacb-1bce-40ee-982c-273edfe9386f-web-config\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:07.759135 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:07.759111 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px99t\" (UniqueName: \"kubernetes.io/projected/d050bacb-1bce-40ee-982c-273edfe9386f-kube-api-access-px99t\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:08.012956 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.012913 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f658b4b7-pttvp"] May 27 18:39:08.249553 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.249508 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29r5j" event={"ID":"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf","Type":"ContainerStarted","Data":"b5f1566b92b268f6e780454bb2d8323611e450ef78fc4af58ad1a646084469e1"} May 27 18:39:08.251344 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.251312 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" event={"ID":"154bc42f-421f-49e9-93ab-0bc79c6679cc","Type":"ContainerStarted","Data":"6d2b2929bae9a150512df638f463653a58225af430b3cac7e43be544c8b3dc18"} May 27 18:39:08.251344 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.251342 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" event={"ID":"154bc42f-421f-49e9-93ab-0bc79c6679cc","Type":"ContainerStarted","Data":"d6a6152248fd77fffc57dd6f4b0f205225ec1733186062814180bfa9e6d36ab2"} May 27 18:39:08.251529 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.251354 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" event={"ID":"154bc42f-421f-49e9-93ab-0bc79c6679cc","Type":"ContainerStarted","Data":"a16e245790f04fa07677059eae3b0472ffedfef9213b8584e5794ffce026f158"} May 27 18:39:08.252712 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.252690 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:08.253468 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.253442 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d050bacb-1bce-40ee-982c-273edfe9386f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d050bacb-1bce-40ee-982c-273edfe9386f\") " pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:08.486757 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.486715 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 18:39:08.675487 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:08.675437 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 18:39:08.844327 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:39:08.844290 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd050bacb_1bce_40ee_982c_273edfe9386f.slice/crio-792b3ea0816c3caee243af83d6d601ada628225fd6917f4b8e59c51b1dc35649 WatchSource:0}: Error finding container 792b3ea0816c3caee243af83d6d601ada628225fd6917f4b8e59c51b1dc35649: Status 404 returned error can't find the container with id 792b3ea0816c3caee243af83d6d601ada628225fd6917f4b8e59c51b1dc35649 May 27 18:39:09.255927 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.255891 2556 generic.go:358] "Generic (PLEG): container finished" podID="e1a451b2-4353-47b5-bb0a-11ae1bcac1bf" containerID="b0539ccca1c8bf4acec84bd699ec1f16ef27ac321f249b9eaea34b12f4238f62" exitCode=0 May 27 18:39:09.256091 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.255970 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29r5j" event={"ID":"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf","Type":"ContainerDied","Data":"b0539ccca1c8bf4acec84bd699ec1f16ef27ac321f249b9eaea34b12f4238f62"} May 27 18:39:09.257987 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.257963 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" event={"ID":"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5","Type":"ContainerStarted","Data":"a6b21b1e6630a81fdde14d6c19eca7adc6773dacd4d0fee64f4a7b0d434ccd39"} May 27 18:39:09.258092 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.257994 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" event={"ID":"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5","Type":"ContainerStarted","Data":"d55f1bdbea4604f77f64ce0c357624d879e3b532be5656d589547dd04e8f955d"} May 27 18:39:09.258092 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.258009 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" event={"ID":"a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5","Type":"ContainerStarted","Data":"e4bf19e58abcf4e55ae5f72049fab60d9e6af66ba41dd77e870d16929f80e013"} May 27 18:39:09.259703 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.259680 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" event={"ID":"154bc42f-421f-49e9-93ab-0bc79c6679cc","Type":"ContainerStarted","Data":"8aac03ff95b6bba2f81d3f7546c7cd2dbcdd3f8fe9c243c8f056991ab752b343"} May 27 18:39:09.260717 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.260693 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerStarted","Data":"792b3ea0816c3caee243af83d6d601ada628225fd6917f4b8e59c51b1dc35649"} May 27 18:39:09.293998 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.293960 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-42nst" podStartSLOduration=1.86398143 podStartE2EDuration="3.29394737s" podCreationTimestamp="2026-05-27 18:39:06 +0000 UTC" firstStartedPulling="2026-05-27 18:39:06.941423269 +0000 UTC m=+189.841484683" lastFinishedPulling="2026-05-27 18:39:08.371389207 +0000 UTC m=+191.271450623" observedRunningTime="2026-05-27 18:39:09.293786356 +0000 UTC m=+192.193847792" watchObservedRunningTime="2026-05-27 18:39:09.29394737 +0000 UTC m=+192.194008812" May 27 18:39:09.314972 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:09.314933 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-2h9ql" podStartSLOduration=2.109856795 podStartE2EDuration="3.314919375s" podCreationTimestamp="2026-05-27 18:39:06 +0000 UTC" firstStartedPulling="2026-05-27 18:39:07.667833983 +0000 UTC m=+190.567895397" lastFinishedPulling="2026-05-27 18:39:08.872896564 +0000 UTC m=+191.772957977" observedRunningTime="2026-05-27 18:39:09.313283347 +0000 UTC m=+192.213344785" watchObservedRunningTime="2026-05-27 18:39:09.314919375 +0000 UTC m=+192.214980810" May 27 18:39:10.265890 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:10.265853 2556 generic.go:358] "Generic (PLEG): container finished" podID="d050bacb-1bce-40ee-982c-273edfe9386f" containerID="bcaaddd40d77c319ce00c3ba224b227def7a05e90c541c4c7829b67b38a47361" exitCode=0 May 27 18:39:10.266309 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:10.265945 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerDied","Data":"bcaaddd40d77c319ce00c3ba224b227def7a05e90c541c4c7829b67b38a47361"} May 27 18:39:10.267944 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:10.267918 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29r5j" event={"ID":"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf","Type":"ContainerStarted","Data":"2e55dd4915cefe1057aac5a034171f12059d684bc5598328075f5a37e16a8767"} May 27 18:39:10.268029 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:10.267952 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29r5j" event={"ID":"e1a451b2-4353-47b5-bb0a-11ae1bcac1bf","Type":"ContainerStarted","Data":"2560eb5aaf271928991752bb96a0a225675ac875c478035d46b64fdc2eabf595"} May 27 18:39:10.309764 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:10.309719 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-29r5j" podStartSLOduration=3.345700614 podStartE2EDuration="4.309704877s" podCreationTimestamp="2026-05-27 18:39:06 +0000 UTC" firstStartedPulling="2026-05-27 18:39:07.408620778 +0000 UTC m=+190.308682194" lastFinishedPulling="2026-05-27 18:39:08.372625033 +0000 UTC m=+191.272686457" observedRunningTime="2026-05-27 18:39:10.30895555 +0000 UTC m=+193.209016987" watchObservedRunningTime="2026-05-27 18:39:10.309704877 +0000 UTC m=+193.209766315" May 27 18:39:11.691780 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.691743 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8676c459ff-rngxm"] May 27 18:39:11.694360 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.694337 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.708962 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.708941 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 18:39:11.711621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.711542 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8676c459ff-rngxm"] May 27 18:39:11.787412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.787369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsfd\" (UniqueName: \"kubernetes.io/projected/1c85ac63-7f2b-4d1f-9222-912856763bb7-kube-api-access-qdsfd\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.787598 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.787432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-service-ca\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.787598 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.787459 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-serving-cert\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.787598 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.787480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-oauth-config\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.787598 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.787541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-config\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.787762 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.787618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-oauth-serving-cert\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.787762 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.787684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-trusted-ca-bundle\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.888453 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.888413 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-trusted-ca-bundle\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.888549 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.888528 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsfd\" (UniqueName: \"kubernetes.io/projected/1c85ac63-7f2b-4d1f-9222-912856763bb7-kube-api-access-qdsfd\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.888598 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.888571 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-service-ca\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.888652 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.888604 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-serving-cert\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.888652 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.888640 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-oauth-config\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.888749 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.888669 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-config\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.888749 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.888708 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-oauth-serving-cert\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.889388 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.889342 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-trusted-ca-bundle\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.889663 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.889519 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-config\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.889663 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.889559 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-service-ca\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.889834 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.889816 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-oauth-serving-cert\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.891073 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.891006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-oauth-config\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.891629 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.891610 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-serving-cert\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:11.913234 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:11.913212 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsfd\" (UniqueName: \"kubernetes.io/projected/1c85ac63-7f2b-4d1f-9222-912856763bb7-kube-api-access-qdsfd\") pod \"console-8676c459ff-rngxm\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:12.005130 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.005102 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:12.146149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.146117 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8676c459ff-rngxm"] May 27 18:39:12.149013 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:39:12.148984 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c85ac63_7f2b_4d1f_9222_912856763bb7.slice/crio-b9e0e7a632a09aa2075f699c08d07df2491122d458e6bc226b9cc7a3186e5f61 WatchSource:0}: Error finding container b9e0e7a632a09aa2075f699c08d07df2491122d458e6bc226b9cc7a3186e5f61: Status 404 returned error can't find the container with id b9e0e7a632a09aa2075f699c08d07df2491122d458e6bc226b9cc7a3186e5f61 May 27 18:39:12.276482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.276440 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerStarted","Data":"a3f50ae9eeeaef76b7cf735aeb96e94786ec6e013fea91d7862e6592a62d0833"} May 27 18:39:12.276482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.276489 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerStarted","Data":"d1141bfe907686a11425d4284c6feba3e186441f6931fcb579123e180a680feb"} May 27 18:39:12.276741 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.276499 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerStarted","Data":"c83449f2cec8db3e6146a5574c21c387f671173dba40d8a1c834cfe29b2ceeca"} May 27 18:39:12.276741 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.276512 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerStarted","Data":"8ba7a15f77377f4676c9bee983ff76485ca3e567791d710c07164bf58dfe45df"} May 27 18:39:12.276741 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.276525 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerStarted","Data":"7e3bb611f631d82c99bbd23b532013d8925e75aed006a6a07f2641623d4979d8"} May 27 18:39:12.277878 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.277853 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8676c459ff-rngxm" event={"ID":"1c85ac63-7f2b-4d1f-9222-912856763bb7","Type":"ContainerStarted","Data":"622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117"} May 27 18:39:12.277990 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.277882 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8676c459ff-rngxm" event={"ID":"1c85ac63-7f2b-4d1f-9222-912856763bb7","Type":"ContainerStarted","Data":"b9e0e7a632a09aa2075f699c08d07df2491122d458e6bc226b9cc7a3186e5f61"} May 27 18:39:12.297408 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:12.297360 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8676c459ff-rngxm" podStartSLOduration=1.297346842 podStartE2EDuration="1.297346842s" podCreationTimestamp="2026-05-27 18:39:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:39:12.296695474 +0000 UTC m=+195.196756909" watchObservedRunningTime="2026-05-27 18:39:12.297346842 +0000 UTC m=+195.197408277" May 27 18:39:13.284574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:13.284476 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d050bacb-1bce-40ee-982c-273edfe9386f","Type":"ContainerStarted","Data":"ad2995251f5d0a1aa918cff336dade6f1cca6e066fa2a2dee862b1860154e280"} May 27 18:39:13.312977 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:13.312930 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.158178369 podStartE2EDuration="6.312916917s" podCreationTimestamp="2026-05-27 18:39:07 +0000 UTC" firstStartedPulling="2026-05-27 18:39:08.846836774 +0000 UTC m=+191.746898193" lastFinishedPulling="2026-05-27 18:39:13.001575328 +0000 UTC m=+195.901636741" observedRunningTime="2026-05-27 18:39:13.311315131 +0000 UTC m=+196.211376567" watchObservedRunningTime="2026-05-27 18:39:13.312916917 +0000 UTC m=+196.212978349" May 27 18:39:22.006077 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:22.006029 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:22.006570 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:22.006096 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:22.010504 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:22.010483 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:22.312752 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:22.312672 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:39:33.036731 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.036638 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84f658b4b7-pttvp" podUID="2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" containerName="console" containerID="cri-o://6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9" gracePeriod=15 May 27 18:39:33.268768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.268749 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84f658b4b7-pttvp_2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a/console/0.log" May 27 18:39:33.268871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.268817 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:39:33.337727 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.337667 2556 generic.go:358] "Generic (PLEG): container finished" podID="b1d43051-f350-4305-bf97-1eb748a62917" containerID="9eb25ab5fd931e145da5b40956b8c5c35b0d3f33eae45bcd6d1f2e3f1a6694cc" exitCode=0 May 27 18:39:33.337846 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.337749 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" event={"ID":"b1d43051-f350-4305-bf97-1eb748a62917","Type":"ContainerDied","Data":"9eb25ab5fd931e145da5b40956b8c5c35b0d3f33eae45bcd6d1f2e3f1a6694cc"} May 27 18:39:33.338108 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.338091 2556 scope.go:117] "RemoveContainer" containerID="9eb25ab5fd931e145da5b40956b8c5c35b0d3f33eae45bcd6d1f2e3f1a6694cc" May 27 18:39:33.338922 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.338906 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84f658b4b7-pttvp_2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a/console/0.log" May 27 18:39:33.339010 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.338939 2556 generic.go:358] "Generic (PLEG): container finished" podID="2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" containerID="6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9" exitCode=2 May 27 18:39:33.339010 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.338965 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f658b4b7-pttvp" event={"ID":"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a","Type":"ContainerDied","Data":"6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9"} May 27 18:39:33.339010 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.339000 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f658b4b7-pttvp" May 27 18:39:33.339119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.339013 2556 scope.go:117] "RemoveContainer" containerID="6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9" May 27 18:39:33.339119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.339000 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f658b4b7-pttvp" event={"ID":"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a","Type":"ContainerDied","Data":"e30ec2f5b241ec14c10aff277a25d9763b0b6783638f986a29c5fd1d8bcc163f"} May 27 18:39:33.346440 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.346418 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-serving-cert\") pod \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " May 27 18:39:33.346523 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.346480 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxdjp\" (UniqueName: \"kubernetes.io/projected/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-kube-api-access-zxdjp\") pod \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " May 27 18:39:33.346603 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.346584 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-config\") pod \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " May 27 18:39:33.346694 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.346675 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-service-ca\") pod \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " May 27 18:39:33.346811 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.346717 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-oauth-serving-cert\") pod \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " May 27 18:39:33.346928 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.346754 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-oauth-config\") pod \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\" (UID: \"2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a\") " May 27 18:39:33.346985 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.346944 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-config" (OuterVolumeSpecName: "console-config") pod "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" (UID: "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:39:33.347057 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.347027 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" (UID: "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:39:33.347181 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.347162 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:39:33.347237 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.347189 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-service-ca\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:39:33.347448 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.347432 2556 scope.go:117] "RemoveContainer" containerID="6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9" May 27 18:39:33.347526 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.347428 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" (UID: "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:39:33.347806 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:39:33.347783 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9\": container with ID starting with 6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9 not found: ID does not exist" containerID="6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9" May 27 18:39:33.347903 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.347811 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9"} err="failed to get container status \"6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9\": rpc error: code = NotFound desc = could not find container \"6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9\": container with ID starting with 6696092653cbb86b054583abfb964e6ba4c41f786a391179ec02a36accf277c9 not found: ID does not exist" May 27 18:39:33.348956 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.348922 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-kube-api-access-zxdjp" (OuterVolumeSpecName: "kube-api-access-zxdjp") pod "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" (UID: "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a"). InnerVolumeSpecName "kube-api-access-zxdjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:39:33.349097 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.349070 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" (UID: "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:39:33.349097 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.349086 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" (UID: "2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:39:33.447918 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.447871 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxdjp\" (UniqueName: \"kubernetes.io/projected/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-kube-api-access-zxdjp\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:39:33.447918 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.447904 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-oauth-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:39:33.447918 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.447920 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-oauth-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:39:33.448114 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.447935 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a-console-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:39:33.660548 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.660512 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f658b4b7-pttvp"] May 27 18:39:33.664517 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.664493 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f658b4b7-pttvp"] May 27 18:39:33.737287 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:33.737257 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" path="/var/lib/kubelet/pods/2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a/volumes" May 27 18:39:34.343947 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:34.343913 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-984df" event={"ID":"b1d43051-f350-4305-bf97-1eb748a62917","Type":"ContainerStarted","Data":"ca0e88826b7f0114dedffaa8e6e1730accbe4d75142c7ff4c3e98ef806b11a60"} May 27 18:39:43.372557 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:43.372523 2556 generic.go:358] "Generic (PLEG): container finished" podID="c1a4f503-f531-47cb-913c-34fe87a34574" containerID="f17b0e67aff325a8294ff3fb766532d755fac6706ff6ba370a72b3d78c0f3a03" exitCode=0 May 27 18:39:43.372902 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:43.372567 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" event={"ID":"c1a4f503-f531-47cb-913c-34fe87a34574","Type":"ContainerDied","Data":"f17b0e67aff325a8294ff3fb766532d755fac6706ff6ba370a72b3d78c0f3a03"} May 27 18:39:43.372902 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:43.372846 2556 scope.go:117] "RemoveContainer" containerID="f17b0e67aff325a8294ff3fb766532d755fac6706ff6ba370a72b3d78c0f3a03" May 27 18:39:44.376660 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:39:44.376626 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z5hbb" event={"ID":"c1a4f503-f531-47cb-913c-34fe87a34574","Type":"ContainerStarted","Data":"36f43fce17e2038a5f434df2354b6e2f0e5468bbd17856c01cb7d8b6114d890a"} May 27 18:40:09.424114 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:09.424076 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:40:09.426368 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:09.426348 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac32ff4-f58e-40c1-bd76-560d7e7f9016-metrics-certs\") pod \"network-metrics-daemon-5sk84\" (UID: \"fac32ff4-f58e-40c1-bd76-560d7e7f9016\") " pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:40:09.437000 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:09.436980 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zr9kw\"" May 27 18:40:09.444818 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:09.444802 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sk84" May 27 18:40:09.569079 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:09.569050 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5sk84"] May 27 18:40:09.571825 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:40:09.571799 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac32ff4_f58e_40c1_bd76_560d7e7f9016.slice/crio-e5d9c9167a23220c01e6ddc51b9e4703ac85cd60b99739763c3d42cb908a713d WatchSource:0}: Error finding container e5d9c9167a23220c01e6ddc51b9e4703ac85cd60b99739763c3d42cb908a713d: Status 404 returned error can't find the container with id e5d9c9167a23220c01e6ddc51b9e4703ac85cd60b99739763c3d42cb908a713d May 27 18:40:10.449159 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:10.449112 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sk84" event={"ID":"fac32ff4-f58e-40c1-bd76-560d7e7f9016","Type":"ContainerStarted","Data":"e5d9c9167a23220c01e6ddc51b9e4703ac85cd60b99739763c3d42cb908a713d"} May 27 18:40:11.453696 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:11.453661 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sk84" event={"ID":"fac32ff4-f58e-40c1-bd76-560d7e7f9016","Type":"ContainerStarted","Data":"1a3e4e0732b2075f52594a90f724a13860144b0619f6a25bc942d3bf951ae1a7"} May 27 18:40:11.453696 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:11.453702 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sk84" event={"ID":"fac32ff4-f58e-40c1-bd76-560d7e7f9016","Type":"ContainerStarted","Data":"051f243979419d579428583599d3cc3e47259fa21cb90682f00cbb9ef3657492"} May 27 18:40:11.471017 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:11.470972 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5sk84" podStartSLOduration=253.328212019 podStartE2EDuration="4m14.470956046s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:40:09.574142712 +0000 UTC m=+252.474204139" lastFinishedPulling="2026-05-27 18:40:10.716886754 +0000 UTC m=+253.616948166" observedRunningTime="2026-05-27 18:40:11.469427224 +0000 UTC m=+254.369488663" watchObservedRunningTime="2026-05-27 18:40:11.470956046 +0000 UTC m=+254.371017480" May 27 18:40:30.996452 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:30.996356 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp"] May 27 18:40:30.997054 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:30.996706 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" containerName="console" May 27 18:40:30.997054 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:30.996722 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" containerName="console" May 27 18:40:30.997054 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:30.996828 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b691b8d-fb2d-4ac4-b5fa-e3c4508f3c5a" containerName="console" May 27 18:40:30.999214 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:30.999197 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.001949 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.001923 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 18:40:31.002098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.001971 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 18:40:31.002098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.001985 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 18:40:31.002098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.001974 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qrccw\"" May 27 18:40:31.002098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.001973 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 18:40:31.002291 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.002260 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 18:40:31.006967 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.006949 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 18:40:31.014522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.014502 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp"] May 27 18:40:31.062343 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-federate-client-tls\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.062464 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.062464 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-secret-telemeter-client\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.062546 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-serving-certs-ca-bundle\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.062546 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-metrics-client-ca\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.062546 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-telemeter-client-tls\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.062636 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c757h\" (UniqueName: \"kubernetes.io/projected/ba341103-6d73-44bc-8b12-8d927d29b160-kube-api-access-c757h\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.062636 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.062599 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.162966 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.162945 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163068 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.162973 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-secret-telemeter-client\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163068 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163000 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-serving-certs-ca-bundle\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163068 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163016 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-metrics-client-ca\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163068 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163035 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-telemeter-client-tls\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163155 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c757h\" (UniqueName: \"kubernetes.io/projected/ba341103-6d73-44bc-8b12-8d927d29b160-kube-api-access-c757h\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163195 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163242 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-federate-client-tls\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.163833 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163777 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-serving-certs-ca-bundle\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.164000 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.163839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-metrics-client-ca\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.164094 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.164065 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba341103-6d73-44bc-8b12-8d927d29b160-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.165717 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.165687 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-telemeter-client-tls\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.165803 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.165748 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-federate-client-tls\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.165803 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.165774 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.165803 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.165798 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba341103-6d73-44bc-8b12-8d927d29b160-secret-telemeter-client\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.171010 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.170989 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c757h\" (UniqueName: \"kubernetes.io/projected/ba341103-6d73-44bc-8b12-8d927d29b160-kube-api-access-c757h\") pod \"telemeter-client-c5f7bf86d-zd5wp\" (UID: \"ba341103-6d73-44bc-8b12-8d927d29b160\") " pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.308859 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.308793 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" May 27 18:40:31.436140 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.436112 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp"] May 27 18:40:31.439056 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:40:31.439029 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba341103_6d73_44bc_8b12_8d927d29b160.slice/crio-fdc3547a4f09ca3ed4cc0b63c977d647d8cefb47f58d336df475f7d27d82178e WatchSource:0}: Error finding container fdc3547a4f09ca3ed4cc0b63c977d647d8cefb47f58d336df475f7d27d82178e: Status 404 returned error can't find the container with id fdc3547a4f09ca3ed4cc0b63c977d647d8cefb47f58d336df475f7d27d82178e May 27 18:40:31.509729 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:31.509698 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" event={"ID":"ba341103-6d73-44bc-8b12-8d927d29b160","Type":"ContainerStarted","Data":"fdc3547a4f09ca3ed4cc0b63c977d647d8cefb47f58d336df475f7d27d82178e"} May 27 18:40:33.516747 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:33.516720 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" event={"ID":"ba341103-6d73-44bc-8b12-8d927d29b160","Type":"ContainerStarted","Data":"8fc1f42955af69f2f74499645a7c0b491fb65b95b6784514a5645928c6ac9014"} May 27 18:40:34.521648 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:34.521612 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" event={"ID":"ba341103-6d73-44bc-8b12-8d927d29b160","Type":"ContainerStarted","Data":"d8fc0057f67ec5877ccb317542a68ab184ba3999d1a99050d7d1d198d571762e"} May 27 18:40:34.521648 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:34.521649 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" event={"ID":"ba341103-6d73-44bc-8b12-8d927d29b160","Type":"ContainerStarted","Data":"c406434fe7525dd8486be20d4a43463ea109444e30b9674e9f37a78f2bd5779e"} May 27 18:40:34.544930 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:34.544877 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c5f7bf86d-zd5wp" podStartSLOduration=2.563878035 podStartE2EDuration="4.54485912s" podCreationTimestamp="2026-05-27 18:40:30 +0000 UTC" firstStartedPulling="2026-05-27 18:40:31.440987733 +0000 UTC m=+274.341049146" lastFinishedPulling="2026-05-27 18:40:33.42196881 +0000 UTC m=+276.322030231" observedRunningTime="2026-05-27 18:40:34.542614016 +0000 UTC m=+277.442675451" watchObservedRunningTime="2026-05-27 18:40:34.54485912 +0000 UTC m=+277.444920560" May 27 18:40:35.444526 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.444495 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c9687fcc4-hbrcx"] May 27 18:40:35.447351 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.447324 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.457947 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.457924 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9687fcc4-hbrcx"] May 27 18:40:35.493679 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.493650 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-oauth-config\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.493785 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.493687 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-console-config\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.493785 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.493717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-trusted-ca-bundle\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.493785 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.493760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptp5q\" (UniqueName: \"kubernetes.io/projected/62369068-dc35-4cb7-b7d8-cb760644e646-kube-api-access-ptp5q\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.493910 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.493785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-oauth-serving-cert\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.493910 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.493804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-service-ca\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.493910 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.493883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-serving-cert\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595059 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595005 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-trusted-ca-bundle\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595059 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595052 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptp5q\" (UniqueName: \"kubernetes.io/projected/62369068-dc35-4cb7-b7d8-cb760644e646-kube-api-access-ptp5q\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595448 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595211 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-oauth-serving-cert\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595448 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595244 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-service-ca\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595576 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595338 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-serving-cert\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595673 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595652 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-oauth-config\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595749 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595734 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-console-config\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.595858 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595835 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-oauth-serving-cert\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.596014 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.595944 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-service-ca\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.596128 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.596064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-trusted-ca-bundle\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.596412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.596370 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-console-config\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.597768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.597742 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-serving-cert\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.598029 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.598006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-oauth-config\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.602947 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.602925 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptp5q\" (UniqueName: \"kubernetes.io/projected/62369068-dc35-4cb7-b7d8-cb760644e646-kube-api-access-ptp5q\") pod \"console-5c9687fcc4-hbrcx\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.756787 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.756762 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:35.878840 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:35.878814 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9687fcc4-hbrcx"] May 27 18:40:35.879766 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:40:35.879738 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62369068_dc35_4cb7_b7d8_cb760644e646.slice/crio-d33a3c5494c45c7fe911c9fd5a029a7ea6d135fcd167662502698d909192625f WatchSource:0}: Error finding container d33a3c5494c45c7fe911c9fd5a029a7ea6d135fcd167662502698d909192625f: Status 404 returned error can't find the container with id d33a3c5494c45c7fe911c9fd5a029a7ea6d135fcd167662502698d909192625f May 27 18:40:36.528832 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:36.528800 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9687fcc4-hbrcx" event={"ID":"62369068-dc35-4cb7-b7d8-cb760644e646","Type":"ContainerStarted","Data":"c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998"} May 27 18:40:36.528832 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:36.528837 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9687fcc4-hbrcx" event={"ID":"62369068-dc35-4cb7-b7d8-cb760644e646","Type":"ContainerStarted","Data":"d33a3c5494c45c7fe911c9fd5a029a7ea6d135fcd167662502698d909192625f"} May 27 18:40:36.548105 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:36.548057 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c9687fcc4-hbrcx" podStartSLOduration=1.548041339 podStartE2EDuration="1.548041339s" podCreationTimestamp="2026-05-27 18:40:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:40:36.547989613 +0000 UTC m=+279.448051049" watchObservedRunningTime="2026-05-27 18:40:36.548041339 +0000 UTC m=+279.448102775" May 27 18:40:45.756991 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:45.756960 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:45.757450 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:45.757029 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:45.761716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:45.761693 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:46.560258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.560223 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:40:46.607875 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.607844 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8676c459ff-rngxm"] May 27 18:40:46.679487 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.679460 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c4bd7b67b-rmplp"] May 27 18:40:46.681672 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.681651 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.696725 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.696700 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4bd7b67b-rmplp"] May 27 18:40:46.776270 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.776244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-trusted-ca-bundle\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.776657 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.776278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-oauth-serving-cert\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.776657 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.776311 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-config\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.776657 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.776334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bxk6\" (UniqueName: \"kubernetes.io/projected/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-kube-api-access-8bxk6\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.776657 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.776450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-service-ca\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.776657 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.776497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-oauth-config\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.776657 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.776550 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-serving-cert\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.877754 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.877696 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-service-ca\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.877754 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.877725 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-oauth-config\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.877754 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.877744 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-serving-cert\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.877974 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.877779 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-trusted-ca-bundle\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.877974 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.877802 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-oauth-serving-cert\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.877974 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.877846 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-config\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.877974 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.877870 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bxk6\" (UniqueName: \"kubernetes.io/projected/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-kube-api-access-8bxk6\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.878509 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.878482 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-service-ca\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.878602 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.878585 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-trusted-ca-bundle\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.878663 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.878599 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-oauth-serving-cert\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.878663 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.878605 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-config\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.880121 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.880096 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-serving-cert\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.880209 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.880193 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-oauth-config\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.887802 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.887779 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bxk6\" (UniqueName: \"kubernetes.io/projected/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-kube-api-access-8bxk6\") pod \"console-c4bd7b67b-rmplp\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:46.992219 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:46.992199 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:47.121876 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:47.121854 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4bd7b67b-rmplp"] May 27 18:40:47.123865 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:40:47.123822 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a5960d_5bb5_4c8a_8d73_a0e4e9adf663.slice/crio-bfb1e683291c387028077046615313436da1eef46ade90b72faee084b091d9d0 WatchSource:0}: Error finding container bfb1e683291c387028077046615313436da1eef46ade90b72faee084b091d9d0: Status 404 returned error can't find the container with id bfb1e683291c387028077046615313436da1eef46ade90b72faee084b091d9d0 May 27 18:40:47.560848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:47.560812 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bd7b67b-rmplp" event={"ID":"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663","Type":"ContainerStarted","Data":"f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6"} May 27 18:40:47.560848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:47.560846 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bd7b67b-rmplp" event={"ID":"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663","Type":"ContainerStarted","Data":"bfb1e683291c387028077046615313436da1eef46ade90b72faee084b091d9d0"} May 27 18:40:47.580619 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:47.580575 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c4bd7b67b-rmplp" podStartSLOduration=1.580562627 podStartE2EDuration="1.580562627s" podCreationTimestamp="2026-05-27 18:40:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:40:47.57956063 +0000 UTC m=+290.479622066" watchObservedRunningTime="2026-05-27 18:40:47.580562627 +0000 UTC m=+290.480624065" May 27 18:40:56.992664 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:56.992628 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:56.993062 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:56.992694 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:56.997848 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:56.997825 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:57.593646 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:57.593620 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:40:57.644897 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:57.644862 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9687fcc4-hbrcx"] May 27 18:40:57.665766 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:40:57.665713 2556 kubelet.go:1628] "Image garbage collection succeeded" May 27 18:41:11.627256 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.627195 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8676c459ff-rngxm" podUID="1c85ac63-7f2b-4d1f-9222-912856763bb7" containerName="console" containerID="cri-o://622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117" gracePeriod=15 May 27 18:41:11.861646 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.861624 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8676c459ff-rngxm_1c85ac63-7f2b-4d1f-9222-912856763bb7/console/0.log" May 27 18:41:11.861738 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.861685 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:41:11.966985 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.966959 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdsfd\" (UniqueName: \"kubernetes.io/projected/1c85ac63-7f2b-4d1f-9222-912856763bb7-kube-api-access-qdsfd\") pod \"1c85ac63-7f2b-4d1f-9222-912856763bb7\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " May 27 18:41:11.967149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.966994 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-oauth-serving-cert\") pod \"1c85ac63-7f2b-4d1f-9222-912856763bb7\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " May 27 18:41:11.967149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967036 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-service-ca\") pod \"1c85ac63-7f2b-4d1f-9222-912856763bb7\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " May 27 18:41:11.967149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967073 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-oauth-config\") pod \"1c85ac63-7f2b-4d1f-9222-912856763bb7\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " May 27 18:41:11.967149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967096 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-serving-cert\") pod \"1c85ac63-7f2b-4d1f-9222-912856763bb7\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " May 27 18:41:11.967149 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967123 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-trusted-ca-bundle\") pod \"1c85ac63-7f2b-4d1f-9222-912856763bb7\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " May 27 18:41:11.967422 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967179 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-config\") pod \"1c85ac63-7f2b-4d1f-9222-912856763bb7\" (UID: \"1c85ac63-7f2b-4d1f-9222-912856763bb7\") " May 27 18:41:11.967573 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967531 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c85ac63-7f2b-4d1f-9222-912856763bb7" (UID: "1c85ac63-7f2b-4d1f-9222-912856763bb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:11.967673 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967564 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c85ac63-7f2b-4d1f-9222-912856763bb7" (UID: "1c85ac63-7f2b-4d1f-9222-912856763bb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:11.967673 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967608 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1c85ac63-7f2b-4d1f-9222-912856763bb7" (UID: "1c85ac63-7f2b-4d1f-9222-912856763bb7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:11.967760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.967686 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-config" (OuterVolumeSpecName: "console-config") pod "1c85ac63-7f2b-4d1f-9222-912856763bb7" (UID: "1c85ac63-7f2b-4d1f-9222-912856763bb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:11.969286 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.969263 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c85ac63-7f2b-4d1f-9222-912856763bb7" (UID: "1c85ac63-7f2b-4d1f-9222-912856763bb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:41:11.969613 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.969588 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c85ac63-7f2b-4d1f-9222-912856763bb7" (UID: "1c85ac63-7f2b-4d1f-9222-912856763bb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:41:11.969670 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:11.969617 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c85ac63-7f2b-4d1f-9222-912856763bb7-kube-api-access-qdsfd" (OuterVolumeSpecName: "kube-api-access-qdsfd") pod "1c85ac63-7f2b-4d1f-9222-912856763bb7" (UID: "1c85ac63-7f2b-4d1f-9222-912856763bb7"). InnerVolumeSpecName "kube-api-access-qdsfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:41:12.068412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.068369 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-oauth-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:12.068412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.068411 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:12.068557 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.068422 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-trusted-ca-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:12.068557 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.068431 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-console-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:12.068557 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.068440 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdsfd\" (UniqueName: \"kubernetes.io/projected/1c85ac63-7f2b-4d1f-9222-912856763bb7-kube-api-access-qdsfd\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:12.068557 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.068449 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-oauth-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:12.068557 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.068458 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c85ac63-7f2b-4d1f-9222-912856763bb7-service-ca\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:12.635091 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.635063 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8676c459ff-rngxm_1c85ac63-7f2b-4d1f-9222-912856763bb7/console/0.log" May 27 18:41:12.635574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.635102 2556 generic.go:358] "Generic (PLEG): container finished" podID="1c85ac63-7f2b-4d1f-9222-912856763bb7" containerID="622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117" exitCode=2 May 27 18:41:12.635574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.635133 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8676c459ff-rngxm" event={"ID":"1c85ac63-7f2b-4d1f-9222-912856763bb7","Type":"ContainerDied","Data":"622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117"} May 27 18:41:12.635574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.635172 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8676c459ff-rngxm" event={"ID":"1c85ac63-7f2b-4d1f-9222-912856763bb7","Type":"ContainerDied","Data":"b9e0e7a632a09aa2075f699c08d07df2491122d458e6bc226b9cc7a3186e5f61"} May 27 18:41:12.635574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.635187 2556 scope.go:117] "RemoveContainer" containerID="622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117" May 27 18:41:12.635574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.635191 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8676c459ff-rngxm" May 27 18:41:12.645545 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.645141 2556 scope.go:117] "RemoveContainer" containerID="622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117" May 27 18:41:12.645620 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:41:12.645599 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117\": container with ID starting with 622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117 not found: ID does not exist" containerID="622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117" May 27 18:41:12.645662 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.645630 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117"} err="failed to get container status \"622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117\": rpc error: code = NotFound desc = could not find container \"622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117\": container with ID starting with 622c13f9eba47386844ca2e0e4f87fdcd2fd1f6c5d1e32ae72b281e0962dc117 not found: ID does not exist" May 27 18:41:12.659872 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.659847 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8676c459ff-rngxm"] May 27 18:41:12.664768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:12.664748 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8676c459ff-rngxm"] May 27 18:41:13.737866 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:13.737834 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c85ac63-7f2b-4d1f-9222-912856763bb7" path="/var/lib/kubelet/pods/1c85ac63-7f2b-4d1f-9222-912856763bb7/volumes" May 27 18:41:22.668445 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:22.668368 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c9687fcc4-hbrcx" podUID="62369068-dc35-4cb7-b7d8-cb760644e646" containerName="console" containerID="cri-o://c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998" gracePeriod=15 May 27 18:41:22.904868 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:22.904847 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c9687fcc4-hbrcx_62369068-dc35-4cb7-b7d8-cb760644e646/console/0.log" May 27 18:41:22.905081 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:22.904908 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:41:23.055791 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.055762 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-console-config\") pod \"62369068-dc35-4cb7-b7d8-cb760644e646\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " May 27 18:41:23.055915 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.055822 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-oauth-config\") pod \"62369068-dc35-4cb7-b7d8-cb760644e646\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " May 27 18:41:23.055915 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.055855 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptp5q\" (UniqueName: \"kubernetes.io/projected/62369068-dc35-4cb7-b7d8-cb760644e646-kube-api-access-ptp5q\") pod \"62369068-dc35-4cb7-b7d8-cb760644e646\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " May 27 18:41:23.055915 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.055881 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-service-ca\") pod \"62369068-dc35-4cb7-b7d8-cb760644e646\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " May 27 18:41:23.056057 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.055915 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-trusted-ca-bundle\") pod \"62369068-dc35-4cb7-b7d8-cb760644e646\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " May 27 18:41:23.056057 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.055994 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-serving-cert\") pod \"62369068-dc35-4cb7-b7d8-cb760644e646\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " May 27 18:41:23.056057 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.056031 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-oauth-serving-cert\") pod \"62369068-dc35-4cb7-b7d8-cb760644e646\" (UID: \"62369068-dc35-4cb7-b7d8-cb760644e646\") " May 27 18:41:23.056198 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.056101 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-console-config" (OuterVolumeSpecName: "console-config") pod "62369068-dc35-4cb7-b7d8-cb760644e646" (UID: "62369068-dc35-4cb7-b7d8-cb760644e646"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:23.056369 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.056345 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-service-ca" (OuterVolumeSpecName: "service-ca") pod "62369068-dc35-4cb7-b7d8-cb760644e646" (UID: "62369068-dc35-4cb7-b7d8-cb760644e646"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:23.056474 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.056383 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-console-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:23.056474 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.056439 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "62369068-dc35-4cb7-b7d8-cb760644e646" (UID: "62369068-dc35-4cb7-b7d8-cb760644e646"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:23.056645 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.056615 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "62369068-dc35-4cb7-b7d8-cb760644e646" (UID: "62369068-dc35-4cb7-b7d8-cb760644e646"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:41:23.058175 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.058149 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "62369068-dc35-4cb7-b7d8-cb760644e646" (UID: "62369068-dc35-4cb7-b7d8-cb760644e646"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:41:23.058528 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.058497 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "62369068-dc35-4cb7-b7d8-cb760644e646" (UID: "62369068-dc35-4cb7-b7d8-cb760644e646"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:41:23.058596 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.058527 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62369068-dc35-4cb7-b7d8-cb760644e646-kube-api-access-ptp5q" (OuterVolumeSpecName: "kube-api-access-ptp5q") pod "62369068-dc35-4cb7-b7d8-cb760644e646" (UID: "62369068-dc35-4cb7-b7d8-cb760644e646"). InnerVolumeSpecName "kube-api-access-ptp5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:41:23.157564 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.157537 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-oauth-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:23.157564 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.157561 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-oauth-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:23.157694 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.157576 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptp5q\" (UniqueName: \"kubernetes.io/projected/62369068-dc35-4cb7-b7d8-cb760644e646-kube-api-access-ptp5q\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:23.157694 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.157592 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-service-ca\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:23.157694 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.157611 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62369068-dc35-4cb7-b7d8-cb760644e646-trusted-ca-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:23.157694 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.157625 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62369068-dc35-4cb7-b7d8-cb760644e646-console-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:41:23.673103 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.673078 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c9687fcc4-hbrcx_62369068-dc35-4cb7-b7d8-cb760644e646/console/0.log" May 27 18:41:23.673477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.673114 2556 generic.go:358] "Generic (PLEG): container finished" podID="62369068-dc35-4cb7-b7d8-cb760644e646" containerID="c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998" exitCode=2 May 27 18:41:23.673477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.673145 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9687fcc4-hbrcx" event={"ID":"62369068-dc35-4cb7-b7d8-cb760644e646","Type":"ContainerDied","Data":"c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998"} May 27 18:41:23.673477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.673185 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9687fcc4-hbrcx" event={"ID":"62369068-dc35-4cb7-b7d8-cb760644e646","Type":"ContainerDied","Data":"d33a3c5494c45c7fe911c9fd5a029a7ea6d135fcd167662502698d909192625f"} May 27 18:41:23.673477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.673182 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9687fcc4-hbrcx" May 27 18:41:23.673477 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.673196 2556 scope.go:117] "RemoveContainer" containerID="c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998" May 27 18:41:23.681146 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.681132 2556 scope.go:117] "RemoveContainer" containerID="c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998" May 27 18:41:23.681380 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:41:23.681363 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998\": container with ID starting with c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998 not found: ID does not exist" containerID="c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998" May 27 18:41:23.681447 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.681387 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998"} err="failed to get container status \"c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998\": rpc error: code = NotFound desc = could not find container \"c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998\": container with ID starting with c8c614a649009453f067624e701fdd376e8b582b34d692a27100609f78250998 not found: ID does not exist" May 27 18:41:23.692340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.692320 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9687fcc4-hbrcx"] May 27 18:41:23.696556 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.696538 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c9687fcc4-hbrcx"] May 27 18:41:23.737653 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:23.737621 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62369068-dc35-4cb7-b7d8-cb760644e646" path="/var/lib/kubelet/pods/62369068-dc35-4cb7-b7d8-cb760644e646/volumes" May 27 18:41:55.042131 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.042094 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm"] May 27 18:41:55.042677 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.042423 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62369068-dc35-4cb7-b7d8-cb760644e646" containerName="console" May 27 18:41:55.042677 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.042434 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="62369068-dc35-4cb7-b7d8-cb760644e646" containerName="console" May 27 18:41:55.042677 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.042445 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c85ac63-7f2b-4d1f-9222-912856763bb7" containerName="console" May 27 18:41:55.042677 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.042451 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c85ac63-7f2b-4d1f-9222-912856763bb7" containerName="console" May 27 18:41:55.042677 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.042494 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="62369068-dc35-4cb7-b7d8-cb760644e646" containerName="console" May 27 18:41:55.042677 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.042504 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c85ac63-7f2b-4d1f-9222-912856763bb7" containerName="console" May 27 18:41:55.044557 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.044539 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.047669 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.047641 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p5mqk\"" May 27 18:41:55.047819 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.047682 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 18:41:55.048374 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.048355 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 18:41:55.053492 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.053469 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm"] May 27 18:41:55.172403 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.172371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.172555 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.172498 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbh5v\" (UniqueName: \"kubernetes.io/projected/166ca966-4967-4847-945a-daea7e68c1d0-kube-api-access-tbh5v\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.172555 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.172548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.273299 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.273270 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbh5v\" (UniqueName: \"kubernetes.io/projected/166ca966-4967-4847-945a-daea7e68c1d0-kube-api-access-tbh5v\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.273453 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.273309 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.273453 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.273344 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.273681 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.273662 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.273794 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.273774 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.282402 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.282371 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbh5v\" (UniqueName: \"kubernetes.io/projected/166ca966-4967-4847-945a-daea7e68c1d0-kube-api-access-tbh5v\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.355784 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.355731 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:41:55.478549 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.478527 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm"] May 27 18:41:55.480509 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:41:55.480480 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166ca966_4967_4847_945a_daea7e68c1d0.slice/crio-8495c994e311e427b87563e38188bfa8a122668ad715d87b277a65beb23920bb WatchSource:0}: Error finding container 8495c994e311e427b87563e38188bfa8a122668ad715d87b277a65beb23920bb: Status 404 returned error can't find the container with id 8495c994e311e427b87563e38188bfa8a122668ad715d87b277a65beb23920bb May 27 18:41:55.482238 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.482220 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:41:55.760354 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:41:55.760316 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" event={"ID":"166ca966-4967-4847-945a-daea7e68c1d0","Type":"ContainerStarted","Data":"8495c994e311e427b87563e38188bfa8a122668ad715d87b277a65beb23920bb"} May 27 18:42:02.784133 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:02.784035 2556 generic.go:358] "Generic (PLEG): container finished" podID="166ca966-4967-4847-945a-daea7e68c1d0" containerID="a54cb77a9e87b88ec64a17ca4efaa789293d436b3c5f633f0560ca9c5e4e3ace" exitCode=0 May 27 18:42:02.784592 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:02.784126 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" event={"ID":"166ca966-4967-4847-945a-daea7e68c1d0","Type":"ContainerDied","Data":"a54cb77a9e87b88ec64a17ca4efaa789293d436b3c5f633f0560ca9c5e4e3ace"} May 27 18:42:05.794296 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:05.794261 2556 generic.go:358] "Generic (PLEG): container finished" podID="166ca966-4967-4847-945a-daea7e68c1d0" containerID="dc14ebdd70ad090b59b9f65c298f7f1f89715be6bf167be5f1ecf3c8732285df" exitCode=0 May 27 18:42:05.794685 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:05.794310 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" event={"ID":"166ca966-4967-4847-945a-daea7e68c1d0","Type":"ContainerDied","Data":"dc14ebdd70ad090b59b9f65c298f7f1f89715be6bf167be5f1ecf3c8732285df"} May 27 18:42:11.814929 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:11.814892 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" event={"ID":"166ca966-4967-4847-945a-daea7e68c1d0","Type":"ContainerStarted","Data":"e11772258e6c6920289b74738f3acbfee957db61ffc69a60b984c8b9fc6f49bc"} May 27 18:42:11.833338 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:11.833291 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" podStartSLOduration=0.618024795 podStartE2EDuration="16.833276756s" podCreationTimestamp="2026-05-27 18:41:55 +0000 UTC" firstStartedPulling="2026-05-27 18:41:55.482341688 +0000 UTC m=+358.382403101" lastFinishedPulling="2026-05-27 18:42:11.697593637 +0000 UTC m=+374.597655062" observedRunningTime="2026-05-27 18:42:11.832356594 +0000 UTC m=+374.732418030" watchObservedRunningTime="2026-05-27 18:42:11.833276756 +0000 UTC m=+374.733338191" May 27 18:42:12.819592 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:12.819557 2556 generic.go:358] "Generic (PLEG): container finished" podID="166ca966-4967-4847-945a-daea7e68c1d0" containerID="e11772258e6c6920289b74738f3acbfee957db61ffc69a60b984c8b9fc6f49bc" exitCode=0 May 27 18:42:12.819945 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:12.819650 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" event={"ID":"166ca966-4967-4847-945a-daea7e68c1d0","Type":"ContainerDied","Data":"e11772258e6c6920289b74738f3acbfee957db61ffc69a60b984c8b9fc6f49bc"} May 27 18:42:13.942068 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:13.942041 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:42:14.031686 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.031655 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-bundle\") pod \"166ca966-4967-4847-945a-daea7e68c1d0\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " May 27 18:42:14.031822 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.031709 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbh5v\" (UniqueName: \"kubernetes.io/projected/166ca966-4967-4847-945a-daea7e68c1d0-kube-api-access-tbh5v\") pod \"166ca966-4967-4847-945a-daea7e68c1d0\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " May 27 18:42:14.031822 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.031746 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-util\") pod \"166ca966-4967-4847-945a-daea7e68c1d0\" (UID: \"166ca966-4967-4847-945a-daea7e68c1d0\") " May 27 18:42:14.032329 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.032304 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-bundle" (OuterVolumeSpecName: "bundle") pod "166ca966-4967-4847-945a-daea7e68c1d0" (UID: "166ca966-4967-4847-945a-daea7e68c1d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:14.033835 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.033806 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/166ca966-4967-4847-945a-daea7e68c1d0-kube-api-access-tbh5v" (OuterVolumeSpecName: "kube-api-access-tbh5v") pod "166ca966-4967-4847-945a-daea7e68c1d0" (UID: "166ca966-4967-4847-945a-daea7e68c1d0"). InnerVolumeSpecName "kube-api-access-tbh5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:42:14.036383 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.036362 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-util" (OuterVolumeSpecName: "util") pod "166ca966-4967-4847-945a-daea7e68c1d0" (UID: "166ca966-4967-4847-945a-daea7e68c1d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:14.132836 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.132779 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:14.132836 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.132802 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbh5v\" (UniqueName: \"kubernetes.io/projected/166ca966-4967-4847-945a-daea7e68c1d0-kube-api-access-tbh5v\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:14.132836 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.132812 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/166ca966-4967-4847-945a-daea7e68c1d0-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:14.826952 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.826917 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" event={"ID":"166ca966-4967-4847-945a-daea7e68c1d0","Type":"ContainerDied","Data":"8495c994e311e427b87563e38188bfa8a122668ad715d87b277a65beb23920bb"} May 27 18:42:14.826952 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.826951 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8495c994e311e427b87563e38188bfa8a122668ad715d87b277a65beb23920bb" May 27 18:42:14.827153 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:14.826973 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlstsm" May 27 18:42:18.057617 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057581 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc"] May 27 18:42:18.057976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057889 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166ca966-4967-4847-945a-daea7e68c1d0" containerName="pull" May 27 18:42:18.057976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057899 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="166ca966-4967-4847-945a-daea7e68c1d0" containerName="pull" May 27 18:42:18.057976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057910 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166ca966-4967-4847-945a-daea7e68c1d0" containerName="util" May 27 18:42:18.057976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057916 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="166ca966-4967-4847-945a-daea7e68c1d0" containerName="util" May 27 18:42:18.057976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057925 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166ca966-4967-4847-945a-daea7e68c1d0" containerName="extract" May 27 18:42:18.057976 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057931 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="166ca966-4967-4847-945a-daea7e68c1d0" containerName="extract" May 27 18:42:18.058156 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.057981 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="166ca966-4967-4847-945a-daea7e68c1d0" containerName="extract" May 27 18:42:18.059869 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.059851 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.062727 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.062697 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 27 18:42:18.062838 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.062699 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j4b9h\"" May 27 18:42:18.062900 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.062790 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 27 18:42:18.074014 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.073987 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc"] May 27 18:42:18.160193 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.160164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4569c7e0-98b2-4e98-b6bd-48de44251785-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-n8xlc\" (UID: \"4569c7e0-98b2-4e98-b6bd-48de44251785\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.160325 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.160234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnddk\" (UniqueName: \"kubernetes.io/projected/4569c7e0-98b2-4e98-b6bd-48de44251785-kube-api-access-rnddk\") pod \"cert-manager-operator-controller-manager-54b9655956-n8xlc\" (UID: \"4569c7e0-98b2-4e98-b6bd-48de44251785\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.260881 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.260848 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4569c7e0-98b2-4e98-b6bd-48de44251785-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-n8xlc\" (UID: \"4569c7e0-98b2-4e98-b6bd-48de44251785\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.261005 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.260900 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnddk\" (UniqueName: \"kubernetes.io/projected/4569c7e0-98b2-4e98-b6bd-48de44251785-kube-api-access-rnddk\") pod \"cert-manager-operator-controller-manager-54b9655956-n8xlc\" (UID: \"4569c7e0-98b2-4e98-b6bd-48de44251785\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.261233 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.261214 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4569c7e0-98b2-4e98-b6bd-48de44251785-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-n8xlc\" (UID: \"4569c7e0-98b2-4e98-b6bd-48de44251785\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.269919 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.269892 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnddk\" (UniqueName: \"kubernetes.io/projected/4569c7e0-98b2-4e98-b6bd-48de44251785-kube-api-access-rnddk\") pod \"cert-manager-operator-controller-manager-54b9655956-n8xlc\" (UID: \"4569c7e0-98b2-4e98-b6bd-48de44251785\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.368830 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.368751 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" May 27 18:42:18.497385 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.497321 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc"] May 27 18:42:18.502362 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:18.502331 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4569c7e0_98b2_4e98_b6bd_48de44251785.slice/crio-21e24204144f64d4212acbfb8d39259f34ce085016288d4e53bb5339d8ca6777 WatchSource:0}: Error finding container 21e24204144f64d4212acbfb8d39259f34ce085016288d4e53bb5339d8ca6777: Status 404 returned error can't find the container with id 21e24204144f64d4212acbfb8d39259f34ce085016288d4e53bb5339d8ca6777 May 27 18:42:18.840546 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:18.840513 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" event={"ID":"4569c7e0-98b2-4e98-b6bd-48de44251785","Type":"ContainerStarted","Data":"21e24204144f64d4212acbfb8d39259f34ce085016288d4e53bb5339d8ca6777"} May 27 18:42:20.848735 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:20.848702 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" event={"ID":"4569c7e0-98b2-4e98-b6bd-48de44251785","Type":"ContainerStarted","Data":"51932bdc48bc485b6fdc85b6fe5e45569b028d90505dc939ed9d533f1f73d689"} May 27 18:42:20.877407 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:20.877331 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-n8xlc" podStartSLOduration=0.983030827 podStartE2EDuration="2.877314122s" podCreationTimestamp="2026-05-27 18:42:18 +0000 UTC" firstStartedPulling="2026-05-27 18:42:18.507339951 +0000 UTC m=+381.407401364" lastFinishedPulling="2026-05-27 18:42:20.401623247 +0000 UTC m=+383.301684659" observedRunningTime="2026-05-27 18:42:20.875752683 +0000 UTC m=+383.775814118" watchObservedRunningTime="2026-05-27 18:42:20.877314122 +0000 UTC m=+383.777375560" May 27 18:42:22.079042 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.079009 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp"] May 27 18:42:22.081457 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.081438 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.084062 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.084041 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 18:42:22.085003 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.084984 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p5mqk\"" May 27 18:42:22.085088 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.085063 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 18:42:22.091119 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.091099 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp"] May 27 18:42:22.193295 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.193271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.193387 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.193302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.193387 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.193327 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjmdb\" (UniqueName: \"kubernetes.io/projected/2770f948-c426-468f-b770-f75670550c14-kube-api-access-wjmdb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.293767 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.293736 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.293887 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.293781 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.293887 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.293813 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjmdb\" (UniqueName: \"kubernetes.io/projected/2770f948-c426-468f-b770-f75670550c14-kube-api-access-wjmdb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.294162 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.294139 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.294228 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.294174 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.308474 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.308450 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjmdb\" (UniqueName: \"kubernetes.io/projected/2770f948-c426-468f-b770-f75670550c14-kube-api-access-wjmdb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.391850 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.391799 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:22.517845 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.517816 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp"] May 27 18:42:22.520253 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:22.520215 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2770f948_c426_468f_b770_f75670550c14.slice/crio-f4c73e3cb8a99abc760c9d2672545b858b297e1312098b169301f2218de83c62 WatchSource:0}: Error finding container f4c73e3cb8a99abc760c9d2672545b858b297e1312098b169301f2218de83c62: Status 404 returned error can't find the container with id f4c73e3cb8a99abc760c9d2672545b858b297e1312098b169301f2218de83c62 May 27 18:42:22.856010 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.855982 2556 generic.go:358] "Generic (PLEG): container finished" podID="2770f948-c426-468f-b770-f75670550c14" containerID="e57281c6cf4f68c8cc67d4c2bffe950504488c55d781b8eb7fd5495419477a0f" exitCode=0 May 27 18:42:22.856144 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.856068 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" event={"ID":"2770f948-c426-468f-b770-f75670550c14","Type":"ContainerDied","Data":"e57281c6cf4f68c8cc67d4c2bffe950504488c55d781b8eb7fd5495419477a0f"} May 27 18:42:22.856144 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.856101 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" event={"ID":"2770f948-c426-468f-b770-f75670550c14","Type":"ContainerStarted","Data":"f4c73e3cb8a99abc760c9d2672545b858b297e1312098b169301f2218de83c62"} May 27 18:42:22.863354 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.863330 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xgprk"] May 27 18:42:22.865598 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.865579 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:22.867967 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.867952 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 18:42:22.868048 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.867953 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8fp5x\"" May 27 18:42:22.868098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.868065 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 18:42:22.877000 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.876979 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xgprk"] May 27 18:42:22.999954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:22.999928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xgprk\" (UID: \"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:23.000089 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.000067 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgvfs\" (UniqueName: \"kubernetes.io/projected/1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd-kube-api-access-hgvfs\") pod \"cert-manager-webhook-587ccfb98-xgprk\" (UID: \"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:23.101279 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.101257 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xgprk\" (UID: \"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:23.101636 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.101302 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hgvfs\" (UniqueName: \"kubernetes.io/projected/1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd-kube-api-access-hgvfs\") pod \"cert-manager-webhook-587ccfb98-xgprk\" (UID: \"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:23.110005 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.109957 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xgprk\" (UID: \"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:23.110078 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.110059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgvfs\" (UniqueName: \"kubernetes.io/projected/1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd-kube-api-access-hgvfs\") pod \"cert-manager-webhook-587ccfb98-xgprk\" (UID: \"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:23.185492 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.185466 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:23.307655 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.307632 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xgprk"] May 27 18:42:23.309937 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:23.309912 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b25e32a_d016_4a96_8ec8_8a2f5a71d7fd.slice/crio-8db04f7f9ee033a6ec9a578e5cb3228388bf2a2878caa20b63a4bdf3146b606d WatchSource:0}: Error finding container 8db04f7f9ee033a6ec9a578e5cb3228388bf2a2878caa20b63a4bdf3146b606d: Status 404 returned error can't find the container with id 8db04f7f9ee033a6ec9a578e5cb3228388bf2a2878caa20b63a4bdf3146b606d May 27 18:42:23.861076 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:23.861038 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" event={"ID":"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd","Type":"ContainerStarted","Data":"8db04f7f9ee033a6ec9a578e5cb3228388bf2a2878caa20b63a4bdf3146b606d"} May 27 18:42:25.870403 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:25.870369 2556 generic.go:358] "Generic (PLEG): container finished" podID="2770f948-c426-468f-b770-f75670550c14" containerID="dc91ee8ada0881804cdb62d6658f2f3d38cbbecf66e06c7726dc87acd61ccc95" exitCode=0 May 27 18:42:25.870790 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:25.870433 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" event={"ID":"2770f948-c426-468f-b770-f75670550c14","Type":"ContainerDied","Data":"dc91ee8ada0881804cdb62d6658f2f3d38cbbecf66e06c7726dc87acd61ccc95"} May 27 18:42:26.882473 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:26.882437 2556 generic.go:358] "Generic (PLEG): container finished" podID="2770f948-c426-468f-b770-f75670550c14" containerID="0b5a3a5568d76c04a102fee640b2bf1b0c69cc20fe3151c180a2bf0af5f2a525" exitCode=0 May 27 18:42:26.882899 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:26.882522 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" event={"ID":"2770f948-c426-468f-b770-f75670550c14","Type":"ContainerDied","Data":"0b5a3a5568d76c04a102fee640b2bf1b0c69cc20fe3151c180a2bf0af5f2a525"} May 27 18:42:27.886613 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:27.886572 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" event={"ID":"1b25e32a-d016-4a96-8ec8-8a2f5a71d7fd","Type":"ContainerStarted","Data":"69b0aa1420d91a4622a80da609a46e76c877a1cf64723d53df2b5c524d4b642b"} May 27 18:42:27.886613 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:27.886613 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:27.903280 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:27.903230 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" podStartSLOduration=2.258295264 podStartE2EDuration="5.903214388s" podCreationTimestamp="2026-05-27 18:42:22 +0000 UTC" firstStartedPulling="2026-05-27 18:42:23.312193218 +0000 UTC m=+386.212254631" lastFinishedPulling="2026-05-27 18:42:26.957112343 +0000 UTC m=+389.857173755" observedRunningTime="2026-05-27 18:42:27.901494707 +0000 UTC m=+390.801556142" watchObservedRunningTime="2026-05-27 18:42:27.903214388 +0000 UTC m=+390.803275822" May 27 18:42:28.013261 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.013240 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:28.144314 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.144238 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-bundle\") pod \"2770f948-c426-468f-b770-f75670550c14\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " May 27 18:42:28.144314 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.144296 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-util\") pod \"2770f948-c426-468f-b770-f75670550c14\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " May 27 18:42:28.144314 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.144318 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjmdb\" (UniqueName: \"kubernetes.io/projected/2770f948-c426-468f-b770-f75670550c14-kube-api-access-wjmdb\") pod \"2770f948-c426-468f-b770-f75670550c14\" (UID: \"2770f948-c426-468f-b770-f75670550c14\") " May 27 18:42:28.144661 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.144636 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-bundle" (OuterVolumeSpecName: "bundle") pod "2770f948-c426-468f-b770-f75670550c14" (UID: "2770f948-c426-468f-b770-f75670550c14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:28.146265 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.146245 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2770f948-c426-468f-b770-f75670550c14-kube-api-access-wjmdb" (OuterVolumeSpecName: "kube-api-access-wjmdb") pod "2770f948-c426-468f-b770-f75670550c14" (UID: "2770f948-c426-468f-b770-f75670550c14"). InnerVolumeSpecName "kube-api-access-wjmdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:42:28.148323 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.148301 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-util" (OuterVolumeSpecName: "util") pod "2770f948-c426-468f-b770-f75670550c14" (UID: "2770f948-c426-468f-b770-f75670550c14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:28.245457 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.245425 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:28.245457 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.245455 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2770f948-c426-468f-b770-f75670550c14-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:28.245457 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.245464 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjmdb\" (UniqueName: \"kubernetes.io/projected/2770f948-c426-468f-b770-f75670550c14-kube-api-access-wjmdb\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:28.891843 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.891811 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" May 27 18:42:28.891843 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.891828 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhmkxp" event={"ID":"2770f948-c426-468f-b770-f75670550c14","Type":"ContainerDied","Data":"f4c73e3cb8a99abc760c9d2672545b858b297e1312098b169301f2218de83c62"} May 27 18:42:28.892259 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:28.891864 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4c73e3cb8a99abc760c9d2672545b858b297e1312098b169301f2218de83c62" May 27 18:42:33.894328 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:33.894300 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xgprk" May 27 18:42:34.743797 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.743762 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk"] May 27 18:42:34.744081 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.744069 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2770f948-c426-468f-b770-f75670550c14" containerName="pull" May 27 18:42:34.744134 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.744082 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2770f948-c426-468f-b770-f75670550c14" containerName="pull" May 27 18:42:34.744134 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.744112 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2770f948-c426-468f-b770-f75670550c14" containerName="util" May 27 18:42:34.744134 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.744118 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2770f948-c426-468f-b770-f75670550c14" containerName="util" May 27 18:42:34.744134 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.744129 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2770f948-c426-468f-b770-f75670550c14" containerName="extract" May 27 18:42:34.744272 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.744135 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2770f948-c426-468f-b770-f75670550c14" containerName="extract" May 27 18:42:34.744272 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.744191 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="2770f948-c426-468f-b770-f75670550c14" containerName="extract" May 27 18:42:34.746625 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.746607 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:34.750655 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.750632 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 18:42:34.751846 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.751830 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-77hjm\"" May 27 18:42:34.751933 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.751860 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 18:42:34.757439 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.757418 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk"] May 27 18:42:34.894475 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.894448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75mk7\" (UniqueName: \"kubernetes.io/projected/62af5530-3af2-4812-b0c1-8d884e53bc42-kube-api-access-75mk7\") pod \"openshift-lws-operator-bfc7f696d-m69nk\" (UID: \"62af5530-3af2-4812-b0c1-8d884e53bc42\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:34.894788 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.894647 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62af5530-3af2-4812-b0c1-8d884e53bc42-tmp\") pod \"openshift-lws-operator-bfc7f696d-m69nk\" (UID: \"62af5530-3af2-4812-b0c1-8d884e53bc42\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:34.995608 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.995542 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75mk7\" (UniqueName: \"kubernetes.io/projected/62af5530-3af2-4812-b0c1-8d884e53bc42-kube-api-access-75mk7\") pod \"openshift-lws-operator-bfc7f696d-m69nk\" (UID: \"62af5530-3af2-4812-b0c1-8d884e53bc42\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:34.995608 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.995585 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62af5530-3af2-4812-b0c1-8d884e53bc42-tmp\") pod \"openshift-lws-operator-bfc7f696d-m69nk\" (UID: \"62af5530-3af2-4812-b0c1-8d884e53bc42\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:34.995880 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:34.995864 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62af5530-3af2-4812-b0c1-8d884e53bc42-tmp\") pod \"openshift-lws-operator-bfc7f696d-m69nk\" (UID: \"62af5530-3af2-4812-b0c1-8d884e53bc42\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:35.004721 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.004703 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75mk7\" (UniqueName: \"kubernetes.io/projected/62af5530-3af2-4812-b0c1-8d884e53bc42-kube-api-access-75mk7\") pod \"openshift-lws-operator-bfc7f696d-m69nk\" (UID: \"62af5530-3af2-4812-b0c1-8d884e53bc42\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:35.056161 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.056141 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" May 27 18:42:35.185653 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.185540 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk"] May 27 18:42:35.188283 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:35.188247 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62af5530_3af2_4812_b0c1_8d884e53bc42.slice/crio-ebc0a5059ab3a74779261ffe085672b1614b0e39433e4a9fbf67e9558b2c2da1 WatchSource:0}: Error finding container ebc0a5059ab3a74779261ffe085672b1614b0e39433e4a9fbf67e9558b2c2da1: Status 404 returned error can't find the container with id ebc0a5059ab3a74779261ffe085672b1614b0e39433e4a9fbf67e9558b2c2da1 May 27 18:42:35.433812 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.433785 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-tc89r"] May 27 18:42:35.436867 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.436851 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.439647 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.439623 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xlkxp\"" May 27 18:42:35.446659 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.446641 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-tc89r"] May 27 18:42:35.599891 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.599837 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b45fd2-5b3b-44c9-aaae-9f87d79e175e-bound-sa-token\") pod \"cert-manager-79c8d999ff-tc89r\" (UID: \"16b45fd2-5b3b-44c9-aaae-9f87d79e175e\") " pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.600001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.599901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh65r\" (UniqueName: \"kubernetes.io/projected/16b45fd2-5b3b-44c9-aaae-9f87d79e175e-kube-api-access-vh65r\") pod \"cert-manager-79c8d999ff-tc89r\" (UID: \"16b45fd2-5b3b-44c9-aaae-9f87d79e175e\") " pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.700209 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.700184 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b45fd2-5b3b-44c9-aaae-9f87d79e175e-bound-sa-token\") pod \"cert-manager-79c8d999ff-tc89r\" (UID: \"16b45fd2-5b3b-44c9-aaae-9f87d79e175e\") " pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.700321 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.700257 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vh65r\" (UniqueName: \"kubernetes.io/projected/16b45fd2-5b3b-44c9-aaae-9f87d79e175e-kube-api-access-vh65r\") pod \"cert-manager-79c8d999ff-tc89r\" (UID: \"16b45fd2-5b3b-44c9-aaae-9f87d79e175e\") " pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.708702 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.708674 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b45fd2-5b3b-44c9-aaae-9f87d79e175e-bound-sa-token\") pod \"cert-manager-79c8d999ff-tc89r\" (UID: \"16b45fd2-5b3b-44c9-aaae-9f87d79e175e\") " pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.708779 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.708732 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh65r\" (UniqueName: \"kubernetes.io/projected/16b45fd2-5b3b-44c9-aaae-9f87d79e175e-kube-api-access-vh65r\") pod \"cert-manager-79c8d999ff-tc89r\" (UID: \"16b45fd2-5b3b-44c9-aaae-9f87d79e175e\") " pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.746330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.746309 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-tc89r" May 27 18:42:35.866895 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.866870 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-tc89r"] May 27 18:42:35.868967 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:35.868942 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16b45fd2_5b3b_44c9_aaae_9f87d79e175e.slice/crio-f90e407cde5f9ecf3238a19c3a813a8b652a41d98327e99accdf8be0cde41d3d WatchSource:0}: Error finding container f90e407cde5f9ecf3238a19c3a813a8b652a41d98327e99accdf8be0cde41d3d: Status 404 returned error can't find the container with id f90e407cde5f9ecf3238a19c3a813a8b652a41d98327e99accdf8be0cde41d3d May 27 18:42:35.917006 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.916978 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-tc89r" event={"ID":"16b45fd2-5b3b-44c9-aaae-9f87d79e175e","Type":"ContainerStarted","Data":"f90e407cde5f9ecf3238a19c3a813a8b652a41d98327e99accdf8be0cde41d3d"} May 27 18:42:35.918080 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:35.918061 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" event={"ID":"62af5530-3af2-4812-b0c1-8d884e53bc42","Type":"ContainerStarted","Data":"ebc0a5059ab3a74779261ffe085672b1614b0e39433e4a9fbf67e9558b2c2da1"} May 27 18:42:36.925430 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:36.925373 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-tc89r" event={"ID":"16b45fd2-5b3b-44c9-aaae-9f87d79e175e","Type":"ContainerStarted","Data":"ec954b820906efa7793b65c5f4f7355a45c90b6fc4c3531dd3f8ff826986ff54"} May 27 18:42:36.945553 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:36.945507 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-tc89r" podStartSLOduration=1.945493771 podStartE2EDuration="1.945493771s" podCreationTimestamp="2026-05-27 18:42:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:42:36.943748112 +0000 UTC m=+399.843809549" watchObservedRunningTime="2026-05-27 18:42:36.945493771 +0000 UTC m=+399.845555201" May 27 18:42:37.931473 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:37.931438 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" event={"ID":"62af5530-3af2-4812-b0c1-8d884e53bc42","Type":"ContainerStarted","Data":"122ee334cfe8f5ce9a3e14ad777b323d41195b89f8ebf0803febd87a0ceb8327"} May 27 18:42:37.948417 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:37.948358 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-m69nk" podStartSLOduration=1.287490872 podStartE2EDuration="3.948343435s" podCreationTimestamp="2026-05-27 18:42:34 +0000 UTC" firstStartedPulling="2026-05-27 18:42:35.189651705 +0000 UTC m=+398.089713119" lastFinishedPulling="2026-05-27 18:42:37.850504269 +0000 UTC m=+400.750565682" observedRunningTime="2026-05-27 18:42:37.946541719 +0000 UTC m=+400.846603155" watchObservedRunningTime="2026-05-27 18:42:37.948343435 +0000 UTC m=+400.848404869" May 27 18:42:42.470236 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.470207 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq"] May 27 18:42:42.477011 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.476990 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.479873 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.479820 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 18:42:42.479873 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.479855 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 18:42:42.480062 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.479820 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p5mqk\"" May 27 18:42:42.481046 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.481025 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq"] May 27 18:42:42.547518 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.547490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.547622 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.547537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.547622 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.547587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzwpz\" (UniqueName: \"kubernetes.io/projected/21ba34c3-e755-4387-8b28-6b464729a785-kube-api-access-lzwpz\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.647928 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.647899 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.648136 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.647961 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzwpz\" (UniqueName: \"kubernetes.io/projected/21ba34c3-e755-4387-8b28-6b464729a785-kube-api-access-lzwpz\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.648136 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.648027 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.648296 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.648276 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.648420 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.648379 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.656154 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.656130 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzwpz\" (UniqueName: \"kubernetes.io/projected/21ba34c3-e755-4387-8b28-6b464729a785-kube-api-access-lzwpz\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.787852 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.787797 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:42.914162 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.914136 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq"] May 27 18:42:42.916084 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:42.916060 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ba34c3_e755_4387_8b28_6b464729a785.slice/crio-886485cb303869f30ad2fac768af92bc148946ebfb5c7fcc2483a8264fe487be WatchSource:0}: Error finding container 886485cb303869f30ad2fac768af92bc148946ebfb5c7fcc2483a8264fe487be: Status 404 returned error can't find the container with id 886485cb303869f30ad2fac768af92bc148946ebfb5c7fcc2483a8264fe487be May 27 18:42:42.947903 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:42.947875 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" event={"ID":"21ba34c3-e755-4387-8b28-6b464729a785","Type":"ContainerStarted","Data":"886485cb303869f30ad2fac768af92bc148946ebfb5c7fcc2483a8264fe487be"} May 27 18:42:43.952220 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:43.952187 2556 generic.go:358] "Generic (PLEG): container finished" podID="21ba34c3-e755-4387-8b28-6b464729a785" containerID="07141cc33fafaead333baa903864978d442064320c1714d0908f2372b0bcfabe" exitCode=0 May 27 18:42:43.952610 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:43.952269 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" event={"ID":"21ba34c3-e755-4387-8b28-6b464729a785","Type":"ContainerDied","Data":"07141cc33fafaead333baa903864978d442064320c1714d0908f2372b0bcfabe"} May 27 18:42:44.959355 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:44.959321 2556 generic.go:358] "Generic (PLEG): container finished" podID="21ba34c3-e755-4387-8b28-6b464729a785" containerID="bd91e2d47b71f910b8075e41968110769ab0991204b806549d180431b74c9d3f" exitCode=0 May 27 18:42:44.959699 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:44.959363 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" event={"ID":"21ba34c3-e755-4387-8b28-6b464729a785","Type":"ContainerDied","Data":"bd91e2d47b71f910b8075e41968110769ab0991204b806549d180431b74c9d3f"} May 27 18:42:45.963920 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:45.963882 2556 generic.go:358] "Generic (PLEG): container finished" podID="21ba34c3-e755-4387-8b28-6b464729a785" containerID="2e44a51c8b38d9dfadef4d2fcb633762e5894e6b56ad24148ec88ea92600af30" exitCode=0 May 27 18:42:45.964292 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:45.963967 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" event={"ID":"21ba34c3-e755-4387-8b28-6b464729a785","Type":"ContainerDied","Data":"2e44a51c8b38d9dfadef4d2fcb633762e5894e6b56ad24148ec88ea92600af30"} May 27 18:42:47.093733 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.093708 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:47.178924 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.178894 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzwpz\" (UniqueName: \"kubernetes.io/projected/21ba34c3-e755-4387-8b28-6b464729a785-kube-api-access-lzwpz\") pod \"21ba34c3-e755-4387-8b28-6b464729a785\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " May 27 18:42:47.179056 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.178931 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-util\") pod \"21ba34c3-e755-4387-8b28-6b464729a785\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " May 27 18:42:47.179056 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.179005 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-bundle\") pod \"21ba34c3-e755-4387-8b28-6b464729a785\" (UID: \"21ba34c3-e755-4387-8b28-6b464729a785\") " May 27 18:42:47.179680 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.179649 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-bundle" (OuterVolumeSpecName: "bundle") pod "21ba34c3-e755-4387-8b28-6b464729a785" (UID: "21ba34c3-e755-4387-8b28-6b464729a785"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:47.181023 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.181000 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ba34c3-e755-4387-8b28-6b464729a785-kube-api-access-lzwpz" (OuterVolumeSpecName: "kube-api-access-lzwpz") pod "21ba34c3-e755-4387-8b28-6b464729a785" (UID: "21ba34c3-e755-4387-8b28-6b464729a785"). InnerVolumeSpecName "kube-api-access-lzwpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:42:47.184284 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.184263 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-util" (OuterVolumeSpecName: "util") pod "21ba34c3-e755-4387-8b28-6b464729a785" (UID: "21ba34c3-e755-4387-8b28-6b464729a785"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:47.280373 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.280317 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzwpz\" (UniqueName: \"kubernetes.io/projected/21ba34c3-e755-4387-8b28-6b464729a785-kube-api-access-lzwpz\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:47.280373 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.280344 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:47.280373 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.280354 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ba34c3-e755-4387-8b28-6b464729a785-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:47.972038 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.972010 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" May 27 18:42:47.972185 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.972010 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5p2wsq" event={"ID":"21ba34c3-e755-4387-8b28-6b464729a785","Type":"ContainerDied","Data":"886485cb303869f30ad2fac768af92bc148946ebfb5c7fcc2483a8264fe487be"} May 27 18:42:47.972185 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:47.972115 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="886485cb303869f30ad2fac768af92bc148946ebfb5c7fcc2483a8264fe487be" May 27 18:42:53.473203 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473147 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq"] May 27 18:42:53.473628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473550 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ba34c3-e755-4387-8b28-6b464729a785" containerName="util" May 27 18:42:53.473628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473564 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ba34c3-e755-4387-8b28-6b464729a785" containerName="util" May 27 18:42:53.473628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473573 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ba34c3-e755-4387-8b28-6b464729a785" containerName="pull" May 27 18:42:53.473628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473578 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ba34c3-e755-4387-8b28-6b464729a785" containerName="pull" May 27 18:42:53.473628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473586 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ba34c3-e755-4387-8b28-6b464729a785" containerName="extract" May 27 18:42:53.473628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473591 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ba34c3-e755-4387-8b28-6b464729a785" containerName="extract" May 27 18:42:53.473836 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.473655 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="21ba34c3-e755-4387-8b28-6b464729a785" containerName="extract" May 27 18:42:53.476423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.476388 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.479192 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.479171 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p5mqk\"" May 27 18:42:53.479465 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.479446 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 18:42:53.480206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.480191 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 18:42:53.486605 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.486585 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq"] May 27 18:42:53.625282 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.625245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcnr\" (UniqueName: \"kubernetes.io/projected/53188763-8d0d-4a9a-bf43-e747c9ecbeab-kube-api-access-jpcnr\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.625498 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.625291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.625498 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.625370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.726874 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.726775 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.727004 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.726883 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.727059 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.727007 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcnr\" (UniqueName: \"kubernetes.io/projected/53188763-8d0d-4a9a-bf43-e747c9ecbeab-kube-api-access-jpcnr\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.727251 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.727225 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.727251 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.727237 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.738077 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.738054 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcnr\" (UniqueName: \"kubernetes.io/projected/53188763-8d0d-4a9a-bf43-e747c9ecbeab-kube-api-access-jpcnr\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.787088 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.787066 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:53.915454 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.915426 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq"] May 27 18:42:53.918807 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:53.918778 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53188763_8d0d_4a9a_bf43_e747c9ecbeab.slice/crio-fc89f437c544bbdd94e74032ee54baccbb22360511ba4ce4bcd3abf8d26ce3c4 WatchSource:0}: Error finding container fc89f437c544bbdd94e74032ee54baccbb22360511ba4ce4bcd3abf8d26ce3c4: Status 404 returned error can't find the container with id fc89f437c544bbdd94e74032ee54baccbb22360511ba4ce4bcd3abf8d26ce3c4 May 27 18:42:53.997962 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.997930 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" event={"ID":"53188763-8d0d-4a9a-bf43-e747c9ecbeab","Type":"ContainerStarted","Data":"389a3b7ee757fef6397cd054e985680524f45b8bfe00c0da4064d3c785bb8ba9"} May 27 18:42:53.998068 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:53.997970 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" event={"ID":"53188763-8d0d-4a9a-bf43-e747c9ecbeab","Type":"ContainerStarted","Data":"fc89f437c544bbdd94e74032ee54baccbb22360511ba4ce4bcd3abf8d26ce3c4"} May 27 18:42:55.002292 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.002213 2556 generic.go:358] "Generic (PLEG): container finished" podID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerID="389a3b7ee757fef6397cd054e985680524f45b8bfe00c0da4064d3c785bb8ba9" exitCode=0 May 27 18:42:55.002292 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.002277 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" event={"ID":"53188763-8d0d-4a9a-bf43-e747c9ecbeab","Type":"ContainerDied","Data":"389a3b7ee757fef6397cd054e985680524f45b8bfe00c0da4064d3c785bb8ba9"} May 27 18:42:55.517298 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.517270 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w"] May 27 18:42:55.520315 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.520297 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.522762 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.522742 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 18:42:55.523161 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.523140 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 18:42:55.523452 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.523437 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 18:42:55.523452 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.523451 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 18:42:55.523578 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.523475 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f4w94\"" May 27 18:42:55.531892 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.531873 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w"] May 27 18:42:55.641487 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.641465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/826ff222-5255-4f4a-9a12-bfe1e0e8690c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.641581 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.641517 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826ff222-5255-4f4a-9a12-bfe1e0e8690c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.641633 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.641589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j6dk\" (UniqueName: \"kubernetes.io/projected/826ff222-5255-4f4a-9a12-bfe1e0e8690c-kube-api-access-4j6dk\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.742186 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.742162 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/826ff222-5255-4f4a-9a12-bfe1e0e8690c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.742267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.742200 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826ff222-5255-4f4a-9a12-bfe1e0e8690c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.742267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.742227 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4j6dk\" (UniqueName: \"kubernetes.io/projected/826ff222-5255-4f4a-9a12-bfe1e0e8690c-kube-api-access-4j6dk\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.744463 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.744436 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826ff222-5255-4f4a-9a12-bfe1e0e8690c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.744584 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.744569 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/826ff222-5255-4f4a-9a12-bfe1e0e8690c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.750456 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.750432 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j6dk\" (UniqueName: \"kubernetes.io/projected/826ff222-5255-4f4a-9a12-bfe1e0e8690c-kube-api-access-4j6dk\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w\" (UID: \"826ff222-5255-4f4a-9a12-bfe1e0e8690c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.831249 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.831202 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:55.973936 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:55.973911 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w"] May 27 18:42:55.975580 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:42:55.975552 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826ff222_5255_4f4a_9a12_bfe1e0e8690c.slice/crio-2a60ab427b91f90a99d24f3e5de1a723807fa7a1f41620324c3951913eb4b0ac WatchSource:0}: Error finding container 2a60ab427b91f90a99d24f3e5de1a723807fa7a1f41620324c3951913eb4b0ac: Status 404 returned error can't find the container with id 2a60ab427b91f90a99d24f3e5de1a723807fa7a1f41620324c3951913eb4b0ac May 27 18:42:56.007258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:56.007231 2556 generic.go:358] "Generic (PLEG): container finished" podID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerID="3b1a1699be867bddb6bc5359e2d91bf6d04bffcca2cb0381479b95a257f11419" exitCode=0 May 27 18:42:56.007609 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:56.007306 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" event={"ID":"53188763-8d0d-4a9a-bf43-e747c9ecbeab","Type":"ContainerDied","Data":"3b1a1699be867bddb6bc5359e2d91bf6d04bffcca2cb0381479b95a257f11419"} May 27 18:42:56.008639 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:56.008613 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" event={"ID":"826ff222-5255-4f4a-9a12-bfe1e0e8690c","Type":"ContainerStarted","Data":"2a60ab427b91f90a99d24f3e5de1a723807fa7a1f41620324c3951913eb4b0ac"} May 27 18:42:57.014498 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:57.014453 2556 generic.go:358] "Generic (PLEG): container finished" podID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerID="9bf99045858d1f5d34f1f2c942fad778e9c68660375f39b5c59e62daed0552fc" exitCode=0 May 27 18:42:57.014881 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:57.014535 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" event={"ID":"53188763-8d0d-4a9a-bf43-e747c9ecbeab","Type":"ContainerDied","Data":"9bf99045858d1f5d34f1f2c942fad778e9c68660375f39b5c59e62daed0552fc"} May 27 18:42:58.503139 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.503117 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:58.667963 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.667939 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-util\") pod \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " May 27 18:42:58.668120 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.668000 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-bundle\") pod \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " May 27 18:42:58.668120 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.668027 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpcnr\" (UniqueName: \"kubernetes.io/projected/53188763-8d0d-4a9a-bf43-e747c9ecbeab-kube-api-access-jpcnr\") pod \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\" (UID: \"53188763-8d0d-4a9a-bf43-e747c9ecbeab\") " May 27 18:42:58.668837 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.668803 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-bundle" (OuterVolumeSpecName: "bundle") pod "53188763-8d0d-4a9a-bf43-e747c9ecbeab" (UID: "53188763-8d0d-4a9a-bf43-e747c9ecbeab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:58.670019 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.669993 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53188763-8d0d-4a9a-bf43-e747c9ecbeab-kube-api-access-jpcnr" (OuterVolumeSpecName: "kube-api-access-jpcnr") pod "53188763-8d0d-4a9a-bf43-e747c9ecbeab" (UID: "53188763-8d0d-4a9a-bf43-e747c9ecbeab"). InnerVolumeSpecName "kube-api-access-jpcnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:42:58.673374 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.673349 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-util" (OuterVolumeSpecName: "util") pod "53188763-8d0d-4a9a-bf43-e747c9ecbeab" (UID: "53188763-8d0d-4a9a-bf43-e747c9ecbeab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:42:58.768745 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.768668 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:58.768745 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.768700 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53188763-8d0d-4a9a-bf43-e747c9ecbeab-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:58.768745 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:58.768714 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpcnr\" (UniqueName: \"kubernetes.io/projected/53188763-8d0d-4a9a-bf43-e747c9ecbeab-kube-api-access-jpcnr\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:42:59.024012 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:59.023926 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" event={"ID":"53188763-8d0d-4a9a-bf43-e747c9ecbeab","Type":"ContainerDied","Data":"fc89f437c544bbdd94e74032ee54baccbb22360511ba4ce4bcd3abf8d26ce3c4"} May 27 18:42:59.024012 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:59.023973 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc89f437c544bbdd94e74032ee54baccbb22360511ba4ce4bcd3abf8d26ce3c4" May 27 18:42:59.024012 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:59.023945 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9prhkq" May 27 18:42:59.025485 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:59.025458 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" event={"ID":"826ff222-5255-4f4a-9a12-bfe1e0e8690c","Type":"ContainerStarted","Data":"72b2b0f5d67d958269bcd108c3e1615bf63f1af440777b4ef2cd00d4df4a6841"} May 27 18:42:59.025654 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:59.025634 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:42:59.047321 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:42:59.047274 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" podStartSLOduration=1.490433158 podStartE2EDuration="4.047256757s" podCreationTimestamp="2026-05-27 18:42:55 +0000 UTC" firstStartedPulling="2026-05-27 18:42:55.977348988 +0000 UTC m=+418.877410401" lastFinishedPulling="2026-05-27 18:42:58.534172587 +0000 UTC m=+421.434234000" observedRunningTime="2026-05-27 18:42:59.04420992 +0000 UTC m=+421.944271365" watchObservedRunningTime="2026-05-27 18:42:59.047256757 +0000 UTC m=+421.947318193" May 27 18:43:03.133418 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133362 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2"] May 27 18:43:03.133871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133740 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerName="extract" May 27 18:43:03.133871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133753 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerName="extract" May 27 18:43:03.133871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133765 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerName="pull" May 27 18:43:03.133871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133771 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerName="pull" May 27 18:43:03.133871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133785 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerName="util" May 27 18:43:03.133871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133790 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerName="util" May 27 18:43:03.133871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.133842 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="53188763-8d0d-4a9a-bf43-e747c9ecbeab" containerName="extract" May 27 18:43:03.140132 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.140110 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.143917 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.143896 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dkkwq\"" May 27 18:43:03.144038 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.143931 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 18:43:03.144038 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.143967 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 18:43:03.144038 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.143973 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 18:43:03.154367 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.154344 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2"] May 27 18:43:03.309283 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.309245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nmc5\" (UniqueName: \"kubernetes.io/projected/7a103572-2010-4217-b444-2344309cdefd-kube-api-access-9nmc5\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.309496 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.309302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7a103572-2010-4217-b444-2344309cdefd-manager-config\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.309496 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.309373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a103572-2010-4217-b444-2344309cdefd-cert\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.309496 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.309427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a103572-2010-4217-b444-2344309cdefd-metrics-cert\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.410754 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.410668 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a103572-2010-4217-b444-2344309cdefd-cert\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.410754 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.410703 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a103572-2010-4217-b444-2344309cdefd-metrics-cert\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.410754 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.410745 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nmc5\" (UniqueName: \"kubernetes.io/projected/7a103572-2010-4217-b444-2344309cdefd-kube-api-access-9nmc5\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.411033 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.410789 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7a103572-2010-4217-b444-2344309cdefd-manager-config\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.411472 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.411451 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7a103572-2010-4217-b444-2344309cdefd-manager-config\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.413363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.413331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a103572-2010-4217-b444-2344309cdefd-cert\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.413469 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.413331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a103572-2010-4217-b444-2344309cdefd-metrics-cert\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.419443 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.419421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nmc5\" (UniqueName: \"kubernetes.io/projected/7a103572-2010-4217-b444-2344309cdefd-kube-api-access-9nmc5\") pod \"lws-controller-manager-5ff9f7544c-7tff2\" (UID: \"7a103572-2010-4217-b444-2344309cdefd\") " pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.449317 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.449296 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:03.581002 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:03.580979 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2"] May 27 18:43:03.583099 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:43:03.583066 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a103572_2010_4217_b444_2344309cdefd.slice/crio-b1fb16baaecfd50d0b20365bae2a52884cf0c536d7685b38c189a6a9b040ddc0 WatchSource:0}: Error finding container b1fb16baaecfd50d0b20365bae2a52884cf0c536d7685b38c189a6a9b040ddc0: Status 404 returned error can't find the container with id b1fb16baaecfd50d0b20365bae2a52884cf0c536d7685b38c189a6a9b040ddc0 May 27 18:43:04.048954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:04.048913 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" event={"ID":"7a103572-2010-4217-b444-2344309cdefd","Type":"ContainerStarted","Data":"b1fb16baaecfd50d0b20365bae2a52884cf0c536d7685b38c189a6a9b040ddc0"} May 27 18:43:06.058200 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:06.058165 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" event={"ID":"7a103572-2010-4217-b444-2344309cdefd","Type":"ContainerStarted","Data":"737fdeb58759602af34b95060ff7f952b5f7168384fbfc4399de2c93528aa7f4"} May 27 18:43:06.058622 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:06.058318 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:06.077213 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:06.077168 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" podStartSLOduration=1.333783352 podStartE2EDuration="3.077152076s" podCreationTimestamp="2026-05-27 18:43:03 +0000 UTC" firstStartedPulling="2026-05-27 18:43:03.584847173 +0000 UTC m=+426.484908590" lastFinishedPulling="2026-05-27 18:43:05.328215899 +0000 UTC m=+428.228277314" observedRunningTime="2026-05-27 18:43:06.075814327 +0000 UTC m=+428.975875762" watchObservedRunningTime="2026-05-27 18:43:06.077152076 +0000 UTC m=+428.977213511" May 27 18:43:10.031760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:10.031731 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w" May 27 18:43:17.063885 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:17.063810 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5ff9f7544c-7tff2" May 27 18:43:24.595565 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.595530 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb"] May 27 18:43:24.598886 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.598863 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.601580 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.601557 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p5mqk\"" May 27 18:43:24.601671 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.601623 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 18:43:24.602381 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.602359 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 18:43:24.610376 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.610352 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb"] May 27 18:43:24.682841 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.682804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fnrr\" (UniqueName: \"kubernetes.io/projected/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-kube-api-access-7fnrr\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.682991 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.682873 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.683035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.683002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.784073 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.784040 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fnrr\" (UniqueName: \"kubernetes.io/projected/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-kube-api-access-7fnrr\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.784258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.784094 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.784258 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.784122 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.784545 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.784527 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.784603 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.784565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.795595 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.795568 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fnrr\" (UniqueName: \"kubernetes.io/projected/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-kube-api-access-7fnrr\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:24.907951 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:24.907880 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:25.042408 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:25.042369 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb"] May 27 18:43:25.044742 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:43:25.044715 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2cbb23f_8b7a_4db4_bbff_a5381e7bead4.slice/crio-7591d21357fa83636c6e7e51e9c5358e6529c8a7d8e01ce2e064f93e6c81eef7 WatchSource:0}: Error finding container 7591d21357fa83636c6e7e51e9c5358e6529c8a7d8e01ce2e064f93e6c81eef7: Status 404 returned error can't find the container with id 7591d21357fa83636c6e7e51e9c5358e6529c8a7d8e01ce2e064f93e6c81eef7 May 27 18:43:25.128271 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:25.128236 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" event={"ID":"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4","Type":"ContainerStarted","Data":"b8b47e2e3638e52a0d4d0ad2835bdb0503d1c7ee0c8934e5284077c78c2ce615"} May 27 18:43:25.128372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:25.128282 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" event={"ID":"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4","Type":"ContainerStarted","Data":"7591d21357fa83636c6e7e51e9c5358e6529c8a7d8e01ce2e064f93e6c81eef7"} May 27 18:43:26.134621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:26.134538 2556 generic.go:358] "Generic (PLEG): container finished" podID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerID="b8b47e2e3638e52a0d4d0ad2835bdb0503d1c7ee0c8934e5284077c78c2ce615" exitCode=0 May 27 18:43:26.134986 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:26.134619 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" event={"ID":"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4","Type":"ContainerDied","Data":"b8b47e2e3638e52a0d4d0ad2835bdb0503d1c7ee0c8934e5284077c78c2ce615"} May 27 18:43:27.139486 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:27.139388 2556 generic.go:358] "Generic (PLEG): container finished" podID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerID="3f0e5db9cd14b828cadf9e5c78660703105481184e07f216ffefb694c644456c" exitCode=0 May 27 18:43:27.139899 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:27.139497 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" event={"ID":"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4","Type":"ContainerDied","Data":"3f0e5db9cd14b828cadf9e5c78660703105481184e07f216ffefb694c644456c"} May 27 18:43:28.145038 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:28.145000 2556 generic.go:358] "Generic (PLEG): container finished" podID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerID="448fb4c4f39c707e5645f2ba9a8c5247fdefdb19bbe82202b861259d304b1df3" exitCode=0 May 27 18:43:28.145502 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:28.145050 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" event={"ID":"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4","Type":"ContainerDied","Data":"448fb4c4f39c707e5645f2ba9a8c5247fdefdb19bbe82202b861259d304b1df3"} May 27 18:43:29.268884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.268863 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:29.319484 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.319460 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-util\") pod \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " May 27 18:43:29.319648 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.319495 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-bundle\") pod \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " May 27 18:43:29.319648 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.319568 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fnrr\" (UniqueName: \"kubernetes.io/projected/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-kube-api-access-7fnrr\") pod \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\" (UID: \"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4\") " May 27 18:43:29.320484 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.320460 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-bundle" (OuterVolumeSpecName: "bundle") pod "c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" (UID: "c2cbb23f-8b7a-4db4-bbff-a5381e7bead4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:43:29.321543 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.321525 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-kube-api-access-7fnrr" (OuterVolumeSpecName: "kube-api-access-7fnrr") pod "c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" (UID: "c2cbb23f-8b7a-4db4-bbff-a5381e7bead4"). InnerVolumeSpecName "kube-api-access-7fnrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:43:29.324895 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.324858 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-util" (OuterVolumeSpecName: "util") pod "c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" (UID: "c2cbb23f-8b7a-4db4-bbff-a5381e7bead4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:43:29.420276 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.420204 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fnrr\" (UniqueName: \"kubernetes.io/projected/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-kube-api-access-7fnrr\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:43:29.420276 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.420232 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:43:29.420276 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:29.420246 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2cbb23f-8b7a-4db4-bbff-a5381e7bead4-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:43:30.153948 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:30.153872 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" May 27 18:43:30.154108 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:30.153869 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bhlgb" event={"ID":"c2cbb23f-8b7a-4db4-bbff-a5381e7bead4","Type":"ContainerDied","Data":"7591d21357fa83636c6e7e51e9c5358e6529c8a7d8e01ce2e064f93e6c81eef7"} May 27 18:43:30.154108 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:30.153977 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7591d21357fa83636c6e7e51e9c5358e6529c8a7d8e01ce2e064f93e6c81eef7" May 27 18:43:39.150631 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.150593 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc"] May 27 18:43:39.151035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.150904 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerName="util" May 27 18:43:39.151035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.150914 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerName="util" May 27 18:43:39.151035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.150931 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerName="pull" May 27 18:43:39.151035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.150936 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerName="pull" May 27 18:43:39.151035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.150943 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerName="extract" May 27 18:43:39.151035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.150949 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerName="extract" May 27 18:43:39.151035 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.151000 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2cbb23f-8b7a-4db4-bbff-a5381e7bead4" containerName="extract" May 27 18:43:39.160850 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.160824 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.170075 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.170056 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p5mqk\"" May 27 18:43:39.175534 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.175508 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 18:43:39.176083 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.176057 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 18:43:39.176599 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.176577 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc"] May 27 18:43:39.195061 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.195037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.195169 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.195083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xk8\" (UniqueName: \"kubernetes.io/projected/123d55b7-59e3-488b-bb56-29d5b35cd02b-kube-api-access-z7xk8\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.195233 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.195208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.296404 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.296375 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.296554 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.296470 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.296554 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.296512 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xk8\" (UniqueName: \"kubernetes.io/projected/123d55b7-59e3-488b-bb56-29d5b35cd02b-kube-api-access-z7xk8\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.296839 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.296802 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.296913 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.296851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.314142 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.314118 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xk8\" (UniqueName: \"kubernetes.io/projected/123d55b7-59e3-488b-bb56-29d5b35cd02b-kube-api-access-z7xk8\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.470340 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.470312 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:39.652609 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:39.652581 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc"] May 27 18:43:40.187795 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:40.187710 2556 generic.go:358] "Generic (PLEG): container finished" podID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerID="4d44b628341675d76fe187c4b8b9e538cc1901a74991c42d87c3882a83fcd524" exitCode=0 May 27 18:43:40.188145 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:40.187796 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" event={"ID":"123d55b7-59e3-488b-bb56-29d5b35cd02b","Type":"ContainerDied","Data":"4d44b628341675d76fe187c4b8b9e538cc1901a74991c42d87c3882a83fcd524"} May 27 18:43:40.188145 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:40.187831 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" event={"ID":"123d55b7-59e3-488b-bb56-29d5b35cd02b","Type":"ContainerStarted","Data":"6ba97e5ad45f22ec35c182a26c5d07105f323587d2548280ae069d067f2e44c2"} May 27 18:43:42.196011 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:42.195978 2556 generic.go:358] "Generic (PLEG): container finished" podID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerID="22fa20b5aa5cb1412896303bae7d3506d701ccedfb162df13d6c99d1b9e1e044" exitCode=0 May 27 18:43:42.196361 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:42.196022 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" event={"ID":"123d55b7-59e3-488b-bb56-29d5b35cd02b","Type":"ContainerDied","Data":"22fa20b5aa5cb1412896303bae7d3506d701ccedfb162df13d6c99d1b9e1e044"} May 27 18:43:43.201155 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:43.201119 2556 generic.go:358] "Generic (PLEG): container finished" podID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerID="7879e91b11e9e793ea3e9dcf7c08a47e079c77a021664262a58d260e1e3b60a3" exitCode=0 May 27 18:43:43.201554 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:43.201201 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" event={"ID":"123d55b7-59e3-488b-bb56-29d5b35cd02b","Type":"ContainerDied","Data":"7879e91b11e9e793ea3e9dcf7c08a47e079c77a021664262a58d260e1e3b60a3"} May 27 18:43:44.328825 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.328803 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:44.438859 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.438831 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-bundle\") pod \"123d55b7-59e3-488b-bb56-29d5b35cd02b\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " May 27 18:43:44.438995 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.438864 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7xk8\" (UniqueName: \"kubernetes.io/projected/123d55b7-59e3-488b-bb56-29d5b35cd02b-kube-api-access-z7xk8\") pod \"123d55b7-59e3-488b-bb56-29d5b35cd02b\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " May 27 18:43:44.439059 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.439037 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-util\") pod \"123d55b7-59e3-488b-bb56-29d5b35cd02b\" (UID: \"123d55b7-59e3-488b-bb56-29d5b35cd02b\") " May 27 18:43:44.439777 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.439753 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-bundle" (OuterVolumeSpecName: "bundle") pod "123d55b7-59e3-488b-bb56-29d5b35cd02b" (UID: "123d55b7-59e3-488b-bb56-29d5b35cd02b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:43:44.440835 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.440815 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123d55b7-59e3-488b-bb56-29d5b35cd02b-kube-api-access-z7xk8" (OuterVolumeSpecName: "kube-api-access-z7xk8") pod "123d55b7-59e3-488b-bb56-29d5b35cd02b" (UID: "123d55b7-59e3-488b-bb56-29d5b35cd02b"). InnerVolumeSpecName "kube-api-access-z7xk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:43:44.447528 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.447502 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-util" (OuterVolumeSpecName: "util") pod "123d55b7-59e3-488b-bb56-29d5b35cd02b" (UID: "123d55b7-59e3-488b-bb56-29d5b35cd02b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:43:44.540339 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.540286 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:43:44.540339 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.540327 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/123d55b7-59e3-488b-bb56-29d5b35cd02b-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:43:44.540339 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:44.540338 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7xk8\" (UniqueName: \"kubernetes.io/projected/123d55b7-59e3-488b-bb56-29d5b35cd02b-kube-api-access-z7xk8\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:43:45.209931 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:45.209903 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" May 27 18:43:45.210084 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:45.209901 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apzdtc" event={"ID":"123d55b7-59e3-488b-bb56-29d5b35cd02b","Type":"ContainerDied","Data":"6ba97e5ad45f22ec35c182a26c5d07105f323587d2548280ae069d067f2e44c2"} May 27 18:43:45.210084 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:45.210016 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ba97e5ad45f22ec35c182a26c5d07105f323587d2548280ae069d067f2e44c2" May 27 18:43:55.308865 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.308829 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf"] May 27 18:43:55.309363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.309204 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerName="extract" May 27 18:43:55.309363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.309221 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerName="extract" May 27 18:43:55.309363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.309233 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerName="util" May 27 18:43:55.309363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.309239 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerName="util" May 27 18:43:55.309363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.309245 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerName="pull" May 27 18:43:55.309363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.309250 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerName="pull" May 27 18:43:55.309363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.309306 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="123d55b7-59e3-488b-bb56-29d5b35cd02b" containerName="extract" May 27 18:43:55.312423 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.312386 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.315492 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.315473 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mdqhd\"" May 27 18:43:55.315824 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.315807 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 18:43:55.331608 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.331585 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf"] May 27 18:43:55.426349 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66800d03-3cc8-496e-be88-f9538dc07317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426362 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426503 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426489 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66800d03-3cc8-496e-be88-f9538dc07317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426647 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426647 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426647 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426625 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66800d03-3cc8-496e-be88-f9538dc07317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb77s\" (UniqueName: \"kubernetes.io/projected/66800d03-3cc8-496e-be88-f9538dc07317-kube-api-access-gb77s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.426768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.426751 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527233 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527206 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527347 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527240 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66800d03-3cc8-496e-be88-f9538dc07317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527347 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527260 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gb77s\" (UniqueName: \"kubernetes.io/projected/66800d03-3cc8-496e-be88-f9538dc07317-kube-api-access-gb77s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527347 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527304 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527347 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527341 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66800d03-3cc8-496e-be88-f9538dc07317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527576 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527367 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527576 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527409 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527576 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527450 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66800d03-3cc8-496e-be88-f9538dc07317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527576 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527484 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527772 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527687 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527772 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527718 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.527968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.527945 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.528085 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.528064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.528203 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.528186 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66800d03-3cc8-496e-be88-f9538dc07317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.529862 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.529841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66800d03-3cc8-496e-be88-f9538dc07317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.529940 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.529895 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66800d03-3cc8-496e-be88-f9538dc07317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.542842 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.542820 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66800d03-3cc8-496e-be88-f9538dc07317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.547668 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.547641 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb77s\" (UniqueName: \"kubernetes.io/projected/66800d03-3cc8-496e-be88-f9538dc07317-kube-api-access-gb77s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf\" (UID: \"66800d03-3cc8-496e-be88-f9538dc07317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.622607 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.622551 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:55.793724 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:55.793695 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf"] May 27 18:43:55.794978 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:43:55.794948 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66800d03_3cc8_496e_be88_f9538dc07317.slice/crio-cb77310d2a13582f6b078d4943a9ce41e80e558110ebe3d0e7d5ad21a63159a7 WatchSource:0}: Error finding container cb77310d2a13582f6b078d4943a9ce41e80e558110ebe3d0e7d5ad21a63159a7: Status 404 returned error can't find the container with id cb77310d2a13582f6b078d4943a9ce41e80e558110ebe3d0e7d5ad21a63159a7 May 27 18:43:56.247376 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:56.247338 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" event={"ID":"66800d03-3cc8-496e-be88-f9538dc07317","Type":"ContainerStarted","Data":"cb77310d2a13582f6b078d4943a9ce41e80e558110ebe3d0e7d5ad21a63159a7"} May 27 18:43:58.387735 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:58.387694 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:43:58.388016 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:58.387766 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:43:58.388016 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:58.387799 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:43:59.260373 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:59.260336 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" event={"ID":"66800d03-3cc8-496e-be88-f9538dc07317","Type":"ContainerStarted","Data":"28596de173bb399fa05fbb4bb939fca774cde293cf6f4af869af4aa838b0cfac"} May 27 18:43:59.282999 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:59.282954 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" podStartSLOduration=1.692692635 podStartE2EDuration="4.282940847s" podCreationTimestamp="2026-05-27 18:43:55 +0000 UTC" firstStartedPulling="2026-05-27 18:43:55.797180098 +0000 UTC m=+478.697241520" lastFinishedPulling="2026-05-27 18:43:58.387428304 +0000 UTC m=+481.287489732" observedRunningTime="2026-05-27 18:43:59.280817905 +0000 UTC m=+482.180879341" watchObservedRunningTime="2026-05-27 18:43:59.282940847 +0000 UTC m=+482.183002281" May 27 18:43:59.623533 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:59.623459 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:43:59.628071 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:43:59.628043 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:44:00.264219 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:00.264180 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:44:00.265107 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:00.265090 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf" May 27 18:44:13.822408 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:13.822360 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp4fs"] May 27 18:44:13.827452 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:13.827435 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" May 27 18:44:13.830356 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:13.830333 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-njnnz\"" May 27 18:44:13.831219 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:13.831198 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 18:44:13.831311 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:13.831199 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 18:44:13.840884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:13.840858 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp4fs"] May 27 18:44:13.987897 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:13.987864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/4b209cec-2811-446d-a084-c4014827d485-kube-api-access-7hz6q\") pod \"kuadrant-operator-catalog-hp4fs\" (UID: \"4b209cec-2811-446d-a084-c4014827d485\") " pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" May 27 18:44:14.089285 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.089212 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/4b209cec-2811-446d-a084-c4014827d485-kube-api-access-7hz6q\") pod \"kuadrant-operator-catalog-hp4fs\" (UID: \"4b209cec-2811-446d-a084-c4014827d485\") " pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" May 27 18:44:14.097868 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.097838 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/4b209cec-2811-446d-a084-c4014827d485-kube-api-access-7hz6q\") pod \"kuadrant-operator-catalog-hp4fs\" (UID: \"4b209cec-2811-446d-a084-c4014827d485\") " pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" May 27 18:44:14.139310 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.139287 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" May 27 18:44:14.200296 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.200226 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp4fs"] May 27 18:44:14.269926 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.269894 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp4fs"] May 27 18:44:14.273132 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:44:14.273106 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b209cec_2811_446d_a084_c4014827d485.slice/crio-ea332ea5ca8ac7facdcff49180a9126d85b36dca65be3d8ed97f707d37c95d6d WatchSource:0}: Error finding container ea332ea5ca8ac7facdcff49180a9126d85b36dca65be3d8ed97f707d37c95d6d: Status 404 returned error can't find the container with id ea332ea5ca8ac7facdcff49180a9126d85b36dca65be3d8ed97f707d37c95d6d May 27 18:44:14.316485 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.316451 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" event={"ID":"4b209cec-2811-446d-a084-c4014827d485","Type":"ContainerStarted","Data":"ea332ea5ca8ac7facdcff49180a9126d85b36dca65be3d8ed97f707d37c95d6d"} May 27 18:44:14.403655 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.403597 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gq2n9"] May 27 18:44:14.408917 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.408900 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:14.414726 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.414704 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gq2n9"] May 27 18:44:14.492954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.492928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngq5f\" (UniqueName: \"kubernetes.io/projected/8f51b7c5-09af-4649-ac1f-78c7dba386dd-kube-api-access-ngq5f\") pod \"kuadrant-operator-catalog-gq2n9\" (UID: \"8f51b7c5-09af-4649-ac1f-78c7dba386dd\") " pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:14.593436 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.593384 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngq5f\" (UniqueName: \"kubernetes.io/projected/8f51b7c5-09af-4649-ac1f-78c7dba386dd-kube-api-access-ngq5f\") pod \"kuadrant-operator-catalog-gq2n9\" (UID: \"8f51b7c5-09af-4649-ac1f-78c7dba386dd\") " pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:14.603381 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.603350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngq5f\" (UniqueName: \"kubernetes.io/projected/8f51b7c5-09af-4649-ac1f-78c7dba386dd-kube-api-access-ngq5f\") pod \"kuadrant-operator-catalog-gq2n9\" (UID: \"8f51b7c5-09af-4649-ac1f-78c7dba386dd\") " pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:14.718652 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.718613 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:14.857307 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:14.857281 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gq2n9"] May 27 18:44:14.889513 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:44:14.889480 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f51b7c5_09af_4649_ac1f_78c7dba386dd.slice/crio-6f70857d90f486d344acf505beee8625a2993c8877c8405e8f42dddbbed3570a WatchSource:0}: Error finding container 6f70857d90f486d344acf505beee8625a2993c8877c8405e8f42dddbbed3570a: Status 404 returned error can't find the container with id 6f70857d90f486d344acf505beee8625a2993c8877c8405e8f42dddbbed3570a May 27 18:44:15.322948 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:15.322913 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" event={"ID":"8f51b7c5-09af-4649-ac1f-78c7dba386dd","Type":"ContainerStarted","Data":"6f70857d90f486d344acf505beee8625a2993c8877c8405e8f42dddbbed3570a"} May 27 18:44:17.331196 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.331155 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" event={"ID":"4b209cec-2811-446d-a084-c4014827d485","Type":"ContainerStarted","Data":"f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695"} May 27 18:44:17.331676 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.331261 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" podUID="4b209cec-2811-446d-a084-c4014827d485" containerName="registry-server" containerID="cri-o://f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695" gracePeriod=2 May 27 18:44:17.332574 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.332552 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" event={"ID":"8f51b7c5-09af-4649-ac1f-78c7dba386dd","Type":"ContainerStarted","Data":"1d22977344294a1d7c30365cfe7363601832e10ae97432d8b52894cf498b2c4e"} May 27 18:44:17.348756 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.348717 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" podStartSLOduration=1.93023247 podStartE2EDuration="4.348706635s" podCreationTimestamp="2026-05-27 18:44:13 +0000 UTC" firstStartedPulling="2026-05-27 18:44:14.274695111 +0000 UTC m=+497.174756528" lastFinishedPulling="2026-05-27 18:44:16.693169279 +0000 UTC m=+499.593230693" observedRunningTime="2026-05-27 18:44:17.346508384 +0000 UTC m=+500.246569821" watchObservedRunningTime="2026-05-27 18:44:17.348706635 +0000 UTC m=+500.248768070" May 27 18:44:17.362385 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.362349 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" podStartSLOduration=1.563599783 podStartE2EDuration="3.362339439s" podCreationTimestamp="2026-05-27 18:44:14 +0000 UTC" firstStartedPulling="2026-05-27 18:44:14.890915346 +0000 UTC m=+497.790976763" lastFinishedPulling="2026-05-27 18:44:16.689655006 +0000 UTC m=+499.589716419" observedRunningTime="2026-05-27 18:44:17.360659076 +0000 UTC m=+500.260720512" watchObservedRunningTime="2026-05-27 18:44:17.362339439 +0000 UTC m=+500.262400873" May 27 18:44:17.572001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.571978 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" May 27 18:44:17.619183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.619122 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/4b209cec-2811-446d-a084-c4014827d485-kube-api-access-7hz6q\") pod \"4b209cec-2811-446d-a084-c4014827d485\" (UID: \"4b209cec-2811-446d-a084-c4014827d485\") " May 27 18:44:17.621160 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.621136 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b209cec-2811-446d-a084-c4014827d485-kube-api-access-7hz6q" (OuterVolumeSpecName: "kube-api-access-7hz6q") pod "4b209cec-2811-446d-a084-c4014827d485" (UID: "4b209cec-2811-446d-a084-c4014827d485"). InnerVolumeSpecName "kube-api-access-7hz6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:44:17.719988 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:17.719963 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/4b209cec-2811-446d-a084-c4014827d485-kube-api-access-7hz6q\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:18.337029 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.336994 2556 generic.go:358] "Generic (PLEG): container finished" podID="4b209cec-2811-446d-a084-c4014827d485" containerID="f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695" exitCode=0 May 27 18:44:18.337443 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.337048 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" May 27 18:44:18.337443 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.337076 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" event={"ID":"4b209cec-2811-446d-a084-c4014827d485","Type":"ContainerDied","Data":"f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695"} May 27 18:44:18.337443 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.337112 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hp4fs" event={"ID":"4b209cec-2811-446d-a084-c4014827d485","Type":"ContainerDied","Data":"ea332ea5ca8ac7facdcff49180a9126d85b36dca65be3d8ed97f707d37c95d6d"} May 27 18:44:18.337443 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.337130 2556 scope.go:117] "RemoveContainer" containerID="f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695" May 27 18:44:18.345862 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.345834 2556 scope.go:117] "RemoveContainer" containerID="f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695" May 27 18:44:18.346114 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:44:18.346096 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695\": container with ID starting with f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695 not found: ID does not exist" containerID="f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695" May 27 18:44:18.346165 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.346121 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695"} err="failed to get container status \"f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695\": rpc error: code = NotFound desc = could not find container \"f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695\": container with ID starting with f6bc57a99cbc823e6c77f053b5ed43ef593e9778f8838f8abdf7b4bf667f5695 not found: ID does not exist" May 27 18:44:18.355528 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.355506 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp4fs"] May 27 18:44:18.360682 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:18.360661 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hp4fs"] May 27 18:44:19.738722 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:19.738693 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b209cec-2811-446d-a084-c4014827d485" path="/var/lib/kubelet/pods/4b209cec-2811-446d-a084-c4014827d485/volumes" May 27 18:44:24.719116 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:24.719079 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:24.719615 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:24.719125 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:24.740490 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:24.740467 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:25.383176 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:25.383141 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gq2n9" May 27 18:44:29.394758 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.394716 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t"] May 27 18:44:29.395242 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.395173 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b209cec-2811-446d-a084-c4014827d485" containerName="registry-server" May 27 18:44:29.395242 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.395189 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b209cec-2811-446d-a084-c4014827d485" containerName="registry-server" May 27 18:44:29.395313 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.395257 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b209cec-2811-446d-a084-c4014827d485" containerName="registry-server" May 27 18:44:29.399841 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.399824 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.402360 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.402338 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jj9nv\"" May 27 18:44:29.407002 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.406979 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t"] May 27 18:44:29.512804 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.512778 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89666\" (UniqueName: \"kubernetes.io/projected/8fce18fb-3ca1-4508-b9dd-e1d85398833b-kube-api-access-89666\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.512915 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.512808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.512915 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.512839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.613363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.613335 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89666\" (UniqueName: \"kubernetes.io/projected/8fce18fb-3ca1-4508-b9dd-e1d85398833b-kube-api-access-89666\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.613363 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.613363 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.613522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.613424 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.613792 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.613777 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.613831 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.613809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.622111 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.622087 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89666\" (UniqueName: \"kubernetes.io/projected/8fce18fb-3ca1-4508-b9dd-e1d85398833b-kube-api-access-89666\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.710152 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.710132 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:29.838692 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:29.838670 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t"] May 27 18:44:29.840885 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:44:29.840856 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fce18fb_3ca1_4508_b9dd_e1d85398833b.slice/crio-87fca0cc5839372c803081712ebd0d35b561c365ada05cfb16c6584b79d27af0 WatchSource:0}: Error finding container 87fca0cc5839372c803081712ebd0d35b561c365ada05cfb16c6584b79d27af0: Status 404 returned error can't find the container with id 87fca0cc5839372c803081712ebd0d35b561c365ada05cfb16c6584b79d27af0 May 27 18:44:30.193230 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.193200 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z"] May 27 18:44:30.198042 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.198023 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.205043 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.205020 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z"] May 27 18:44:30.318996 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.318968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.319118 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.319005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.319118 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.319044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2xbp\" (UniqueName: \"kubernetes.io/projected/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-kube-api-access-s2xbp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.381185 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.381157 2556 generic.go:358] "Generic (PLEG): container finished" podID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerID="c7bde4f6dbd3a15ae52bd17abcb2d0f705d3719312694c1961609286b6deb314" exitCode=0 May 27 18:44:30.381301 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.381217 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" event={"ID":"8fce18fb-3ca1-4508-b9dd-e1d85398833b","Type":"ContainerDied","Data":"c7bde4f6dbd3a15ae52bd17abcb2d0f705d3719312694c1961609286b6deb314"} May 27 18:44:30.381301 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.381237 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" event={"ID":"8fce18fb-3ca1-4508-b9dd-e1d85398833b","Type":"ContainerStarted","Data":"87fca0cc5839372c803081712ebd0d35b561c365ada05cfb16c6584b79d27af0"} May 27 18:44:30.419529 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.419502 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.419907 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.419534 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.419907 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.419724 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2xbp\" (UniqueName: \"kubernetes.io/projected/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-kube-api-access-s2xbp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.420023 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.419920 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.420023 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.419932 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.427613 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.427593 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2xbp\" (UniqueName: \"kubernetes.io/projected/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-kube-api-access-s2xbp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.507646 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.507589 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:30.598433 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.598405 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg"] May 27 18:44:30.603206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.603183 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.611359 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.611244 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg"] May 27 18:44:30.638388 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.638361 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z"] May 27 18:44:30.722570 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.722543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.722668 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.722597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.722668 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.722620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghg6x\" (UniqueName: \"kubernetes.io/projected/149b926e-c691-4af6-8245-a20924a83660-kube-api-access-ghg6x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.823678 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.823619 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.823767 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.823676 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.823767 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.823711 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghg6x\" (UniqueName: \"kubernetes.io/projected/149b926e-c691-4af6-8245-a20924a83660-kube-api-access-ghg6x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.824046 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.824025 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.824096 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.824035 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.832059 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.832035 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghg6x\" (UniqueName: \"kubernetes.io/projected/149b926e-c691-4af6-8245-a20924a83660-kube-api-access-ghg6x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:30.916218 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:30.916185 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:31.010026 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.009999 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5"] May 27 18:44:31.015287 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.015267 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.024130 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.024103 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5"] May 27 18:44:31.084724 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.084696 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg"] May 27 18:44:31.086598 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:44:31.086569 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149b926e_c691_4af6_8245_a20924a83660.slice/crio-aced537a35cc052ed45dcd6016bb5aad19181619adf49cc1f388338005a096db WatchSource:0}: Error finding container aced537a35cc052ed45dcd6016bb5aad19181619adf49cc1f388338005a096db: Status 404 returned error can't find the container with id aced537a35cc052ed45dcd6016bb5aad19181619adf49cc1f388338005a096db May 27 18:44:31.126284 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.126260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.126373 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.126295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmcw\" (UniqueName: \"kubernetes.io/projected/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-kube-api-access-8mmcw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.126373 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.126338 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.227422 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.227371 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.227552 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.227443 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmcw\" (UniqueName: \"kubernetes.io/projected/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-kube-api-access-8mmcw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.227552 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.227521 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.227753 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.227733 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.227820 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.227802 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.235910 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.235890 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmcw\" (UniqueName: \"kubernetes.io/projected/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-kube-api-access-8mmcw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.353036 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.352964 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:31.390919 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.390886 2556 generic.go:358] "Generic (PLEG): container finished" podID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerID="22b5e4f643cefd3f9a820fa6f67f8687fdc39bea675c841a6ba76c3ccab7973d" exitCode=0 May 27 18:44:31.391079 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.390976 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" event={"ID":"8fce18fb-3ca1-4508-b9dd-e1d85398833b","Type":"ContainerDied","Data":"22b5e4f643cefd3f9a820fa6f67f8687fdc39bea675c841a6ba76c3ccab7973d"} May 27 18:44:31.392382 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.392351 2556 generic.go:358] "Generic (PLEG): container finished" podID="149b926e-c691-4af6-8245-a20924a83660" containerID="8d4e44a7c11f838d7f57fdefdce51a9001ddd7164c136486a17710ff120b1e40" exitCode=0 May 27 18:44:31.392525 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.392460 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" event={"ID":"149b926e-c691-4af6-8245-a20924a83660","Type":"ContainerDied","Data":"8d4e44a7c11f838d7f57fdefdce51a9001ddd7164c136486a17710ff120b1e40"} May 27 18:44:31.392525 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.392483 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" event={"ID":"149b926e-c691-4af6-8245-a20924a83660","Type":"ContainerStarted","Data":"aced537a35cc052ed45dcd6016bb5aad19181619adf49cc1f388338005a096db"} May 27 18:44:31.394023 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.393999 2556 generic.go:358] "Generic (PLEG): container finished" podID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerID="bfce9b94a28d862af1a3abeadbac083f0a959bcd8df0ed85c9833a2777b51465" exitCode=0 May 27 18:44:31.394111 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.394085 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" event={"ID":"9f7b4b05-c21f-43cd-bddc-40308e8b2af2","Type":"ContainerDied","Data":"bfce9b94a28d862af1a3abeadbac083f0a959bcd8df0ed85c9833a2777b51465"} May 27 18:44:31.394169 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.394116 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" event={"ID":"9f7b4b05-c21f-43cd-bddc-40308e8b2af2","Type":"ContainerStarted","Data":"6a5e86a48f07e235e830dbc534d2143322538622cd9360e1df99918528a104f3"} May 27 18:44:31.490649 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:31.490623 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5"] May 27 18:44:31.492125 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:44:31.492105 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeeca7df_bc83_4ef9_af70_115ba6ea8dcc.slice/crio-f454a523a18f6abc4c5b67bce73803c1afdb0bb6398cbf10da405f5cd63bd04a WatchSource:0}: Error finding container f454a523a18f6abc4c5b67bce73803c1afdb0bb6398cbf10da405f5cd63bd04a: Status 404 returned error can't find the container with id f454a523a18f6abc4c5b67bce73803c1afdb0bb6398cbf10da405f5cd63bd04a May 27 18:44:32.400999 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.400957 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" event={"ID":"9f7b4b05-c21f-43cd-bddc-40308e8b2af2","Type":"ContainerStarted","Data":"67f40398c7b1144d8e8d20dcd690acb3d3fb190c0bd0d33fc419479c4d4cd6db"} May 27 18:44:32.402517 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.402489 2556 generic.go:358] "Generic (PLEG): container finished" podID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerID="127c2b5801ef1edd81065be12f1d754750c21d3480b59401e7d579536cb69fb1" exitCode=0 May 27 18:44:32.402634 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.402536 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" event={"ID":"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc","Type":"ContainerDied","Data":"127c2b5801ef1edd81065be12f1d754750c21d3480b59401e7d579536cb69fb1"} May 27 18:44:32.402634 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.402583 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" event={"ID":"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc","Type":"ContainerStarted","Data":"f454a523a18f6abc4c5b67bce73803c1afdb0bb6398cbf10da405f5cd63bd04a"} May 27 18:44:32.404920 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.404896 2556 generic.go:358] "Generic (PLEG): container finished" podID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerID="0db34884b752d6ef838c190e123313b1152209dbbfd0e427ba249dbb65f274d5" exitCode=0 May 27 18:44:32.405012 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.404971 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" event={"ID":"8fce18fb-3ca1-4508-b9dd-e1d85398833b","Type":"ContainerDied","Data":"0db34884b752d6ef838c190e123313b1152209dbbfd0e427ba249dbb65f274d5"} May 27 18:44:32.407313 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.407295 2556 generic.go:358] "Generic (PLEG): container finished" podID="149b926e-c691-4af6-8245-a20924a83660" containerID="73290835cf88e57a4e0f73ac5213e460d6066435cbed4a6a08a82bb3b3aa8cb1" exitCode=0 May 27 18:44:32.407505 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:32.407331 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" event={"ID":"149b926e-c691-4af6-8245-a20924a83660","Type":"ContainerDied","Data":"73290835cf88e57a4e0f73ac5213e460d6066435cbed4a6a08a82bb3b3aa8cb1"} May 27 18:44:33.413309 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.413225 2556 generic.go:358] "Generic (PLEG): container finished" podID="149b926e-c691-4af6-8245-a20924a83660" containerID="6eb4ca94a9f6d835fce880e05d079521d79c803af5876df127fed189f7aecdd5" exitCode=0 May 27 18:44:33.413713 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.413319 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" event={"ID":"149b926e-c691-4af6-8245-a20924a83660","Type":"ContainerDied","Data":"6eb4ca94a9f6d835fce880e05d079521d79c803af5876df127fed189f7aecdd5"} May 27 18:44:33.414895 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.414866 2556 generic.go:358] "Generic (PLEG): container finished" podID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerID="67f40398c7b1144d8e8d20dcd690acb3d3fb190c0bd0d33fc419479c4d4cd6db" exitCode=0 May 27 18:44:33.415016 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.414953 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" event={"ID":"9f7b4b05-c21f-43cd-bddc-40308e8b2af2","Type":"ContainerDied","Data":"67f40398c7b1144d8e8d20dcd690acb3d3fb190c0bd0d33fc419479c4d4cd6db"} May 27 18:44:33.416568 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.416546 2556 generic.go:358] "Generic (PLEG): container finished" podID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerID="0b0a431a9b9d74d6c345a00771d37096bc7d2955225bcf1e9f6207d4d0ab4238" exitCode=0 May 27 18:44:33.416650 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.416613 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" event={"ID":"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc","Type":"ContainerDied","Data":"0b0a431a9b9d74d6c345a00771d37096bc7d2955225bcf1e9f6207d4d0ab4238"} May 27 18:44:33.541931 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.541910 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:33.647428 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.647383 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89666\" (UniqueName: \"kubernetes.io/projected/8fce18fb-3ca1-4508-b9dd-e1d85398833b-kube-api-access-89666\") pod \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " May 27 18:44:33.647559 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.647449 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-util\") pod \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " May 27 18:44:33.647559 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.647532 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-bundle\") pod \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\" (UID: \"8fce18fb-3ca1-4508-b9dd-e1d85398833b\") " May 27 18:44:33.648016 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.647989 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-bundle" (OuterVolumeSpecName: "bundle") pod "8fce18fb-3ca1-4508-b9dd-e1d85398833b" (UID: "8fce18fb-3ca1-4508-b9dd-e1d85398833b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:33.649260 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.649234 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fce18fb-3ca1-4508-b9dd-e1d85398833b-kube-api-access-89666" (OuterVolumeSpecName: "kube-api-access-89666") pod "8fce18fb-3ca1-4508-b9dd-e1d85398833b" (UID: "8fce18fb-3ca1-4508-b9dd-e1d85398833b"). InnerVolumeSpecName "kube-api-access-89666". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:44:33.653214 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.653181 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-util" (OuterVolumeSpecName: "util") pod "8fce18fb-3ca1-4508-b9dd-e1d85398833b" (UID: "8fce18fb-3ca1-4508-b9dd-e1d85398833b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:33.748268 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.748248 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89666\" (UniqueName: \"kubernetes.io/projected/8fce18fb-3ca1-4508-b9dd-e1d85398833b-kube-api-access-89666\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:33.748268 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.748269 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:33.748383 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:33.748279 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fce18fb-3ca1-4508-b9dd-e1d85398833b-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:34.423015 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.422972 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" event={"ID":"8fce18fb-3ca1-4508-b9dd-e1d85398833b","Type":"ContainerDied","Data":"87fca0cc5839372c803081712ebd0d35b561c365ada05cfb16c6584b79d27af0"} May 27 18:44:34.423015 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.423019 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87fca0cc5839372c803081712ebd0d35b561c365ada05cfb16c6584b79d27af0" May 27 18:44:34.423619 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.422986 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t" May 27 18:44:34.424873 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.424844 2556 generic.go:358] "Generic (PLEG): container finished" podID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerID="f005d4e112e9b2fa759c0cae8b8b4720a35cec125a7b95e7830904facf79fdc4" exitCode=0 May 27 18:44:34.425001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.424950 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" event={"ID":"9f7b4b05-c21f-43cd-bddc-40308e8b2af2","Type":"ContainerDied","Data":"f005d4e112e9b2fa759c0cae8b8b4720a35cec125a7b95e7830904facf79fdc4"} May 27 18:44:34.426925 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.426905 2556 generic.go:358] "Generic (PLEG): container finished" podID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerID="3f0eb807b0b61c3268805129ab0f00108f8db8f842cf3974adfde0343f4c07c0" exitCode=0 May 27 18:44:34.427024 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.426985 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" event={"ID":"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc","Type":"ContainerDied","Data":"3f0eb807b0b61c3268805129ab0f00108f8db8f842cf3974adfde0343f4c07c0"} May 27 18:44:34.555298 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.555277 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:34.655997 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.655974 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-bundle\") pod \"149b926e-c691-4af6-8245-a20924a83660\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " May 27 18:44:34.656121 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.656041 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghg6x\" (UniqueName: \"kubernetes.io/projected/149b926e-c691-4af6-8245-a20924a83660-kube-api-access-ghg6x\") pod \"149b926e-c691-4af6-8245-a20924a83660\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " May 27 18:44:34.656121 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.656082 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-util\") pod \"149b926e-c691-4af6-8245-a20924a83660\" (UID: \"149b926e-c691-4af6-8245-a20924a83660\") " May 27 18:44:34.656608 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.656568 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-bundle" (OuterVolumeSpecName: "bundle") pod "149b926e-c691-4af6-8245-a20924a83660" (UID: "149b926e-c691-4af6-8245-a20924a83660"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:34.658004 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.657984 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/149b926e-c691-4af6-8245-a20924a83660-kube-api-access-ghg6x" (OuterVolumeSpecName: "kube-api-access-ghg6x") pod "149b926e-c691-4af6-8245-a20924a83660" (UID: "149b926e-c691-4af6-8245-a20924a83660"). InnerVolumeSpecName "kube-api-access-ghg6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:44:34.660956 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.660920 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-util" (OuterVolumeSpecName: "util") pod "149b926e-c691-4af6-8245-a20924a83660" (UID: "149b926e-c691-4af6-8245-a20924a83660"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:34.757133 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.757108 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:34.757240 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.757136 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghg6x\" (UniqueName: \"kubernetes.io/projected/149b926e-c691-4af6-8245-a20924a83660-kube-api-access-ghg6x\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:34.757240 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:34.757152 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/149b926e-c691-4af6-8245-a20924a83660-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:35.432416 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.432376 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" May 27 18:44:35.432749 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.432377 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg" event={"ID":"149b926e-c691-4af6-8245-a20924a83660","Type":"ContainerDied","Data":"aced537a35cc052ed45dcd6016bb5aad19181619adf49cc1f388338005a096db"} May 27 18:44:35.432749 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.432509 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aced537a35cc052ed45dcd6016bb5aad19181619adf49cc1f388338005a096db" May 27 18:44:35.566489 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.566465 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:35.593645 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.593626 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:35.663713 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.663685 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-bundle\") pod \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " May 27 18:44:35.663857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.663719 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-util\") pod \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " May 27 18:44:35.663857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.663764 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-util\") pod \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " May 27 18:44:35.663857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.663786 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-bundle\") pod \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " May 27 18:44:35.663857 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.663837 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2xbp\" (UniqueName: \"kubernetes.io/projected/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-kube-api-access-s2xbp\") pod \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\" (UID: \"9f7b4b05-c21f-43cd-bddc-40308e8b2af2\") " May 27 18:44:35.664050 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.663894 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mmcw\" (UniqueName: \"kubernetes.io/projected/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-kube-api-access-8mmcw\") pod \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\" (UID: \"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc\") " May 27 18:44:35.664618 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.664211 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-bundle" (OuterVolumeSpecName: "bundle") pod "9f7b4b05-c21f-43cd-bddc-40308e8b2af2" (UID: "9f7b4b05-c21f-43cd-bddc-40308e8b2af2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:35.664618 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.664432 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-bundle" (OuterVolumeSpecName: "bundle") pod "aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" (UID: "aeeca7df-bc83-4ef9-af70-115ba6ea8dcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:35.666030 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.666007 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-kube-api-access-s2xbp" (OuterVolumeSpecName: "kube-api-access-s2xbp") pod "9f7b4b05-c21f-43cd-bddc-40308e8b2af2" (UID: "9f7b4b05-c21f-43cd-bddc-40308e8b2af2"). InnerVolumeSpecName "kube-api-access-s2xbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:44:35.666360 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.666330 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-kube-api-access-8mmcw" (OuterVolumeSpecName: "kube-api-access-8mmcw") pod "aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" (UID: "aeeca7df-bc83-4ef9-af70-115ba6ea8dcc"). InnerVolumeSpecName "kube-api-access-8mmcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:44:35.670444 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.670384 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-util" (OuterVolumeSpecName: "util") pod "aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" (UID: "aeeca7df-bc83-4ef9-af70-115ba6ea8dcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:35.672347 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.672323 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-util" (OuterVolumeSpecName: "util") pod "9f7b4b05-c21f-43cd-bddc-40308e8b2af2" (UID: "9f7b4b05-c21f-43cd-bddc-40308e8b2af2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:44:35.765551 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.765526 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:35.765551 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.765549 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:35.765674 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.765557 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-util\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:35.765674 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.765566 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:35.765674 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.765575 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2xbp\" (UniqueName: \"kubernetes.io/projected/9f7b4b05-c21f-43cd-bddc-40308e8b2af2-kube-api-access-s2xbp\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:35.765674 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:35.765584 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mmcw\" (UniqueName: \"kubernetes.io/projected/aeeca7df-bc83-4ef9-af70-115ba6ea8dcc-kube-api-access-8mmcw\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:44:36.439200 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:36.439164 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" event={"ID":"9f7b4b05-c21f-43cd-bddc-40308e8b2af2","Type":"ContainerDied","Data":"6a5e86a48f07e235e830dbc534d2143322538622cd9360e1df99918528a104f3"} May 27 18:44:36.439200 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:36.439199 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a5e86a48f07e235e830dbc534d2143322538622cd9360e1df99918528a104f3" May 27 18:44:36.439679 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:36.439230 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z" May 27 18:44:36.441112 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:36.441074 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" event={"ID":"aeeca7df-bc83-4ef9-af70-115ba6ea8dcc","Type":"ContainerDied","Data":"f454a523a18f6abc4c5b67bce73803c1afdb0bb6398cbf10da405f5cd63bd04a"} May 27 18:44:36.441112 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:36.441105 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f454a523a18f6abc4c5b67bce73803c1afdb0bb6398cbf10da405f5cd63bd04a" May 27 18:44:36.441305 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:36.441157 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5" May 27 18:44:49.467373 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467297 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb"] May 27 18:44:49.467734 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467692 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerName="util" May 27 18:44:49.467734 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467706 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerName="util" May 27 18:44:49.467734 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467718 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerName="extract" May 27 18:44:49.467734 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467724 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerName="extract" May 27 18:44:49.467734 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467732 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467738 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467749 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerName="extract" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467755 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerName="extract" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467761 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467765 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467771 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="149b926e-c691-4af6-8245-a20924a83660" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467776 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="149b926e-c691-4af6-8245-a20924a83660" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467788 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerName="util" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467793 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerName="util" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467799 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="149b926e-c691-4af6-8245-a20924a83660" containerName="util" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467803 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="149b926e-c691-4af6-8245-a20924a83660" containerName="util" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467810 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerName="extract" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467816 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerName="extract" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467822 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerName="util" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467826 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerName="util" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467834 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467839 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerName="pull" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467848 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="149b926e-c691-4af6-8245-a20924a83660" containerName="extract" May 27 18:44:49.467889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467853 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="149b926e-c691-4af6-8245-a20924a83660" containerName="extract" May 27 18:44:49.468436 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467904 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeeca7df-bc83-4ef9-af70-115ba6ea8dcc" containerName="extract" May 27 18:44:49.468436 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467914 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f7b4b05-c21f-43cd-bddc-40308e8b2af2" containerName="extract" May 27 18:44:49.468436 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467924 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fce18fb-3ca1-4508-b9dd-e1d85398833b" containerName="extract" May 27 18:44:49.468436 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.467929 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="149b926e-c691-4af6-8245-a20924a83660" containerName="extract" May 27 18:44:49.470949 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.470932 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:44:49.473703 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.473673 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-smf8h\"" May 27 18:44:49.481831 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.481810 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb"] May 27 18:44:49.571778 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.571744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj87h\" (UniqueName: \"kubernetes.io/projected/4c48a2ad-5624-42d7-b569-7671d70aaf45-kube-api-access-wj87h\") pod \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" (UID: \"4c48a2ad-5624-42d7-b569-7671d70aaf45\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:44:49.672114 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.672080 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wj87h\" (UniqueName: \"kubernetes.io/projected/4c48a2ad-5624-42d7-b569-7671d70aaf45-kube-api-access-wj87h\") pod \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" (UID: \"4c48a2ad-5624-42d7-b569-7671d70aaf45\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:44:49.686199 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.686172 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj87h\" (UniqueName: \"kubernetes.io/projected/4c48a2ad-5624-42d7-b569-7671d70aaf45-kube-api-access-wj87h\") pod \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" (UID: \"4c48a2ad-5624-42d7-b569-7671d70aaf45\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:44:49.781202 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.781146 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:44:49.914048 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:49.914023 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb"] May 27 18:44:49.915003 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:44:49.914977 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c48a2ad_5624_42d7_b569_7671d70aaf45.slice/crio-d4695c0fac68a1afb9b4b105f6fb1384896178f44b18d6c7d8a76b2329414f81 WatchSource:0}: Error finding container d4695c0fac68a1afb9b4b105f6fb1384896178f44b18d6c7d8a76b2329414f81: Status 404 returned error can't find the container with id d4695c0fac68a1afb9b4b105f6fb1384896178f44b18d6c7d8a76b2329414f81 May 27 18:44:50.509231 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:50.509196 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" event={"ID":"4c48a2ad-5624-42d7-b569-7671d70aaf45","Type":"ContainerStarted","Data":"d4695c0fac68a1afb9b4b105f6fb1384896178f44b18d6c7d8a76b2329414f81"} May 27 18:44:52.518288 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:52.518249 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" event={"ID":"4c48a2ad-5624-42d7-b569-7671d70aaf45","Type":"ContainerStarted","Data":"2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da"} May 27 18:44:52.518288 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:52.518291 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:44:52.541368 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:44:52.541325 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" podStartSLOduration=1.622755277 podStartE2EDuration="3.541311763s" podCreationTimestamp="2026-05-27 18:44:49 +0000 UTC" firstStartedPulling="2026-05-27 18:44:49.916850729 +0000 UTC m=+532.816912142" lastFinishedPulling="2026-05-27 18:44:51.835407207 +0000 UTC m=+534.735468628" observedRunningTime="2026-05-27 18:44:52.540035107 +0000 UTC m=+535.440096542" watchObservedRunningTime="2026-05-27 18:44:52.541311763 +0000 UTC m=+535.441373197" May 27 18:45:03.525293 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:03.525254 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:45:15.567650 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.567615 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm"] May 27 18:45:15.572824 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.572806 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:15.575598 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.575580 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rtsds\"" May 27 18:45:15.586685 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.586663 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm"] May 27 18:45:15.686685 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.686655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rr58\" (UniqueName: \"kubernetes.io/projected/ecf826ba-0ebe-429c-84b7-17764de56313-kube-api-access-7rr58\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:15.686824 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.686717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf826ba-0ebe-429c-84b7-17764de56313-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:15.787679 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.787647 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf826ba-0ebe-429c-84b7-17764de56313-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:15.787830 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.787741 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rr58\" (UniqueName: \"kubernetes.io/projected/ecf826ba-0ebe-429c-84b7-17764de56313-kube-api-access-7rr58\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:15.788113 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.788090 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf826ba-0ebe-429c-84b7-17764de56313-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:15.797643 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.797619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rr58\" (UniqueName: \"kubernetes.io/projected/ecf826ba-0ebe-429c-84b7-17764de56313-kube-api-access-7rr58\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:15.882331 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:15.882267 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:16.021667 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.021645 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm"] May 27 18:45:16.023542 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:45:16.023512 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf826ba_0ebe_429c_84b7_17764de56313.slice/crio-9847b12db3572fa8e9f7ee4e4a875370b53b59a6104cbf978f293ed9f6a422f8 WatchSource:0}: Error finding container 9847b12db3572fa8e9f7ee4e4a875370b53b59a6104cbf978f293ed9f6a422f8: Status 404 returned error can't find the container with id 9847b12db3572fa8e9f7ee4e4a875370b53b59a6104cbf978f293ed9f6a422f8 May 27 18:45:16.358785 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.358738 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm"] May 27 18:45:16.369266 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.369233 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm"] May 27 18:45:16.386650 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.386622 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb"] May 27 18:45:16.386920 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.386891 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" containerName="manager" containerID="cri-o://2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da" gracePeriod=2 May 27 18:45:16.393074 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.393045 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz"] May 27 18:45:16.398267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.397978 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb"] May 27 18:45:16.398472 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.398387 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.403195 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.403162 2556 status_manager.go:895] "Failed to get status for pod" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" err="pods \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:16.412912 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.412891 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz"] May 27 18:45:16.415275 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.415251 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh"] May 27 18:45:16.415586 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.415572 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" containerName="manager" May 27 18:45:16.415586 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.415587 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" containerName="manager" May 27 18:45:16.415715 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.415663 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" containerName="manager" May 27 18:45:16.418683 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.418663 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" May 27 18:45:16.434138 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.434108 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh"] May 27 18:45:16.450281 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.450243 2556 status_manager.go:895] "Failed to get status for pod" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" err="pods \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:16.493746 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.493716 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpms7\" (UniqueName: \"kubernetes.io/projected/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-kube-api-access-bpms7\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-krgfz\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.493880 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.493779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-krgfz\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.595083 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.594989 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpms7\" (UniqueName: \"kubernetes.io/projected/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-kube-api-access-bpms7\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-krgfz\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.595083 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.595042 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-krgfz\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.595583 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.595137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47wj6\" (UniqueName: \"kubernetes.io/projected/573f639d-9c3f-492d-b770-ef320a3d4c74-kube-api-access-47wj6\") pod \"limitador-operator-controller-manager-85c4996f8c-5lqrh\" (UID: \"573f639d-9c3f-492d-b770-ef320a3d4c74\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" May 27 18:45:16.595635 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.595611 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-krgfz\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.604751 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.604731 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpms7\" (UniqueName: \"kubernetes.io/projected/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-kube-api-access-bpms7\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-krgfz\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.621747 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.621727 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:45:16.625580 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.625554 2556 generic.go:358] "Generic (PLEG): container finished" podID="4c48a2ad-5624-42d7-b569-7671d70aaf45" containerID="2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da" exitCode=0 May 27 18:45:16.625692 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.625603 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" May 27 18:45:16.625692 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.625634 2556 scope.go:117] "RemoveContainer" containerID="2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da" May 27 18:45:16.628212 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.628189 2556 status_manager.go:895] "Failed to get status for pod" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" err="pods \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:16.630428 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.630383 2556 status_manager.go:895] "Failed to get status for pod" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" err="pods \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:16.636285 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.636260 2556 scope.go:117] "RemoveContainer" containerID="2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da" May 27 18:45:16.636575 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:45:16.636551 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da\": container with ID starting with 2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da not found: ID does not exist" containerID="2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da" May 27 18:45:16.636684 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.636582 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da"} err="failed to get container status \"2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da\": rpc error: code = NotFound desc = could not find container \"2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da\": container with ID starting with 2e37deba9b2e97eccb2f2c5849cdeaed6514765c6a1d1d943de57e355524a7da not found: ID does not exist" May 27 18:45:16.696005 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.695969 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47wj6\" (UniqueName: \"kubernetes.io/projected/573f639d-9c3f-492d-b770-ef320a3d4c74-kube-api-access-47wj6\") pod \"limitador-operator-controller-manager-85c4996f8c-5lqrh\" (UID: \"573f639d-9c3f-492d-b770-ef320a3d4c74\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" May 27 18:45:16.706998 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.706975 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47wj6\" (UniqueName: \"kubernetes.io/projected/573f639d-9c3f-492d-b770-ef320a3d4c74-kube-api-access-47wj6\") pod \"limitador-operator-controller-manager-85c4996f8c-5lqrh\" (UID: \"573f639d-9c3f-492d-b770-ef320a3d4c74\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" May 27 18:45:16.770935 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.770904 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:16.776663 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.776631 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" May 27 18:45:16.797595 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.797304 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj87h\" (UniqueName: \"kubernetes.io/projected/4c48a2ad-5624-42d7-b569-7671d70aaf45-kube-api-access-wj87h\") pod \"4c48a2ad-5624-42d7-b569-7671d70aaf45\" (UID: \"4c48a2ad-5624-42d7-b569-7671d70aaf45\") " May 27 18:45:16.799496 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.799464 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c48a2ad-5624-42d7-b569-7671d70aaf45-kube-api-access-wj87h" (OuterVolumeSpecName: "kube-api-access-wj87h") pod "4c48a2ad-5624-42d7-b569-7671d70aaf45" (UID: "4c48a2ad-5624-42d7-b569-7671d70aaf45"). InnerVolumeSpecName "kube-api-access-wj87h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:45:16.898063 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.898029 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj87h\" (UniqueName: \"kubernetes.io/projected/4c48a2ad-5624-42d7-b569-7671d70aaf45-kube-api-access-wj87h\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:45:16.938776 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.938749 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh"] May 27 18:45:16.940986 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.940954 2556 status_manager.go:895] "Failed to get status for pod" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" err="pods \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:16.946555 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:45:16.946530 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573f639d_9c3f_492d_b770_ef320a3d4c74.slice/crio-6def78a105e3d17812e4eaaf4e4a6f6f4dfed83268652e90e6ad9db5c82bd4dd WatchSource:0}: Error finding container 6def78a105e3d17812e4eaaf4e4a6f6f4dfed83268652e90e6ad9db5c82bd4dd: Status 404 returned error can't find the container with id 6def78a105e3d17812e4eaaf4e4a6f6f4dfed83268652e90e6ad9db5c82bd4dd May 27 18:45:16.971980 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:16.971937 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz"] May 27 18:45:16.973325 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:45:16.973299 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadaf10fb_5d14_4913_ad8e_f0f558c3a0ef.slice/crio-e6bbd167d70ce2edff81f662e0e25bbdedd1eb4c02138b551df6e80cbfbfc428 WatchSource:0}: Error finding container e6bbd167d70ce2edff81f662e0e25bbdedd1eb4c02138b551df6e80cbfbfc428: Status 404 returned error can't find the container with id e6bbd167d70ce2edff81f662e0e25bbdedd1eb4c02138b551df6e80cbfbfc428 May 27 18:45:17.634203 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.634163 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" event={"ID":"573f639d-9c3f-492d-b770-ef320a3d4c74","Type":"ContainerStarted","Data":"aa7a1f9da0e5c2b06a21b155b6303c0c739e426c453e7324a65acece6a0ea94d"} May 27 18:45:17.634203 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.634209 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" event={"ID":"573f639d-9c3f-492d-b770-ef320a3d4c74","Type":"ContainerStarted","Data":"6def78a105e3d17812e4eaaf4e4a6f6f4dfed83268652e90e6ad9db5c82bd4dd"} May 27 18:45:17.634784 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.634231 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" May 27 18:45:17.635828 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.635796 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" event={"ID":"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef","Type":"ContainerStarted","Data":"e6bbd167d70ce2edff81f662e0e25bbdedd1eb4c02138b551df6e80cbfbfc428"} May 27 18:45:17.656250 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.656184 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" podStartSLOduration=1.656166481 podStartE2EDuration="1.656166481s" podCreationTimestamp="2026-05-27 18:45:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:45:17.655619294 +0000 UTC m=+560.555680729" watchObservedRunningTime="2026-05-27 18:45:17.656166481 +0000 UTC m=+560.556227918" May 27 18:45:17.657595 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.657560 2556 status_manager.go:895] "Failed to get status for pod" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" err="pods \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:17.740268 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.740229 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" path="/var/lib/kubelet/pods/4c48a2ad-5624-42d7-b569-7671d70aaf45/volumes" May 27 18:45:17.740496 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:17.740334 2556 status_manager.go:895] "Failed to get status for pod" podUID="4c48a2ad-5624-42d7-b569-7671d70aaf45" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wmrcb" err="pods \"limitador-operator-controller-manager-85c4996f8c-wmrcb\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:20.656700 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:20.656665 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" event={"ID":"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef","Type":"ContainerStarted","Data":"d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc"} May 27 18:45:20.657131 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:20.656770 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:20.658298 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:20.658272 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" containerName="manager" containerID="cri-o://5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c" gracePeriod=2 May 27 18:45:20.680044 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:20.680005 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" podStartSLOduration=1.7587300959999999 podStartE2EDuration="4.679993708s" podCreationTimestamp="2026-05-27 18:45:16 +0000 UTC" firstStartedPulling="2026-05-27 18:45:16.976970101 +0000 UTC m=+559.877031530" lastFinishedPulling="2026-05-27 18:45:19.898233714 +0000 UTC m=+562.798295142" observedRunningTime="2026-05-27 18:45:20.678103835 +0000 UTC m=+563.578165270" watchObservedRunningTime="2026-05-27 18:45:20.679993708 +0000 UTC m=+563.580055143" May 27 18:45:20.890712 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:20.890691 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:20.893133 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:20.893109 2556 status_manager.go:895] "Failed to get status for pod" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:21.036751 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.036727 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rr58\" (UniqueName: \"kubernetes.io/projected/ecf826ba-0ebe-429c-84b7-17764de56313-kube-api-access-7rr58\") pod \"ecf826ba-0ebe-429c-84b7-17764de56313\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " May 27 18:45:21.036863 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.036789 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf826ba-0ebe-429c-84b7-17764de56313-extensions-socket-volume\") pod \"ecf826ba-0ebe-429c-84b7-17764de56313\" (UID: \"ecf826ba-0ebe-429c-84b7-17764de56313\") " May 27 18:45:21.037077 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.037051 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf826ba-0ebe-429c-84b7-17764de56313-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ecf826ba-0ebe-429c-84b7-17764de56313" (UID: "ecf826ba-0ebe-429c-84b7-17764de56313"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:45:21.038716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.038692 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf826ba-0ebe-429c-84b7-17764de56313-kube-api-access-7rr58" (OuterVolumeSpecName: "kube-api-access-7rr58") pod "ecf826ba-0ebe-429c-84b7-17764de56313" (UID: "ecf826ba-0ebe-429c-84b7-17764de56313"). InnerVolumeSpecName "kube-api-access-7rr58". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:45:21.137874 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.137847 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rr58\" (UniqueName: \"kubernetes.io/projected/ecf826ba-0ebe-429c-84b7-17764de56313-kube-api-access-7rr58\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:45:21.137874 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.137870 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecf826ba-0ebe-429c-84b7-17764de56313-extensions-socket-volume\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:45:21.666310 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.666279 2556 generic.go:358] "Generic (PLEG): container finished" podID="ecf826ba-0ebe-429c-84b7-17764de56313" containerID="5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c" exitCode=2 May 27 18:45:21.666768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.666336 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" May 27 18:45:21.666768 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.666370 2556 scope.go:117] "RemoveContainer" containerID="5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c" May 27 18:45:21.668635 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.668604 2556 status_manager.go:895] "Failed to get status for pod" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:21.675904 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.675887 2556 scope.go:117] "RemoveContainer" containerID="5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c" May 27 18:45:21.676140 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:45:21.676123 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c\": container with ID starting with 5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c not found: ID does not exist" containerID="5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c" May 27 18:45:21.676182 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.676148 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c"} err="failed to get container status \"5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c\": rpc error: code = NotFound desc = could not find container \"5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c\": container with ID starting with 5346777100b6630a8edac93032b71dce4c97fb75d7afb737aacb741001b9fa5c not found: ID does not exist" May 27 18:45:21.677235 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.677215 2556 status_manager.go:895] "Failed to get status for pod" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mj6fm\" is forbidden: User \"system:node:ip-10-0-141-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-244.ec2.internal' and this object" May 27 18:45:21.737787 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:21.737768 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" path="/var/lib/kubelet/pods/ecf826ba-0ebe-429c-84b7-17764de56313/volumes" May 27 18:45:28.647604 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:28.647578 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-5lqrh" May 27 18:45:31.669583 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:31.669551 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:43.773532 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:43.773496 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz"] May 27 18:45:43.774014 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:43.773720 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" podUID="adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" containerName="manager" containerID="cri-o://d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc" gracePeriod=10 May 27 18:45:44.020505 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.020478 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:44.110775 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.110716 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpms7\" (UniqueName: \"kubernetes.io/projected/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-kube-api-access-bpms7\") pod \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " May 27 18:45:44.110880 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.110822 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-extensions-socket-volume\") pod \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\" (UID: \"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef\") " May 27 18:45:44.111319 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.111290 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" (UID: "adaf10fb-5d14-4913-ad8e-f0f558c3a0ef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 18:45:44.112815 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.112791 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-kube-api-access-bpms7" (OuterVolumeSpecName: "kube-api-access-bpms7") pod "adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" (UID: "adaf10fb-5d14-4913-ad8e-f0f558c3a0ef"). InnerVolumeSpecName "kube-api-access-bpms7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:45:44.211986 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.211960 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpms7\" (UniqueName: \"kubernetes.io/projected/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-kube-api-access-bpms7\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:45:44.211986 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.211984 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef-extensions-socket-volume\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:45:44.766118 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.766084 2556 generic.go:358] "Generic (PLEG): container finished" podID="adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" containerID="d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc" exitCode=0 May 27 18:45:44.766267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.766138 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" May 27 18:45:44.766267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.766150 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" event={"ID":"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef","Type":"ContainerDied","Data":"d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc"} May 27 18:45:44.766267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.766176 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz" event={"ID":"adaf10fb-5d14-4913-ad8e-f0f558c3a0ef","Type":"ContainerDied","Data":"e6bbd167d70ce2edff81f662e0e25bbdedd1eb4c02138b551df6e80cbfbfc428"} May 27 18:45:44.766267 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.766192 2556 scope.go:117] "RemoveContainer" containerID="d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc" May 27 18:45:44.775001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.774870 2556 scope.go:117] "RemoveContainer" containerID="d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc" May 27 18:45:44.775210 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:45:44.775117 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc\": container with ID starting with d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc not found: ID does not exist" containerID="d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc" May 27 18:45:44.775210 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.775141 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc"} err="failed to get container status \"d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc\": rpc error: code = NotFound desc = could not find container \"d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc\": container with ID starting with d7f8c31ed5e5e1b149aec4f5370c1574b06a15ce2166d5a9e39b587f388ad0cc not found: ID does not exist" May 27 18:45:44.792417 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.792382 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz"] May 27 18:45:44.797453 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:44.797431 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-krgfz"] May 27 18:45:45.737751 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:45.737719 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" path="/var/lib/kubelet/pods/adaf10fb-5d14-4913-ad8e-f0f558c3a0ef/volumes" May 27 18:45:47.346759 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:47.346726 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4bd7b67b-rmplp"] May 27 18:45:48.056135 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.056104 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6"] May 27 18:45:48.056638 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.056610 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" containerName="manager" May 27 18:45:48.056638 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.056634 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" containerName="manager" May 27 18:45:48.056815 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.056687 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" containerName="manager" May 27 18:45:48.056815 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.056697 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" containerName="manager" May 27 18:45:48.056890 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.056789 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecf826ba-0ebe-429c-84b7-17764de56313" containerName="manager" May 27 18:45:48.056890 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.056828 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="adaf10fb-5d14-4913-ad8e-f0f558c3a0ef" containerName="manager" May 27 18:45:48.060970 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.060954 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.064365 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.064350 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tfbmt\"" May 27 18:45:48.079520 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.079496 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6"] May 27 18:45:48.139657 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.139803 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.139803 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.139803 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.139931 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139803 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.139931 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.139931 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139922 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.140051 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139947 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chgz2\" (UniqueName: \"kubernetes.io/projected/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-kube-api-access-chgz2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.140051 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.139967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.240968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.240942 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241090 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.240974 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241090 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.240994 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241090 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241016 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241090 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241046 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241090 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241087 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241120 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241148 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chgz2\" (UniqueName: \"kubernetes.io/projected/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-kube-api-access-chgz2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241178 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241534 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241352 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241534 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241487 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241534 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241524 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241732 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241709 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.241806 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.241787 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.243356 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.243333 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.243514 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.243496 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.254534 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.254517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.256940 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.256920 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chgz2\" (UniqueName: \"kubernetes.io/projected/a6957266-7ba0-49ad-a340-3a0c9b2b3d71-kube-api-access-chgz2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2wh6\" (UID: \"a6957266-7ba0-49ad-a340-3a0c9b2b3d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.372062 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.372008 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:48.517110 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:45:48.517082 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6957266_7ba0_49ad_a340_3a0c9b2b3d71.slice/crio-2280d7bb6d433f379dc44da0b6a1dd7c2185d529e59114c6c5b707e3dd0bcd06 WatchSource:0}: Error finding container 2280d7bb6d433f379dc44da0b6a1dd7c2185d529e59114c6c5b707e3dd0bcd06: Status 404 returned error can't find the container with id 2280d7bb6d433f379dc44da0b6a1dd7c2185d529e59114c6c5b707e3dd0bcd06 May 27 18:45:48.517347 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.517326 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6"] May 27 18:45:48.519087 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.519062 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:45:48.519157 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.519116 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:45:48.519157 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.519145 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 18:45:48.782314 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.782281 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" event={"ID":"a6957266-7ba0-49ad-a340-3a0c9b2b3d71","Type":"ContainerStarted","Data":"5334600771facb521998ad259133dbc79fb9bb8f84e8e7887aad1a4e915cba63"} May 27 18:45:48.782488 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.782322 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" event={"ID":"a6957266-7ba0-49ad-a340-3a0c9b2b3d71","Type":"ContainerStarted","Data":"2280d7bb6d433f379dc44da0b6a1dd7c2185d529e59114c6c5b707e3dd0bcd06"} May 27 18:45:48.814007 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:48.813964 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" podStartSLOduration=0.813951977 podStartE2EDuration="813.951977ms" podCreationTimestamp="2026-05-27 18:45:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:45:48.810766866 +0000 UTC m=+591.710828298" watchObservedRunningTime="2026-05-27 18:45:48.813951977 +0000 UTC m=+591.714013461" May 27 18:45:49.372753 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:49.372721 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:49.377497 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:49.377473 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:49.786354 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:49.786328 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:45:49.787276 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:45:49.787259 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2wh6" May 27 18:46:03.411861 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.411823 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-22wdv"] May 27 18:46:03.415116 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.415099 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.417894 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.417875 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 18:46:03.417998 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.417879 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jj9nv\"" May 27 18:46:03.425116 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.425093 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-22wdv"] May 27 18:46:03.510608 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.510578 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-22wdv"] May 27 18:46:03.570815 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.570782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-config-file\") pod \"limitador-limitador-7d549b5b-22wdv\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.570968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.570927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz6xz\" (UniqueName: \"kubernetes.io/projected/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-kube-api-access-mz6xz\") pod \"limitador-limitador-7d549b5b-22wdv\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.671446 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.671340 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mz6xz\" (UniqueName: \"kubernetes.io/projected/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-kube-api-access-mz6xz\") pod \"limitador-limitador-7d549b5b-22wdv\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.671446 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.671387 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-config-file\") pod \"limitador-limitador-7d549b5b-22wdv\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.672032 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.672012 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-config-file\") pod \"limitador-limitador-7d549b5b-22wdv\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.680105 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.680076 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz6xz\" (UniqueName: \"kubernetes.io/projected/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-kube-api-access-mz6xz\") pod \"limitador-limitador-7d549b5b-22wdv\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.727090 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.727064 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:03.868178 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:03.868155 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-22wdv"] May 27 18:46:03.870559 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:46:03.870498 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cfd72a_4d0a_4379_909f_ca00c8a0da2f.slice/crio-36d6a1f27e4d7f8cb1f5d7a2f0342e1409fae12995567b04dbe87bf720b9d64d WatchSource:0}: Error finding container 36d6a1f27e4d7f8cb1f5d7a2f0342e1409fae12995567b04dbe87bf720b9d64d: Status 404 returned error can't find the container with id 36d6a1f27e4d7f8cb1f5d7a2f0342e1409fae12995567b04dbe87bf720b9d64d May 27 18:46:04.271030 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.270993 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mntmg"] May 27 18:46:04.274086 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.274062 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" May 27 18:46:04.276760 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.276738 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8h5xc\"" May 27 18:46:04.286292 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.286260 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mntmg"] May 27 18:46:04.378328 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.378297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmmxn\" (UniqueName: \"kubernetes.io/projected/ee9a80e7-7461-429d-ba98-d7ed9e51190b-kube-api-access-cmmxn\") pod \"authorino-f99f4b5cd-mntmg\" (UID: \"ee9a80e7-7461-429d-ba98-d7ed9e51190b\") " pod="kuadrant-system/authorino-f99f4b5cd-mntmg" May 27 18:46:04.479887 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.479850 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmmxn\" (UniqueName: \"kubernetes.io/projected/ee9a80e7-7461-429d-ba98-d7ed9e51190b-kube-api-access-cmmxn\") pod \"authorino-f99f4b5cd-mntmg\" (UID: \"ee9a80e7-7461-429d-ba98-d7ed9e51190b\") " pod="kuadrant-system/authorino-f99f4b5cd-mntmg" May 27 18:46:04.489749 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.489717 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmmxn\" (UniqueName: \"kubernetes.io/projected/ee9a80e7-7461-429d-ba98-d7ed9e51190b-kube-api-access-cmmxn\") pod \"authorino-f99f4b5cd-mntmg\" (UID: \"ee9a80e7-7461-429d-ba98-d7ed9e51190b\") " pod="kuadrant-system/authorino-f99f4b5cd-mntmg" May 27 18:46:04.585237 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.584876 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" May 27 18:46:04.772781 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.772724 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mntmg"] May 27 18:46:04.774126 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:46:04.774084 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee9a80e7_7461_429d_ba98_d7ed9e51190b.slice/crio-3aa1c0b6ad2703b2efca97195f13d432b24fdc6a54867a1692ed60c4f11d0b82 WatchSource:0}: Error finding container 3aa1c0b6ad2703b2efca97195f13d432b24fdc6a54867a1692ed60c4f11d0b82: Status 404 returned error can't find the container with id 3aa1c0b6ad2703b2efca97195f13d432b24fdc6a54867a1692ed60c4f11d0b82 May 27 18:46:04.848365 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.848271 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" event={"ID":"88cfd72a-4d0a-4379-909f-ca00c8a0da2f","Type":"ContainerStarted","Data":"36d6a1f27e4d7f8cb1f5d7a2f0342e1409fae12995567b04dbe87bf720b9d64d"} May 27 18:46:04.849826 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:04.849777 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" event={"ID":"ee9a80e7-7461-429d-ba98-d7ed9e51190b","Type":"ContainerStarted","Data":"3aa1c0b6ad2703b2efca97195f13d432b24fdc6a54867a1692ed60c4f11d0b82"} May 27 18:46:08.870146 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:08.870109 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" event={"ID":"ee9a80e7-7461-429d-ba98-d7ed9e51190b","Type":"ContainerStarted","Data":"31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c"} May 27 18:46:08.871460 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:08.871436 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" event={"ID":"88cfd72a-4d0a-4379-909f-ca00c8a0da2f","Type":"ContainerStarted","Data":"161a66e8f009ba43d7545c20ba6d0967649075cca718d24f98c275a13eebe6e7"} May 27 18:46:08.871582 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:08.871570 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:08.885387 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:08.885335 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" podStartSLOduration=1.247560507 podStartE2EDuration="4.885322227s" podCreationTimestamp="2026-05-27 18:46:04 +0000 UTC" firstStartedPulling="2026-05-27 18:46:04.77658075 +0000 UTC m=+607.676642163" lastFinishedPulling="2026-05-27 18:46:08.414342468 +0000 UTC m=+611.314403883" observedRunningTime="2026-05-27 18:46:08.885205309 +0000 UTC m=+611.785266744" watchObservedRunningTime="2026-05-27 18:46:08.885322227 +0000 UTC m=+611.785383662" May 27 18:46:08.904934 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:08.904881 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" podStartSLOduration=1.425169323 podStartE2EDuration="5.904863403s" podCreationTimestamp="2026-05-27 18:46:03 +0000 UTC" firstStartedPulling="2026-05-27 18:46:03.872831884 +0000 UTC m=+606.772893297" lastFinishedPulling="2026-05-27 18:46:08.352525961 +0000 UTC m=+611.252587377" observedRunningTime="2026-05-27 18:46:08.903536863 +0000 UTC m=+611.803598299" watchObservedRunningTime="2026-05-27 18:46:08.904863403 +0000 UTC m=+611.804924842" May 27 18:46:09.388039 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:09.388010 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mntmg"] May 27 18:46:10.879151 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:10.879111 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" podUID="ee9a80e7-7461-429d-ba98-d7ed9e51190b" containerName="authorino" containerID="cri-o://31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c" gracePeriod=30 May 27 18:46:11.120809 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.120782 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" May 27 18:46:11.245644 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.245620 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmmxn\" (UniqueName: \"kubernetes.io/projected/ee9a80e7-7461-429d-ba98-d7ed9e51190b-kube-api-access-cmmxn\") pod \"ee9a80e7-7461-429d-ba98-d7ed9e51190b\" (UID: \"ee9a80e7-7461-429d-ba98-d7ed9e51190b\") " May 27 18:46:11.247933 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.247901 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9a80e7-7461-429d-ba98-d7ed9e51190b-kube-api-access-cmmxn" (OuterVolumeSpecName: "kube-api-access-cmmxn") pod "ee9a80e7-7461-429d-ba98-d7ed9e51190b" (UID: "ee9a80e7-7461-429d-ba98-d7ed9e51190b"). InnerVolumeSpecName "kube-api-access-cmmxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:46:11.346596 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.346563 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmmxn\" (UniqueName: \"kubernetes.io/projected/ee9a80e7-7461-429d-ba98-d7ed9e51190b-kube-api-access-cmmxn\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:11.883924 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.883891 2556 generic.go:358] "Generic (PLEG): container finished" podID="ee9a80e7-7461-429d-ba98-d7ed9e51190b" containerID="31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c" exitCode=0 May 27 18:46:11.884355 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.883934 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" May 27 18:46:11.884355 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.883976 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" event={"ID":"ee9a80e7-7461-429d-ba98-d7ed9e51190b","Type":"ContainerDied","Data":"31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c"} May 27 18:46:11.884355 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.884013 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mntmg" event={"ID":"ee9a80e7-7461-429d-ba98-d7ed9e51190b","Type":"ContainerDied","Data":"3aa1c0b6ad2703b2efca97195f13d432b24fdc6a54867a1692ed60c4f11d0b82"} May 27 18:46:11.884355 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.884035 2556 scope.go:117] "RemoveContainer" containerID="31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c" May 27 18:46:11.893306 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.893288 2556 scope.go:117] "RemoveContainer" containerID="31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c" May 27 18:46:11.893567 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:46:11.893547 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c\": container with ID starting with 31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c not found: ID does not exist" containerID="31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c" May 27 18:46:11.893621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.893575 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c"} err="failed to get container status \"31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c\": rpc error: code = NotFound desc = could not find container \"31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c\": container with ID starting with 31f0eb0618424d6c05b5ed7a66a161705db4a0681c477556a58266f3c6252c2c not found: ID does not exist" May 27 18:46:11.902133 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.902112 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mntmg"] May 27 18:46:11.906961 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:11.906942 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mntmg"] May 27 18:46:12.373098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.373060 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c4bd7b67b-rmplp" podUID="e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" containerName="console" containerID="cri-o://f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6" gracePeriod=15 May 27 18:46:12.618826 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.618807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c4bd7b67b-rmplp_e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663/console/0.log" May 27 18:46:12.618934 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.618867 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:46:12.758628 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.758598 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-trusted-ca-bundle\") pod \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " May 27 18:46:12.758844 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.758636 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-oauth-serving-cert\") pod \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " May 27 18:46:12.758844 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.758668 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-serving-cert\") pod \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " May 27 18:46:12.758844 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.758694 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-oauth-config\") pod \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " May 27 18:46:12.758844 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.758743 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-service-ca\") pod \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " May 27 18:46:12.758844 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.758802 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-config\") pod \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " May 27 18:46:12.759109 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.758876 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bxk6\" (UniqueName: \"kubernetes.io/projected/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-kube-api-access-8bxk6\") pod \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\" (UID: \"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663\") " May 27 18:46:12.759109 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.759007 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" (UID: "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:46:12.759214 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.759130 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" (UID: "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:46:12.759214 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.759200 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" (UID: "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:46:12.759322 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.759233 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-oauth-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:12.759369 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.759324 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-config" (OuterVolumeSpecName: "console-config") pod "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" (UID: "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:46:12.760989 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.760967 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" (UID: "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:46:12.761097 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.760998 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" (UID: "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 18:46:12.761097 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.761086 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-kube-api-access-8bxk6" (OuterVolumeSpecName: "kube-api-access-8bxk6") pod "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" (UID: "e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663"). InnerVolumeSpecName "kube-api-access-8bxk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:46:12.859825 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.859799 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-serving-cert\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:12.859825 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.859823 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-oauth-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:12.859992 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.859834 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-service-ca\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:12.859992 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.859843 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-console-config\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:12.859992 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.859851 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bxk6\" (UniqueName: \"kubernetes.io/projected/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-kube-api-access-8bxk6\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:12.859992 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.859859 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663-trusted-ca-bundle\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:12.890534 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.890513 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c4bd7b67b-rmplp_e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663/console/0.log" May 27 18:46:12.890954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.890547 2556 generic.go:358] "Generic (PLEG): container finished" podID="e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" containerID="f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6" exitCode=2 May 27 18:46:12.890954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.890641 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bd7b67b-rmplp" May 27 18:46:12.890954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.890643 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bd7b67b-rmplp" event={"ID":"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663","Type":"ContainerDied","Data":"f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6"} May 27 18:46:12.890954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.890755 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bd7b67b-rmplp" event={"ID":"e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663","Type":"ContainerDied","Data":"bfb1e683291c387028077046615313436da1eef46ade90b72faee084b091d9d0"} May 27 18:46:12.890954 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.890770 2556 scope.go:117] "RemoveContainer" containerID="f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6" May 27 18:46:12.899846 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.899829 2556 scope.go:117] "RemoveContainer" containerID="f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6" May 27 18:46:12.900101 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:46:12.900082 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6\": container with ID starting with f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6 not found: ID does not exist" containerID="f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6" May 27 18:46:12.900147 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.900110 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6"} err="failed to get container status \"f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6\": rpc error: code = NotFound desc = could not find container \"f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6\": container with ID starting with f7e982857d965ba596b3603f42d27de99421d0c43b89c8eb9b38665265d34ee6 not found: ID does not exist" May 27 18:46:12.914899 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.914874 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4bd7b67b-rmplp"] May 27 18:46:12.924022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:12.919528 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c4bd7b67b-rmplp"] May 27 18:46:13.738957 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:13.738923 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" path="/var/lib/kubelet/pods/e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663/volumes" May 27 18:46:13.739275 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:13.739262 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee9a80e7-7461-429d-ba98-d7ed9e51190b" path="/var/lib/kubelet/pods/ee9a80e7-7461-429d-ba98-d7ed9e51190b/volumes" May 27 18:46:18.392507 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:18.392429 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-22wdv"] May 27 18:46:18.392886 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:18.392684 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" podUID="88cfd72a-4d0a-4379-909f-ca00c8a0da2f" containerName="limitador" containerID="cri-o://161a66e8f009ba43d7545c20ba6d0967649075cca718d24f98c275a13eebe6e7" gracePeriod=30 May 27 18:46:18.393458 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:18.393261 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:18.918159 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:18.918126 2556 generic.go:358] "Generic (PLEG): container finished" podID="88cfd72a-4d0a-4379-909f-ca00c8a0da2f" containerID="161a66e8f009ba43d7545c20ba6d0967649075cca718d24f98c275a13eebe6e7" exitCode=0 May 27 18:46:18.918298 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:18.918202 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" event={"ID":"88cfd72a-4d0a-4379-909f-ca00c8a0da2f","Type":"ContainerDied","Data":"161a66e8f009ba43d7545c20ba6d0967649075cca718d24f98c275a13eebe6e7"} May 27 18:46:18.938744 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:18.938723 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:19.111180 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.111092 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-config-file\") pod \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " May 27 18:46:19.111180 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.111136 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz6xz\" (UniqueName: \"kubernetes.io/projected/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-kube-api-access-mz6xz\") pod \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\" (UID: \"88cfd72a-4d0a-4379-909f-ca00c8a0da2f\") " May 27 18:46:19.111541 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.111515 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-config-file" (OuterVolumeSpecName: "config-file") pod "88cfd72a-4d0a-4379-909f-ca00c8a0da2f" (UID: "88cfd72a-4d0a-4379-909f-ca00c8a0da2f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 18:46:19.113099 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.113079 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-kube-api-access-mz6xz" (OuterVolumeSpecName: "kube-api-access-mz6xz") pod "88cfd72a-4d0a-4379-909f-ca00c8a0da2f" (UID: "88cfd72a-4d0a-4379-909f-ca00c8a0da2f"). InnerVolumeSpecName "kube-api-access-mz6xz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:46:19.212731 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.212705 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-config-file\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:19.212731 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.212728 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz6xz\" (UniqueName: \"kubernetes.io/projected/88cfd72a-4d0a-4379-909f-ca00c8a0da2f-kube-api-access-mz6xz\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:19.922540 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.922515 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" May 27 18:46:19.922884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.922513 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-22wdv" event={"ID":"88cfd72a-4d0a-4379-909f-ca00c8a0da2f","Type":"ContainerDied","Data":"36d6a1f27e4d7f8cb1f5d7a2f0342e1409fae12995567b04dbe87bf720b9d64d"} May 27 18:46:19.922884 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.922625 2556 scope.go:117] "RemoveContainer" containerID="161a66e8f009ba43d7545c20ba6d0967649075cca718d24f98c275a13eebe6e7" May 27 18:46:19.940064 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.940037 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-22wdv"] May 27 18:46:19.944341 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:19.944317 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-22wdv"] May 27 18:46:21.738953 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:21.738911 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88cfd72a-4d0a-4379-909f-ca00c8a0da2f" path="/var/lib/kubelet/pods/88cfd72a-4d0a-4379-909f-ca00c8a0da2f/volumes" May 27 18:46:23.832845 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.832814 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t8kh6"] May 27 18:46:23.833206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833149 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" containerName="console" May 27 18:46:23.833206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833160 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" containerName="console" May 27 18:46:23.833206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833167 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88cfd72a-4d0a-4379-909f-ca00c8a0da2f" containerName="limitador" May 27 18:46:23.833206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833172 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="88cfd72a-4d0a-4379-909f-ca00c8a0da2f" containerName="limitador" May 27 18:46:23.833206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833185 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9a80e7-7461-429d-ba98-d7ed9e51190b" containerName="authorino" May 27 18:46:23.833206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833191 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9a80e7-7461-429d-ba98-d7ed9e51190b" containerName="authorino" May 27 18:46:23.833412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833247 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee9a80e7-7461-429d-ba98-d7ed9e51190b" containerName="authorino" May 27 18:46:23.833412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833256 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9a5960d-5bb5-4c8a-8d73-a0e4e9adf663" containerName="console" May 27 18:46:23.833412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.833266 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="88cfd72a-4d0a-4379-909f-ca00c8a0da2f" containerName="limitador" May 27 18:46:23.837212 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.837197 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:23.840069 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.840047 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 27 18:46:23.840232 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.840202 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5jh9g\"" May 27 18:46:23.847039 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.847017 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t8kh6"] May 27 18:46:23.949823 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.949798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh758\" (UniqueName: \"kubernetes.io/projected/b96955ad-1ab5-4851-bdb0-ddfe2f997b43-kube-api-access-xh758\") pod \"postgres-68c4fbbd6f-t8kh6\" (UID: \"b96955ad-1ab5-4851-bdb0-ddfe2f997b43\") " pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:23.949965 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:23.949829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b96955ad-1ab5-4851-bdb0-ddfe2f997b43-data\") pod \"postgres-68c4fbbd6f-t8kh6\" (UID: \"b96955ad-1ab5-4851-bdb0-ddfe2f997b43\") " pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:24.050491 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:24.050462 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh758\" (UniqueName: \"kubernetes.io/projected/b96955ad-1ab5-4851-bdb0-ddfe2f997b43-kube-api-access-xh758\") pod \"postgres-68c4fbbd6f-t8kh6\" (UID: \"b96955ad-1ab5-4851-bdb0-ddfe2f997b43\") " pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:24.050638 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:24.050499 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b96955ad-1ab5-4851-bdb0-ddfe2f997b43-data\") pod \"postgres-68c4fbbd6f-t8kh6\" (UID: \"b96955ad-1ab5-4851-bdb0-ddfe2f997b43\") " pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:24.050856 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:24.050841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b96955ad-1ab5-4851-bdb0-ddfe2f997b43-data\") pod \"postgres-68c4fbbd6f-t8kh6\" (UID: \"b96955ad-1ab5-4851-bdb0-ddfe2f997b43\") " pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:24.059372 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:24.059351 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh758\" (UniqueName: \"kubernetes.io/projected/b96955ad-1ab5-4851-bdb0-ddfe2f997b43-kube-api-access-xh758\") pod \"postgres-68c4fbbd6f-t8kh6\" (UID: \"b96955ad-1ab5-4851-bdb0-ddfe2f997b43\") " pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:24.150592 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:24.150520 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:24.295088 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:24.295058 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t8kh6"] May 27 18:46:24.297120 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:46:24.297092 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96955ad_1ab5_4851_bdb0_ddfe2f997b43.slice/crio-b94c1a359ccf7a853fb7cf84133c067b03a8e2b793e21a45ea25027299750135 WatchSource:0}: Error finding container b94c1a359ccf7a853fb7cf84133c067b03a8e2b793e21a45ea25027299750135: Status 404 returned error can't find the container with id b94c1a359ccf7a853fb7cf84133c067b03a8e2b793e21a45ea25027299750135 May 27 18:46:24.943235 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:24.943199 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-t8kh6" event={"ID":"b96955ad-1ab5-4851-bdb0-ddfe2f997b43","Type":"ContainerStarted","Data":"b94c1a359ccf7a853fb7cf84133c067b03a8e2b793e21a45ea25027299750135"} May 27 18:46:29.966097 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:29.966057 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-t8kh6" event={"ID":"b96955ad-1ab5-4851-bdb0-ddfe2f997b43","Type":"ContainerStarted","Data":"fbec1533dfb1dc047e6e172fe80a76a88b0521524803d995575b0b9eb2e749c1"} May 27 18:46:29.966521 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:29.966122 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:29.989851 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:29.989806 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-t8kh6" podStartSLOduration=1.9284115750000002 podStartE2EDuration="6.989792831s" podCreationTimestamp="2026-05-27 18:46:23 +0000 UTC" firstStartedPulling="2026-05-27 18:46:24.298488269 +0000 UTC m=+627.198549695" lastFinishedPulling="2026-05-27 18:46:29.359869538 +0000 UTC m=+632.259930951" observedRunningTime="2026-05-27 18:46:29.986477992 +0000 UTC m=+632.886539426" watchObservedRunningTime="2026-05-27 18:46:29.989792831 +0000 UTC m=+632.889854266" May 27 18:46:35.998173 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:35.998140 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-t8kh6" May 27 18:46:36.540629 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.540596 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bkqfx"] May 27 18:46:36.549208 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.549184 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" May 27 18:46:36.550772 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.550744 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bkqfx"] May 27 18:46:36.551833 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.551811 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8h5xc\"" May 27 18:46:36.656587 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.656560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h8d4\" (UniqueName: \"kubernetes.io/projected/40c121c9-6cde-4abf-9c30-ac7dd864af03-kube-api-access-2h8d4\") pod \"authorino-8b475cf9f-bkqfx\" (UID: \"40c121c9-6cde-4abf-9c30-ac7dd864af03\") " pod="kuadrant-system/authorino-8b475cf9f-bkqfx" May 27 18:46:36.757660 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.757636 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h8d4\" (UniqueName: \"kubernetes.io/projected/40c121c9-6cde-4abf-9c30-ac7dd864af03-kube-api-access-2h8d4\") pod \"authorino-8b475cf9f-bkqfx\" (UID: \"40c121c9-6cde-4abf-9c30-ac7dd864af03\") " pod="kuadrant-system/authorino-8b475cf9f-bkqfx" May 27 18:46:36.766406 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.766378 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h8d4\" (UniqueName: \"kubernetes.io/projected/40c121c9-6cde-4abf-9c30-ac7dd864af03-kube-api-access-2h8d4\") pod \"authorino-8b475cf9f-bkqfx\" (UID: \"40c121c9-6cde-4abf-9c30-ac7dd864af03\") " pod="kuadrant-system/authorino-8b475cf9f-bkqfx" May 27 18:46:36.771609 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.771586 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bkqfx"] May 27 18:46:36.771813 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.771800 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" May 27 18:46:36.801560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.801500 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7897557d88-9zx7f"] May 27 18:46:36.806633 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.806608 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7897557d88-9zx7f" May 27 18:46:36.819168 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.819142 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7897557d88-9zx7f"] May 27 18:46:36.858936 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.858894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zsxr\" (UniqueName: \"kubernetes.io/projected/1adb85d5-a4fc-4e56-8fda-c57922a49a13-kube-api-access-7zsxr\") pod \"authorino-7897557d88-9zx7f\" (UID: \"1adb85d5-a4fc-4e56-8fda-c57922a49a13\") " pod="kuadrant-system/authorino-7897557d88-9zx7f" May 27 18:46:36.921496 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.921469 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bkqfx"] May 27 18:46:36.923152 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:46:36.923124 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40c121c9_6cde_4abf_9c30_ac7dd864af03.slice/crio-481c88b4f46ffe2a92e63ba59c5185d652e8f160bf056b4ac85a770fbbd6aefe WatchSource:0}: Error finding container 481c88b4f46ffe2a92e63ba59c5185d652e8f160bf056b4ac85a770fbbd6aefe: Status 404 returned error can't find the container with id 481c88b4f46ffe2a92e63ba59c5185d652e8f160bf056b4ac85a770fbbd6aefe May 27 18:46:36.959379 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.959353 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zsxr\" (UniqueName: \"kubernetes.io/projected/1adb85d5-a4fc-4e56-8fda-c57922a49a13-kube-api-access-7zsxr\") pod \"authorino-7897557d88-9zx7f\" (UID: \"1adb85d5-a4fc-4e56-8fda-c57922a49a13\") " pod="kuadrant-system/authorino-7897557d88-9zx7f" May 27 18:46:36.974757 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.974732 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zsxr\" (UniqueName: \"kubernetes.io/projected/1adb85d5-a4fc-4e56-8fda-c57922a49a13-kube-api-access-7zsxr\") pod \"authorino-7897557d88-9zx7f\" (UID: \"1adb85d5-a4fc-4e56-8fda-c57922a49a13\") " pod="kuadrant-system/authorino-7897557d88-9zx7f" May 27 18:46:36.993654 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:36.993632 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" event={"ID":"40c121c9-6cde-4abf-9c30-ac7dd864af03","Type":"ContainerStarted","Data":"481c88b4f46ffe2a92e63ba59c5185d652e8f160bf056b4ac85a770fbbd6aefe"} May 27 18:46:37.084914 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:37.084855 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7897557d88-9zx7f"] May 27 18:46:37.085175 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:37.085061 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7897557d88-9zx7f" May 27 18:46:37.211696 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:37.211666 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7897557d88-9zx7f"] May 27 18:46:37.212751 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:46:37.212726 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1adb85d5_a4fc_4e56_8fda_c57922a49a13.slice/crio-637bbfabd24dd72c60f16412e46b43f2ce8d5d1849fb14bdfb689fb91d052b50 WatchSource:0}: Error finding container 637bbfabd24dd72c60f16412e46b43f2ce8d5d1849fb14bdfb689fb91d052b50: Status 404 returned error can't find the container with id 637bbfabd24dd72c60f16412e46b43f2ce8d5d1849fb14bdfb689fb91d052b50 May 27 18:46:37.998691 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:37.998652 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7897557d88-9zx7f" event={"ID":"1adb85d5-a4fc-4e56-8fda-c57922a49a13","Type":"ContainerStarted","Data":"affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2"} May 27 18:46:37.998873 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:37.998694 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7897557d88-9zx7f" event={"ID":"1adb85d5-a4fc-4e56-8fda-c57922a49a13","Type":"ContainerStarted","Data":"637bbfabd24dd72c60f16412e46b43f2ce8d5d1849fb14bdfb689fb91d052b50"} May 27 18:46:37.998873 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:37.998673 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7897557d88-9zx7f" podUID="1adb85d5-a4fc-4e56-8fda-c57922a49a13" containerName="authorino" containerID="cri-o://affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2" gracePeriod=30 May 27 18:46:38.000183 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.000160 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" event={"ID":"40c121c9-6cde-4abf-9c30-ac7dd864af03","Type":"ContainerStarted","Data":"f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb"} May 27 18:46:38.000300 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.000232 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" podUID="40c121c9-6cde-4abf-9c30-ac7dd864af03" containerName="authorino" containerID="cri-o://f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb" gracePeriod=30 May 27 18:46:38.021434 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.021381 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7897557d88-9zx7f" podStartSLOduration=1.6749107730000001 podStartE2EDuration="2.021368721s" podCreationTimestamp="2026-05-27 18:46:36 +0000 UTC" firstStartedPulling="2026-05-27 18:46:37.214081123 +0000 UTC m=+640.114142536" lastFinishedPulling="2026-05-27 18:46:37.560539071 +0000 UTC m=+640.460600484" observedRunningTime="2026-05-27 18:46:38.01988963 +0000 UTC m=+640.919951066" watchObservedRunningTime="2026-05-27 18:46:38.021368721 +0000 UTC m=+640.921430156" May 27 18:46:38.040041 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.040006 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" podStartSLOduration=1.596418616 podStartE2EDuration="2.039996378s" podCreationTimestamp="2026-05-27 18:46:36 +0000 UTC" firstStartedPulling="2026-05-27 18:46:36.924486817 +0000 UTC m=+639.824548230" lastFinishedPulling="2026-05-27 18:46:37.368064576 +0000 UTC m=+640.268125992" observedRunningTime="2026-05-27 18:46:38.038461274 +0000 UTC m=+640.938522710" watchObservedRunningTime="2026-05-27 18:46:38.039996378 +0000 UTC m=+640.940057812" May 27 18:46:38.234603 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.234581 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7897557d88-9zx7f" May 27 18:46:38.264724 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.264696 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" May 27 18:46:38.269493 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.269470 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zsxr\" (UniqueName: \"kubernetes.io/projected/1adb85d5-a4fc-4e56-8fda-c57922a49a13-kube-api-access-7zsxr\") pod \"1adb85d5-a4fc-4e56-8fda-c57922a49a13\" (UID: \"1adb85d5-a4fc-4e56-8fda-c57922a49a13\") " May 27 18:46:38.271438 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.271411 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1adb85d5-a4fc-4e56-8fda-c57922a49a13-kube-api-access-7zsxr" (OuterVolumeSpecName: "kube-api-access-7zsxr") pod "1adb85d5-a4fc-4e56-8fda-c57922a49a13" (UID: "1adb85d5-a4fc-4e56-8fda-c57922a49a13"). InnerVolumeSpecName "kube-api-access-7zsxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:46:38.369940 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.369914 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h8d4\" (UniqueName: \"kubernetes.io/projected/40c121c9-6cde-4abf-9c30-ac7dd864af03-kube-api-access-2h8d4\") pod \"40c121c9-6cde-4abf-9c30-ac7dd864af03\" (UID: \"40c121c9-6cde-4abf-9c30-ac7dd864af03\") " May 27 18:46:38.370091 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.370078 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zsxr\" (UniqueName: \"kubernetes.io/projected/1adb85d5-a4fc-4e56-8fda-c57922a49a13-kube-api-access-7zsxr\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:38.371888 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.371865 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40c121c9-6cde-4abf-9c30-ac7dd864af03-kube-api-access-2h8d4" (OuterVolumeSpecName: "kube-api-access-2h8d4") pod "40c121c9-6cde-4abf-9c30-ac7dd864af03" (UID: "40c121c9-6cde-4abf-9c30-ac7dd864af03"). InnerVolumeSpecName "kube-api-access-2h8d4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 18:46:38.470713 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:38.470686 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h8d4\" (UniqueName: \"kubernetes.io/projected/40c121c9-6cde-4abf-9c30-ac7dd864af03-kube-api-access-2h8d4\") on node \"ip-10-0-141-244.ec2.internal\" DevicePath \"\"" May 27 18:46:39.005542 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.005503 2556 generic.go:358] "Generic (PLEG): container finished" podID="40c121c9-6cde-4abf-9c30-ac7dd864af03" containerID="f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb" exitCode=0 May 27 18:46:39.005716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.005554 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" May 27 18:46:39.005716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.005591 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" event={"ID":"40c121c9-6cde-4abf-9c30-ac7dd864af03","Type":"ContainerDied","Data":"f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb"} May 27 18:46:39.005716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.005626 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bkqfx" event={"ID":"40c121c9-6cde-4abf-9c30-ac7dd864af03","Type":"ContainerDied","Data":"481c88b4f46ffe2a92e63ba59c5185d652e8f160bf056b4ac85a770fbbd6aefe"} May 27 18:46:39.005716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.005646 2556 scope.go:117] "RemoveContainer" containerID="f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb" May 27 18:46:39.006984 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.006965 2556 generic.go:358] "Generic (PLEG): container finished" podID="1adb85d5-a4fc-4e56-8fda-c57922a49a13" containerID="affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2" exitCode=0 May 27 18:46:39.007057 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.007034 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7897557d88-9zx7f" May 27 18:46:39.007057 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.007046 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7897557d88-9zx7f" event={"ID":"1adb85d5-a4fc-4e56-8fda-c57922a49a13","Type":"ContainerDied","Data":"affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2"} May 27 18:46:39.007128 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.007066 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7897557d88-9zx7f" event={"ID":"1adb85d5-a4fc-4e56-8fda-c57922a49a13","Type":"ContainerDied","Data":"637bbfabd24dd72c60f16412e46b43f2ce8d5d1849fb14bdfb689fb91d052b50"} May 27 18:46:39.015333 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.015315 2556 scope.go:117] "RemoveContainer" containerID="f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb" May 27 18:46:39.015597 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:46:39.015575 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb\": container with ID starting with f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb not found: ID does not exist" containerID="f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb" May 27 18:46:39.015680 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.015602 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb"} err="failed to get container status \"f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb\": rpc error: code = NotFound desc = could not find container \"f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb\": container with ID starting with f2de6e7e5a1a50eb2b0644b2dc89870aec8f89dd33b78ea961dd5f8831beb8eb not found: ID does not exist" May 27 18:46:39.015680 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.015621 2556 scope.go:117] "RemoveContainer" containerID="affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2" May 27 18:46:39.025852 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.025832 2556 scope.go:117] "RemoveContainer" containerID="affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2" May 27 18:46:39.026214 ip-10-0-141-244 kubenswrapper[2556]: E0527 18:46:39.026188 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2\": container with ID starting with affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2 not found: ID does not exist" containerID="affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2" May 27 18:46:39.026312 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.026222 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2"} err="failed to get container status \"affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2\": rpc error: code = NotFound desc = could not find container \"affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2\": container with ID starting with affe3b71375851f97ebb6800003a455ab811fa6f5d19e9ebda6757c7faddc5c2 not found: ID does not exist" May 27 18:46:39.030453 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.030414 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bkqfx"] May 27 18:46:39.032867 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.032849 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bkqfx"] May 27 18:46:39.047006 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.046986 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7897557d88-9zx7f"] May 27 18:46:39.053130 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.053112 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7897557d88-9zx7f"] May 27 18:46:39.738512 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.738480 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1adb85d5-a4fc-4e56-8fda-c57922a49a13" path="/var/lib/kubelet/pods/1adb85d5-a4fc-4e56-8fda-c57922a49a13/volumes" May 27 18:46:39.738874 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:46:39.738791 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40c121c9-6cde-4abf-9c30-ac7dd864af03" path="/var/lib/kubelet/pods/40c121c9-6cde-4abf-9c30-ac7dd864af03/volumes" May 27 18:47:14.604011 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.603974 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rk9pj"] May 27 18:47:14.604533 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.604481 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40c121c9-6cde-4abf-9c30-ac7dd864af03" containerName="authorino" May 27 18:47:14.604533 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.604498 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c121c9-6cde-4abf-9c30-ac7dd864af03" containerName="authorino" May 27 18:47:14.604533 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.604508 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1adb85d5-a4fc-4e56-8fda-c57922a49a13" containerName="authorino" May 27 18:47:14.604533 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.604513 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1adb85d5-a4fc-4e56-8fda-c57922a49a13" containerName="authorino" May 27 18:47:14.604668 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.604601 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1adb85d5-a4fc-4e56-8fda-c57922a49a13" containerName="authorino" May 27 18:47:14.604668 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.604614 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="40c121c9-6cde-4abf-9c30-ac7dd864af03" containerName="authorino" May 27 18:47:14.620635 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.620608 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rk9pj"] May 27 18:47:14.620776 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.620752 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" May 27 18:47:14.623597 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.623568 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 27 18:47:14.623716 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.623654 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-22n9x\"" May 27 18:47:14.756812 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.756782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx8s6\" (UniqueName: \"kubernetes.io/projected/65cd6e6f-a3b7-457a-9b6e-273706e85cc6-kube-api-access-cx8s6\") pod \"payload-processing-58b6c8fdc7-rk9pj\" (UID: \"65cd6e6f-a3b7-457a-9b6e-273706e85cc6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" May 27 18:47:14.858120 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.858006 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8s6\" (UniqueName: \"kubernetes.io/projected/65cd6e6f-a3b7-457a-9b6e-273706e85cc6-kube-api-access-cx8s6\") pod \"payload-processing-58b6c8fdc7-rk9pj\" (UID: \"65cd6e6f-a3b7-457a-9b6e-273706e85cc6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" May 27 18:47:14.867808 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.867781 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx8s6\" (UniqueName: \"kubernetes.io/projected/65cd6e6f-a3b7-457a-9b6e-273706e85cc6-kube-api-access-cx8s6\") pod \"payload-processing-58b6c8fdc7-rk9pj\" (UID: \"65cd6e6f-a3b7-457a-9b6e-273706e85cc6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" May 27 18:47:14.931861 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:14.931831 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" May 27 18:47:15.063980 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:15.063953 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rk9pj"] May 27 18:47:15.065443 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:47:15.065415 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cd6e6f_a3b7_457a_9b6e_273706e85cc6.slice/crio-6a368b4f44f79e1a740aff961413684b2ea6345f9d9dec4450bdb4cb72cf66ea WatchSource:0}: Error finding container 6a368b4f44f79e1a740aff961413684b2ea6345f9d9dec4450bdb4cb72cf66ea: Status 404 returned error can't find the container with id 6a368b4f44f79e1a740aff961413684b2ea6345f9d9dec4450bdb4cb72cf66ea May 27 18:47:15.067668 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:15.067654 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 18:47:15.146490 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:15.146415 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" event={"ID":"65cd6e6f-a3b7-457a-9b6e-273706e85cc6","Type":"ContainerStarted","Data":"6a368b4f44f79e1a740aff961413684b2ea6345f9d9dec4450bdb4cb72cf66ea"} May 27 18:47:18.160468 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:18.160429 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" event={"ID":"65cd6e6f-a3b7-457a-9b6e-273706e85cc6","Type":"ContainerStarted","Data":"b2b0dda9a13e31d98ca3fd90c26f65b9691727d850fcb816243ff68eb9ca1527"} May 27 18:47:18.160877 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:18.160563 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" May 27 18:47:18.188132 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:18.188088 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" podStartSLOduration=1.268646468 podStartE2EDuration="4.188072972s" podCreationTimestamp="2026-05-27 18:47:14 +0000 UTC" firstStartedPulling="2026-05-27 18:47:15.067776093 +0000 UTC m=+677.967837505" lastFinishedPulling="2026-05-27 18:47:17.987202577 +0000 UTC m=+680.887264009" observedRunningTime="2026-05-27 18:47:18.186825451 +0000 UTC m=+681.086886886" watchObservedRunningTime="2026-05-27 18:47:18.188072972 +0000 UTC m=+681.088134407" May 27 18:47:29.165985 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:29.165953 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rk9pj" May 27 18:47:30.346575 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.346545 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59"] May 27 18:47:30.350474 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.350458 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.359411 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.354430 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 18:47:30.359411 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.354702 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 18:47:30.359411 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.354941 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5h7zc\"" May 27 18:47:30.359411 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.355054 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 27 18:47:30.363411 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.363376 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59"] May 27 18:47:30.412407 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.412366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.412547 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.412424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsv92\" (UniqueName: \"kubernetes.io/projected/242fdcf5-d584-4c42-aea8-880b93583fa8-kube-api-access-vsv92\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.412547 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.412465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.412547 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.412491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.412713 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.412615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.412713 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.412658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/242fdcf5-d584-4c42-aea8-880b93583fa8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513130 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513101 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/242fdcf5-d584-4c42-aea8-880b93583fa8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513280 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513143 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513280 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513161 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsv92\" (UniqueName: \"kubernetes.io/projected/242fdcf5-d584-4c42-aea8-880b93583fa8-kube-api-access-vsv92\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513280 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513197 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513280 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513214 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513280 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513262 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513620 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513593 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513674 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513621 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.513711 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.513690 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.515585 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.515553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/242fdcf5-d584-4c42-aea8-880b93583fa8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.515738 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.515719 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/242fdcf5-d584-4c42-aea8-880b93583fa8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.524472 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.524445 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsv92\" (UniqueName: \"kubernetes.io/projected/242fdcf5-d584-4c42-aea8-880b93583fa8-kube-api-access-vsv92\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6th59\" (UID: \"242fdcf5-d584-4c42-aea8-880b93583fa8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.669188 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.669122 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:30.806066 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:30.806038 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59"] May 27 18:47:30.806667 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:47:30.806641 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242fdcf5_d584_4c42_aea8_880b93583fa8.slice/crio-01d0708d6248176071c31a148fb3296664c4ba76c8d914f91ee885b231fa9a68 WatchSource:0}: Error finding container 01d0708d6248176071c31a148fb3296664c4ba76c8d914f91ee885b231fa9a68: Status 404 returned error can't find the container with id 01d0708d6248176071c31a148fb3296664c4ba76c8d914f91ee885b231fa9a68 May 27 18:47:31.211126 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:31.211090 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" event={"ID":"242fdcf5-d584-4c42-aea8-880b93583fa8","Type":"ContainerStarted","Data":"01d0708d6248176071c31a148fb3296664c4ba76c8d914f91ee885b231fa9a68"} May 27 18:47:38.246764 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:38.246724 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" event={"ID":"242fdcf5-d584-4c42-aea8-880b93583fa8","Type":"ContainerStarted","Data":"950a16b6bd4bf82fe707084ec82f358c2217434b91d7e41bbf28739bdd74be34"} May 27 18:47:40.942500 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:40.942467 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz"] May 27 18:47:40.946482 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:40.946457 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:40.949243 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:40.949221 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 27 18:47:40.958824 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:40.958798 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz"] May 27 18:47:41.014615 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.014565 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcm2r\" (UniqueName: \"kubernetes.io/projected/2d14ccad-be93-44eb-b7d0-8f076602ae47-kube-api-access-wcm2r\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.014797 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.014635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.014797 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.014677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.014797 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.014711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.014797 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.014765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d14ccad-be93-44eb-b7d0-8f076602ae47-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.015022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.014822 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115369 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115336 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcm2r\" (UniqueName: \"kubernetes.io/projected/2d14ccad-be93-44eb-b7d0-8f076602ae47-kube-api-access-wcm2r\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115369 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115373 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115610 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115413 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115610 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115433 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115610 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115477 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d14ccad-be93-44eb-b7d0-8f076602ae47-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115610 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115527 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115859 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115833 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115922 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115862 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.115968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.115922 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.117740 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.117715 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d14ccad-be93-44eb-b7d0-8f076602ae47-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.117980 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.117961 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d14ccad-be93-44eb-b7d0-8f076602ae47-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.130225 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.130198 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcm2r\" (UniqueName: \"kubernetes.io/projected/2d14ccad-be93-44eb-b7d0-8f076602ae47-kube-api-access-wcm2r\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz\" (UID: \"2d14ccad-be93-44eb-b7d0-8f076602ae47\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.258438 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.258343 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:41.400106 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:41.400059 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz"] May 27 18:47:41.400249 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:47:41.400210 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d14ccad_be93_44eb_b7d0_8f076602ae47.slice/crio-23add5314872bc8be1c274e5c97f48211a64092466fe3702ea9b1397b5577975 WatchSource:0}: Error finding container 23add5314872bc8be1c274e5c97f48211a64092466fe3702ea9b1397b5577975: Status 404 returned error can't find the container with id 23add5314872bc8be1c274e5c97f48211a64092466fe3702ea9b1397b5577975 May 27 18:47:42.265742 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:42.265691 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" event={"ID":"2d14ccad-be93-44eb-b7d0-8f076602ae47","Type":"ContainerStarted","Data":"4adf74cd679a3af7a1fdd4577ba17a58077c32fb112ea2d83c22b8243feebd6d"} May 27 18:47:42.266120 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:42.265750 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" event={"ID":"2d14ccad-be93-44eb-b7d0-8f076602ae47","Type":"ContainerStarted","Data":"23add5314872bc8be1c274e5c97f48211a64092466fe3702ea9b1397b5577975"} May 27 18:47:43.271601 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:43.271564 2556 generic.go:358] "Generic (PLEG): container finished" podID="242fdcf5-d584-4c42-aea8-880b93583fa8" containerID="950a16b6bd4bf82fe707084ec82f358c2217434b91d7e41bbf28739bdd74be34" exitCode=0 May 27 18:47:43.271986 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:43.271600 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" event={"ID":"242fdcf5-d584-4c42-aea8-880b93583fa8","Type":"ContainerDied","Data":"950a16b6bd4bf82fe707084ec82f358c2217434b91d7e41bbf28739bdd74be34"} May 27 18:47:45.283529 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:45.283494 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" event={"ID":"242fdcf5-d584-4c42-aea8-880b93583fa8","Type":"ContainerStarted","Data":"8bce33b0962ad0cd48633746f9a3b63cec78a9f5775d46a25cd7c097074f0e84"} May 27 18:47:45.283993 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:45.283722 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:45.308253 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:45.308200 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" podStartSLOduration=1.183029625 podStartE2EDuration="15.308178017s" podCreationTimestamp="2026-05-27 18:47:30 +0000 UTC" firstStartedPulling="2026-05-27 18:47:30.80899372 +0000 UTC m=+693.709055148" lastFinishedPulling="2026-05-27 18:47:44.934142126 +0000 UTC m=+707.834203540" observedRunningTime="2026-05-27 18:47:45.306798518 +0000 UTC m=+708.206859952" watchObservedRunningTime="2026-05-27 18:47:45.308178017 +0000 UTC m=+708.208239456" May 27 18:47:47.293434 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:47.293340 2556 generic.go:358] "Generic (PLEG): container finished" podID="2d14ccad-be93-44eb-b7d0-8f076602ae47" containerID="4adf74cd679a3af7a1fdd4577ba17a58077c32fb112ea2d83c22b8243feebd6d" exitCode=0 May 27 18:47:47.293839 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:47.293423 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" event={"ID":"2d14ccad-be93-44eb-b7d0-8f076602ae47","Type":"ContainerDied","Data":"4adf74cd679a3af7a1fdd4577ba17a58077c32fb112ea2d83c22b8243feebd6d"} May 27 18:47:48.299166 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:48.299129 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" event={"ID":"2d14ccad-be93-44eb-b7d0-8f076602ae47","Type":"ContainerStarted","Data":"bae0b47baf43802391d1b9155c2e746d86750252898c3dc639f4995161b490e0"} May 27 18:47:48.299560 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:48.299352 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:47:48.322606 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:48.322557 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" podStartSLOduration=8.089476907 podStartE2EDuration="8.322540772s" podCreationTimestamp="2026-05-27 18:47:40 +0000 UTC" firstStartedPulling="2026-05-27 18:47:47.294081155 +0000 UTC m=+710.194142568" lastFinishedPulling="2026-05-27 18:47:47.527145009 +0000 UTC m=+710.427206433" observedRunningTime="2026-05-27 18:47:48.321772406 +0000 UTC m=+711.221833842" watchObservedRunningTime="2026-05-27 18:47:48.322540772 +0000 UTC m=+711.222602209" May 27 18:47:56.301470 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:56.301441 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6th59" May 27 18:47:59.318969 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:47:59.318938 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz" May 27 18:48:42.736962 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.736926 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj"] May 27 18:48:42.742498 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.742468 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.749447 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.749423 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 27 18:48:42.756092 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.756065 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj"] May 27 18:48:42.824421 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.824370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f319ca0-9058-4912-bc1c-d2884aeafa9d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.824565 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.824433 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.824565 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.824472 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.824664 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.824573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.824664 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.824616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.824664 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.824647 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8h5h\" (UniqueName: \"kubernetes.io/projected/5f319ca0-9058-4912-bc1c-d2884aeafa9d-kube-api-access-g8h5h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925216 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925187 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925428 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925241 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925428 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925269 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925428 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925292 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8h5h\" (UniqueName: \"kubernetes.io/projected/5f319ca0-9058-4912-bc1c-d2884aeafa9d-kube-api-access-g8h5h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925428 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925340 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f319ca0-9058-4912-bc1c-d2884aeafa9d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925428 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925374 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925744 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925680 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925744 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925718 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.925968 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.925946 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.928068 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.928046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f319ca0-9058-4912-bc1c-d2884aeafa9d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.928539 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.928513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f319ca0-9058-4912-bc1c-d2884aeafa9d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:42.935307 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:42.935282 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8h5h\" (UniqueName: \"kubernetes.io/projected/5f319ca0-9058-4912-bc1c-d2884aeafa9d-kube-api-access-g8h5h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj\" (UID: \"5f319ca0-9058-4912-bc1c-d2884aeafa9d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:43.061607 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:43.061554 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:43.195057 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:43.195026 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj"] May 27 18:48:43.196073 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:48:43.196048 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f319ca0_9058_4912_bc1c_d2884aeafa9d.slice/crio-6daccb7d1ae8763f860927bd38a8c9269774158d24ca3f39fb2d47711d0a8a29 WatchSource:0}: Error finding container 6daccb7d1ae8763f860927bd38a8c9269774158d24ca3f39fb2d47711d0a8a29: Status 404 returned error can't find the container with id 6daccb7d1ae8763f860927bd38a8c9269774158d24ca3f39fb2d47711d0a8a29 May 27 18:48:43.514830 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:43.514793 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" event={"ID":"5f319ca0-9058-4912-bc1c-d2884aeafa9d","Type":"ContainerStarted","Data":"886fee8c07ae06ef91cd476c367d9ae61b8291e33ff8585309104f2b0bf6ffc9"} May 27 18:48:43.514830 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:43.514834 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" event={"ID":"5f319ca0-9058-4912-bc1c-d2884aeafa9d","Type":"ContainerStarted","Data":"6daccb7d1ae8763f860927bd38a8c9269774158d24ca3f39fb2d47711d0a8a29"} May 27 18:48:48.534919 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:48.534890 2556 generic.go:358] "Generic (PLEG): container finished" podID="5f319ca0-9058-4912-bc1c-d2884aeafa9d" containerID="886fee8c07ae06ef91cd476c367d9ae61b8291e33ff8585309104f2b0bf6ffc9" exitCode=0 May 27 18:48:48.535257 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:48.534971 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" event={"ID":"5f319ca0-9058-4912-bc1c-d2884aeafa9d","Type":"ContainerDied","Data":"886fee8c07ae06ef91cd476c367d9ae61b8291e33ff8585309104f2b0bf6ffc9"} May 27 18:48:49.540022 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:49.539984 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" event={"ID":"5f319ca0-9058-4912-bc1c-d2884aeafa9d","Type":"ContainerStarted","Data":"85695e3b4989cdccb706f7a8e5b5bb7ff93d42ba972b96a0769958f707d633bb"} May 27 18:48:49.540412 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:49.540193 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:48:49.564330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:48:49.564280 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" podStartSLOduration=7.333597771 podStartE2EDuration="7.564268861s" podCreationTimestamp="2026-05-27 18:48:42 +0000 UTC" firstStartedPulling="2026-05-27 18:48:48.535626367 +0000 UTC m=+771.435687779" lastFinishedPulling="2026-05-27 18:48:48.766297448 +0000 UTC m=+771.666358869" observedRunningTime="2026-05-27 18:48:49.561054563 +0000 UTC m=+772.461116010" watchObservedRunningTime="2026-05-27 18:48:49.564268861 +0000 UTC m=+772.464330343" May 27 18:49:00.556892 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:49:00.556860 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj" May 27 18:50:44.788116 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:44.788083 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w_826ff222-5255-4f4a-9a12-bfe1e0e8690c/manager/0.log" May 27 18:50:44.914050 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:44.914026 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-t8kh6_b96955ad-1ab5-4851-bdb0-ddfe2f997b43/postgres/0.log" May 27 18:50:45.657414 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.657366 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z_9f7b4b05-c21f-43cd-bddc-40308e8b2af2/util/0.log" May 27 18:50:45.663637 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.663617 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z_9f7b4b05-c21f-43cd-bddc-40308e8b2af2/pull/0.log" May 27 18:50:45.669829 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.669812 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z_9f7b4b05-c21f-43cd-bddc-40308e8b2af2/extract/0.log" May 27 18:50:45.778328 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.778302 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t_8fce18fb-3ca1-4508-b9dd-e1d85398833b/util/0.log" May 27 18:50:45.785522 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.785502 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t_8fce18fb-3ca1-4508-b9dd-e1d85398833b/pull/0.log" May 27 18:50:45.792864 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.792841 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t_8fce18fb-3ca1-4508-b9dd-e1d85398833b/extract/0.log" May 27 18:50:45.901014 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.900990 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5_aeeca7df-bc83-4ef9-af70-115ba6ea8dcc/extract/0.log" May 27 18:50:45.907059 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.907040 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5_aeeca7df-bc83-4ef9-af70-115ba6ea8dcc/util/0.log" May 27 18:50:45.913180 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:45.913127 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5_aeeca7df-bc83-4ef9-af70-115ba6ea8dcc/pull/0.log" May 27 18:50:46.022186 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:46.022164 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg_149b926e-c691-4af6-8245-a20924a83660/extract/0.log" May 27 18:50:46.028621 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:46.028594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg_149b926e-c691-4af6-8245-a20924a83660/util/0.log" May 27 18:50:46.035487 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:46.035473 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg_149b926e-c691-4af6-8245-a20924a83660/pull/0.log" May 27 18:50:46.607182 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:46.607158 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gq2n9_8f51b7c5-09af-4649-ac1f-78c7dba386dd/registry-server/0.log" May 27 18:50:46.947496 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:46.947471 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-5lqrh_573f639d-9c3f-492d-b770-ef320a3d4c74/manager/0.log" May 27 18:50:47.291612 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:47.291540 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf_66800d03-3cc8-496e-be88-f9538dc07317/istio-proxy/0.log" May 27 18:50:47.732589 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:47.732561 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-p2wh6_a6957266-7ba0-49ad-a340-3a0c9b2b3d71/istio-proxy/0.log" May 27 18:50:47.845075 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:47.845051 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rk9pj_65cd6e6f-a3b7-457a-9b6e-273706e85cc6/payload-processing/0.log" May 27 18:50:47.956682 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:47.956657 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-758ddf86b6-r9jvf_bb199dc7-3b25-435e-9b4b-394a8c1f08a6/router/0.log" May 27 18:50:48.544004 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:48.543975 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-6th59_242fdcf5-d584-4c42-aea8-880b93583fa8/storage-initializer/0.log" May 27 18:50:48.551554 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:48.551529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-6th59_242fdcf5-d584-4c42-aea8-880b93583fa8/main/0.log" May 27 18:50:48.663691 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:48.663672 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj_5f319ca0-9058-4912-bc1c-d2884aeafa9d/storage-initializer/0.log" May 27 18:50:48.672206 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:48.672178 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7rtbj_5f319ca0-9058-4912-bc1c-d2884aeafa9d/main/0.log" May 27 18:50:48.784877 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:48.784859 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz_2d14ccad-be93-44eb-b7d0-8f076602ae47/storage-initializer/0.log" May 27 18:50:48.791922 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:48.791907 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-ds9vz_2d14ccad-be93-44eb-b7d0-8f076602ae47/main/0.log" May 27 18:50:56.312740 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:56.312714 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zkdp5_af1a7161-f90e-4801-83ef-059e2ea6cbe6/global-pull-secret-syncer/0.log" May 27 18:50:56.355247 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:56.355213 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-45wck_bf628f60-16d3-49fd-b183-1e160fde9be3/konnectivity-agent/0.log" May 27 18:50:56.428717 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:50:56.428694 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-244.ec2.internal_7b41983331afe86ebb89c18c24a89355/haproxy/0.log" May 27 18:51:00.344078 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.343997 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z_9f7b4b05-c21f-43cd-bddc-40308e8b2af2/extract/0.log" May 27 18:51:00.367098 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.367078 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z_9f7b4b05-c21f-43cd-bddc-40308e8b2af2/util/0.log" May 27 18:51:00.389646 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.389623 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbb6z_9f7b4b05-c21f-43cd-bddc-40308e8b2af2/pull/0.log" May 27 18:51:00.424936 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.424915 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t_8fce18fb-3ca1-4508-b9dd-e1d85398833b/extract/0.log" May 27 18:51:00.449653 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.449633 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t_8fce18fb-3ca1-4508-b9dd-e1d85398833b/util/0.log" May 27 18:51:00.472614 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.472590 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s699t_8fce18fb-3ca1-4508-b9dd-e1d85398833b/pull/0.log" May 27 18:51:00.500640 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.500615 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5_aeeca7df-bc83-4ef9-af70-115ba6ea8dcc/extract/0.log" May 27 18:51:00.522129 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.522108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5_aeeca7df-bc83-4ef9-af70-115ba6ea8dcc/util/0.log" May 27 18:51:00.549709 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.549692 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73klrw5_aeeca7df-bc83-4ef9-af70-115ba6ea8dcc/pull/0.log" May 27 18:51:00.584089 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.584068 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg_149b926e-c691-4af6-8245-a20924a83660/extract/0.log" May 27 18:51:00.609889 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.609827 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg_149b926e-c691-4af6-8245-a20924a83660/util/0.log" May 27 18:51:00.636679 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.636661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168wrg_149b926e-c691-4af6-8245-a20924a83660/pull/0.log" May 27 18:51:00.807543 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.807511 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gq2n9_8f51b7c5-09af-4649-ac1f-78c7dba386dd/registry-server/0.log" May 27 18:51:00.914064 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:00.913997 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-5lqrh_573f639d-9c3f-492d-b770-ef320a3d4c74/manager/0.log" May 27 18:51:02.481092 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.481067 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d050bacb-1bce-40ee-982c-273edfe9386f/alertmanager/0.log" May 27 18:51:02.510656 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.510633 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d050bacb-1bce-40ee-982c-273edfe9386f/config-reloader/0.log" May 27 18:51:02.535117 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.535095 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d050bacb-1bce-40ee-982c-273edfe9386f/kube-rbac-proxy-web/0.log" May 27 18:51:02.560247 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.560227 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d050bacb-1bce-40ee-982c-273edfe9386f/kube-rbac-proxy/0.log" May 27 18:51:02.604626 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.604604 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d050bacb-1bce-40ee-982c-273edfe9386f/kube-rbac-proxy-metric/0.log" May 27 18:51:02.631844 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.631822 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d050bacb-1bce-40ee-982c-273edfe9386f/prom-label-proxy/0.log" May 27 18:51:02.656319 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.656297 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d050bacb-1bce-40ee-982c-273edfe9386f/init-config-reloader/0.log" May 27 18:51:02.720502 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.720477 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-42nst_a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5/kube-state-metrics/0.log" May 27 18:51:02.743883 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.743828 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-42nst_a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5/kube-rbac-proxy-main/0.log" May 27 18:51:02.768137 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.768117 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-42nst_a64d4eb0-d775-47a2-a4d9-bbe1c12d61b5/kube-rbac-proxy-self/0.log" May 27 18:51:02.951610 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.951589 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29r5j_e1a451b2-4353-47b5-bb0a-11ae1bcac1bf/node-exporter/0.log" May 27 18:51:02.975284 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.975260 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29r5j_e1a451b2-4353-47b5-bb0a-11ae1bcac1bf/kube-rbac-proxy/0.log" May 27 18:51:02.999567 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:02.999518 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29r5j_e1a451b2-4353-47b5-bb0a-11ae1bcac1bf/init-textfile/0.log" May 27 18:51:03.113229 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:03.113212 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-2h9ql_154bc42f-421f-49e9-93ab-0bc79c6679cc/kube-rbac-proxy-main/0.log" May 27 18:51:03.148658 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:03.148635 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-2h9ql_154bc42f-421f-49e9-93ab-0bc79c6679cc/kube-rbac-proxy-self/0.log" May 27 18:51:03.172654 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:03.172633 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-2h9ql_154bc42f-421f-49e9-93ab-0bc79c6679cc/openshift-state-metrics/0.log" May 27 18:51:03.460828 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:03.460799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-mtt6w_b407c031-a187-4fd9-ae2c-a411abadd228/prometheus-operator-admission-webhook/0.log" May 27 18:51:03.491154 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:03.491131 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c5f7bf86d-zd5wp_ba341103-6d73-44bc-8b12-8d927d29b160/telemeter-client/0.log" May 27 18:51:03.515612 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:03.515592 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c5f7bf86d-zd5wp_ba341103-6d73-44bc-8b12-8d927d29b160/reload/0.log" May 27 18:51:03.539995 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:03.539976 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c5f7bf86d-zd5wp_ba341103-6d73-44bc-8b12-8d927d29b160/kube-rbac-proxy/0.log" May 27 18:51:04.976113 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:04.976080 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7"] May 27 18:51:04.978723 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:04.978706 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:04.981386 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:04.981364 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xfprs\"/\"default-dockercfg-dp7jr\"" May 27 18:51:04.981547 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:04.981533 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xfprs\"/\"openshift-service-ca.crt\"" May 27 18:51:04.982359 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:04.982346 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xfprs\"/\"kube-root-ca.crt\"" May 27 18:51:04.989551 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:04.989529 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7"] May 27 18:51:05.030108 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.030084 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-proc\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.030229 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.030129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-podres\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.030229 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.030161 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgjjg\" (UniqueName: \"kubernetes.io/projected/97ef644f-cff5-4dd4-a893-3b0315cac528-kube-api-access-pgjjg\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.030229 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.030207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-lib-modules\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.030389 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.030262 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-sys\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.130754 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.130731 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-podres\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.130875 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.130766 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgjjg\" (UniqueName: \"kubernetes.io/projected/97ef644f-cff5-4dd4-a893-3b0315cac528-kube-api-access-pgjjg\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.130875 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.130811 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-lib-modules\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.130875 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.130855 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-sys\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.131027 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.130891 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-proc\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.131027 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.130921 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-podres\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.131027 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.130987 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-sys\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.131027 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.131005 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-lib-modules\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.131027 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.131017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97ef644f-cff5-4dd4-a893-3b0315cac528-proc\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.138486 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.138467 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgjjg\" (UniqueName: \"kubernetes.io/projected/97ef644f-cff5-4dd4-a893-3b0315cac528-kube-api-access-pgjjg\") pod \"perf-node-gather-daemonset-m6dc7\" (UID: \"97ef644f-cff5-4dd4-a893-3b0315cac528\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.289301 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.289242 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:05.430330 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:05.428974 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7"] May 27 18:51:05.431195 ip-10-0-141-244 kubenswrapper[2556]: W0527 18:51:05.431167 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97ef644f_cff5_4dd4_a893_3b0315cac528.slice/crio-e27fb7e60fd2b6e0dc739b8938e313fdf02e9d6e8892e7c37b26ac3b6649f220 WatchSource:0}: Error finding container e27fb7e60fd2b6e0dc739b8938e313fdf02e9d6e8892e7c37b26ac3b6649f220: Status 404 returned error can't find the container with id e27fb7e60fd2b6e0dc739b8938e313fdf02e9d6e8892e7c37b26ac3b6649f220 May 27 18:51:06.076916 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:06.076875 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" event={"ID":"97ef644f-cff5-4dd4-a893-3b0315cac528","Type":"ContainerStarted","Data":"be887333e823935914f58f6440572c5db4d5c28e3b01c3b2c9a8fd861de591f7"} May 27 18:51:06.077272 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:06.076922 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" event={"ID":"97ef644f-cff5-4dd4-a893-3b0315cac528","Type":"ContainerStarted","Data":"e27fb7e60fd2b6e0dc739b8938e313fdf02e9d6e8892e7c37b26ac3b6649f220"} May 27 18:51:06.077272 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:06.076979 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:06.096678 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:06.096633 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" podStartSLOduration=2.096621589 podStartE2EDuration="2.096621589s" podCreationTimestamp="2026-05-27 18:51:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:51:06.093628811 +0000 UTC m=+908.993690259" watchObservedRunningTime="2026-05-27 18:51:06.096621589 +0000 UTC m=+908.996683023" May 27 18:51:06.608771 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:06.608741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-2dpnd_d8b1a701-1f1e-4879-a924-5b06481b31c5/volume-data-source-validator/0.log" May 27 18:51:07.520558 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:07.520528 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gwl77_166c076b-8d89-4736-b539-afcf8d064d76/dns/0.log" May 27 18:51:07.542106 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:07.542074 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gwl77_166c076b-8d89-4736-b539-afcf8d064d76/kube-rbac-proxy/0.log" May 27 18:51:07.613556 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:07.613540 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kkhq8_fb2efac6-d4e5-4ea2-9401-f85e21b4d58e/dns-node-resolver/0.log" May 27 18:51:08.147387 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:08.147360 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mncsf_e0fc65dd-a9f4-4371-a240-8deb8db9d999/node-ca/0.log" May 27 18:51:08.992515 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:08.992489 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bfnsbf_66800d03-3cc8-496e-be88-f9538dc07317/istio-proxy/0.log" May 27 18:51:09.135920 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:09.135895 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-p2wh6_a6957266-7ba0-49ad-a340-3a0c9b2b3d71/istio-proxy/0.log" May 27 18:51:09.168223 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:09.168203 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rk9pj_65cd6e6f-a3b7-457a-9b6e-273706e85cc6/payload-processing/0.log" May 27 18:51:09.195691 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:09.195667 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-758ddf86b6-r9jvf_bb199dc7-3b25-435e-9b4b-394a8c1f08a6/router/0.log" May 27 18:51:09.810500 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:09.810466 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lqgfx_bcfb1af4-05a5-4473-b348-804babdf33bf/serve-healthcheck-canary/0.log" May 27 18:51:10.251001 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:10.250977 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-z5hbb_c1a4f503-f531-47cb-913c-34fe87a34574/insights-operator/1.log" May 27 18:51:10.251453 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:10.251212 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-z5hbb_c1a4f503-f531-47cb-913c-34fe87a34574/insights-operator/0.log" May 27 18:51:10.344985 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:10.344961 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6lzk_d09d62da-3426-453a-b9ce-56e7e719ffef/kube-rbac-proxy/0.log" May 27 18:51:10.366813 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:10.366791 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6lzk_d09d62da-3426-453a-b9ce-56e7e719ffef/exporter/0.log" May 27 18:51:10.390532 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:10.390509 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6lzk_d09d62da-3426-453a-b9ce-56e7e719ffef/extractor/0.log" May 27 18:51:12.091314 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:12.091289 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-m6dc7" May 27 18:51:12.591672 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:12.591641 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bdcb4b57b-mpk2w_826ff222-5255-4f4a-9a12-bfe1e0e8690c/manager/0.log" May 27 18:51:12.611871 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:12.611848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-t8kh6_b96955ad-1ab5-4851-bdb0-ddfe2f997b43/postgres/0.log" May 27 18:51:13.934323 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:13.934297 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5ff9f7544c-7tff2_7a103572-2010-4217-b444-2344309cdefd/manager/0.log" May 27 18:51:13.995283 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:13.995218 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-m69nk_62af5530-3af2-4812-b0c1-8d884e53bc42/openshift-lws-operator/0.log" May 27 18:51:18.853160 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:18.853129 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-zfhlr_700305a3-ac2c-4ee1-b740-2c5a82af90cf/migrator/0.log" May 27 18:51:18.877055 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:18.877033 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-zfhlr_700305a3-ac2c-4ee1-b740-2c5a82af90cf/graceful-termination/0.log" May 27 18:51:19.275332 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:19.275302 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-984df_b1d43051-f350-4305-bf97-1eb748a62917/kube-storage-version-migrator-operator/1.log" May 27 18:51:19.276241 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:19.276216 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-984df_b1d43051-f350-4305-bf97-1eb748a62917/kube-storage-version-migrator-operator/0.log" May 27 18:51:20.714769 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:20.714741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksdlz_16b382be-b6de-434d-b4c9-f6fdd9bd81e3/kube-multus-additional-cni-plugins/0.log" May 27 18:51:20.740176 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:20.740149 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksdlz_16b382be-b6de-434d-b4c9-f6fdd9bd81e3/egress-router-binary-copy/0.log" May 27 18:51:20.763349 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:20.763325 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksdlz_16b382be-b6de-434d-b4c9-f6fdd9bd81e3/cni-plugins/0.log" May 27 18:51:20.786679 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:20.786649 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksdlz_16b382be-b6de-434d-b4c9-f6fdd9bd81e3/bond-cni-plugin/0.log" May 27 18:51:20.810316 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:20.810295 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksdlz_16b382be-b6de-434d-b4c9-f6fdd9bd81e3/routeoverride-cni/0.log" May 27 18:51:20.834565 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:20.834543 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksdlz_16b382be-b6de-434d-b4c9-f6fdd9bd81e3/whereabouts-cni-bincopy/0.log" May 27 18:51:20.862727 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:20.862703 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksdlz_16b382be-b6de-434d-b4c9-f6fdd9bd81e3/whereabouts-cni/0.log" May 27 18:51:21.162479 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:21.162451 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t6dpz_8ce79359-2523-4c6e-89a6-36d6b66e7e9a/kube-multus/0.log" May 27 18:51:21.184416 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:21.184372 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5sk84_fac32ff4-f58e-40c1-bd76-560d7e7f9016/network-metrics-daemon/0.log" May 27 18:51:21.203226 ip-10-0-141-244 kubenswrapper[2556]: I0527 18:51:21.203201 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5sk84_fac32ff4-f58e-40c1-bd76-560d7e7f9016/kube-rbac-proxy/0.log"