May 28 17:14:29.236179 ip-10-0-130-182 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 17:14:29.236191 ip-10-0-130-182 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 17:14:29.236199 ip-10-0-130-182 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 17:14:29.236432 ip-10-0-130-182 systemd[1]: Failed to start Kubernetes Kubelet. May 28 17:14:39.467416 ip-10-0-130-182 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 17:14:39.467439 ip-10-0-130-182 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 11a7ce1bb4904acca5d2275358a5c336 -- May 28 17:17:11.247173 ip-10-0-130-182 systemd[1]: Starting Kubernetes Kubelet... May 28 17:17:11.708533 ip-10-0-130-182 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:17:11.708533 ip-10-0-130-182 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 17:17:11.708533 ip-10-0-130-182 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:17:11.708533 ip-10-0-130-182 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 17:17:11.708533 ip-10-0-130-182 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:17:11.710651 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.710548 2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 17:17:11.715212 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715184 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:11.715212 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715208 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:11.715212 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715212 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:11.715212 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715218 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715223 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715226 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715229 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715232 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715234 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715237 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715240 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715243 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715246 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715249 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715251 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715254 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715257 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715260 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715262 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715265 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715268 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715270 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715279 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:11.715373 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715282 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715285 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715288 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715290 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715293 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715296 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715298 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715301 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715304 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715306 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715309 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715312 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715316 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715320 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715325 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715328 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715331 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715334 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715337 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:11.715897 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715340 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715343 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715346 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715349 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715352 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715355 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715357 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715360 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715362 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715365 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715368 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715371 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715373 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715376 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715379 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715382 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715385 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715387 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715390 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715393 2558 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:11.716366 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715395 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715398 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715400 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715403 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715406 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715408 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715411 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715415 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715418 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715420 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715424 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715426 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715429 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715431 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715434 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715438 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715441 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715443 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715445 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715448 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:11.716905 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715451 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715454 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715456 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715459 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715893 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715899 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715903 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715906 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715909 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715911 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715914 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715917 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715919 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715923 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715925 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715929 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715932 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715934 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715937 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715940 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:11.717392 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715943 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715946 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715949 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715951 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715954 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715957 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715959 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715962 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715964 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715967 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715969 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715972 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715974 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715977 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715979 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715982 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715984 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715987 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715990 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715992 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:11.717911 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715995 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.715997 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716000 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716002 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716005 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716007 2558 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716010 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716013 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716016 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716019 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716021 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716024 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716027 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716030 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716033 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716035 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716038 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716040 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716043 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716046 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:11.718404 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716049 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716051 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716054 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716056 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716058 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716061 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716063 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716066 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716069 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716072 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716074 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716078 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716082 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716085 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716088 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716091 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716093 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716097 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716101 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:11.718925 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716105 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716108 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716111 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716114 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716118 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716122 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716125 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716128 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716131 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716134 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.716136 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716759 2558 flags.go:64] FLAG: --address="0.0.0.0" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716776 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716783 2558 flags.go:64] FLAG: --anonymous-auth="true" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716788 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716792 2558 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716795 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716800 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716804 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716822 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716826 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 17:17:11.719400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716829 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716833 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716836 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716839 2558 flags.go:64] FLAG: --cgroup-root="" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716843 2558 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716846 2558 flags.go:64] FLAG: --client-ca-file="" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716849 2558 flags.go:64] FLAG: --cloud-config="" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716852 2558 flags.go:64] FLAG: --cloud-provider="external" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716855 2558 flags.go:64] FLAG: --cluster-dns="[]" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716861 2558 flags.go:64] FLAG: --cluster-domain="" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716864 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716868 2558 flags.go:64] FLAG: --config-dir="" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716871 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716875 2558 flags.go:64] FLAG: --container-log-max-files="5" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716879 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716886 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716890 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716894 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716897 2558 flags.go:64] FLAG: --contention-profiling="false" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716901 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716905 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716908 2558 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716912 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716916 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716919 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 17:17:11.719985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716923 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716926 2558 flags.go:64] FLAG: --enable-load-reader="false" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716929 2558 flags.go:64] FLAG: --enable-server="true" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716932 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716937 2558 flags.go:64] FLAG: --event-burst="100" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716940 2558 flags.go:64] FLAG: --event-qps="50" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716943 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716946 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716949 2558 flags.go:64] FLAG: --eviction-hard="" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716953 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716956 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716959 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716962 2558 flags.go:64] FLAG: --eviction-soft="" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716965 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716968 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716971 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716974 2558 flags.go:64] FLAG: --experimental-mounter-path="" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716977 2558 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716981 2558 flags.go:64] FLAG: --fail-swap-on="true" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716984 2558 flags.go:64] FLAG: --feature-gates="" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716988 2558 flags.go:64] FLAG: --file-check-frequency="20s" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.716991 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717000 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717003 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717006 2558 flags.go:64] FLAG: --healthz-port="10248" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717010 2558 flags.go:64] FLAG: --help="false" May 28 17:17:11.720604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717013 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-130-182.ec2.internal" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717017 2558 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717021 2558 flags.go:64] FLAG: --http-check-frequency="20s" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717024 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717027 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717031 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717034 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717037 2558 flags.go:64] FLAG: --image-service-endpoint="" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717040 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717043 2558 flags.go:64] FLAG: --kube-api-burst="100" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717046 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717049 2558 flags.go:64] FLAG: --kube-api-qps="50" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717052 2558 flags.go:64] FLAG: --kube-reserved="" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717055 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717058 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717062 2558 flags.go:64] FLAG: --kubelet-cgroups="" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717064 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717067 2558 flags.go:64] FLAG: --lock-file="" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717070 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717073 2558 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717076 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717081 2558 flags.go:64] FLAG: --log-json-split-stream="false" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717084 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717087 2558 flags.go:64] FLAG: --log-text-split-stream="false" May 28 17:17:11.721250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717090 2558 flags.go:64] FLAG: --logging-format="text" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717093 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717097 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717100 2558 flags.go:64] FLAG: --manifest-url="" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717105 2558 flags.go:64] FLAG: --manifest-url-header="" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717110 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717113 2558 flags.go:64] FLAG: --max-open-files="1000000" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717118 2558 flags.go:64] FLAG: --max-pods="110" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717121 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717124 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717127 2558 flags.go:64] FLAG: --memory-manager-policy="None" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717130 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717134 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717137 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717140 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717149 2558 flags.go:64] FLAG: --node-status-max-images="50" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717152 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717155 2558 flags.go:64] FLAG: --oom-score-adj="-999" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717158 2558 flags.go:64] FLAG: --pod-cidr="" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717162 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717168 2558 flags.go:64] FLAG: --pod-manifest-path="" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717171 2558 flags.go:64] FLAG: --pod-max-pids="-1" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717174 2558 flags.go:64] FLAG: --pods-per-core="0" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717177 2558 flags.go:64] FLAG: --port="10250" May 28 17:17:11.721902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717181 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717184 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ff5a820586d3ec1" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717187 2558 flags.go:64] FLAG: --qos-reserved="" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717191 2558 flags.go:64] FLAG: --read-only-port="10255" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717194 2558 flags.go:64] FLAG: --register-node="true" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717197 2558 flags.go:64] FLAG: --register-schedulable="true" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717200 2558 flags.go:64] FLAG: --register-with-taints="" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717203 2558 flags.go:64] FLAG: --registry-burst="10" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717206 2558 flags.go:64] FLAG: --registry-qps="5" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717209 2558 flags.go:64] FLAG: --reserved-cpus="" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717212 2558 flags.go:64] FLAG: --reserved-memory="" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717216 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717220 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717224 2558 flags.go:64] FLAG: --rotate-certificates="false" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717227 2558 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717230 2558 flags.go:64] FLAG: --runonce="false" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717233 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717236 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717239 2558 flags.go:64] FLAG: --seccomp-default="false" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717243 2558 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717246 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717249 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717252 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717274 2558 flags.go:64] FLAG: --storage-driver-password="root" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717278 2558 flags.go:64] FLAG: --storage-driver-secure="false" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717282 2558 flags.go:64] FLAG: --storage-driver-table="stats" May 28 17:17:11.722492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717285 2558 flags.go:64] FLAG: --storage-driver-user="root" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717289 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717292 2558 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717296 2558 flags.go:64] FLAG: --system-cgroups="" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717299 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717305 2558 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717308 2558 flags.go:64] FLAG: --tls-cert-file="" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717311 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717317 2558 flags.go:64] FLAG: --tls-min-version="" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717320 2558 flags.go:64] FLAG: --tls-private-key-file="" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717323 2558 flags.go:64] FLAG: --topology-manager-policy="none" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717326 2558 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717329 2558 flags.go:64] FLAG: --topology-manager-scope="container" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717332 2558 flags.go:64] FLAG: --v="2" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717337 2558 flags.go:64] FLAG: --version="false" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717341 2558 flags.go:64] FLAG: --vmodule="" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717345 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717349 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717468 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717473 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717477 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717480 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717483 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717486 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:11.723157 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717489 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717492 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717496 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717499 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717503 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717505 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717508 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717511 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717514 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717516 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717519 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717522 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717524 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717527 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717530 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717532 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717535 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717537 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717540 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717542 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:11.723754 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717545 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717548 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717551 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717553 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717556 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717558 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717562 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717565 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717567 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717569 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717572 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717575 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717577 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717580 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717582 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717586 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717589 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717591 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717594 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717597 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:11.724292 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717599 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717602 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717606 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717609 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717613 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717618 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717621 2558 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717623 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717626 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717629 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717631 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717634 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717637 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717640 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717642 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717645 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717647 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717650 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717653 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717656 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:11.724793 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717658 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717661 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717664 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717666 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717669 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717672 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717675 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717677 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717680 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717683 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717686 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717688 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717691 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717693 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717696 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717699 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717701 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717704 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717706 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:11.725348 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.717709 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.717715 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.724584 2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.724608 2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724669 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724677 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724680 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724683 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724686 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724689 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724692 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724695 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724698 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724700 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724704 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724707 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:11.725854 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724710 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724713 2558 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724715 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724718 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724721 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724724 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724728 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724731 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724733 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724736 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724739 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724741 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724744 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724747 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724749 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724752 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724755 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724758 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724760 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724765 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:11.726281 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724768 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724771 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724773 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724776 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724779 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724781 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724784 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724787 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724789 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724792 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724794 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724797 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724800 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724803 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724805 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724820 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724824 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724827 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724829 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724832 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:11.726788 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724835 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724838 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724841 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724845 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724849 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724852 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724855 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724858 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724861 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724864 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724867 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724870 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724873 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724876 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724879 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724882 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724884 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724887 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724890 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724892 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:11.727323 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724895 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724898 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724900 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724903 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724906 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724909 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724911 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724914 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724917 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724919 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724923 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724928 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724931 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.724934 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.724940 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:17:11.727873 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725058 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725064 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725067 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725070 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725074 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725076 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725080 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725083 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725086 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725089 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725093 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725096 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725098 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725101 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725104 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725106 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725109 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725112 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725115 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725117 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:11.728249 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725120 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725123 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725125 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725128 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725131 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725134 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725136 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725139 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725141 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725144 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725146 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725149 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725151 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725155 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725160 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725162 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725166 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725168 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725172 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725174 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:11.728835 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725177 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725180 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725185 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725189 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725193 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725195 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725198 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725201 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725204 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725206 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725209 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725212 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725214 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725216 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725219 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725222 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725224 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725227 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725229 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:11.729345 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725232 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725235 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725237 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725240 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725242 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725245 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725247 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725250 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725252 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725255 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725257 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725261 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725263 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725266 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725269 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725271 2558 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725274 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725277 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725280 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725283 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725285 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:11.729951 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725288 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725290 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725293 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725295 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725298 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:11.725300 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.725306 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.726218 2558 server.go:962] "Client rotation is on, will bootstrap in background" May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.728381 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.729519 2558 server.go:1019] "Starting client certificate rotation" May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.729637 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 17:17:11.730484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.729701 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 17:17:11.754400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.754366 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 17:17:11.762243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.762211 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 17:17:11.777827 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.777786 2558 log.go:25] "Validated CRI v1 runtime API" May 28 17:17:11.783357 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.783332 2558 log.go:25] "Validated CRI v1 image API" May 28 17:17:11.785924 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.785906 2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 17:17:11.788480 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.788450 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 908a609f-890d-46d5-b35c-35980b361354:/dev/nvme0n1p4 99d47ae6-5274-4004-84a7-c2e6cbb289ce:/dev/nvme0n1p3] May 28 17:17:11.788574 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.788477 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 17:17:11.790461 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.790436 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 17:17:11.793035 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.792905 2558 manager.go:217] Machine: {Timestamp:2026-05-28 17:17:11.792333965 +0000 UTC m=+0.421025425 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102133 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec270cdded8ca517db606b8ae7927c6f SystemUUID:ec270cdd-ed8c-a517-db60-6b8ae7927c6f BootID:11a7ce1b-b490-4acc-a5d2-275358a5c336 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b1:ff:f9:15:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b1:ff:f9:15:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:cc:46:13:b7:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 17:17:11.793681 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.793665 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 17:17:11.793784 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.793768 2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 17:17:11.795614 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.795578 2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 17:17:11.795782 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.795615 2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 17:17:11.795843 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.795794 2558 topology_manager.go:138] "Creating topology manager with none policy" May 28 17:17:11.795843 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.795802 2558 container_manager_linux.go:306] "Creating device plugin manager" May 28 17:17:11.795843 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.795826 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 17:17:11.797266 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.797250 2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 17:17:11.798104 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.798089 2558 state_mem.go:36] "Initialized new in-memory state store" May 28 17:17:11.798223 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.798214 2558 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 17:17:11.800552 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.800537 2558 kubelet.go:491] "Attempting to sync node with API server" May 28 17:17:11.801128 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.801114 2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 17:17:11.801178 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.801143 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 17:17:11.801178 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.801154 2558 kubelet.go:397] "Adding apiserver pod source" May 28 17:17:11.801178 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.801164 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 17:17:11.802265 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.802247 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 17:17:11.802323 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.802276 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 17:17:11.808341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.808314 2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 17:17:11.810642 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.810619 2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 17:17:11.811665 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811652 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 17:17:11.811712 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811671 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 17:17:11.811712 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811677 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 17:17:11.811712 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811683 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 17:17:11.811712 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811694 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 17:17:11.811712 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811703 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 17:17:11.811712 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811711 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 17:17:11.811906 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811720 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 17:17:11.811906 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811729 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 17:17:11.811906 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811737 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 17:17:11.811906 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811768 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 17:17:11.811906 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811863 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nml5k" May 28 17:17:11.812035 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.811982 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 17:17:11.813777 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.813763 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 17:17:11.813777 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.813777 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 17:17:11.816124 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.816090 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 17:17:11.816124 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.816103 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 17:17:11.817351 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.817338 2558 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 17:17:11.817391 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.817378 2558 server.go:1295] "Started kubelet" May 28 17:17:11.817484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.817444 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 17:17:11.817540 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.817481 2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 17:17:11.817601 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.817586 2558 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 17:17:11.818291 ip-10-0-130-182 systemd[1]: Started Kubernetes Kubelet. May 28 17:17:11.819530 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.819509 2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 17:17:11.820031 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.820011 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nml5k" May 28 17:17:11.820276 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.820257 2558 server.go:317] "Adding debug handlers to kubelet server" May 28 17:17:11.826543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.826512 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 17:17:11.827175 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.827150 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 17:17:11.827379 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.827361 2558 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 17:17:11.827379 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.827378 2558 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 17:17:11.827513 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.827503 2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 17:17:11.827564 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.827557 2558 reconstruct.go:97] "Volume reconstruction finished" May 28 17:17:11.827564 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.827564 2558 reconciler.go:26] "Reconciler: start to sync state" May 28 17:17:11.828115 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.828095 2558 factory.go:55] Registering systemd factory May 28 17:17:11.828115 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.828115 2558 factory.go:223] Registration of the systemd container factory successfully May 28 17:17:11.828366 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.828348 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:11.828529 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.828512 2558 factory.go:153] Registering CRI-O factory May 28 17:17:11.828585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.828535 2558 factory.go:223] Registration of the crio container factory successfully May 28 17:17:11.828632 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.828514 2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 17:17:11.828632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.828603 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 17:17:11.828729 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.828646 2558 factory.go:103] Registering Raw factory May 28 17:17:11.828729 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.828672 2558 manager.go:1196] Started watching for new ooms in manager May 28 17:17:11.829064 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.829050 2558 manager.go:319] Starting recovery of all containers May 28 17:17:11.830660 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.830634 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:11.836232 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.836183 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-182.ec2.internal\" not found" node="ip-10-0-130-182.ec2.internal" May 28 17:17:11.837162 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.837135 2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-182.ec2.internal" not found May 28 17:17:11.842328 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.842199 2558 manager.go:324] Recovery completed May 28 17:17:11.843546 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.843528 2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 28 17:17:11.846824 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.846799 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:11.849142 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.849126 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:11.849200 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.849157 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:11.849200 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.849169 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:11.849682 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.849665 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 17:17:11.849737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.849682 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 17:17:11.849737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.849734 2558 state_mem.go:36] "Initialized new in-memory state store" May 28 17:17:11.852180 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.852162 2558 policy_none.go:49] "None policy: Start" May 28 17:17:11.852180 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.852183 2558 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 17:17:11.852268 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.852196 2558 state_mem.go:35] "Initializing new in-memory state store" May 28 17:17:11.854667 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.854645 2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-182.ec2.internal" not found May 28 17:17:11.899651 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.899630 2558 manager.go:341] "Starting Device Plugin manager" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.899703 2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.899726 2558 server.go:85] "Starting device plugin registration server" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.900062 2558 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.900077 2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.900196 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.900291 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.900302 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.900963 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 17:17:11.913751 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.901006 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:11.915111 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.915090 2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-182.ec2.internal" not found May 28 17:17:11.969731 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.969635 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 17:17:11.970971 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.970952 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 17:17:11.971038 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.970981 2558 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 17:17:11.971038 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.971008 2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 17:17:11.971038 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.971015 2558 kubelet.go:2451] "Starting kubelet main sync loop" May 28 17:17:11.971159 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:11.971063 2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 17:17:11.974057 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:11.974033 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:12.001242 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.001210 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:12.002621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.002601 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:12.002737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.002632 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:12.002737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.002644 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:12.002737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.002676 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-182.ec2.internal" May 28 17:17:12.011218 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.011174 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-182.ec2.internal" May 28 17:17:12.011218 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.011204 2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-182.ec2.internal\": node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.027976 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.027935 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.072163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.072125 2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal"] May 28 17:17:12.072296 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.072209 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:12.074368 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.074349 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:12.074454 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.074383 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:12.074454 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.074396 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:12.075762 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.075747 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:12.075959 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.075945 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.076002 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.075975 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:12.076636 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.076620 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:12.076709 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.076650 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:12.076709 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.076660 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:12.076709 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.076620 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:12.076796 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.076735 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:12.076796 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.076748 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:12.077931 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.077914 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" May 28 17:17:12.078031 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.077943 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:12.078763 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.078745 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:12.078860 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.078773 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:12.078860 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.078783 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:12.108872 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.108836 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-182.ec2.internal\" not found" node="ip-10-0-130-182.ec2.internal" May 28 17:17:12.112961 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.112941 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-182.ec2.internal\" not found" node="ip-10-0-130-182.ec2.internal" May 28 17:17:12.128769 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.128735 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.128955 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.128934 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8763c4f52328516cdf43d9e2637f43ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal\" (UID: \"8763c4f52328516cdf43d9e2637f43ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.128997 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.128966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8763c4f52328516cdf43d9e2637f43ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal\" (UID: \"8763c4f52328516cdf43d9e2637f43ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.128997 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.128988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c1b0bd7a552c99e08577a389f430b84-config\") pod \"kube-apiserver-proxy-ip-10-0-130-182.ec2.internal\" (UID: \"6c1b0bd7a552c99e08577a389f430b84\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" May 28 17:17:12.229873 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.229759 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.229873 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.229826 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8763c4f52328516cdf43d9e2637f43ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal\" (UID: \"8763c4f52328516cdf43d9e2637f43ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.229873 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.229857 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8763c4f52328516cdf43d9e2637f43ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal\" (UID: \"8763c4f52328516cdf43d9e2637f43ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.229873 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.229872 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c1b0bd7a552c99e08577a389f430b84-config\") pod \"kube-apiserver-proxy-ip-10-0-130-182.ec2.internal\" (UID: \"6c1b0bd7a552c99e08577a389f430b84\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" May 28 17:17:12.230105 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.229906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8763c4f52328516cdf43d9e2637f43ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal\" (UID: \"8763c4f52328516cdf43d9e2637f43ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.230105 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.229912 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8763c4f52328516cdf43d9e2637f43ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal\" (UID: \"8763c4f52328516cdf43d9e2637f43ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.230105 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.229962 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c1b0bd7a552c99e08577a389f430b84-config\") pod \"kube-apiserver-proxy-ip-10-0-130-182.ec2.internal\" (UID: \"6c1b0bd7a552c99e08577a389f430b84\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" May 28 17:17:12.330550 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.330513 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.412798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.412751 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:12.415529 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.415506 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" May 28 17:17:12.431497 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.431456 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.531880 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.531838 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.632281 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.632243 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.729596 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.729560 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 17:17:12.730204 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.729721 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 17:17:12.730204 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.729766 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 17:17:12.732751 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.732725 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.822458 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.822413 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 17:12:11 +0000 UTC" deadline="2028-01-07 14:56:14.937560781 +0000 UTC" May 28 17:17:12.822458 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.822451 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14133h39m2.115113066s" May 28 17:17:12.827606 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.827580 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 17:17:12.833723 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.833679 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.849246 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.849213 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 17:17:12.869208 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.869174 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw2nx" May 28 17:17:12.877517 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.877488 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw2nx" May 28 17:17:12.899535 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.899488 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:12.917879 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:12.917839 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8763c4f52328516cdf43d9e2637f43ab.slice/crio-d14ca3f72ac03e8c9ce80e379434d5f921330d584c29bc78edaba273037bcaa6 WatchSource:0}: Error finding container d14ca3f72ac03e8c9ce80e379434d5f921330d584c29bc78edaba273037bcaa6: Status 404 returned error can't find the container with id d14ca3f72ac03e8c9ce80e379434d5f921330d584c29bc78edaba273037bcaa6 May 28 17:17:12.918164 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:12.918140 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1b0bd7a552c99e08577a389f430b84.slice/crio-9132bd66fd8a68812ff7053e8de7712686b18783d810993e3723817208f8a674 WatchSource:0}: Error finding container 9132bd66fd8a68812ff7053e8de7712686b18783d810993e3723817208f8a674: Status 404 returned error can't find the container with id 9132bd66fd8a68812ff7053e8de7712686b18783d810993e3723817208f8a674 May 28 17:17:12.921943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.921924 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:17:12.934688 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:12.934650 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:12.974846 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.974776 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" event={"ID":"8763c4f52328516cdf43d9e2637f43ab","Type":"ContainerStarted","Data":"d14ca3f72ac03e8c9ce80e379434d5f921330d584c29bc78edaba273037bcaa6"} May 28 17:17:12.978039 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:12.977998 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" event={"ID":"6c1b0bd7a552c99e08577a389f430b84","Type":"ContainerStarted","Data":"9132bd66fd8a68812ff7053e8de7712686b18783d810993e3723817208f8a674"} May 28 17:17:13.035434 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.035389 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:13.135926 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.135834 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:13.236319 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.236279 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-182.ec2.internal\" not found" May 28 17:17:13.251383 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.251343 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:13.328015 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.327955 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" May 28 17:17:13.339401 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.339364 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 17:17:13.340512 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.340484 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" May 28 17:17:13.349802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.349768 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 17:17:13.802915 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.802877 2558 apiserver.go:52] "Watching apiserver" May 28 17:17:13.810451 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.810416 2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 17:17:13.810995 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.810949 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-xn92p","openshift-multus/multus-zptlc","openshift-network-diagnostics/network-check-target-chx54","openshift-network-operator/iptables-alerter-fwc49","openshift-dns/node-resolver-7nzbr","openshift-image-registry/node-ca-vw5ws","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal","openshift-multus/network-metrics-daemon-tl7x7","openshift-ovn-kubernetes/ovnkube-node-pzncx","kube-system/konnectivity-agent-g966j","kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm","openshift-cluster-node-tuning-operator/tuned-ztzg9"] May 28 17:17:13.813071 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.813045 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g966j" May 28 17:17:13.814700 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.814676 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zptlc" May 28 17:17:13.815687 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.815635 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 17:17:13.815687 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.815686 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p7vz4\"" May 28 17:17:13.816172 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.816123 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:13.816272 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.816220 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:13.816778 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.816755 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 17:17:13.817264 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.817242 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 17:17:13.817384 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.817365 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 17:17:13.817596 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.817580 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 17:17:13.817750 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.817586 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lnx7k\"" May 28 17:17:13.817892 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.817802 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 17:17:13.820072 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.819981 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.821129 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.821105 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.822235 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.822210 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 17:17:13.822235 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.822198 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 17:17:13.822424 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.822289 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 17:17:13.822424 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.822294 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wgwlr\"" May 28 17:17:13.822513 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.822472 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.822640 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.822624 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:13.822723 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.822698 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:13.823148 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.823131 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 17:17:13.823243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.823173 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 17:17:13.823301 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.823273 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sswzk\"" May 28 17:17:13.824197 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.824177 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.824859 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.824832 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 17:17:13.824960 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.824832 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 17:17:13.824960 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.824871 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 17:17:13.824960 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.824835 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bx6ph\"" May 28 17:17:13.826130 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.826110 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 17:17:13.826265 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.826236 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.826387 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.826371 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 17:17:13.826836 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.826763 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 17:17:13.829243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.827775 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6lq8v\"" May 28 17:17:13.829243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.828261 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 17:17:13.829243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.828563 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 17:17:13.829243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.828787 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jvlzp\"" May 28 17:17:13.829243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.828886 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 17:17:13.829243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.829213 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 17:17:13.829610 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.829488 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 17:17:13.830698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.830524 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.832422 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.832396 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.832617 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.832550 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 17:17:13.832950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.832929 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27pb5\"" May 28 17:17:13.833043 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.832998 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 17:17:13.833524 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.833505 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 17:17:13.834880 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.834715 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 17:17:13.834880 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.834852 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ss4xm\"" May 28 17:17:13.835063 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.835040 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 17:17:13.840570 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-device-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.840689 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840584 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-var-lib-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.840689 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-system-cni-dir\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.840689 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-os-release\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.840868 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840712 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e46bbf10-a66d-4752-8215-f65b0656d4ee-agent-certs\") pod \"konnectivity-agent-g966j\" (UID: \"e46bbf10-a66d-4752-8215-f65b0656d4ee\") " pod="kube-system/konnectivity-agent-g966j" May 28 17:17:13.840868 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-ovn\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.840868 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-ovnkube-script-lib\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.840868 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-cni-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.841059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a7c3076-39c0-4727-af6d-e1230ea2cb75-hosts-file\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.841059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-socket-dir-parent\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.841059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-etc-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.840986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-env-overrides\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.841059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e46bbf10-a66d-4752-8215-f65b0656d4ee-konnectivity-ca\") pod \"konnectivity-agent-g966j\" (UID: \"e46bbf10-a66d-4752-8215-f65b0656d4ee\") " pod="kube-system/konnectivity-agent-g966j" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-os-release\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841147 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-node-log\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8twrc\" (UniqueName: \"kubernetes.io/projected/d2417ece-b70b-4476-9f06-cc37c636f24a-kube-api-access-8twrc\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cni-binary-copy\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr4tk\" (UniqueName: \"kubernetes.io/projected/cf37a3b2-f906-41a6-932d-6c3f51ba7492-kube-api-access-qr4tk\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-netns\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841319 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-systemd\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/576367f2-ba4c-4aec-8ce0-8028b106885a-host\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/576367f2-ba4c-4aec-8ce0-8028b106885a-serviceca\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841396 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-sys-fs\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-run-netns\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-cni-netd\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841592 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-cni-bin\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841614 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841635 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-system-cni-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-kubelet\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.841838 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-daemon-config\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctlc\" (UniqueName: \"kubernetes.io/projected/b1484c80-968a-49b6-9a96-5a196a9385ab-kube-api-access-4ctlc\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-iptables-alerter-script\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-host-slash\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-systemd-units\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.841988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1484c80-968a-49b6-9a96-5a196a9385ab-cni-binary-copy\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-conf-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-registration-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842103 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-kubelet\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2417ece-b70b-4476-9f06-cc37c636f24a-ovn-node-metrics-cert\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cnibin\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-hostroot\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-socket-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4pl8\" (UniqueName: \"kubernetes.io/projected/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-kube-api-access-x4pl8\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.842407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25cgq\" (UniqueName: \"kubernetes.io/projected/9a7c3076-39c0-4727-af6d-e1230ea2cb75-kube-api-access-25cgq\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-cni-multus\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqbwn\" (UniqueName: \"kubernetes.io/projected/576367f2-ba4c-4aec-8ce0-8028b106885a-kube-api-access-cqbwn\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvvn\" (UniqueName: \"kubernetes.io/projected/94e63360-d78d-4910-9edb-b0f72ad0f24e-kube-api-access-jcvvn\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842373 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-slash\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-log-socket\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-ovnkube-config\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-k8s-cni-cncf-io\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-multus-certs\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9j6r\" (UniqueName: \"kubernetes.io/projected/4d622259-85d3-4b8f-b79c-93a95ff01b04-kube-api-access-v9j6r\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a7c3076-39c0-4727-af6d-e1230ea2cb75-tmp-dir\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-cnibin\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-etc-kubernetes\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.843164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.842581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-cni-bin\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.862188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.862157 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:13.878676 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.878635 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:12 +0000 UTC" deadline="2027-11-28 20:51:08.2460579 +0000 UTC" May 28 17:17:13.878676 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.878673 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13179h33m54.367388575s" May 28 17:17:13.928729 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.928688 2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 17:17:13.943442 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943394 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:13.943442 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943451 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-slash\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.943677 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943476 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-log-socket\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.943677 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943504 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-ovnkube-config\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.943677 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943525 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-k8s-cni-cncf-io\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943677 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943549 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-multus-certs\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943677 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.943572 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:13.943677 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysctl-d\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943688 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9j6r\" (UniqueName: \"kubernetes.io/projected/4d622259-85d3-4b8f-b79c-93a95ff01b04-kube-api-access-v9j6r\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943711 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-k8s-cni-cncf-io\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943719 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-multus-certs\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943720 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a7c3076-39c0-4727-af6d-e1230ea2cb75-tmp-dir\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.943780 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:14.443745486 +0000 UTC m=+3.072436957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943788 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-slash\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943804 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-cnibin\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943847 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-etc-kubernetes\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-etc-kubernetes\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943897 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-log-socket\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-cnibin\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.943949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysconfig\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.943979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-kubernetes\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944008 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-var-lib-kubelet\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a7c3076-39c0-4727-af6d-e1230ea2cb75-tmp-dir\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-cni-bin\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944061 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-cni-bin\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944156 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-etc-selinux\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944163 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-device-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-device-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944208 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-var-lib-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944230 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-system-cni-dir\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944245 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-ovnkube-config\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944248 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-os-release\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944302 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-var-lib-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-system-cni-dir\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-os-release\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.944411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944349 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e46bbf10-a66d-4752-8215-f65b0656d4ee-agent-certs\") pod \"konnectivity-agent-g966j\" (UID: \"e46bbf10-a66d-4752-8215-f65b0656d4ee\") " pod="kube-system/konnectivity-agent-g966j" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5npgr\" (UniqueName: \"kubernetes.io/projected/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-kube-api-access-5npgr\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944409 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-ovn\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944436 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-ovnkube-script-lib\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944462 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-cni-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944478 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-ovn\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-lib-modules\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944541 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a7c3076-39c0-4727-af6d-e1230ea2cb75-hosts-file\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944549 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-cni-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944571 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-socket-dir-parent\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a7c3076-39c0-4727-af6d-e1230ea2cb75-hosts-file\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-sys\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944645 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-etc-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944649 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-socket-dir-parent\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944670 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-env-overrides\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944688 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944702 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944712 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-etc-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.945195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944729 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e46bbf10-a66d-4752-8215-f65b0656d4ee-konnectivity-ca\") pod \"konnectivity-agent-g966j\" (UID: \"e46bbf10-a66d-4752-8215-f65b0656d4ee\") " pod="kube-system/konnectivity-agent-g966j" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944755 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-os-release\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944783 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-modprobe-d\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-tuned\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944852 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-os-release\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944854 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944882 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-node-log\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944902 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8twrc\" (UniqueName: \"kubernetes.io/projected/d2417ece-b70b-4476-9f06-cc37c636f24a-kube-api-access-8twrc\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944920 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cni-binary-copy\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944935 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944953 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr4tk\" (UniqueName: \"kubernetes.io/projected/cf37a3b2-f906-41a6-932d-6c3f51ba7492-kube-api-access-qr4tk\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-node-log\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-ovnkube-script-lib\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945020 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-netns\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944976 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-run-netns\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945053 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2417ece-b70b-4476-9f06-cc37c636f24a-env-overrides\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-run\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945104 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-systemd\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945149 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/576367f2-ba4c-4aec-8ce0-8028b106885a-host\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945179 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/576367f2-ba4c-4aec-8ce0-8028b106885a-serviceca\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945203 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-sys-fs\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945229 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-run-netns\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945254 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945275 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945279 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-cni-netd\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945323 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-systemd\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.944900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-run-openvswitch\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/576367f2-ba4c-4aec-8ce0-8028b106885a-host\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-sys-fs\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945418 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-cni-netd\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945463 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945494 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-cni-bin\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945521 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945571 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-system-cni-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.946757 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945576 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cni-binary-copy\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e46bbf10-a66d-4752-8215-f65b0656d4ee-konnectivity-ca\") pod \"konnectivity-agent-g966j\" (UID: \"e46bbf10-a66d-4752-8215-f65b0656d4ee\") " pod="kube-system/konnectivity-agent-g966j" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945600 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-kubelet\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945620 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945627 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-daemon-config\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945641 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-cni-bin\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/576367f2-ba4c-4aec-8ce0-8028b106885a-serviceca\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945672 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-run-netns\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-kubelet\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945737 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-system-cni-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945766 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctlc\" (UniqueName: \"kubernetes.io/projected/b1484c80-968a-49b6-9a96-5a196a9385ab-kube-api-access-4ctlc\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945803 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.945949 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-iptables-alerter-script\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946052 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-daemon-config\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946056 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-host-slash\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.947407 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946120 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-systemd-units\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-host-slash\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946180 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1484c80-968a-49b6-9a96-5a196a9385ab-cni-binary-copy\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946205 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-conf-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946245 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-systemd-units\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysctl-conf\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946294 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-multus-conf-dir\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946332 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946361 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-registration-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946389 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-kubelet\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946405 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2417ece-b70b-4476-9f06-cc37c636f24a-ovn-node-metrics-cert\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946422 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cnibin\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946429 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946437 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-hostroot\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-hostroot\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946479 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-socket-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946500 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-registration-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.947965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4pl8\" (UniqueName: \"kubernetes.io/projected/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-kube-api-access-x4pl8\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-iptables-alerter-script\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946538 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25cgq\" (UniqueName: \"kubernetes.io/projected/9a7c3076-39c0-4727-af6d-e1230ea2cb75-kube-api-access-25cgq\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946564 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-cni-multus\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf37a3b2-f906-41a6-932d-6c3f51ba7492-cnibin\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946592 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-systemd\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2417ece-b70b-4476-9f06-cc37c636f24a-host-kubelet\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946626 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94e63360-d78d-4910-9edb-b0f72ad0f24e-socket-dir\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946652 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1484c80-968a-49b6-9a96-5a196a9385ab-host-var-lib-cni-multus\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946663 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1484c80-968a-49b6-9a96-5a196a9385ab-cni-binary-copy\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-host\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-tmp\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946767 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqbwn\" (UniqueName: \"kubernetes.io/projected/576367f2-ba4c-4aec-8ce0-8028b106885a-kube-api-access-cqbwn\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.946796 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvvn\" (UniqueName: \"kubernetes.io/projected/94e63360-d78d-4910-9edb-b0f72ad0f24e-kube-api-access-jcvvn\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.948753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.948755 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e46bbf10-a66d-4752-8215-f65b0656d4ee-agent-certs\") pod \"konnectivity-agent-g966j\" (UID: \"e46bbf10-a66d-4752-8215-f65b0656d4ee\") " pod="kube-system/konnectivity-agent-g966j" May 28 17:17:13.949442 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.949178 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2417ece-b70b-4476-9f06-cc37c636f24a-ovn-node-metrics-cert\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.955566 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.955466 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9j6r\" (UniqueName: \"kubernetes.io/projected/4d622259-85d3-4b8f-b79c-93a95ff01b04-kube-api-access-v9j6r\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:13.957059 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.956684 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:13.957059 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.956715 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:13.957059 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.956729 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gzbk8 for pod openshift-network-diagnostics/network-check-target-chx54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:13.957059 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:13.956829 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8 podName:293f6a4b-e3c6-4520-aad8-44a25990b7a8 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:14.456789599 +0000 UTC m=+3.085481061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gzbk8" (UniqueName: "kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8") pod "network-check-target-chx54" (UID: "293f6a4b-e3c6-4520-aad8-44a25990b7a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:13.959144 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.957656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8twrc\" (UniqueName: \"kubernetes.io/projected/d2417ece-b70b-4476-9f06-cc37c636f24a-kube-api-access-8twrc\") pod \"ovnkube-node-pzncx\" (UID: \"d2417ece-b70b-4476-9f06-cc37c636f24a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:13.959144 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.957692 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4pl8\" (UniqueName: \"kubernetes.io/projected/7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18-kube-api-access-x4pl8\") pod \"iptables-alerter-fwc49\" (UID: \"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18\") " pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:13.960976 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.960948 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqbwn\" (UniqueName: \"kubernetes.io/projected/576367f2-ba4c-4aec-8ce0-8028b106885a-kube-api-access-cqbwn\") pod \"node-ca-vw5ws\" (UID: \"576367f2-ba4c-4aec-8ce0-8028b106885a\") " pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:13.962093 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.962065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr4tk\" (UniqueName: \"kubernetes.io/projected/cf37a3b2-f906-41a6-932d-6c3f51ba7492-kube-api-access-qr4tk\") pod \"multus-additional-cni-plugins-xn92p\" (UID: \"cf37a3b2-f906-41a6-932d-6c3f51ba7492\") " pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:13.962220 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.962197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvvn\" (UniqueName: \"kubernetes.io/projected/94e63360-d78d-4910-9edb-b0f72ad0f24e-kube-api-access-jcvvn\") pod \"aws-ebs-csi-driver-node-kw4nm\" (UID: \"94e63360-d78d-4910-9edb-b0f72ad0f24e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:13.962299 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.962272 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25cgq\" (UniqueName: \"kubernetes.io/projected/9a7c3076-39c0-4727-af6d-e1230ea2cb75-kube-api-access-25cgq\") pod \"node-resolver-7nzbr\" (UID: \"9a7c3076-39c0-4727-af6d-e1230ea2cb75\") " pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:13.963165 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:13.963138 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctlc\" (UniqueName: \"kubernetes.io/projected/b1484c80-968a-49b6-9a96-5a196a9385ab-kube-api-access-4ctlc\") pod \"multus-zptlc\" (UID: \"b1484c80-968a-49b6-9a96-5a196a9385ab\") " pod="openshift-multus/multus-zptlc" May 28 17:17:14.047395 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047357 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysctl-conf\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047395 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047403 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-systemd\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047422 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-host\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047438 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-tmp\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047464 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysctl-d\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047485 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysconfig\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047500 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-kubernetes\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047504 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-host\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047504 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-systemd\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047517 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-var-lib-kubelet\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysconfig\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047556 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysctl-conf\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047588 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5npgr\" (UniqueName: \"kubernetes.io/projected/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-kube-api-access-5npgr\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-var-lib-kubelet\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047599 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-kubernetes\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.047621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047607 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-lib-modules\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047652 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-sys\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047671 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-modprobe-d\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-lib-modules\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047667 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-sysctl-d\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047706 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-sys\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047713 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-tuned\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047732 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-run\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-modprobe-d\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.047782 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-run\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.049777 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.049745 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-etc-tuned\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.049911 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.049889 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-tmp\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.057742 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.057660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5npgr\" (UniqueName: \"kubernetes.io/projected/d1a9944d-26d1-47bf-bdd3-468cf2acf1c3-kube-api-access-5npgr\") pod \"tuned-ztzg9\" (UID: \"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3\") " pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.128532 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.128499 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g966j" May 28 17:17:14.135517 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.135479 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zptlc" May 28 17:17:14.146347 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.146307 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwc49" May 28 17:17:14.152317 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.152283 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7nzbr" May 28 17:17:14.159141 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.159109 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vw5ws" May 28 17:17:14.166975 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.166944 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:14.173787 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.173755 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xn92p" May 28 17:17:14.181625 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.181594 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" May 28 17:17:14.187448 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.187411 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" May 28 17:17:14.277376 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.277344 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:14.450323 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.450233 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:14.450488 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:14.450389 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:14.450488 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:14.450474 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:15.450454295 +0000 UTC m=+4.079145747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:14.551331 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.551277 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:14.551495 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:14.551451 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:14.551495 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:14.551474 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:14.551495 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:14.551486 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gzbk8 for pod openshift-network-diagnostics/network-check-target-chx54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:14.551608 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:14.551542 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8 podName:293f6a4b-e3c6-4520-aad8-44a25990b7a8 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:15.551526942 +0000 UTC m=+4.180218393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzbk8" (UniqueName: "kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8") pod "network-check-target-chx54" (UID: "293f6a4b-e3c6-4520-aad8-44a25990b7a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:14.574209 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.574184 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2417ece_b70b_4476_9f06_cc37c636f24a.slice/crio-6c65ef3efbfbd0fba9323ed704248c9ee6eee0388e9031f7ec1d1061ab519384 WatchSource:0}: Error finding container 6c65ef3efbfbd0fba9323ed704248c9ee6eee0388e9031f7ec1d1061ab519384: Status 404 returned error can't find the container with id 6c65ef3efbfbd0fba9323ed704248c9ee6eee0388e9031f7ec1d1061ab519384 May 28 17:17:14.575354 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.575320 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a9944d_26d1_47bf_bdd3_468cf2acf1c3.slice/crio-61d0c45305f9fd635ce377cd307d663e2cc8d43a77b03bed42c80b74477e044f WatchSource:0}: Error finding container 61d0c45305f9fd635ce377cd307d663e2cc8d43a77b03bed42c80b74477e044f: Status 404 returned error can't find the container with id 61d0c45305f9fd635ce377cd307d663e2cc8d43a77b03bed42c80b74477e044f May 28 17:17:14.580393 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.580366 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1484c80_968a_49b6_9a96_5a196a9385ab.slice/crio-c73391e9112c1b66c126e22b027e197b414b3516f6ca1a748015469c2a142baf WatchSource:0}: Error finding container c73391e9112c1b66c126e22b027e197b414b3516f6ca1a748015469c2a142baf: Status 404 returned error can't find the container with id c73391e9112c1b66c126e22b027e197b414b3516f6ca1a748015469c2a142baf May 28 17:17:14.580994 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.580980 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576367f2_ba4c_4aec_8ce0_8028b106885a.slice/crio-420246539fc54117899bd1bd6253ba79c38e766cff2681121269eed544f6bdd6 WatchSource:0}: Error finding container 420246539fc54117899bd1bd6253ba79c38e766cff2681121269eed544f6bdd6: Status 404 returned error can't find the container with id 420246539fc54117899bd1bd6253ba79c38e766cff2681121269eed544f6bdd6 May 28 17:17:14.582148 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.582055 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c501a4d_dc6b_4832_8df3_6ebe3f4c2a18.slice/crio-714e2bbde88e93b669d4e444c6714f2feb425f3a3194486e1b08d3028ce98494 WatchSource:0}: Error finding container 714e2bbde88e93b669d4e444c6714f2feb425f3a3194486e1b08d3028ce98494: Status 404 returned error can't find the container with id 714e2bbde88e93b669d4e444c6714f2feb425f3a3194486e1b08d3028ce98494 May 28 17:17:14.583792 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.583436 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf37a3b2_f906_41a6_932d_6c3f51ba7492.slice/crio-c31d4ef688c534327635d25d1ea85dc0481fcdc31ae8ca966ec5908430fdb087 WatchSource:0}: Error finding container c31d4ef688c534327635d25d1ea85dc0481fcdc31ae8ca966ec5908430fdb087: Status 404 returned error can't find the container with id c31d4ef688c534327635d25d1ea85dc0481fcdc31ae8ca966ec5908430fdb087 May 28 17:17:14.584319 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.584294 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46bbf10_a66d_4752_8215_f65b0656d4ee.slice/crio-ef52e73153106b0081fde4b43a21174058abea95c469704b9aaeba4cca7576fa WatchSource:0}: Error finding container ef52e73153106b0081fde4b43a21174058abea95c469704b9aaeba4cca7576fa: Status 404 returned error can't find the container with id ef52e73153106b0081fde4b43a21174058abea95c469704b9aaeba4cca7576fa May 28 17:17:14.585259 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.585238 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7c3076_39c0_4727_af6d_e1230ea2cb75.slice/crio-da3a2dddea53695df67b7bc73093ab32b26e283afb25862d4e33d0943895d557 WatchSource:0}: Error finding container da3a2dddea53695df67b7bc73093ab32b26e283afb25862d4e33d0943895d557: Status 404 returned error can't find the container with id da3a2dddea53695df67b7bc73093ab32b26e283afb25862d4e33d0943895d557 May 28 17:17:14.587687 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:14.587661 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e63360_d78d_4910_9edb_b0f72ad0f24e.slice/crio-8ea6dadf068ba750ffdbb8dd0a80d022710d8fd8032fab302e54e4bb33c293ea WatchSource:0}: Error finding container 8ea6dadf068ba750ffdbb8dd0a80d022710d8fd8032fab302e54e4bb33c293ea: Status 404 returned error can't find the container with id 8ea6dadf068ba750ffdbb8dd0a80d022710d8fd8032fab302e54e4bb33c293ea May 28 17:17:14.879450 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.879257 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:12 +0000 UTC" deadline="2028-01-21 08:09:32.857185626 +0000 UTC" May 28 17:17:14.879450 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.879446 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14462h52m17.977744194s" May 28 17:17:14.984141 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.984083 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" event={"ID":"6c1b0bd7a552c99e08577a389f430b84","Type":"ContainerStarted","Data":"96683c469f87e02fba24f66091a5f27041e4b989ad38a921e8218a58e4060e3e"} May 28 17:17:14.998841 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:14.997210 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" event={"ID":"94e63360-d78d-4910-9edb-b0f72ad0f24e","Type":"ContainerStarted","Data":"8ea6dadf068ba750ffdbb8dd0a80d022710d8fd8032fab302e54e4bb33c293ea"} May 28 17:17:15.002482 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.002407 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g966j" event={"ID":"e46bbf10-a66d-4752-8215-f65b0656d4ee","Type":"ContainerStarted","Data":"ef52e73153106b0081fde4b43a21174058abea95c469704b9aaeba4cca7576fa"} May 28 17:17:15.011110 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.011043 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwc49" event={"ID":"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18","Type":"ContainerStarted","Data":"714e2bbde88e93b669d4e444c6714f2feb425f3a3194486e1b08d3028ce98494"} May 28 17:17:15.013889 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.013802 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vw5ws" event={"ID":"576367f2-ba4c-4aec-8ce0-8028b106885a","Type":"ContainerStarted","Data":"420246539fc54117899bd1bd6253ba79c38e766cff2681121269eed544f6bdd6"} May 28 17:17:15.015677 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.015616 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zptlc" event={"ID":"b1484c80-968a-49b6-9a96-5a196a9385ab","Type":"ContainerStarted","Data":"c73391e9112c1b66c126e22b027e197b414b3516f6ca1a748015469c2a142baf"} May 28 17:17:15.017188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.017132 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" event={"ID":"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3","Type":"ContainerStarted","Data":"61d0c45305f9fd635ce377cd307d663e2cc8d43a77b03bed42c80b74477e044f"} May 28 17:17:15.021872 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.021778 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7nzbr" event={"ID":"9a7c3076-39c0-4727-af6d-e1230ea2cb75","Type":"ContainerStarted","Data":"da3a2dddea53695df67b7bc73093ab32b26e283afb25862d4e33d0943895d557"} May 28 17:17:15.023598 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.023536 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerStarted","Data":"c31d4ef688c534327635d25d1ea85dc0481fcdc31ae8ca966ec5908430fdb087"} May 28 17:17:15.026455 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.026390 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"6c65ef3efbfbd0fba9323ed704248c9ee6eee0388e9031f7ec1d1061ab519384"} May 28 17:17:15.029295 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.029206 2558 generic.go:358] "Generic (PLEG): container finished" podID="8763c4f52328516cdf43d9e2637f43ab" containerID="f783c46cf1bea89eed0aaa36e5cd46a62623d74a35e65323d695cc3d8f944bbc" exitCode=0 May 28 17:17:15.029295 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.029254 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" event={"ID":"8763c4f52328516cdf43d9e2637f43ab","Type":"ContainerDied","Data":"f783c46cf1bea89eed0aaa36e5cd46a62623d74a35e65323d695cc3d8f944bbc"} May 28 17:17:15.046035 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.045387 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-182.ec2.internal" podStartSLOduration=2.045364573 podStartE2EDuration="2.045364573s" podCreationTimestamp="2026-05-28 17:17:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:17:15.010262592 +0000 UTC m=+3.638954062" watchObservedRunningTime="2026-05-28 17:17:15.045364573 +0000 UTC m=+3.674056044" May 28 17:17:15.458621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.458530 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:15.458794 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.458675 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:15.458794 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.458741 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:17.45872237 +0000 UTC m=+6.087413831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:15.559289 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.559247 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:15.559466 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.559443 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:15.559466 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.559461 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:15.559567 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.559474 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gzbk8 for pod openshift-network-diagnostics/network-check-target-chx54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:15.559567 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.559547 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8 podName:293f6a4b-e3c6-4520-aad8-44a25990b7a8 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:17.559527917 +0000 UTC m=+6.188219367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzbk8" (UniqueName: "kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8") pod "network-check-target-chx54" (UID: "293f6a4b-e3c6-4520-aad8-44a25990b7a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:15.972119 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.972081 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:15.972565 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.972240 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:15.972565 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:15.972337 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:15.972565 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:15.972405 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:16.049597 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.049561 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" event={"ID":"8763c4f52328516cdf43d9e2637f43ab","Type":"ContainerStarted","Data":"1292bc7ad6a51a4078b6427df48f6cda1bd1520c2c573d58a21f79ce01817a12"} May 28 17:17:16.508799 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.507598 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-182.ec2.internal" podStartSLOduration=3.5075756609999997 podStartE2EDuration="3.507575661s" podCreationTimestamp="2026-05-28 17:17:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:17:16.066775423 +0000 UTC m=+4.695466893" watchObservedRunningTime="2026-05-28 17:17:16.507575661 +0000 UTC m=+5.136267131" May 28 17:17:16.508799 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.507982 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mc9xw"] May 28 17:17:16.510643 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.510190 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.510643 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:16.510278 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:16.568231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.567995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78e38760-b1d6-404c-a607-7acd976da96b-dbus\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.568231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.568088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.568231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.568122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78e38760-b1d6-404c-a607-7acd976da96b-kubelet-config\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.669536 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.668658 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78e38760-b1d6-404c-a607-7acd976da96b-dbus\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.669536 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.668763 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.669536 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.668800 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78e38760-b1d6-404c-a607-7acd976da96b-kubelet-config\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.669536 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.668931 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78e38760-b1d6-404c-a607-7acd976da96b-kubelet-config\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.669536 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:16.669073 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78e38760-b1d6-404c-a607-7acd976da96b-dbus\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:16.669536 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:16.669178 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:17:16.669536 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:16.669242 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret podName:78e38760-b1d6-404c-a607-7acd976da96b nodeName:}" failed. No retries permitted until 2026-05-28 17:17:17.169222867 +0000 UTC m=+5.797914328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret") pod "global-pull-secret-syncer-mc9xw" (UID: "78e38760-b1d6-404c-a607-7acd976da96b") : object "kube-system"/"original-pull-secret" not registered May 28 17:17:17.175220 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:17.174341 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:17.175220 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.174522 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:17:17.175220 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.174585 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret podName:78e38760-b1d6-404c-a607-7acd976da96b nodeName:}" failed. No retries permitted until 2026-05-28 17:17:18.174567467 +0000 UTC m=+6.803258918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret") pod "global-pull-secret-syncer-mc9xw" (UID: "78e38760-b1d6-404c-a607-7acd976da96b") : object "kube-system"/"original-pull-secret" not registered May 28 17:17:17.477469 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:17.476756 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:17.477469 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.476939 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:17.477469 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.477008 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:21.476987874 +0000 UTC m=+10.105679328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:17.577585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:17.577370 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:17.577585 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.577558 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:17.577585 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.577577 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:17.577585 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.577590 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gzbk8 for pod openshift-network-diagnostics/network-check-target-chx54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:17.577928 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.577656 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8 podName:293f6a4b-e3c6-4520-aad8-44a25990b7a8 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:21.577637928 +0000 UTC m=+10.206329382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzbk8" (UniqueName: "kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8") pod "network-check-target-chx54" (UID: "293f6a4b-e3c6-4520-aad8-44a25990b7a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:17.972069 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:17.971898 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:17.972069 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.972034 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:17.972321 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:17.972114 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:17.972321 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.972228 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:17.972321 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:17.972307 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:17.972476 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:17.972395 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:18.183955 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:18.183906 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:18.184355 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:18.184069 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:17:18.184355 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:18.184143 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret podName:78e38760-b1d6-404c-a607-7acd976da96b nodeName:}" failed. No retries permitted until 2026-05-28 17:17:20.184124014 +0000 UTC m=+8.812815473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret") pod "global-pull-secret-syncer-mc9xw" (UID: "78e38760-b1d6-404c-a607-7acd976da96b") : object "kube-system"/"original-pull-secret" not registered May 28 17:17:19.971331 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:19.971294 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:19.971794 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:19.971335 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:19.971794 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:19.971335 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:19.971794 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:19.971417 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:19.971794 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:19.971531 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:19.971794 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:19.971610 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:20.203453 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:20.203413 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:20.203636 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:20.203604 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:17:20.203716 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:20.203704 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret podName:78e38760-b1d6-404c-a607-7acd976da96b nodeName:}" failed. No retries permitted until 2026-05-28 17:17:24.203680149 +0000 UTC m=+12.832371597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret") pod "global-pull-secret-syncer-mc9xw" (UID: "78e38760-b1d6-404c-a607-7acd976da96b") : object "kube-system"/"original-pull-secret" not registered May 28 17:17:21.515365 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:21.515330 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:21.515893 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.515477 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:21.515893 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.515551 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:29.515530209 +0000 UTC m=+18.144221676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:21.616686 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:21.616280 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:21.616686 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.616515 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:21.616686 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.616535 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:21.616686 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.616548 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gzbk8 for pod openshift-network-diagnostics/network-check-target-chx54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:21.616686 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.616613 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8 podName:293f6a4b-e3c6-4520-aad8-44a25990b7a8 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:29.616593909 +0000 UTC m=+18.245285370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzbk8" (UniqueName: "kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8") pod "network-check-target-chx54" (UID: "293f6a4b-e3c6-4520-aad8-44a25990b7a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:21.972865 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:21.972297 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:21.972865 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.972419 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:21.972865 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:21.972540 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:21.972865 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:21.972657 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:21.972865 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.972739 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:21.972865 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:21.972715 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:23.971707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:23.971670 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:23.972293 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:23.971785 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:23.972293 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:23.972249 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:23.972421 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:23.972347 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:23.972466 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:23.972442 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:23.972547 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:23.972527 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:24.239187 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:24.239090 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:24.239341 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:24.239219 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:17:24.239341 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:24.239284 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret podName:78e38760-b1d6-404c-a607-7acd976da96b nodeName:}" failed. No retries permitted until 2026-05-28 17:17:32.239267591 +0000 UTC m=+20.867959039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret") pod "global-pull-secret-syncer-mc9xw" (UID: "78e38760-b1d6-404c-a607-7acd976da96b") : object "kube-system"/"original-pull-secret" not registered May 28 17:17:25.971842 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:25.971787 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:25.972322 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:25.971931 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:25.972322 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:25.971943 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:25.972322 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:25.972050 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:25.972322 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:25.972114 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:25.972322 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:25.972206 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:27.971682 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:27.971640 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:27.972195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:27.971640 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:27.972195 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:27.971775 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:27.972195 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:27.971654 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:27.972195 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:27.971913 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:27.972195 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:27.971961 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:29.573932 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:29.573893 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:29.574351 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.574079 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:29.574351 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.574151 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:45.574130518 +0000 UTC m=+34.202821982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:29.674553 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:29.674503 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:29.674729 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.674689 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:29.674729 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.674710 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:29.674729 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.674720 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gzbk8 for pod openshift-network-diagnostics/network-check-target-chx54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:29.674890 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.674793 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8 podName:293f6a4b-e3c6-4520-aad8-44a25990b7a8 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:45.674772576 +0000 UTC m=+34.303464056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzbk8" (UniqueName: "kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8") pod "network-check-target-chx54" (UID: "293f6a4b-e3c6-4520-aad8-44a25990b7a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:29.972062 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:29.971972 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:29.972254 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:29.971972 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:29.972254 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.972115 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:29.972254 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:29.971977 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:29.972254 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.972217 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:29.972440 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:29.972274 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:31.972182 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:31.972143 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:31.972182 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:31.972178 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:31.972861 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:31.972254 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:31.972861 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:31.972308 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:31.972861 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:31.972300 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:31.972861 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:31.972390 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:32.296176 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:32.296130 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:32.296345 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:32.296293 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:17:32.296410 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:32.296373 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret podName:78e38760-b1d6-404c-a607-7acd976da96b nodeName:}" failed. No retries permitted until 2026-05-28 17:17:48.296351318 +0000 UTC m=+36.925042786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret") pod "global-pull-secret-syncer-mc9xw" (UID: "78e38760-b1d6-404c-a607-7acd976da96b") : object "kube-system"/"original-pull-secret" not registered May 28 17:17:33.084263 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.084063 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" event={"ID":"94e63360-d78d-4910-9edb-b0f72ad0f24e","Type":"ContainerStarted","Data":"e958c94ec65d8ad697d3bb7ed9a8c0a7e98b49ab2531263d57e570aee26b75db"} May 28 17:17:33.085379 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.085342 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g966j" event={"ID":"e46bbf10-a66d-4752-8215-f65b0656d4ee","Type":"ContainerStarted","Data":"4734d147d5e92b3e31af17b866e2351585ecbe5267a5f5fe894eee8362596f94"} May 28 17:17:33.086721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.086694 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vw5ws" event={"ID":"576367f2-ba4c-4aec-8ce0-8028b106885a","Type":"ContainerStarted","Data":"0153f54cfd96fd81c7d2d1980431c9ee9d06dc3258db4519b1f52253779a2c5d"} May 28 17:17:33.088021 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.087992 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zptlc" event={"ID":"b1484c80-968a-49b6-9a96-5a196a9385ab","Type":"ContainerStarted","Data":"1395300e0d9909c843e1c291c2f98dc86c11cf7cdc4b15ffbe0cbade8ea0ca99"} May 28 17:17:33.089256 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.089227 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" event={"ID":"d1a9944d-26d1-47bf-bdd3-468cf2acf1c3","Type":"ContainerStarted","Data":"74899d0c54574e3fddd7f4ec2a77c4b87748a4c8737573dd1fbe4667de94c451"} May 28 17:17:33.090372 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.090349 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7nzbr" event={"ID":"9a7c3076-39c0-4727-af6d-e1230ea2cb75","Type":"ContainerStarted","Data":"4ef5be28cd6ed110af078a2dfd8c62762d302f768461feacce7d096e8d94fd15"} May 28 17:17:33.091449 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.091425 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf37a3b2-f906-41a6-932d-6c3f51ba7492" containerID="4e263418a71ccf56bd1bf2880a19b34dedac88413549430ad776a95563bbfbc4" exitCode=0 May 28 17:17:33.091521 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.091497 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerDied","Data":"4e263418a71ccf56bd1bf2880a19b34dedac88413549430ad776a95563bbfbc4"} May 28 17:17:33.093392 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.093358 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:17:33.093736 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.093708 2558 generic.go:358] "Generic (PLEG): container finished" podID="d2417ece-b70b-4476-9f06-cc37c636f24a" containerID="39bfc036ff92fab286a8efebc7d9059f86b2a2d8eb26dd92bad4077841d7ef8e" exitCode=1 May 28 17:17:33.093824 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.093753 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"5fe5dc262b2e787844d32ab1ebcbf73596530e18cdf470d55428f819fd503514"} May 28 17:17:33.093824 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.093777 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"2ec17fa1ed12eff9e2b1cf1f3b94019e51138519f7551375ed79e5dca0c41f61"} May 28 17:17:33.093824 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.093791 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerDied","Data":"39bfc036ff92fab286a8efebc7d9059f86b2a2d8eb26dd92bad4077841d7ef8e"} May 28 17:17:33.093914 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.093805 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"0c7ebd4d5172f66cecca1e1b862ff51c1974b90ce7e8455c065003a549799f32"} May 28 17:17:33.102482 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.102430 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g966j" podStartSLOduration=3.210669489 podStartE2EDuration="21.102416452s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.587799133 +0000 UTC m=+3.216490582" lastFinishedPulling="2026-05-28 17:17:32.479546083 +0000 UTC m=+21.108237545" observedRunningTime="2026-05-28 17:17:33.101731884 +0000 UTC m=+21.730423354" watchObservedRunningTime="2026-05-28 17:17:33.102416452 +0000 UTC m=+21.731107920" May 28 17:17:33.140738 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.140458 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vw5ws" podStartSLOduration=6.783596556 podStartE2EDuration="21.140436302s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.583543988 +0000 UTC m=+3.212235435" lastFinishedPulling="2026-05-28 17:17:28.940383726 +0000 UTC m=+17.569075181" observedRunningTime="2026-05-28 17:17:33.118324488 +0000 UTC m=+21.747015961" watchObservedRunningTime="2026-05-28 17:17:33.140436302 +0000 UTC m=+21.769127772" May 28 17:17:33.159531 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.159475 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zptlc" podStartSLOduration=3.161494806 podStartE2EDuration="21.15945839s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.583057522 +0000 UTC m=+3.211748991" lastFinishedPulling="2026-05-28 17:17:32.581021109 +0000 UTC m=+21.209712575" observedRunningTime="2026-05-28 17:17:33.15900686 +0000 UTC m=+21.787698329" watchObservedRunningTime="2026-05-28 17:17:33.15945839 +0000 UTC m=+21.788149859" May 28 17:17:33.173898 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.173843 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7nzbr" podStartSLOduration=3.282656266 podStartE2EDuration="21.173826207s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.588377578 +0000 UTC m=+3.217069040" lastFinishedPulling="2026-05-28 17:17:32.479547527 +0000 UTC m=+21.108238981" observedRunningTime="2026-05-28 17:17:33.173598095 +0000 UTC m=+21.802289565" watchObservedRunningTime="2026-05-28 17:17:33.173826207 +0000 UTC m=+21.802517667" May 28 17:17:33.191388 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.191332 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ztzg9" podStartSLOduration=3.244716677 podStartE2EDuration="21.191315757s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.577996225 +0000 UTC m=+3.206687674" lastFinishedPulling="2026-05-28 17:17:32.524595302 +0000 UTC m=+21.153286754" observedRunningTime="2026-05-28 17:17:33.190907599 +0000 UTC m=+21.819599067" watchObservedRunningTime="2026-05-28 17:17:33.191315757 +0000 UTC m=+21.820007277" May 28 17:17:33.972343 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.972266 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:33.972567 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.972359 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:33.972567 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:33.972279 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:33.972567 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:33.972447 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:33.972567 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:33.972496 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:33.972567 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:33.972561 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:34.100133 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.100103 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:17:34.100835 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.100528 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"5d403a02042a1a8a7b8cb9f594f9c2be44dd84f2e7c9c4516ae157404f11e92d"} May 28 17:17:34.100835 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.100579 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"eaebfa7933c41f0eb38913e047e3304acb736146c50c2faa4f46f64d53fbb566"} May 28 17:17:34.102322 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.102148 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwc49" event={"ID":"7c501a4d-dc6b-4832-8df3-6ebe3f4c2a18","Type":"ContainerStarted","Data":"8ff0af4d34fc684d46e2cb1ac2f13f0a092556af6f0dec2cd15043c101d13750"} May 28 17:17:34.118941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.118894 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fwc49" podStartSLOduration=4.224556139 podStartE2EDuration="22.11887755s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.585315769 +0000 UTC m=+3.214007216" lastFinishedPulling="2026-05-28 17:17:32.479637179 +0000 UTC m=+21.108328627" observedRunningTime="2026-05-28 17:17:34.11837948 +0000 UTC m=+22.747070950" watchObservedRunningTime="2026-05-28 17:17:34.11887755 +0000 UTC m=+22.747569033" May 28 17:17:34.168443 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.168368 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 17:17:34.910474 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.910291 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T17:17:34.168393918Z","UUID":"6c5e9e85-ff85-426e-89b5-a7a4aefd82e3","Handler":null,"Name":"","Endpoint":""} May 28 17:17:34.912288 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.912249 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 17:17:34.912288 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:34.912287 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 17:17:35.106039 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:35.105997 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" event={"ID":"94e63360-d78d-4910-9edb-b0f72ad0f24e","Type":"ContainerStarted","Data":"42a10dcf4afc02bdcb7a0d2035a5f5432ad21c65df18d1582d1e5d01606cad91"} May 28 17:17:35.971462 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:35.971369 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:35.971621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:35.971484 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:35.971621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:35.971507 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:35.971621 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:35.971484 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:35.971621 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:35.971602 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:35.971778 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:35.971659 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:36.111830 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:36.111789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:17:36.112289 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:36.112227 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"863d17ca818da87b18bb5bf24ccd6a88ecd88828d2e87c7d0c8f48ad096b1c5e"} May 28 17:17:36.114280 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:36.114243 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" event={"ID":"94e63360-d78d-4910-9edb-b0f72ad0f24e","Type":"ContainerStarted","Data":"ad1b66da33a5787a564c091b1b29cfa0c9efa85679e45a8f8f48266d1b63844e"} May 28 17:17:36.133992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:36.133920 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kw4nm" podStartSLOduration=3.109837178 podStartE2EDuration="24.133904117s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.589825387 +0000 UTC m=+3.218516848" lastFinishedPulling="2026-05-28 17:17:35.613892322 +0000 UTC m=+24.242583787" observedRunningTime="2026-05-28 17:17:36.133189263 +0000 UTC m=+24.761880732" watchObservedRunningTime="2026-05-28 17:17:36.133904117 +0000 UTC m=+24.762595587" May 28 17:17:36.338744 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:36.338692 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g966j" May 28 17:17:36.339698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:36.339506 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g966j" May 28 17:17:37.116626 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:37.116588 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g966j" May 28 17:17:37.117136 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:37.117112 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g966j" May 28 17:17:37.971983 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:37.971792 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:37.972207 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:37.971804 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:37.972207 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:37.972066 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:37.972207 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:37.971861 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:37.972207 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:37.972139 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:37.972420 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:37.972234 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:38.119467 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.119340 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf37a3b2-f906-41a6-932d-6c3f51ba7492" containerID="bf443e46e3d19ad2baf8d9c476d9b3caffff7be25d28f92dba99d0f4635138fa" exitCode=0 May 28 17:17:38.119467 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.119421 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerDied","Data":"bf443e46e3d19ad2baf8d9c476d9b3caffff7be25d28f92dba99d0f4635138fa"} May 28 17:17:38.123374 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.123352 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:17:38.124192 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.124151 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"a0cc2e0aad5322d731d42b1320a7889b4dbaf65249c05a55056160fc143eded0"} May 28 17:17:38.124673 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.124633 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:38.124763 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.124681 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:38.124763 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.124695 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:38.124903 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.124790 2558 scope.go:117] "RemoveContainer" containerID="39bfc036ff92fab286a8efebc7d9059f86b2a2d8eb26dd92bad4077841d7ef8e" May 28 17:17:38.143234 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.143210 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:38.143341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:38.143305 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:17:39.127608 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.127575 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf37a3b2-f906-41a6-932d-6c3f51ba7492" containerID="e90732d096a1ad292778cc8c49f4ad7b4baf79818975719074093af902708a93" exitCode=0 May 28 17:17:39.128027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.127661 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerDied","Data":"e90732d096a1ad292778cc8c49f4ad7b4baf79818975719074093af902708a93"} May 28 17:17:39.131066 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.131045 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:17:39.131424 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.131397 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" event={"ID":"d2417ece-b70b-4476-9f06-cc37c636f24a","Type":"ContainerStarted","Data":"a8942be989ece01aa79c35e0747e86b407814c5a01ee4e5323e52f272afe2dd4"} May 28 17:17:39.183553 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.183492 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" podStartSLOduration=9.179241892 podStartE2EDuration="27.18347468s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.577713378 +0000 UTC m=+3.206404843" lastFinishedPulling="2026-05-28 17:17:32.581946177 +0000 UTC m=+21.210637631" observedRunningTime="2026-05-28 17:17:39.182936538 +0000 UTC m=+27.811628049" watchObservedRunningTime="2026-05-28 17:17:39.18347468 +0000 UTC m=+27.812166148" May 28 17:17:39.754901 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.754854 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mc9xw"] May 28 17:17:39.755074 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.755003 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:39.755141 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:39.755119 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:39.759239 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.759071 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chx54"] May 28 17:17:39.759239 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.759125 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tl7x7"] May 28 17:17:39.759239 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.759248 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:39.759505 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:39.759354 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:39.759505 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:39.759443 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:39.759605 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:39.759514 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:40.135736 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:40.135643 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf37a3b2-f906-41a6-932d-6c3f51ba7492" containerID="5afb584c01f63ae04fa116a0314bfbe543adeb3cc263777cf59dce68157d4f12" exitCode=0 May 28 17:17:40.136125 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:40.135731 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerDied","Data":"5afb584c01f63ae04fa116a0314bfbe543adeb3cc263777cf59dce68157d4f12"} May 28 17:17:40.971824 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:40.971764 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:40.971985 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:40.971902 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:41.973199 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:41.972999 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:41.973635 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:41.973088 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:41.973635 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:41.973275 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:41.973635 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:41.973373 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:42.971269 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:42.971228 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:42.971618 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:42.971567 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:43.971591 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:43.971551 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:43.972188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:43.971551 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:43.972188 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:43.971669 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tl7x7" podUID="4d622259-85d3-4b8f-b79c-93a95ff01b04" May 28 17:17:43.972188 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:43.971729 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chx54" podUID="293f6a4b-e3c6-4520-aad8-44a25990b7a8" May 28 17:17:44.971989 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:44.971944 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:44.972650 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:44.972084 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc9xw" podUID="78e38760-b1d6-404c-a607-7acd976da96b" May 28 17:17:45.600544 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.600503 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:45.600778 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:45.600681 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:45.600778 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:45.600763 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:17.600742703 +0000 UTC m=+66.229434154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:45.701685 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.701644 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:45.701890 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:45.701793 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:45.701890 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:45.701827 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:45.701890 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:45.701839 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gzbk8 for pod openshift-network-diagnostics/network-check-target-chx54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:45.702043 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:45.701900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8 podName:293f6a4b-e3c6-4520-aad8-44a25990b7a8 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:17.701885231 +0000 UTC m=+66.330576682 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzbk8" (UniqueName: "kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8") pod "network-check-target-chx54" (UID: "293f6a4b-e3c6-4520-aad8-44a25990b7a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:45.707552 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.707523 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-182.ec2.internal" event="NodeReady" May 28 17:17:45.707730 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.707695 2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 17:17:45.759240 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.759202 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gn8kg"] May 28 17:17:45.767765 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.767728 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2hfhm"] May 28 17:17:45.767977 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.767949 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gn8kg" May 28 17:17:45.770591 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.770529 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 17:17:45.770759 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.770600 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 17:17:45.770759 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.770631 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sh6sk\"" May 28 17:17:45.771164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.771140 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:45.772524 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.772439 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gn8kg"] May 28 17:17:45.773188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.773149 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 17:17:45.773188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.773165 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 17:17:45.773188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.773178 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nznc5\"" May 28 17:17:45.774728 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.774295 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 17:17:45.775332 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.775311 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2hfhm"] May 28 17:17:45.903074 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.902971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:45.903074 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.903028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:45.903292 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.903143 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn9m7\" (UniqueName: \"kubernetes.io/projected/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-kube-api-access-jn9m7\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:45.903292 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.903220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45be3247-7b50-440f-be65-9e36f2ca7aaf-config-volume\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:45.903292 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.903282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45be3247-7b50-440f-be65-9e36f2ca7aaf-tmp-dir\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:45.903404 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.903311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9f4p\" (UniqueName: \"kubernetes.io/projected/45be3247-7b50-440f-be65-9e36f2ca7aaf-kube-api-access-q9f4p\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:45.971993 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.971924 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:17:45.972573 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.972381 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:17:45.975189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.974945 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 17:17:45.975189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.974996 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-svsk4\"" May 28 17:17:45.975189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.974996 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 17:17:45.975189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.975078 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 17:17:45.975189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:45.974945 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rjfcr\"" May 28 17:17:46.004580 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.004544 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jn9m7\" (UniqueName: \"kubernetes.io/projected/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-kube-api-access-jn9m7\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:46.004779 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.004595 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45be3247-7b50-440f-be65-9e36f2ca7aaf-config-volume\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.004779 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.004647 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45be3247-7b50-440f-be65-9e36f2ca7aaf-tmp-dir\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.004779 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.004673 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9f4p\" (UniqueName: \"kubernetes.io/projected/45be3247-7b50-440f-be65-9e36f2ca7aaf-kube-api-access-q9f4p\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.004969 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.004776 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.004969 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.004843 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:46.004969 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.004888 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:17:46.004969 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.004943 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:17:46.005156 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.004950 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls podName:45be3247-7b50-440f-be65-9e36f2ca7aaf nodeName:}" failed. No retries permitted until 2026-05-28 17:17:46.504928654 +0000 UTC m=+35.133620110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls") pod "dns-default-gn8kg" (UID: "45be3247-7b50-440f-be65-9e36f2ca7aaf") : secret "dns-default-metrics-tls" not found May 28 17:17:46.005156 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.005020 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert podName:aadac7af-4c9a-4c76-83c7-9461b9d01dfb nodeName:}" failed. No retries permitted until 2026-05-28 17:17:46.505003629 +0000 UTC m=+35.133695076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert") pod "ingress-canary-2hfhm" (UID: "aadac7af-4c9a-4c76-83c7-9461b9d01dfb") : secret "canary-serving-cert" not found May 28 17:17:46.005156 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.005077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45be3247-7b50-440f-be65-9e36f2ca7aaf-tmp-dir\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.005469 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.005451 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45be3247-7b50-440f-be65-9e36f2ca7aaf-config-volume\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.017240 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.017203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9f4p\" (UniqueName: \"kubernetes.io/projected/45be3247-7b50-440f-be65-9e36f2ca7aaf-kube-api-access-q9f4p\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.017240 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.017239 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn9m7\" (UniqueName: \"kubernetes.io/projected/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-kube-api-access-jn9m7\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:46.509656 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.509614 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:46.509656 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.509654 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:46.509955 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.509798 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:17:46.509955 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.509847 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:17:46.509955 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.509906 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls podName:45be3247-7b50-440f-be65-9e36f2ca7aaf nodeName:}" failed. No retries permitted until 2026-05-28 17:17:47.509881585 +0000 UTC m=+36.138573054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls") pod "dns-default-gn8kg" (UID: "45be3247-7b50-440f-be65-9e36f2ca7aaf") : secret "dns-default-metrics-tls" not found May 28 17:17:46.509955 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:46.509930 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert podName:aadac7af-4c9a-4c76-83c7-9461b9d01dfb nodeName:}" failed. No retries permitted until 2026-05-28 17:17:47.509919204 +0000 UTC m=+36.138610653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert") pod "ingress-canary-2hfhm" (UID: "aadac7af-4c9a-4c76-83c7-9461b9d01dfb") : secret "canary-serving-cert" not found May 28 17:17:46.971469 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.971428 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:46.974346 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:46.974322 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 17:17:47.153634 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:47.153546 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf37a3b2-f906-41a6-932d-6c3f51ba7492" containerID="4e6094dc1251717ac20c34860d688ab76ee8ba198e8e27af52231aee7948c23f" exitCode=0 May 28 17:17:47.153634 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:47.153595 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerDied","Data":"4e6094dc1251717ac20c34860d688ab76ee8ba198e8e27af52231aee7948c23f"} May 28 17:17:47.518209 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:47.518169 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:47.518209 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:47.518216 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:47.518414 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:47.518324 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:17:47.518414 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:47.518324 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:17:47.518476 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:47.518418 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert podName:aadac7af-4c9a-4c76-83c7-9461b9d01dfb nodeName:}" failed. No retries permitted until 2026-05-28 17:17:49.518398671 +0000 UTC m=+38.147090118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert") pod "ingress-canary-2hfhm" (UID: "aadac7af-4c9a-4c76-83c7-9461b9d01dfb") : secret "canary-serving-cert" not found May 28 17:17:47.518476 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:47.518460 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls podName:45be3247-7b50-440f-be65-9e36f2ca7aaf nodeName:}" failed. No retries permitted until 2026-05-28 17:17:49.518445523 +0000 UTC m=+38.147136970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls") pod "dns-default-gn8kg" (UID: "45be3247-7b50-440f-be65-9e36f2ca7aaf") : secret "dns-default-metrics-tls" not found May 28 17:17:48.158188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:48.157981 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf37a3b2-f906-41a6-932d-6c3f51ba7492" containerID="98454bed5dbd8b6acb5c2f23e89c948ad944d504bd0646d34a7a0878de3c7c5d" exitCode=0 May 28 17:17:48.158188 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:48.158032 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerDied","Data":"98454bed5dbd8b6acb5c2f23e89c948ad944d504bd0646d34a7a0878de3c7c5d"} May 28 17:17:48.326404 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:48.326353 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:48.329553 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:48.329527 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78e38760-b1d6-404c-a607-7acd976da96b-original-pull-secret\") pod \"global-pull-secret-syncer-mc9xw\" (UID: \"78e38760-b1d6-404c-a607-7acd976da96b\") " pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:48.480419 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:48.480285 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc9xw" May 28 17:17:48.672868 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:48.672831 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mc9xw"] May 28 17:17:48.678376 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:48.678343 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e38760_b1d6_404c_a607_7acd976da96b.slice/crio-2b0d6e64ad45792ace646a499ad2c79e2bdc20a8c255a4c6e4ad3926c333991f WatchSource:0}: Error finding container 2b0d6e64ad45792ace646a499ad2c79e2bdc20a8c255a4c6e4ad3926c333991f: Status 404 returned error can't find the container with id 2b0d6e64ad45792ace646a499ad2c79e2bdc20a8c255a4c6e4ad3926c333991f May 28 17:17:49.161616 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:49.161573 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mc9xw" event={"ID":"78e38760-b1d6-404c-a607-7acd976da96b","Type":"ContainerStarted","Data":"2b0d6e64ad45792ace646a499ad2c79e2bdc20a8c255a4c6e4ad3926c333991f"} May 28 17:17:49.165213 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:49.165170 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn92p" event={"ID":"cf37a3b2-f906-41a6-932d-6c3f51ba7492","Type":"ContainerStarted","Data":"178ffa79245186bef5b344169cb907f0fbafca8b2395b61ea507fe1967e26a9e"} May 28 17:17:49.191244 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:49.191167 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xn92p" podStartSLOduration=5.228678659 podStartE2EDuration="37.191146501s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:14.585411394 +0000 UTC m=+3.214102855" lastFinishedPulling="2026-05-28 17:17:46.547879245 +0000 UTC m=+35.176570697" observedRunningTime="2026-05-28 17:17:49.189964143 +0000 UTC m=+37.818655707" watchObservedRunningTime="2026-05-28 17:17:49.191146501 +0000 UTC m=+37.819837973" May 28 17:17:49.535701 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:49.535510 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:49.535701 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:49.535683 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:17:49.535985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:49.535722 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:49.535985 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:49.535764 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls podName:45be3247-7b50-440f-be65-9e36f2ca7aaf nodeName:}" failed. No retries permitted until 2026-05-28 17:17:53.535741125 +0000 UTC m=+42.164432580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls") pod "dns-default-gn8kg" (UID: "45be3247-7b50-440f-be65-9e36f2ca7aaf") : secret "dns-default-metrics-tls" not found May 28 17:17:49.535985 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:49.535837 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:17:49.535985 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:49.535891 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert podName:aadac7af-4c9a-4c76-83c7-9461b9d01dfb nodeName:}" failed. No retries permitted until 2026-05-28 17:17:53.535876231 +0000 UTC m=+42.164567678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert") pod "ingress-canary-2hfhm" (UID: "aadac7af-4c9a-4c76-83c7-9461b9d01dfb") : secret "canary-serving-cert" not found May 28 17:17:53.175008 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:53.174970 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mc9xw" event={"ID":"78e38760-b1d6-404c-a607-7acd976da96b","Type":"ContainerStarted","Data":"b8284e1ae5af1a777ca60f408bc542654433a94b6524814a73a2cefeaf301e7b"} May 28 17:17:53.190919 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:53.190860 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mc9xw" podStartSLOduration=33.594468992 podStartE2EDuration="37.190841836s" podCreationTimestamp="2026-05-28 17:17:16 +0000 UTC" firstStartedPulling="2026-05-28 17:17:48.680917912 +0000 UTC m=+37.309609394" lastFinishedPulling="2026-05-28 17:17:52.277290792 +0000 UTC m=+40.905982238" observedRunningTime="2026-05-28 17:17:53.190272976 +0000 UTC m=+41.818964458" watchObservedRunningTime="2026-05-28 17:17:53.190841836 +0000 UTC m=+41.819533304" May 28 17:17:53.568587 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:53.568528 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:17:53.568587 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:53.568586 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:17:53.568855 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:53.568678 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:17:53.568855 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:53.568681 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:17:53.568855 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:53.568739 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert podName:aadac7af-4c9a-4c76-83c7-9461b9d01dfb nodeName:}" failed. No retries permitted until 2026-05-28 17:18:01.568722296 +0000 UTC m=+50.197413764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert") pod "ingress-canary-2hfhm" (UID: "aadac7af-4c9a-4c76-83c7-9461b9d01dfb") : secret "canary-serving-cert" not found May 28 17:17:53.568855 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:17:53.568763 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls podName:45be3247-7b50-440f-be65-9e36f2ca7aaf nodeName:}" failed. No retries permitted until 2026-05-28 17:18:01.568757144 +0000 UTC m=+50.197448591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls") pod "dns-default-gn8kg" (UID: "45be3247-7b50-440f-be65-9e36f2ca7aaf") : secret "dns-default-metrics-tls" not found May 28 17:17:54.188238 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.188203 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj"] May 28 17:17:54.190302 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.190270 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.192978 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.192950 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 28 17:17:54.193800 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.193780 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 28 17:17:54.193967 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.193932 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bxxrt\"" May 28 17:17:54.194076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.193981 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 28 17:17:54.194164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.194151 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 28 17:17:54.198763 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.198735 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj"] May 28 17:17:54.273451 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.273397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bszw\" (UniqueName: \"kubernetes.io/projected/6f91e443-e3d7-4f10-8ac3-b082770bdef3-kube-api-access-2bszw\") pod \"managed-serviceaccount-addon-agent-5687b98ff8-5ffxj\" (UID: \"6f91e443-e3d7-4f10-8ac3-b082770bdef3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.273663 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.273559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f91e443-e3d7-4f10-8ac3-b082770bdef3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5687b98ff8-5ffxj\" (UID: \"6f91e443-e3d7-4f10-8ac3-b082770bdef3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.375027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.374974 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f91e443-e3d7-4f10-8ac3-b082770bdef3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5687b98ff8-5ffxj\" (UID: \"6f91e443-e3d7-4f10-8ac3-b082770bdef3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.375027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.375039 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bszw\" (UniqueName: \"kubernetes.io/projected/6f91e443-e3d7-4f10-8ac3-b082770bdef3-kube-api-access-2bszw\") pod \"managed-serviceaccount-addon-agent-5687b98ff8-5ffxj\" (UID: \"6f91e443-e3d7-4f10-8ac3-b082770bdef3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.378778 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.378738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f91e443-e3d7-4f10-8ac3-b082770bdef3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5687b98ff8-5ffxj\" (UID: \"6f91e443-e3d7-4f10-8ac3-b082770bdef3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.384024 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.383993 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bszw\" (UniqueName: \"kubernetes.io/projected/6f91e443-e3d7-4f10-8ac3-b082770bdef3-kube-api-access-2bszw\") pod \"managed-serviceaccount-addon-agent-5687b98ff8-5ffxj\" (UID: \"6f91e443-e3d7-4f10-8ac3-b082770bdef3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.508804 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.508768 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" May 28 17:17:54.638402 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:54.638368 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj"] May 28 17:17:54.641350 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:17:54.641322 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f91e443_e3d7_4f10_8ac3_b082770bdef3.slice/crio-9f2dc6d0a8eb24b42a22f61c389f26a53c516c152056f5e112d2d2cde39d302e WatchSource:0}: Error finding container 9f2dc6d0a8eb24b42a22f61c389f26a53c516c152056f5e112d2d2cde39d302e: Status 404 returned error can't find the container with id 9f2dc6d0a8eb24b42a22f61c389f26a53c516c152056f5e112d2d2cde39d302e May 28 17:17:55.179955 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:55.179916 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" event={"ID":"6f91e443-e3d7-4f10-8ac3-b082770bdef3","Type":"ContainerStarted","Data":"9f2dc6d0a8eb24b42a22f61c389f26a53c516c152056f5e112d2d2cde39d302e"} May 28 17:17:58.187315 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:17:58.187275 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" event={"ID":"6f91e443-e3d7-4f10-8ac3-b082770bdef3","Type":"ContainerStarted","Data":"af290f624dcebfc76926b0211f29ddbae9385da8d2075c35ca5be6e8e249973b"} May 28 17:18:01.629882 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:01.629830 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:18:01.630346 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:01.629934 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:18:01.630346 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:01.629991 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:18:01.630346 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:01.630012 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:18:01.630346 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:01.630061 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert podName:aadac7af-4c9a-4c76-83c7-9461b9d01dfb nodeName:}" failed. No retries permitted until 2026-05-28 17:18:17.63004178 +0000 UTC m=+66.258733226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert") pod "ingress-canary-2hfhm" (UID: "aadac7af-4c9a-4c76-83c7-9461b9d01dfb") : secret "canary-serving-cert" not found May 28 17:18:01.630346 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:01.630079 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls podName:45be3247-7b50-440f-be65-9e36f2ca7aaf nodeName:}" failed. No retries permitted until 2026-05-28 17:18:17.630072003 +0000 UTC m=+66.258763450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls") pod "dns-default-gn8kg" (UID: "45be3247-7b50-440f-be65-9e36f2ca7aaf") : secret "dns-default-metrics-tls" not found May 28 17:18:10.146683 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:10.146652 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzncx" May 28 17:18:10.179305 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:10.179249 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5687b98ff8-5ffxj" podStartSLOduration=13.235081546 podStartE2EDuration="16.179233772s" podCreationTimestamp="2026-05-28 17:17:54 +0000 UTC" firstStartedPulling="2026-05-28 17:17:54.643300019 +0000 UTC m=+43.271991470" lastFinishedPulling="2026-05-28 17:17:57.587452245 +0000 UTC m=+46.216143696" observedRunningTime="2026-05-28 17:17:58.210190378 +0000 UTC m=+46.838881846" watchObservedRunningTime="2026-05-28 17:18:10.179233772 +0000 UTC m=+58.807925241" May 28 17:18:17.651857 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.651786 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:18:17.652258 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.651862 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:18:17.652258 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.651945 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:18:17.652258 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:17.651994 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:18:17.652258 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:17.652073 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls podName:45be3247-7b50-440f-be65-9e36f2ca7aaf nodeName:}" failed. No retries permitted until 2026-05-28 17:18:49.652053183 +0000 UTC m=+98.280744649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls") pod "dns-default-gn8kg" (UID: "45be3247-7b50-440f-be65-9e36f2ca7aaf") : secret "dns-default-metrics-tls" not found May 28 17:18:17.652258 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:17.652078 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:18:17.652258 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:17.652129 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert podName:aadac7af-4c9a-4c76-83c7-9461b9d01dfb nodeName:}" failed. No retries permitted until 2026-05-28 17:18:49.652112725 +0000 UTC m=+98.280804193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert") pod "ingress-canary-2hfhm" (UID: "aadac7af-4c9a-4c76-83c7-9461b9d01dfb") : secret "canary-serving-cert" not found May 28 17:18:17.654737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.654713 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 17:18:17.662123 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:17.662093 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 17:18:17.662271 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:17.662215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs podName:4d622259-85d3-4b8f-b79c-93a95ff01b04 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:21.662198169 +0000 UTC m=+130.290889616 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs") pod "network-metrics-daemon-tl7x7" (UID: "4d622259-85d3-4b8f-b79c-93a95ff01b04") : secret "metrics-daemon-secret" not found May 28 17:18:17.752948 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.752904 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:18:17.755962 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.755935 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 17:18:17.766958 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.766931 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 17:18:17.776771 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.776739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbk8\" (UniqueName: \"kubernetes.io/projected/293f6a4b-e3c6-4520-aad8-44a25990b7a8-kube-api-access-gzbk8\") pod \"network-check-target-chx54\" (UID: \"293f6a4b-e3c6-4520-aad8-44a25990b7a8\") " pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:18:17.787340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.787306 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rjfcr\"" May 28 17:18:17.794652 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.794617 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:18:17.924943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:17.924865 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chx54"] May 28 17:18:17.928741 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:18:17.928711 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293f6a4b_e3c6_4520_aad8_44a25990b7a8.slice/crio-11fdf08bacd79d6401857060b729619b32af73610762ea52489902e5ce20e10e WatchSource:0}: Error finding container 11fdf08bacd79d6401857060b729619b32af73610762ea52489902e5ce20e10e: Status 404 returned error can't find the container with id 11fdf08bacd79d6401857060b729619b32af73610762ea52489902e5ce20e10e May 28 17:18:18.230686 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:18.230599 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chx54" event={"ID":"293f6a4b-e3c6-4520-aad8-44a25990b7a8","Type":"ContainerStarted","Data":"11fdf08bacd79d6401857060b729619b32af73610762ea52489902e5ce20e10e"} May 28 17:18:21.238842 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:21.238730 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chx54" event={"ID":"293f6a4b-e3c6-4520-aad8-44a25990b7a8","Type":"ContainerStarted","Data":"f1f4cd4b6881d140b5339a31d0d5ade71d1191fb4617014e99168e14ebb59d13"} May 28 17:18:21.239295 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:21.238877 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:18:21.258121 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:21.258066 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-chx54" podStartSLOduration=66.282311384 podStartE2EDuration="1m9.258048146s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:18:17.930668073 +0000 UTC m=+66.559359532" lastFinishedPulling="2026-05-28 17:18:20.906404847 +0000 UTC m=+69.535096294" observedRunningTime="2026-05-28 17:18:21.257382787 +0000 UTC m=+69.886074257" watchObservedRunningTime="2026-05-28 17:18:21.258048146 +0000 UTC m=+69.886739615" May 28 17:18:25.867747 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.867710 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9f45d9458-x5rqw"] May 28 17:18:25.870173 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.870151 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:25.872873 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.872838 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 28 17:18:25.873276 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.873248 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k8zmg\"" May 28 17:18:25.873625 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.873604 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 28 17:18:25.873903 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.873875 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 28 17:18:25.873903 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.873893 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 28 17:18:25.874165 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.874098 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 17:18:25.874247 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.874227 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 17:18:25.882653 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.882622 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9f45d9458-x5rqw"] May 28 17:18:25.912607 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.912560 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:25.912607 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.912617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-stats-auth\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:25.912912 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.912715 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-default-certificate\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:25.912912 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.912761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcgdx\" (UniqueName: \"kubernetes.io/projected/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-kube-api-access-fcgdx\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:25.912912 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:25.912794 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.013329 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.013286 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-stats-auth\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.013524 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.013357 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-default-certificate\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.013524 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.013388 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcgdx\" (UniqueName: \"kubernetes.io/projected/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-kube-api-access-fcgdx\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.013524 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.013412 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.013524 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.013452 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.013712 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:26.013556 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 17:18:26.013712 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:26.013648 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:26.513625328 +0000 UTC m=+75.142316776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : secret "router-metrics-certs-default" not found May 28 17:18:26.013712 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:26.013703 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:26.513680812 +0000 UTC m=+75.142372283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : configmap references non-existent config key: service-ca.crt May 28 17:18:26.015973 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.015936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-default-certificate\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.016111 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.015975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-stats-auth\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.024953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.024917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcgdx\" (UniqueName: \"kubernetes.io/projected/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-kube-api-access-fcgdx\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.517533 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.517468 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.517533 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:26.517543 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:26.517753 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:26.517635 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 17:18:26.517753 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:26.517703 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:27.517681329 +0000 UTC m=+76.146372776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : configmap references non-existent config key: service-ca.crt May 28 17:18:26.517753 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:26.517745 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:27.51772883 +0000 UTC m=+76.146420277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : secret "router-metrics-certs-default" not found May 28 17:18:27.524351 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:27.524306 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:27.524759 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:27.524376 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:27.524759 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:27.524466 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 17:18:27.524759 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:27.524497 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:29.524483399 +0000 UTC m=+78.153174846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : configmap references non-existent config key: service-ca.crt May 28 17:18:27.524759 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:27.524543 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:29.524526554 +0000 UTC m=+78.153218001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : secret "router-metrics-certs-default" not found May 28 17:18:29.542794 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:29.542643 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:29.542794 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:29.542705 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:29.543262 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:29.542790 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 17:18:29.543262 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:29.542887 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:33.542866997 +0000 UTC m=+82.171558457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : configmap references non-existent config key: service-ca.crt May 28 17:18:29.543262 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:29.542912 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:33.542902044 +0000 UTC m=+82.171593495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : secret "router-metrics-certs-default" not found May 28 17:18:30.847345 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:30.847309 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr"] May 28 17:18:30.851345 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:30.851321 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" May 28 17:18:30.855439 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:30.855414 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 28 17:18:30.855556 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:30.855415 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 28 17:18:30.856489 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:30.856470 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lhrwg\"" May 28 17:18:30.864099 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:30.864070 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr"] May 28 17:18:30.953688 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:30.953648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsfbm\" (UniqueName: \"kubernetes.io/projected/e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9-kube-api-access-gsfbm\") pod \"volume-data-source-validator-5cf8c89d64-qxlzr\" (UID: \"e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" May 28 17:18:31.054495 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:31.054447 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsfbm\" (UniqueName: \"kubernetes.io/projected/e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9-kube-api-access-gsfbm\") pod \"volume-data-source-validator-5cf8c89d64-qxlzr\" (UID: \"e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" May 28 17:18:31.064434 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:31.064401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsfbm\" (UniqueName: \"kubernetes.io/projected/e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9-kube-api-access-gsfbm\") pod \"volume-data-source-validator-5cf8c89d64-qxlzr\" (UID: \"e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" May 28 17:18:31.160647 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:31.160552 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" May 28 17:18:31.297833 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:31.297780 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr"] May 28 17:18:31.300663 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:18:31.300624 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode671a0c8_bd51_4bb8_aae8_ef1ebe3e3ac9.slice/crio-b75587d68ba737bd9ff4f46cc61a64afa06454366bb56d25b3feaba66b75cea5 WatchSource:0}: Error finding container b75587d68ba737bd9ff4f46cc61a64afa06454366bb56d25b3feaba66b75cea5: Status 404 returned error can't find the container with id b75587d68ba737bd9ff4f46cc61a64afa06454366bb56d25b3feaba66b75cea5 May 28 17:18:32.262319 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:32.262281 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" event={"ID":"e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9","Type":"ContainerStarted","Data":"b75587d68ba737bd9ff4f46cc61a64afa06454366bb56d25b3feaba66b75cea5"} May 28 17:18:32.290370 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:32.290340 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7nzbr_9a7c3076-39c0-4727-af6d-e1230ea2cb75/dns-node-resolver/0.log" May 28 17:18:33.001999 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.001963 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-646687fd54-szrn2"] May 28 17:18:33.004029 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.004009 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.006743 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.006717 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 17:18:33.007315 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.007296 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 17:18:33.007506 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.007486 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 17:18:33.007665 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.007645 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xv2ct\"" May 28 17:18:33.013122 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.013093 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 17:18:33.018252 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.018223 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646687fd54-szrn2"] May 28 17:18:33.069701 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.069651 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-installation-pull-secrets\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.069942 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.069715 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtnm7\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-kube-api-access-dtnm7\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.069942 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.069739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-ca-trust-extracted\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.069942 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.069784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-bound-sa-token\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.069942 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.069919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-image-registry-private-configuration\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.070116 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.069959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.070116 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.069986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-trusted-ca\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.070116 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.070056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-certificates\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170412 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-image-registry-private-configuration\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170484 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170510 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-trusted-ca\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170754 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170544 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-certificates\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170754 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170590 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-installation-pull-secrets\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170754 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.170674 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 17:18:33.170754 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.170702 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646687fd54-szrn2: secret "image-registry-tls" not found May 28 17:18:33.170941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170746 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtnm7\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-kube-api-access-dtnm7\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170941 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.170774 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls podName:25586ca8-e876-4075-a4d2-c1bc7ea9aba2 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:33.670755317 +0000 UTC m=+82.299446781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls") pod "image-registry-646687fd54-szrn2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2") : secret "image-registry-tls" not found May 28 17:18:33.170941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170835 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-ca-trust-extracted\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.170941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.170866 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-bound-sa-token\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.171288 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.171246 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-ca-trust-extracted\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.171376 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.171362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-certificates\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.171686 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.171666 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-trusted-ca\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.173545 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.173520 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-image-registry-private-configuration\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.173642 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.173562 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-installation-pull-secrets\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.180124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.180077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtnm7\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-kube-api-access-dtnm7\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.180280 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.180183 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-bound-sa-token\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.266206 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.266115 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" event={"ID":"e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9","Type":"ContainerStarted","Data":"9fb9ce9ce2da3cd41e938c4287d07c9f9f4240b03ee0513926e807ed1db3dc02"} May 28 17:18:33.283117 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.283054 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qxlzr" podStartSLOduration=1.917640209 podStartE2EDuration="3.283037715s" podCreationTimestamp="2026-05-28 17:18:30 +0000 UTC" firstStartedPulling="2026-05-28 17:18:31.302364698 +0000 UTC m=+79.931056149" lastFinishedPulling="2026-05-28 17:18:32.667762205 +0000 UTC m=+81.296453655" observedRunningTime="2026-05-28 17:18:33.282044418 +0000 UTC m=+81.910735889" watchObservedRunningTime="2026-05-28 17:18:33.283037715 +0000 UTC m=+81.911729184" May 28 17:18:33.485444 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.485413 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vw5ws_576367f2-ba4c-4aec-8ce0-8028b106885a/node-ca/0.log" May 28 17:18:33.574597 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.574494 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:33.574597 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.574558 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:33.574791 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.574676 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:41.574661284 +0000 UTC m=+90.203352731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : configmap references non-existent config key: service-ca.crt May 28 17:18:33.574791 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.574757 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 17:18:33.574897 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.574838 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:41.574799927 +0000 UTC m=+90.203491374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : secret "router-metrics-certs-default" not found May 28 17:18:33.675197 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:33.675136 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:33.675418 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.675301 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 17:18:33.675418 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.675320 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646687fd54-szrn2: secret "image-registry-tls" not found May 28 17:18:33.675418 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:33.675390 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls podName:25586ca8-e876-4075-a4d2-c1bc7ea9aba2 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:34.675373426 +0000 UTC m=+83.304064872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls") pod "image-registry-646687fd54-szrn2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2") : secret "image-registry-tls" not found May 28 17:18:34.683863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:34.683795 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:34.684252 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:34.683946 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 17:18:34.684252 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:34.683964 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646687fd54-szrn2: secret "image-registry-tls" not found May 28 17:18:34.684252 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:34.684025 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls podName:25586ca8-e876-4075-a4d2-c1bc7ea9aba2 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:36.684006106 +0000 UTC m=+85.312697553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls") pod "image-registry-646687fd54-szrn2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2") : secret "image-registry-tls" not found May 28 17:18:36.700776 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:36.700716 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:36.701201 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:36.700915 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 17:18:36.701201 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:36.700939 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646687fd54-szrn2: secret "image-registry-tls" not found May 28 17:18:36.701201 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:36.701002 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls podName:25586ca8-e876-4075-a4d2-c1bc7ea9aba2 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:40.700984543 +0000 UTC m=+89.329676006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls") pod "image-registry-646687fd54-szrn2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2") : secret "image-registry-tls" not found May 28 17:18:40.733958 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:40.733908 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:40.734341 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:40.734117 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 17:18:40.734341 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:40.734139 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646687fd54-szrn2: secret "image-registry-tls" not found May 28 17:18:40.734341 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:40.734217 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls podName:25586ca8-e876-4075-a4d2-c1bc7ea9aba2 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:48.734198596 +0000 UTC m=+97.362890043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls") pod "image-registry-646687fd54-szrn2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2") : secret "image-registry-tls" not found May 28 17:18:41.642792 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.642739 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:41.643027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.642804 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:41.643027 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:41.642932 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 17:18:41.643027 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:41.643003 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:57.642984922 +0000 UTC m=+106.271676374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : secret "router-metrics-certs-default" not found May 28 17:18:41.643027 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:41.643019 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle podName:ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae nodeName:}" failed. No retries permitted until 2026-05-28 17:18:57.643013521 +0000 UTC m=+106.271704968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle") pod "router-default-9f45d9458-x5rqw" (UID: "ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae") : configmap references non-existent config key: service-ca.crt May 28 17:18:41.948037 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.947956 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bn58v"] May 28 17:18:41.951367 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.951344 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:41.954111 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.954078 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 28 17:18:41.954250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.954112 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hnktx\"" May 28 17:18:41.955074 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.955053 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 28 17:18:41.955167 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.955053 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 28 17:18:41.955167 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.955094 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 28 17:18:41.960284 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:41.960257 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bn58v"] May 28 17:18:42.046362 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.046326 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2cj9\" (UniqueName: \"kubernetes.io/projected/0b6874d3-4901-4596-8e89-ff8e8f2a461b-kube-api-access-c2cj9\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.046565 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.046383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b6874d3-4901-4596-8e89-ff8e8f2a461b-signing-key\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.046565 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.046404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b6874d3-4901-4596-8e89-ff8e8f2a461b-signing-cabundle\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.147320 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.147272 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2cj9\" (UniqueName: \"kubernetes.io/projected/0b6874d3-4901-4596-8e89-ff8e8f2a461b-kube-api-access-c2cj9\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.147511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.147342 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b6874d3-4901-4596-8e89-ff8e8f2a461b-signing-key\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.147511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.147366 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b6874d3-4901-4596-8e89-ff8e8f2a461b-signing-cabundle\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.148118 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.148092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b6874d3-4901-4596-8e89-ff8e8f2a461b-signing-cabundle\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.149834 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.149797 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b6874d3-4901-4596-8e89-ff8e8f2a461b-signing-key\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.157654 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.157621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2cj9\" (UniqueName: \"kubernetes.io/projected/0b6874d3-4901-4596-8e89-ff8e8f2a461b-kube-api-access-c2cj9\") pod \"service-ca-67d667c7d-bn58v\" (UID: \"0b6874d3-4901-4596-8e89-ff8e8f2a461b\") " pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.261093 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.261052 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bn58v" May 28 17:18:42.395193 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:42.395160 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bn58v"] May 28 17:18:42.398225 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:18:42.398189 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6874d3_4901_4596_8e89_ff8e8f2a461b.slice/crio-5e3c2f05726245b7acea463cb16e8239d4efcd6760f015d9043e91daeb52861c WatchSource:0}: Error finding container 5e3c2f05726245b7acea463cb16e8239d4efcd6760f015d9043e91daeb52861c: Status 404 returned error can't find the container with id 5e3c2f05726245b7acea463cb16e8239d4efcd6760f015d9043e91daeb52861c May 28 17:18:43.287653 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:43.287609 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bn58v" event={"ID":"0b6874d3-4901-4596-8e89-ff8e8f2a461b","Type":"ContainerStarted","Data":"5e3c2f05726245b7acea463cb16e8239d4efcd6760f015d9043e91daeb52861c"} May 28 17:18:44.292745 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:44.292706 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bn58v" event={"ID":"0b6874d3-4901-4596-8e89-ff8e8f2a461b","Type":"ContainerStarted","Data":"35c66fbb2bc7ab8828b82d91a1692fce1357c908a41ec7479394e72e94eb827e"} May 28 17:18:44.310497 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:44.310439 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-bn58v" podStartSLOduration=1.728347373 podStartE2EDuration="3.310422382s" podCreationTimestamp="2026-05-28 17:18:41 +0000 UTC" firstStartedPulling="2026-05-28 17:18:42.399962149 +0000 UTC m=+91.028653597" lastFinishedPulling="2026-05-28 17:18:43.982037154 +0000 UTC m=+92.610728606" observedRunningTime="2026-05-28 17:18:44.310065756 +0000 UTC m=+92.938757226" watchObservedRunningTime="2026-05-28 17:18:44.310422382 +0000 UTC m=+92.939113853" May 28 17:18:48.802695 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:48.802645 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:18:48.803129 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:48.802765 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 17:18:48.803129 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:48.802778 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646687fd54-szrn2: secret "image-registry-tls" not found May 28 17:18:48.803129 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:18:48.802863 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls podName:25586ca8-e876-4075-a4d2-c1bc7ea9aba2 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:04.802844212 +0000 UTC m=+113.431535662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls") pod "image-registry-646687fd54-szrn2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2") : secret "image-registry-tls" not found May 28 17:18:49.711014 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:49.710927 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:18:49.711014 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:49.710980 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:18:49.713628 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:49.713594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45be3247-7b50-440f-be65-9e36f2ca7aaf-metrics-tls\") pod \"dns-default-gn8kg\" (UID: \"45be3247-7b50-440f-be65-9e36f2ca7aaf\") " pod="openshift-dns/dns-default-gn8kg" May 28 17:18:49.713795 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:49.713741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aadac7af-4c9a-4c76-83c7-9461b9d01dfb-cert\") pod \"ingress-canary-2hfhm\" (UID: \"aadac7af-4c9a-4c76-83c7-9461b9d01dfb\") " pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:18:49.985973 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:49.985890 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sh6sk\"" May 28 17:18:49.993138 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:49.993102 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gn8kg" May 28 17:18:49.993336 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:49.993320 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nznc5\"" May 28 17:18:50.001031 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:50.001005 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2hfhm" May 28 17:18:50.138863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:50.138827 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gn8kg"] May 28 17:18:50.142731 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:18:50.142691 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45be3247_7b50_440f_be65_9e36f2ca7aaf.slice/crio-a8c8cbd4c4b36da781c5701eddca66b8599cf9d5f899d64c1d7e93b045b8381c WatchSource:0}: Error finding container a8c8cbd4c4b36da781c5701eddca66b8599cf9d5f899d64c1d7e93b045b8381c: Status 404 returned error can't find the container with id a8c8cbd4c4b36da781c5701eddca66b8599cf9d5f899d64c1d7e93b045b8381c May 28 17:18:50.154464 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:50.154430 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2hfhm"] May 28 17:18:50.157378 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:18:50.157348 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaadac7af_4c9a_4c76_83c7_9461b9d01dfb.slice/crio-db8c262498190ea18279c0c522a76b2f6e03d87d15c67eff9ac2667e4acc591a WatchSource:0}: Error finding container db8c262498190ea18279c0c522a76b2f6e03d87d15c67eff9ac2667e4acc591a: Status 404 returned error can't find the container with id db8c262498190ea18279c0c522a76b2f6e03d87d15c67eff9ac2667e4acc591a May 28 17:18:50.311782 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:50.311744 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gn8kg" event={"ID":"45be3247-7b50-440f-be65-9e36f2ca7aaf","Type":"ContainerStarted","Data":"a8c8cbd4c4b36da781c5701eddca66b8599cf9d5f899d64c1d7e93b045b8381c"} May 28 17:18:50.312684 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:50.312651 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2hfhm" event={"ID":"aadac7af-4c9a-4c76-83c7-9461b9d01dfb","Type":"ContainerStarted","Data":"db8c262498190ea18279c0c522a76b2f6e03d87d15c67eff9ac2667e4acc591a"} May 28 17:18:52.243677 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:52.243616 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-chx54" May 28 17:18:52.320678 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:52.320568 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gn8kg" event={"ID":"45be3247-7b50-440f-be65-9e36f2ca7aaf","Type":"ContainerStarted","Data":"6f4fcc9a7168f350571cf1a9b3920bd0fcf10ab2d0806fbc11507da7a2f4b4fb"} May 28 17:18:52.320678 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:52.320616 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gn8kg" event={"ID":"45be3247-7b50-440f-be65-9e36f2ca7aaf","Type":"ContainerStarted","Data":"b15874026657fcf39fde93a302819c3807d4eb125b327ccba9a5056c224f2ab5"} May 28 17:18:52.320678 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:52.320662 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gn8kg" May 28 17:18:52.322133 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:52.322099 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2hfhm" event={"ID":"aadac7af-4c9a-4c76-83c7-9461b9d01dfb","Type":"ContainerStarted","Data":"70b0de1a89208b01a47620cb76f406f2f0629cf7a17b269028572f703634dfe1"} May 28 17:18:52.339103 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:52.339030 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gn8kg" podStartSLOduration=65.419507203 podStartE2EDuration="1m7.339013357s" podCreationTimestamp="2026-05-28 17:17:45 +0000 UTC" firstStartedPulling="2026-05-28 17:18:50.144448358 +0000 UTC m=+98.773139808" lastFinishedPulling="2026-05-28 17:18:52.063954512 +0000 UTC m=+100.692645962" observedRunningTime="2026-05-28 17:18:52.338358832 +0000 UTC m=+100.967050304" watchObservedRunningTime="2026-05-28 17:18:52.339013357 +0000 UTC m=+100.967704820" May 28 17:18:52.354098 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:52.354046 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2hfhm" podStartSLOduration=65.447794058 podStartE2EDuration="1m7.35403033s" podCreationTimestamp="2026-05-28 17:17:45 +0000 UTC" firstStartedPulling="2026-05-28 17:18:50.15961149 +0000 UTC m=+98.788302937" lastFinishedPulling="2026-05-28 17:18:52.065847763 +0000 UTC m=+100.694539209" observedRunningTime="2026-05-28 17:18:52.353517475 +0000 UTC m=+100.982208945" watchObservedRunningTime="2026-05-28 17:18:52.35403033 +0000 UTC m=+100.982721796" May 28 17:18:57.674386 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:57.674349 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:57.674861 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:57.674397 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:57.675070 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:57.675035 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-service-ca-bundle\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:57.676846 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:57.676823 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae-metrics-certs\") pod \"router-default-9f45d9458-x5rqw\" (UID: \"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae\") " pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:57.679742 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:57.679702 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:57.819294 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:57.819261 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9f45d9458-x5rqw"] May 28 17:18:57.822603 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:18:57.822555 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1cbd8b_dbe9_474f_aa57_3847e4ee00ae.slice/crio-7cee7f4b822db752dd7597ccee1fa6fe72502783139d1b917523578e18878262 WatchSource:0}: Error finding container 7cee7f4b822db752dd7597ccee1fa6fe72502783139d1b917523578e18878262: Status 404 returned error can't find the container with id 7cee7f4b822db752dd7597ccee1fa6fe72502783139d1b917523578e18878262 May 28 17:18:58.339888 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:58.339848 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9f45d9458-x5rqw" event={"ID":"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae","Type":"ContainerStarted","Data":"b34f3a42f2f5cfd4cf3783a30325cdb55e58fdd3d26801a13d02edfdb9aa5876"} May 28 17:18:58.339888 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:58.339886 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9f45d9458-x5rqw" event={"ID":"ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae","Type":"ContainerStarted","Data":"7cee7f4b822db752dd7597ccee1fa6fe72502783139d1b917523578e18878262"} May 28 17:18:58.360561 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:58.360496 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-9f45d9458-x5rqw" podStartSLOduration=33.360482014 podStartE2EDuration="33.360482014s" podCreationTimestamp="2026-05-28 17:18:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:58.358913261 +0000 UTC m=+106.987604743" watchObservedRunningTime="2026-05-28 17:18:58.360482014 +0000 UTC m=+106.989173516" May 28 17:18:58.680550 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:58.680457 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:58.683199 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:58.683173 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:59.344412 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:59.344372 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:18:59.345671 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:18:59.345646 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9f45d9458-x5rqw" May 28 17:19:02.327158 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:02.327124 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gn8kg" May 28 17:19:04.826338 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:04.826302 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:19:04.829695 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:04.829668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"image-registry-646687fd54-szrn2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:19:04.898604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:04.898564 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646687fd54-szrn2"] May 28 17:19:04.898777 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:04.898768 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:19:05.032625 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.032582 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6bvjr"] May 28 17:19:05.036294 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.036247 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.040002 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.039967 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9mq7s\"" May 28 17:19:05.040273 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.040254 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 17:19:05.040389 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.040365 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 17:19:05.040449 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.040365 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 17:19:05.040791 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.040772 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 17:19:05.050923 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.050891 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bvjr"] May 28 17:19:05.094557 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.094474 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646687fd54-szrn2"] May 28 17:19:05.097876 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.097847 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d8b947c5-7kdnr"] May 28 17:19:05.098772 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:05.098746 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25586ca8_e876_4075_a4d2_c1bc7ea9aba2.slice/crio-223f1ca03b62b91e6709c7e290fb92b8a76300bdb906b3fecc2b4ac5e9a2b125 WatchSource:0}: Error finding container 223f1ca03b62b91e6709c7e290fb92b8a76300bdb906b3fecc2b4ac5e9a2b125: Status 404 returned error can't find the container with id 223f1ca03b62b91e6709c7e290fb92b8a76300bdb906b3fecc2b4ac5e9a2b125 May 28 17:19:05.100427 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.100327 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.103715 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.103683 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 28 17:19:05.103848 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.103780 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 28 17:19:05.103848 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.103832 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 28 17:19:05.104168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.104151 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 28 17:19:05.104556 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.104511 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l49br\"" May 28 17:19:05.104767 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.104750 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 28 17:19:05.105095 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.105079 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 28 17:19:05.105309 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.105292 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 28 17:19:05.115525 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.115497 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d8b947c5-7kdnr"] May 28 17:19:05.129323 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.129289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75389e13-d5ea-4f3e-80b7-efe00b95da7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.129503 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.129337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75389e13-d5ea-4f3e-80b7-efe00b95da7b-crio-socket\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.129503 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.129358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whkwj\" (UniqueName: \"kubernetes.io/projected/75389e13-d5ea-4f3e-80b7-efe00b95da7b-kube-api-access-whkwj\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.129503 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.129455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75389e13-d5ea-4f3e-80b7-efe00b95da7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.129633 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.129510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75389e13-d5ea-4f3e-80b7-efe00b95da7b-data-volume\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230161 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-config\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.230364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230172 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75389e13-d5ea-4f3e-80b7-efe00b95da7b-crio-socket\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whkwj\" (UniqueName: \"kubernetes.io/projected/75389e13-d5ea-4f3e-80b7-efe00b95da7b-kube-api-access-whkwj\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-service-ca\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.230364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230267 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75389e13-d5ea-4f3e-80b7-efe00b95da7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230278 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75389e13-d5ea-4f3e-80b7-efe00b95da7b-crio-socket\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-serving-cert\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.230364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-oauth-config\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.230589 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-oauth-serving-cert\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.230589 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230540 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75389e13-d5ea-4f3e-80b7-efe00b95da7b-data-volume\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230718 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230690 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75389e13-d5ea-4f3e-80b7-efe00b95da7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230741 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8c6\" (UniqueName: \"kubernetes.io/projected/2f8253f2-bafa-4e61-9997-05b9a41adc34-kube-api-access-rr8c6\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.230944 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75389e13-d5ea-4f3e-80b7-efe00b95da7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.230993 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.230954 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75389e13-d5ea-4f3e-80b7-efe00b95da7b-data-volume\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.233281 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.233254 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75389e13-d5ea-4f3e-80b7-efe00b95da7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.241713 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.241676 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whkwj\" (UniqueName: \"kubernetes.io/projected/75389e13-d5ea-4f3e-80b7-efe00b95da7b-kube-api-access-whkwj\") pod \"insights-runtime-extractor-6bvjr\" (UID: \"75389e13-d5ea-4f3e-80b7-efe00b95da7b\") " pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.331129 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.331087 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-serving-cert\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.331129 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.331128 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-oauth-config\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.331379 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.331150 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-oauth-serving-cert\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.331379 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.331178 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8c6\" (UniqueName: \"kubernetes.io/projected/2f8253f2-bafa-4e61-9997-05b9a41adc34-kube-api-access-rr8c6\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.331379 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.331217 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-config\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.331379 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.331248 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-service-ca\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.332040 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.332002 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-oauth-serving-cert\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.332040 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.332002 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-service-ca\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.332222 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.332094 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-config\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.333943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.333912 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-oauth-config\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.333943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.333938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-serving-cert\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.339679 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.339647 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8c6\" (UniqueName: \"kubernetes.io/projected/2f8253f2-bafa-4e61-9997-05b9a41adc34-kube-api-access-rr8c6\") pod \"console-65d8b947c5-7kdnr\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.348595 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.348508 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bvjr" May 28 17:19:05.366108 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.366066 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646687fd54-szrn2" event={"ID":"25586ca8-e876-4075-a4d2-c1bc7ea9aba2","Type":"ContainerStarted","Data":"2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc"} May 28 17:19:05.366298 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.366117 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646687fd54-szrn2" event={"ID":"25586ca8-e876-4075-a4d2-c1bc7ea9aba2","Type":"ContainerStarted","Data":"223f1ca03b62b91e6709c7e290fb92b8a76300bdb906b3fecc2b4ac5e9a2b125"} May 28 17:19:05.366364 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.366292 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:19:05.384921 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.384872 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-646687fd54-szrn2" podStartSLOduration=33.384858529 podStartE2EDuration="33.384858529s" podCreationTimestamp="2026-05-28 17:18:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:19:05.384734574 +0000 UTC m=+114.013426062" watchObservedRunningTime="2026-05-28 17:19:05.384858529 +0000 UTC m=+114.013549997" May 28 17:19:05.412950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.412877 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:05.501318 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.500990 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bvjr"] May 28 17:19:05.504616 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:05.504575 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75389e13_d5ea_4f3e_80b7_efe00b95da7b.slice/crio-da003b39e26156588c9da155d0d9d3ccf08641e6fa8f875efc5086dfc554bb14 WatchSource:0}: Error finding container da003b39e26156588c9da155d0d9d3ccf08641e6fa8f875efc5086dfc554bb14: Status 404 returned error can't find the container with id da003b39e26156588c9da155d0d9d3ccf08641e6fa8f875efc5086dfc554bb14 May 28 17:19:05.559240 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:05.559199 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d8b947c5-7kdnr"] May 28 17:19:05.566344 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:05.566310 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8253f2_bafa_4e61_9997_05b9a41adc34.slice/crio-facee192662e125987d470af017cd5d420e2ea0e8dbea212321647be0ea052d4 WatchSource:0}: Error finding container facee192662e125987d470af017cd5d420e2ea0e8dbea212321647be0ea052d4: Status 404 returned error can't find the container with id facee192662e125987d470af017cd5d420e2ea0e8dbea212321647be0ea052d4 May 28 17:19:06.370238 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:06.370195 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8b947c5-7kdnr" event={"ID":"2f8253f2-bafa-4e61-9997-05b9a41adc34","Type":"ContainerStarted","Data":"facee192662e125987d470af017cd5d420e2ea0e8dbea212321647be0ea052d4"} May 28 17:19:06.372143 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:06.372110 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bvjr" event={"ID":"75389e13-d5ea-4f3e-80b7-efe00b95da7b","Type":"ContainerStarted","Data":"9768290aa6efd358d524a2641d7eb5174148d068e1007a6d53b334dae84ec796"} May 28 17:19:06.372337 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:06.372149 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bvjr" event={"ID":"75389e13-d5ea-4f3e-80b7-efe00b95da7b","Type":"ContainerStarted","Data":"e341ad751c71b591e93e5e4f20f238bc1e59d62552f4c62c2e8505dd6c63e762"} May 28 17:19:06.372337 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:06.372160 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bvjr" event={"ID":"75389e13-d5ea-4f3e-80b7-efe00b95da7b","Type":"ContainerStarted","Data":"da003b39e26156588c9da155d0d9d3ccf08641e6fa8f875efc5086dfc554bb14"} May 28 17:19:09.158161 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.158117 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj"] May 28 17:19:09.163683 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.163649 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.167296 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.167262 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 17:19:09.168291 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.168268 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 28 17:19:09.168423 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.168326 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 17:19:09.168423 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.168409 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h64ls\"" May 28 17:19:09.168522 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.168440 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 17:19:09.168557 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.168520 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 28 17:19:09.186250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.186205 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj"] May 28 17:19:09.264976 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.264935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.265163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.264980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.265163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.265043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9px8\" (UniqueName: \"kubernetes.io/projected/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-kube-api-access-b9px8\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.265163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.265097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.366065 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.366011 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.366269 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.366109 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.366269 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.366140 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.366269 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.366182 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9px8\" (UniqueName: \"kubernetes.io/projected/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-kube-api-access-b9px8\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.366772 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.366747 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.368771 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.368738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.368887 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.368756 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.376481 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.376447 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9px8\" (UniqueName: \"kubernetes.io/projected/c22ad3a6-83c8-4aeb-afc1-09a8b89650c2-kube-api-access-b9px8\") pod \"prometheus-operator-7779bbdd78-gp6pj\" (UID: \"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.383174 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.383136 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8b947c5-7kdnr" event={"ID":"2f8253f2-bafa-4e61-9997-05b9a41adc34","Type":"ContainerStarted","Data":"42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee"} May 28 17:19:09.384971 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.384936 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bvjr" event={"ID":"75389e13-d5ea-4f3e-80b7-efe00b95da7b","Type":"ContainerStarted","Data":"79b0a7f5954b65fdd116d07011a04b9a5cef5a1755a7eceecb84ce059af696e3"} May 28 17:19:09.407822 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.407750 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65d8b947c5-7kdnr" podStartSLOduration=1.417653903 podStartE2EDuration="4.407735184s" podCreationTimestamp="2026-05-28 17:19:05 +0000 UTC" firstStartedPulling="2026-05-28 17:19:05.568777696 +0000 UTC m=+114.197469150" lastFinishedPulling="2026-05-28 17:19:08.558858973 +0000 UTC m=+117.187550431" observedRunningTime="2026-05-28 17:19:09.406904699 +0000 UTC m=+118.035596170" watchObservedRunningTime="2026-05-28 17:19:09.407735184 +0000 UTC m=+118.036426649" May 28 17:19:09.430496 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.430382 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6bvjr" podStartSLOduration=1.4599809449999999 podStartE2EDuration="4.430366239s" podCreationTimestamp="2026-05-28 17:19:05 +0000 UTC" firstStartedPulling="2026-05-28 17:19:05.582914087 +0000 UTC m=+114.211605535" lastFinishedPulling="2026-05-28 17:19:08.553299371 +0000 UTC m=+117.181990829" observedRunningTime="2026-05-28 17:19:09.429977317 +0000 UTC m=+118.058668786" watchObservedRunningTime="2026-05-28 17:19:09.430366239 +0000 UTC m=+118.059057708" May 28 17:19:09.473025 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.472981 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" May 28 17:19:09.608565 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:09.608529 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj"] May 28 17:19:09.611829 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:09.611784 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22ad3a6_83c8_4aeb_afc1_09a8b89650c2.slice/crio-5f25da8ee0ae2f782b3d843f0afa3900b28c211a23d292461839c1bc1f4c45a1 WatchSource:0}: Error finding container 5f25da8ee0ae2f782b3d843f0afa3900b28c211a23d292461839c1bc1f4c45a1: Status 404 returned error can't find the container with id 5f25da8ee0ae2f782b3d843f0afa3900b28c211a23d292461839c1bc1f4c45a1 May 28 17:19:10.389350 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:10.389308 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" event={"ID":"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2","Type":"ContainerStarted","Data":"5f25da8ee0ae2f782b3d843f0afa3900b28c211a23d292461839c1bc1f4c45a1"} May 28 17:19:11.393912 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:11.393871 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" event={"ID":"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2","Type":"ContainerStarted","Data":"1910d350ddc56235926a8ecfcdac6392a9c32e45ac86dad5e9b36e1f868082e3"} May 28 17:19:11.393912 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:11.393910 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" event={"ID":"c22ad3a6-83c8-4aeb-afc1-09a8b89650c2","Type":"ContainerStarted","Data":"3ed4c5917ff7987c46faca128f9e1090455201661c41ef9f957a275a41ecc61f"} May 28 17:19:11.417686 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:11.417626 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gp6pj" podStartSLOduration=1.272251244 podStartE2EDuration="2.417609232s" podCreationTimestamp="2026-05-28 17:19:09 +0000 UTC" firstStartedPulling="2026-05-28 17:19:09.613784703 +0000 UTC m=+118.242476151" lastFinishedPulling="2026-05-28 17:19:10.759142688 +0000 UTC m=+119.387834139" observedRunningTime="2026-05-28 17:19:11.416285804 +0000 UTC m=+120.044977273" watchObservedRunningTime="2026-05-28 17:19:11.417609232 +0000 UTC m=+120.046300753" May 28 17:19:13.473390 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.473339 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-txt6d"] May 28 17:19:13.476722 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.476689 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.479362 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.479333 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 28 17:19:13.479362 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.479350 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 28 17:19:13.479574 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.479354 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5595m\"" May 28 17:19:13.488533 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.488500 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-txt6d"] May 28 17:19:13.496905 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.496867 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f98fg"] May 28 17:19:13.499182 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.499148 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.501898 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.501869 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 17:19:13.502146 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.502121 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 17:19:13.502374 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.501934 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9sdlp\"" May 28 17:19:13.502875 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.502841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.502977 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.502897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-sys\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.502977 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.502920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-wtmp\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.502977 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.502947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-root\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.502977 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.502970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-textfile\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.503154 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.503154 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vzz4\" (UniqueName: \"kubernetes.io/projected/a2b433ae-181d-49c3-94db-61f8b864b274-kube-api-access-9vzz4\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.503154 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/910c40f4-e741-4d3b-b671-0659c0986e1f-metrics-client-ca\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.503154 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.503302 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-tls\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.503302 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brnv9\" (UniqueName: \"kubernetes.io/projected/910c40f4-e741-4d3b-b671-0659c0986e1f-kube-api-access-brnv9\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.503302 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503216 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b433ae-181d-49c3-94db-61f8b864b274-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.503302 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503254 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.504124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.503886 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 17:19:13.603705 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.603657 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b433ae-181d-49c3-94db-61f8b864b274-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.603946 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.603722 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.603946 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.603756 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.603946 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.603902 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-sys\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604080 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.603950 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-wtmp\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604080 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.603979 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-root\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604080 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604003 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-textfile\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604080 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-root\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604318 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604006 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-sys\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604318 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604152 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-wtmp\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604318 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:19:13.604309 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 28 17:19:13.604463 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604368 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-textfile\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604463 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:19:13.604395 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-tls podName:a2b433ae-181d-49c3-94db-61f8b864b274 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:14.104373968 +0000 UTC m=+122.733065430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-txt6d" (UID: "a2b433ae-181d-49c3-94db-61f8b864b274") : secret "openshift-state-metrics-tls" not found May 28 17:19:13.604463 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604448 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604577 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604561 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b433ae-181d-49c3-94db-61f8b864b274-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.604643 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604623 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.604688 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604677 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vzz4\" (UniqueName: \"kubernetes.io/projected/a2b433ae-181d-49c3-94db-61f8b864b274-kube-api-access-9vzz4\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.604729 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604702 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/910c40f4-e741-4d3b-b671-0659c0986e1f-metrics-client-ca\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604729 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604723 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.604845 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604742 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-tls\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.604845 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.604785 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brnv9\" (UniqueName: \"kubernetes.io/projected/910c40f4-e741-4d3b-b671-0659c0986e1f-kube-api-access-brnv9\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.605278 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.605254 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/910c40f4-e741-4d3b-b671-0659c0986e1f-metrics-client-ca\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.606636 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.606614 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.607164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.607138 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.607267 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.607200 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/910c40f4-e741-4d3b-b671-0659c0986e1f-node-exporter-tls\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.613363 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.613329 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vzz4\" (UniqueName: \"kubernetes.io/projected/a2b433ae-181d-49c3-94db-61f8b864b274-kube-api-access-9vzz4\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:13.613520 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.613422 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brnv9\" (UniqueName: \"kubernetes.io/projected/910c40f4-e741-4d3b-b671-0659c0986e1f-kube-api-access-brnv9\") pod \"node-exporter-f98fg\" (UID: \"910c40f4-e741-4d3b-b671-0659c0986e1f\") " pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.812319 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:13.812260 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f98fg" May 28 17:19:13.820757 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:13.820724 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910c40f4_e741_4d3b_b671_0659c0986e1f.slice/crio-83a602ae0395830c38bd9a2eaf75f1aa0f52c938909e8ac0a867fb040e6ea5fd WatchSource:0}: Error finding container 83a602ae0395830c38bd9a2eaf75f1aa0f52c938909e8ac0a867fb040e6ea5fd: Status 404 returned error can't find the container with id 83a602ae0395830c38bd9a2eaf75f1aa0f52c938909e8ac0a867fb040e6ea5fd May 28 17:19:14.109252 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.109143 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:14.111746 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.111719 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2b433ae-181d-49c3-94db-61f8b864b274-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-txt6d\" (UID: \"a2b433ae-181d-49c3-94db-61f8b864b274\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:14.352737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.352699 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-746f584648-2kx7t"] May 28 17:19:14.355126 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.355099 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.364475 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.364391 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 28 17:19:14.374068 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.374027 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746f584648-2kx7t"] May 28 17:19:14.389590 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.389538 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" May 28 17:19:14.405047 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.405004 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f98fg" event={"ID":"910c40f4-e741-4d3b-b671-0659c0986e1f","Type":"ContainerStarted","Data":"83a602ae0395830c38bd9a2eaf75f1aa0f52c938909e8ac0a867fb040e6ea5fd"} May 28 17:19:14.411766 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.411726 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-oauth-serving-cert\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.411951 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.411780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvx8\" (UniqueName: \"kubernetes.io/projected/9213422d-5c15-4e77-b8ab-c4a7ac41c696-kube-api-access-khvx8\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.411951 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.411894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-config\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.412076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.411976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-trusted-ca-bundle\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.412076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.412038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-service-ca\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.412178 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.412075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-serving-cert\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.412178 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.412105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-oauth-config\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.513126 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.512979 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-trusted-ca-bundle\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.513126 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.513066 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-service-ca\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.513126 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.513105 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-serving-cert\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.513126 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.513135 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-oauth-config\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.514049 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.513218 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-oauth-serving-cert\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.514049 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.513362 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khvx8\" (UniqueName: \"kubernetes.io/projected/9213422d-5c15-4e77-b8ab-c4a7ac41c696-kube-api-access-khvx8\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.514049 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.513948 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-config\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.515571 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.515397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-config\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.515571 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.515413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-service-ca\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.516101 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.516079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-oauth-serving-cert\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.516221 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.516140 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-trusted-ca-bundle\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.521226 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.520725 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-oauth-config\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.521226 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.520868 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-serving-cert\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.525982 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.525907 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvx8\" (UniqueName: \"kubernetes.io/projected/9213422d-5c15-4e77-b8ab-c4a7ac41c696-kube-api-access-khvx8\") pod \"console-746f584648-2kx7t\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.569523 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.569483 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-txt6d"] May 28 17:19:14.668739 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.668643 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:14.733962 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:14.733906 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b433ae_181d_49c3_94db_61f8b864b274.slice/crio-e42b37efff43c7698865d2d5f7f645a562150ccb5e7c6f5ee53719cc7bc771f9 WatchSource:0}: Error finding container e42b37efff43c7698865d2d5f7f645a562150ccb5e7c6f5ee53719cc7bc771f9: Status 404 returned error can't find the container with id e42b37efff43c7698865d2d5f7f645a562150ccb5e7c6f5ee53719cc7bc771f9 May 28 17:19:14.902721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:14.901506 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746f584648-2kx7t"] May 28 17:19:14.906072 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:14.906036 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9213422d_5c15_4e77_b8ab_c4a7ac41c696.slice/crio-0baa21a5e0632cce2bdb89f24e844c12d942b5cd684f9d850ce82e36a054c958 WatchSource:0}: Error finding container 0baa21a5e0632cce2bdb89f24e844c12d942b5cd684f9d850ce82e36a054c958: Status 404 returned error can't find the container with id 0baa21a5e0632cce2bdb89f24e844c12d942b5cd684f9d850ce82e36a054c958 May 28 17:19:15.410755 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.410646 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f584648-2kx7t" event={"ID":"9213422d-5c15-4e77-b8ab-c4a7ac41c696","Type":"ContainerStarted","Data":"4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f"} May 28 17:19:15.410755 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.410715 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f584648-2kx7t" event={"ID":"9213422d-5c15-4e77-b8ab-c4a7ac41c696","Type":"ContainerStarted","Data":"0baa21a5e0632cce2bdb89f24e844c12d942b5cd684f9d850ce82e36a054c958"} May 28 17:19:15.413126 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.413068 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:15.413378 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.413331 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:15.414204 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.414170 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" event={"ID":"a2b433ae-181d-49c3-94db-61f8b864b274","Type":"ContainerStarted","Data":"d69f8df9fc97ffc9f9bdcab6de773555f0e86ee701d2ed6930dff6119ba371df"} May 28 17:19:15.414340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.414210 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" event={"ID":"a2b433ae-181d-49c3-94db-61f8b864b274","Type":"ContainerStarted","Data":"c3e710a5f77f4e6135ba97cc865ce266b571eb2edf7f481fe93af575bc851605"} May 28 17:19:15.414340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.414225 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" event={"ID":"a2b433ae-181d-49c3-94db-61f8b864b274","Type":"ContainerStarted","Data":"e42b37efff43c7698865d2d5f7f645a562150ccb5e7c6f5ee53719cc7bc771f9"} May 28 17:19:15.416204 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.416172 2558 generic.go:358] "Generic (PLEG): container finished" podID="910c40f4-e741-4d3b-b671-0659c0986e1f" containerID="4d1a59de73a3b32fa99c73a7039fa47f3e41feabe65b78ae18244c53558cd59f" exitCode=0 May 28 17:19:15.416345 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.416240 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f98fg" event={"ID":"910c40f4-e741-4d3b-b671-0659c0986e1f","Type":"ContainerDied","Data":"4d1a59de73a3b32fa99c73a7039fa47f3e41feabe65b78ae18244c53558cd59f"} May 28 17:19:15.419493 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.419436 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:15.432736 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.432663 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-746f584648-2kx7t" podStartSLOduration=1.432637752 podStartE2EDuration="1.432637752s" podCreationTimestamp="2026-05-28 17:19:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:19:15.430017329 +0000 UTC m=+124.058708831" watchObservedRunningTime="2026-05-28 17:19:15.432637752 +0000 UTC m=+124.061329224" May 28 17:19:15.580524 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.580473 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7996fdc58f-d72f8"] May 28 17:19:15.583898 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.583863 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.586416 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.586357 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 28 17:19:15.586688 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.586517 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 28 17:19:15.586877 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.586858 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a506e27uisthc\"" May 28 17:19:15.587020 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.586858 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kh8kq\"" May 28 17:19:15.587105 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.586950 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 28 17:19:15.587571 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.587550 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 28 17:19:15.587798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.587779 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 28 17:19:15.596903 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.596875 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7996fdc58f-d72f8"] May 28 17:19:15.623366 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.623575 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.623575 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2fj\" (UniqueName: \"kubernetes.io/projected/42cc39fa-9b31-471b-9138-a86e99743b0d-kube-api-access-cj2fj\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.623575 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42cc39fa-9b31-471b-9138-a86e99743b0d-metrics-client-ca\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.623575 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.623575 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-grpc-tls\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.623575 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.623833 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.623610 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-tls\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724326 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724219 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-grpc-tls\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724326 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724269 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724326 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724300 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-tls\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724355 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724387 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724421 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2fj\" (UniqueName: \"kubernetes.io/projected/42cc39fa-9b31-471b-9138-a86e99743b0d-kube-api-access-cj2fj\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724455 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42cc39fa-9b31-471b-9138-a86e99743b0d-metrics-client-ca\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.724604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.724481 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.725564 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.725487 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42cc39fa-9b31-471b-9138-a86e99743b0d-metrics-client-ca\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.727890 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.727774 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.727890 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.727780 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-tls\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.727890 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.727876 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.728183 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.728155 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-grpc-tls\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.728484 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.728456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.728658 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.728639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/42cc39fa-9b31-471b-9138-a86e99743b0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.740454 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.740414 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2fj\" (UniqueName: \"kubernetes.io/projected/42cc39fa-9b31-471b-9138-a86e99743b0d-kube-api-access-cj2fj\") pod \"thanos-querier-7996fdc58f-d72f8\" (UID: \"42cc39fa-9b31-471b-9138-a86e99743b0d\") " pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:15.896802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:15.896762 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:16.039003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.038865 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7996fdc58f-d72f8"] May 28 17:19:16.041658 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:16.041627 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cc39fa_9b31_471b_9138_a86e99743b0d.slice/crio-59efde8ee5e809ba8d2dec96ea88c70d1bd15676a4760aa6a21c35bedc2b7cb0 WatchSource:0}: Error finding container 59efde8ee5e809ba8d2dec96ea88c70d1bd15676a4760aa6a21c35bedc2b7cb0: Status 404 returned error can't find the container with id 59efde8ee5e809ba8d2dec96ea88c70d1bd15676a4760aa6a21c35bedc2b7cb0 May 28 17:19:16.422955 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.422913 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f98fg" event={"ID":"910c40f4-e741-4d3b-b671-0659c0986e1f","Type":"ContainerStarted","Data":"69310fb08e63b57c411515a101282d45315f195ef518e75883f36a89de57eecc"} May 28 17:19:16.422955 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.422962 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f98fg" event={"ID":"910c40f4-e741-4d3b-b671-0659c0986e1f","Type":"ContainerStarted","Data":"657f96206e6007c460950f3d605ccb792329de5fc2bac785ace7e29dcc76d678"} May 28 17:19:16.427256 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.427129 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" event={"ID":"a2b433ae-181d-49c3-94db-61f8b864b274","Type":"ContainerStarted","Data":"9c6f7c1ce8d8d026b789349a02acadef17ee47156c56e00be5db7c54313d7b3b"} May 28 17:19:16.430805 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.430756 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" event={"ID":"42cc39fa-9b31-471b-9138-a86e99743b0d","Type":"ContainerStarted","Data":"59efde8ee5e809ba8d2dec96ea88c70d1bd15676a4760aa6a21c35bedc2b7cb0"} May 28 17:19:16.436778 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.436735 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:16.446007 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.445938 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f98fg" podStartSLOduration=2.497553018 podStartE2EDuration="3.445914482s" podCreationTimestamp="2026-05-28 17:19:13 +0000 UTC" firstStartedPulling="2026-05-28 17:19:13.822553032 +0000 UTC m=+122.451244479" lastFinishedPulling="2026-05-28 17:19:14.770914477 +0000 UTC m=+123.399605943" observedRunningTime="2026-05-28 17:19:16.443744573 +0000 UTC m=+125.072436055" watchObservedRunningTime="2026-05-28 17:19:16.445914482 +0000 UTC m=+125.074605952" May 28 17:19:16.467227 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:16.467163 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-txt6d" podStartSLOduration=2.602827833 podStartE2EDuration="3.467143774s" podCreationTimestamp="2026-05-28 17:19:13 +0000 UTC" firstStartedPulling="2026-05-28 17:19:14.919454551 +0000 UTC m=+123.548145997" lastFinishedPulling="2026-05-28 17:19:15.783770488 +0000 UTC m=+124.412461938" observedRunningTime="2026-05-28 17:19:16.466518867 +0000 UTC m=+125.095210335" watchObservedRunningTime="2026-05-28 17:19:16.467143774 +0000 UTC m=+125.095835248" May 28 17:19:18.281368 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.281334 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7"] May 28 17:19:18.284914 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.284890 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" May 28 17:19:18.287296 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.287265 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 28 17:19:18.287419 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.287309 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-dg4sq\"" May 28 17:19:18.291774 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.291742 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7"] May 28 17:19:18.353652 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.353607 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/334787c0-676d-48ee-be2c-064eada9d3aa-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4k8j7\" (UID: \"334787c0-676d-48ee-be2c-064eada9d3aa\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" May 28 17:19:18.438045 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.438003 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" event={"ID":"42cc39fa-9b31-471b-9138-a86e99743b0d","Type":"ContainerStarted","Data":"3dc6550adcfb108b5ce2f5c5178c0e7658e33a603591da9e85baff43b811638a"} May 28 17:19:18.438045 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.438051 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" event={"ID":"42cc39fa-9b31-471b-9138-a86e99743b0d","Type":"ContainerStarted","Data":"efab397f4336d104f9e7bc3406af88e7e106139c3f524a887ff4b58703212ed6"} May 28 17:19:18.438302 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.438066 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" event={"ID":"42cc39fa-9b31-471b-9138-a86e99743b0d","Type":"ContainerStarted","Data":"a23f6c36f43478348488eafd4f3d2982cfac6d2ad7c83dbae7506fbd944679b4"} May 28 17:19:18.455209 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.455167 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/334787c0-676d-48ee-be2c-064eada9d3aa-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4k8j7\" (UID: \"334787c0-676d-48ee-be2c-064eada9d3aa\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" May 28 17:19:18.458143 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.458110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/334787c0-676d-48ee-be2c-064eada9d3aa-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4k8j7\" (UID: \"334787c0-676d-48ee-be2c-064eada9d3aa\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" May 28 17:19:18.595287 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.595179 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" May 28 17:19:18.818425 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:18.818387 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7"] May 28 17:19:18.821405 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:18.821373 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334787c0_676d_48ee_be2c_064eada9d3aa.slice/crio-50e5ce18288aadb8a5cb6ca61ff3ec2994952ba07e75742378a5288a35055abe WatchSource:0}: Error finding container 50e5ce18288aadb8a5cb6ca61ff3ec2994952ba07e75742378a5288a35055abe: Status 404 returned error can't find the container with id 50e5ce18288aadb8a5cb6ca61ff3ec2994952ba07e75742378a5288a35055abe May 28 17:19:19.445036 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:19.444981 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" event={"ID":"42cc39fa-9b31-471b-9138-a86e99743b0d","Type":"ContainerStarted","Data":"42c6d8926e8be8a878e73a043553d8d78325855d9067765415209e8a199f993f"} May 28 17:19:19.445036 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:19.445037 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" event={"ID":"42cc39fa-9b31-471b-9138-a86e99743b0d","Type":"ContainerStarted","Data":"9183f1a965e8ae5dc7babea2cc62b09c682686618f7c1629a785067a87af728a"} May 28 17:19:19.445577 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:19.445057 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" event={"ID":"42cc39fa-9b31-471b-9138-a86e99743b0d","Type":"ContainerStarted","Data":"cb1ecf7d6928595ddf6c3806f570be40c467cd0c2d5d7721b4829d7f23909aa5"} May 28 17:19:19.445948 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:19.445900 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:19.448530 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:19.448500 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" event={"ID":"334787c0-676d-48ee-be2c-064eada9d3aa","Type":"ContainerStarted","Data":"50e5ce18288aadb8a5cb6ca61ff3ec2994952ba07e75742378a5288a35055abe"} May 28 17:19:19.479896 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:19.479828 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" podStartSLOduration=1.7921928 podStartE2EDuration="4.479792429s" podCreationTimestamp="2026-05-28 17:19:15 +0000 UTC" firstStartedPulling="2026-05-28 17:19:16.043563258 +0000 UTC m=+124.672254705" lastFinishedPulling="2026-05-28 17:19:18.731162874 +0000 UTC m=+127.359854334" observedRunningTime="2026-05-28 17:19:19.478887377 +0000 UTC m=+128.107578872" watchObservedRunningTime="2026-05-28 17:19:19.479792429 +0000 UTC m=+128.108483899" May 28 17:19:20.455643 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:20.455604 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" event={"ID":"334787c0-676d-48ee-be2c-064eada9d3aa","Type":"ContainerStarted","Data":"388b74b441c11ae0851b68ffc394a4fe91317e0d7beaa2d86037d64ea33c90e3"} May 28 17:19:20.456065 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:20.455753 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" May 28 17:19:20.460560 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:20.460526 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" May 28 17:19:20.474600 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:20.474543 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4k8j7" podStartSLOduration=1.048680751 podStartE2EDuration="2.474526261s" podCreationTimestamp="2026-05-28 17:19:18 +0000 UTC" firstStartedPulling="2026-05-28 17:19:18.823451524 +0000 UTC m=+127.452142986" lastFinishedPulling="2026-05-28 17:19:20.249297034 +0000 UTC m=+128.877988496" observedRunningTime="2026-05-28 17:19:20.473683394 +0000 UTC m=+129.102374864" watchObservedRunningTime="2026-05-28 17:19:20.474526261 +0000 UTC m=+129.103217730" May 28 17:19:21.685081 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.685028 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:19:21.687452 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.687425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d622259-85d3-4b8f-b79c-93a95ff01b04-metrics-certs\") pod \"network-metrics-daemon-tl7x7\" (UID: \"4d622259-85d3-4b8f-b79c-93a95ff01b04\") " pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:19:21.695853 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.695802 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-svsk4\"" May 28 17:19:21.703298 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.703270 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tl7x7" May 28 17:19:21.796444 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.796405 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746f584648-2kx7t"] May 28 17:19:21.834230 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.834189 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bbd5b9d45-m4dql"] May 28 17:19:21.845475 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.845439 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.849258 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.849221 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbd5b9d45-m4dql"] May 28 17:19:21.876452 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.876418 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tl7x7"] May 28 17:19:21.879471 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:21.879438 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d622259_85d3_4b8f_b79c_93a95ff01b04.slice/crio-962551b9001c305ecd5a130d3159ce507dac77a9a21b46125e25569455d2b5c3 WatchSource:0}: Error finding container 962551b9001c305ecd5a130d3159ce507dac77a9a21b46125e25569455d2b5c3: Status 404 returned error can't find the container with id 962551b9001c305ecd5a130d3159ce507dac77a9a21b46125e25569455d2b5c3 May 28 17:19:21.887196 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.887157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-console-config\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.887340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.887215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-service-ca\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.887340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.887252 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zvp\" (UniqueName: \"kubernetes.io/projected/613a925d-0cae-4a13-aada-25bd40a20ae5-kube-api-access-p2zvp\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.887340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.887287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-serving-cert\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.887340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.887311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-oauth-config\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.887514 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.887394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-oauth-serving-cert\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.887514 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.887465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-trusted-ca-bundle\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988118 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988020 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-service-ca\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988118 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988064 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zvp\" (UniqueName: \"kubernetes.io/projected/613a925d-0cae-4a13-aada-25bd40a20ae5-kube-api-access-p2zvp\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988118 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988086 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-serving-cert\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988118 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988101 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-oauth-config\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988444 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988132 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-oauth-serving-cert\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988444 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988163 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-trusted-ca-bundle\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988444 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988215 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-console-config\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.988945 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988916 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-service-ca\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.989068 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.988922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-oauth-serving-cert\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.989068 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.989048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-console-config\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.989184 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.989116 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-trusted-ca-bundle\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.990662 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.990629 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-serving-cert\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:21.990759 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:21.990668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-oauth-config\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:22.003798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:22.003757 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zvp\" (UniqueName: \"kubernetes.io/projected/613a925d-0cae-4a13-aada-25bd40a20ae5-kube-api-access-p2zvp\") pod \"console-7bbd5b9d45-m4dql\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:22.156698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:22.156655 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:22.305795 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:22.305739 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbd5b9d45-m4dql"] May 28 17:19:22.309595 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:19:22.309547 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613a925d_0cae_4a13_aada_25bd40a20ae5.slice/crio-ca0b08b5422e08154c61ddb4db096d338d65bd29bf74d2d939e11ea29797369d WatchSource:0}: Error finding container ca0b08b5422e08154c61ddb4db096d338d65bd29bf74d2d939e11ea29797369d: Status 404 returned error can't find the container with id ca0b08b5422e08154c61ddb4db096d338d65bd29bf74d2d939e11ea29797369d May 28 17:19:22.463198 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:22.463123 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tl7x7" event={"ID":"4d622259-85d3-4b8f-b79c-93a95ff01b04","Type":"ContainerStarted","Data":"962551b9001c305ecd5a130d3159ce507dac77a9a21b46125e25569455d2b5c3"} May 28 17:19:22.464735 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:22.464695 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbd5b9d45-m4dql" event={"ID":"613a925d-0cae-4a13-aada-25bd40a20ae5","Type":"ContainerStarted","Data":"9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2"} May 28 17:19:22.464898 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:22.464740 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbd5b9d45-m4dql" event={"ID":"613a925d-0cae-4a13-aada-25bd40a20ae5","Type":"ContainerStarted","Data":"ca0b08b5422e08154c61ddb4db096d338d65bd29bf74d2d939e11ea29797369d"} May 28 17:19:22.493552 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:22.493452 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bbd5b9d45-m4dql" podStartSLOduration=1.493431068 podStartE2EDuration="1.493431068s" podCreationTimestamp="2026-05-28 17:19:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:19:22.491416446 +0000 UTC m=+131.120107916" watchObservedRunningTime="2026-05-28 17:19:22.493431068 +0000 UTC m=+131.122122538" May 28 17:19:23.469609 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:23.469566 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tl7x7" event={"ID":"4d622259-85d3-4b8f-b79c-93a95ff01b04","Type":"ContainerStarted","Data":"87e9f4bd8574657afe75c1d842f21492ea28fb583bf1f12554895cfc2dfaac89"} May 28 17:19:23.469609 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:23.469613 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tl7x7" event={"ID":"4d622259-85d3-4b8f-b79c-93a95ff01b04","Type":"ContainerStarted","Data":"90fc76e3745e683aa05abec252bf1b296e5febfb5a949d98476577dd423b36d1"} May 28 17:19:23.488699 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:23.488634 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tl7x7" podStartSLOduration=130.435332463 podStartE2EDuration="2m11.488614935s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:19:21.881344562 +0000 UTC m=+130.510036013" lastFinishedPulling="2026-05-28 17:19:22.934627035 +0000 UTC m=+131.563318485" observedRunningTime="2026-05-28 17:19:23.487213228 +0000 UTC m=+132.115904698" watchObservedRunningTime="2026-05-28 17:19:23.488614935 +0000 UTC m=+132.117306403" May 28 17:19:24.669637 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:24.669592 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:25.373132 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:25.373101 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:19:25.463946 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:25.463917 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7996fdc58f-d72f8" May 28 17:19:30.385858 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.385787 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-646687fd54-szrn2" podUID="25586ca8-e876-4075-a4d2-c1bc7ea9aba2" containerName="registry" containerID="cri-o://2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc" gracePeriod=30 May 28 17:19:30.652857 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.652804 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:19:30.770754 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770718 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-trusted-ca\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.770754 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770760 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-certificates\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.771025 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770784 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-ca-trust-extracted\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.771025 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770805 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-image-registry-private-configuration\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.771025 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770855 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-installation-pull-secrets\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.771025 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770877 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-bound-sa-token\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.771025 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770895 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtnm7\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-kube-api-access-dtnm7\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.771025 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.770948 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") pod \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\" (UID: \"25586ca8-e876-4075-a4d2-c1bc7ea9aba2\") " May 28 17:19:30.771569 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.771505 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:30.771721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.771667 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:30.773515 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.773451 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:19:30.773515 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.773507 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:19:30.773698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.773624 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:30.773742 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.773690 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:30.773869 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.773846 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-kube-api-access-dtnm7" (OuterVolumeSpecName: "kube-api-access-dtnm7") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "kube-api-access-dtnm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:19:30.782799 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.782756 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "25586ca8-e876-4075-a4d2-c1bc7ea9aba2" (UID: "25586ca8-e876-4075-a4d2-c1bc7ea9aba2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:19:30.871788 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871734 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-certificates\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:30.871788 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871779 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-ca-trust-extracted\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:30.871788 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871791 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-image-registry-private-configuration\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:30.871788 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871803 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-installation-pull-secrets\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:30.872087 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871842 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-bound-sa-token\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:30.872087 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871852 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtnm7\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-kube-api-access-dtnm7\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:30.872087 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871861 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-registry-tls\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:30.872087 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:30.871871 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25586ca8-e876-4075-a4d2-c1bc7ea9aba2-trusted-ca\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:31.493597 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.493555 2558 generic.go:358] "Generic (PLEG): container finished" podID="25586ca8-e876-4075-a4d2-c1bc7ea9aba2" containerID="2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc" exitCode=0 May 28 17:19:31.494000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.493632 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646687fd54-szrn2" May 28 17:19:31.494000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.493650 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646687fd54-szrn2" event={"ID":"25586ca8-e876-4075-a4d2-c1bc7ea9aba2","Type":"ContainerDied","Data":"2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc"} May 28 17:19:31.494000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.493698 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646687fd54-szrn2" event={"ID":"25586ca8-e876-4075-a4d2-c1bc7ea9aba2","Type":"ContainerDied","Data":"223f1ca03b62b91e6709c7e290fb92b8a76300bdb906b3fecc2b4ac5e9a2b125"} May 28 17:19:31.494000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.493715 2558 scope.go:117] "RemoveContainer" containerID="2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc" May 28 17:19:31.503822 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.503791 2558 scope.go:117] "RemoveContainer" containerID="2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc" May 28 17:19:31.504151 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:19:31.504125 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc\": container with ID starting with 2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc not found: ID does not exist" containerID="2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc" May 28 17:19:31.504219 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.504158 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc"} err="failed to get container status \"2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc\": rpc error: code = NotFound desc = could not find container \"2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc\": container with ID starting with 2fd57a4859341341454e6d78e4e6bddd4b7751d5466f5fa045d10e79c617c0bc not found: ID does not exist" May 28 17:19:31.516765 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.516722 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646687fd54-szrn2"] May 28 17:19:31.520591 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.520556 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-646687fd54-szrn2"] May 28 17:19:31.976685 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:31.976647 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25586ca8-e876-4075-a4d2-c1bc7ea9aba2" path="/var/lib/kubelet/pods/25586ca8-e876-4075-a4d2-c1bc7ea9aba2/volumes" May 28 17:19:32.157884 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:32.157839 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:32.157884 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:32.157893 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:32.162946 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:32.162917 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:32.501282 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:32.501253 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:19:32.558756 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:32.558713 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d8b947c5-7kdnr"] May 28 17:19:37.357419 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:37.357389 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9f45d9458-x5rqw_ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae/router/0.log" May 28 17:19:37.363692 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:37.363669 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2hfhm_aadac7af-4c9a-4c76-83c7-9461b9d01dfb/serve-healthcheck-canary/0.log" May 28 17:19:46.816512 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:46.816472 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-746f584648-2kx7t" podUID="9213422d-5c15-4e77-b8ab-c4a7ac41c696" containerName="console" containerID="cri-o://4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f" gracePeriod=15 May 28 17:19:47.069108 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.069037 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-746f584648-2kx7t_9213422d-5c15-4e77-b8ab-c4a7ac41c696/console/0.log" May 28 17:19:47.069265 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.069111 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:47.207097 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207050 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-oauth-config\") pod \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " May 28 17:19:47.207097 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207094 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-config\") pod \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " May 28 17:19:47.207341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207115 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-oauth-serving-cert\") pod \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " May 28 17:19:47.207341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207154 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-trusted-ca-bundle\") pod \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " May 28 17:19:47.207341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207294 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-serving-cert\") pod \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " May 28 17:19:47.207502 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207349 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-service-ca\") pod \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " May 28 17:19:47.207502 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207474 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khvx8\" (UniqueName: \"kubernetes.io/projected/9213422d-5c15-4e77-b8ab-c4a7ac41c696-kube-api-access-khvx8\") pod \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\" (UID: \"9213422d-5c15-4e77-b8ab-c4a7ac41c696\") " May 28 17:19:47.207643 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207608 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9213422d-5c15-4e77-b8ab-c4a7ac41c696" (UID: "9213422d-5c15-4e77-b8ab-c4a7ac41c696"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:47.207643 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207623 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9213422d-5c15-4e77-b8ab-c4a7ac41c696" (UID: "9213422d-5c15-4e77-b8ab-c4a7ac41c696"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:47.207643 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207612 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-config" (OuterVolumeSpecName: "console-config") pod "9213422d-5c15-4e77-b8ab-c4a7ac41c696" (UID: "9213422d-5c15-4e77-b8ab-c4a7ac41c696"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:47.207798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207713 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-service-ca" (OuterVolumeSpecName: "service-ca") pod "9213422d-5c15-4e77-b8ab-c4a7ac41c696" (UID: "9213422d-5c15-4e77-b8ab-c4a7ac41c696"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:47.207798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207748 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:47.207798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207760 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-oauth-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:47.207798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.207770 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-trusted-ca-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:47.209527 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.209492 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9213422d-5c15-4e77-b8ab-c4a7ac41c696" (UID: "9213422d-5c15-4e77-b8ab-c4a7ac41c696"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:47.209654 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.209539 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9213422d-5c15-4e77-b8ab-c4a7ac41c696" (UID: "9213422d-5c15-4e77-b8ab-c4a7ac41c696"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:47.209654 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.209546 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9213422d-5c15-4e77-b8ab-c4a7ac41c696-kube-api-access-khvx8" (OuterVolumeSpecName: "kube-api-access-khvx8") pod "9213422d-5c15-4e77-b8ab-c4a7ac41c696" (UID: "9213422d-5c15-4e77-b8ab-c4a7ac41c696"). InnerVolumeSpecName "kube-api-access-khvx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:19:47.309029 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.308987 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:47.309029 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.309020 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9213422d-5c15-4e77-b8ab-c4a7ac41c696-service-ca\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:47.309227 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.309058 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khvx8\" (UniqueName: \"kubernetes.io/projected/9213422d-5c15-4e77-b8ab-c4a7ac41c696-kube-api-access-khvx8\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:47.309227 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.309068 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9213422d-5c15-4e77-b8ab-c4a7ac41c696-console-oauth-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:47.543262 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.543236 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-746f584648-2kx7t_9213422d-5c15-4e77-b8ab-c4a7ac41c696/console/0.log" May 28 17:19:47.543470 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.543277 2558 generic.go:358] "Generic (PLEG): container finished" podID="9213422d-5c15-4e77-b8ab-c4a7ac41c696" containerID="4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f" exitCode=2 May 28 17:19:47.543470 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.543338 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f584648-2kx7t" event={"ID":"9213422d-5c15-4e77-b8ab-c4a7ac41c696","Type":"ContainerDied","Data":"4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f"} May 28 17:19:47.543470 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.543364 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f584648-2kx7t" event={"ID":"9213422d-5c15-4e77-b8ab-c4a7ac41c696","Type":"ContainerDied","Data":"0baa21a5e0632cce2bdb89f24e844c12d942b5cd684f9d850ce82e36a054c958"} May 28 17:19:47.543470 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.543366 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f584648-2kx7t" May 28 17:19:47.543661 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.543379 2558 scope.go:117] "RemoveContainer" containerID="4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f" May 28 17:19:47.552839 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.552795 2558 scope.go:117] "RemoveContainer" containerID="4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f" May 28 17:19:47.553206 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:19:47.553179 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f\": container with ID starting with 4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f not found: ID does not exist" containerID="4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f" May 28 17:19:47.553317 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.553216 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f"} err="failed to get container status \"4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f\": rpc error: code = NotFound desc = could not find container \"4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f\": container with ID starting with 4814670ddcb32cb451ef7a8c631d9991e2a3b39c8b5042dddd514807cac5323f not found: ID does not exist" May 28 17:19:47.566495 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.566451 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746f584648-2kx7t"] May 28 17:19:47.570169 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.570136 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-746f584648-2kx7t"] May 28 17:19:47.975964 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:47.975885 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9213422d-5c15-4e77-b8ab-c4a7ac41c696" path="/var/lib/kubelet/pods/9213422d-5c15-4e77-b8ab-c4a7ac41c696/volumes" May 28 17:19:57.578749 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.578685 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65d8b947c5-7kdnr" podUID="2f8253f2-bafa-4e61-9997-05b9a41adc34" containerName="console" containerID="cri-o://42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee" gracePeriod=15 May 28 17:19:57.830371 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.830302 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65d8b947c5-7kdnr_2f8253f2-bafa-4e61-9997-05b9a41adc34/console/0.log" May 28 17:19:57.830371 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.830367 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:57.994257 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.994222 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-service-ca\") pod \"2f8253f2-bafa-4e61-9997-05b9a41adc34\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " May 28 17:19:57.994451 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.994280 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-config\") pod \"2f8253f2-bafa-4e61-9997-05b9a41adc34\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " May 28 17:19:57.994451 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.994301 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-serving-cert\") pod \"2f8253f2-bafa-4e61-9997-05b9a41adc34\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " May 28 17:19:57.994568 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.994472 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-oauth-serving-cert\") pod \"2f8253f2-bafa-4e61-9997-05b9a41adc34\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " May 28 17:19:57.994568 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.994541 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-oauth-config\") pod \"2f8253f2-bafa-4e61-9997-05b9a41adc34\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " May 28 17:19:57.994674 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.994571 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr8c6\" (UniqueName: \"kubernetes.io/projected/2f8253f2-bafa-4e61-9997-05b9a41adc34-kube-api-access-rr8c6\") pod \"2f8253f2-bafa-4e61-9997-05b9a41adc34\" (UID: \"2f8253f2-bafa-4e61-9997-05b9a41adc34\") " May 28 17:19:57.995076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.995043 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f8253f2-bafa-4e61-9997-05b9a41adc34" (UID: "2f8253f2-bafa-4e61-9997-05b9a41adc34"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:57.995710 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.995682 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-config" (OuterVolumeSpecName: "console-config") pod "2f8253f2-bafa-4e61-9997-05b9a41adc34" (UID: "2f8253f2-bafa-4e61-9997-05b9a41adc34"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:57.995840 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.995779 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f8253f2-bafa-4e61-9997-05b9a41adc34" (UID: "2f8253f2-bafa-4e61-9997-05b9a41adc34"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:57.996733 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:57.996697 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8253f2-bafa-4e61-9997-05b9a41adc34-kube-api-access-rr8c6" (OuterVolumeSpecName: "kube-api-access-rr8c6") pod "2f8253f2-bafa-4e61-9997-05b9a41adc34" (UID: "2f8253f2-bafa-4e61-9997-05b9a41adc34"). InnerVolumeSpecName "kube-api-access-rr8c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:19:58.005011 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.004967 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f8253f2-bafa-4e61-9997-05b9a41adc34" (UID: "2f8253f2-bafa-4e61-9997-05b9a41adc34"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:58.005011 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.005003 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f8253f2-bafa-4e61-9997-05b9a41adc34" (UID: "2f8253f2-bafa-4e61-9997-05b9a41adc34"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:58.095863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.095752 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-oauth-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:58.095863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.095782 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-oauth-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:58.095863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.095796 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr8c6\" (UniqueName: \"kubernetes.io/projected/2f8253f2-bafa-4e61-9997-05b9a41adc34-kube-api-access-rr8c6\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:58.095863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.095835 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-service-ca\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:58.095863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.095852 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:58.095863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.095865 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f8253f2-bafa-4e61-9997-05b9a41adc34-console-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:19:58.583231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.583202 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65d8b947c5-7kdnr_2f8253f2-bafa-4e61-9997-05b9a41adc34/console/0.log" May 28 17:19:58.583632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.583242 2558 generic.go:358] "Generic (PLEG): container finished" podID="2f8253f2-bafa-4e61-9997-05b9a41adc34" containerID="42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee" exitCode=2 May 28 17:19:58.583632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.583297 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8b947c5-7kdnr" event={"ID":"2f8253f2-bafa-4e61-9997-05b9a41adc34","Type":"ContainerDied","Data":"42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee"} May 28 17:19:58.583632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.583315 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8b947c5-7kdnr" May 28 17:19:58.583632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.583330 2558 scope.go:117] "RemoveContainer" containerID="42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee" May 28 17:19:58.583632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.583320 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8b947c5-7kdnr" event={"ID":"2f8253f2-bafa-4e61-9997-05b9a41adc34","Type":"ContainerDied","Data":"facee192662e125987d470af017cd5d420e2ea0e8dbea212321647be0ea052d4"} May 28 17:19:58.591676 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.591653 2558 scope.go:117] "RemoveContainer" containerID="42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee" May 28 17:19:58.592028 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:19:58.592006 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee\": container with ID starting with 42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee not found: ID does not exist" containerID="42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee" May 28 17:19:58.592086 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.592038 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee"} err="failed to get container status \"42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee\": rpc error: code = NotFound desc = could not find container \"42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee\": container with ID starting with 42c11e70984e24d7205772513adaaab83c2525358b9edfd7f05d2b15511dc8ee not found: ID does not exist" May 28 17:19:58.606784 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.606749 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d8b947c5-7kdnr"] May 28 17:19:58.610918 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:58.610887 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d8b947c5-7kdnr"] May 28 17:19:59.975870 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:19:59.975771 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8253f2-bafa-4e61-9997-05b9a41adc34" path="/var/lib/kubelet/pods/2f8253f2-bafa-4e61-9997-05b9a41adc34/volumes" May 28 17:20:41.323461 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323429 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d9bdcd9c-lvr2x"] May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323715 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25586ca8-e876-4075-a4d2-c1bc7ea9aba2" containerName="registry" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323728 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="25586ca8-e876-4075-a4d2-c1bc7ea9aba2" containerName="registry" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323749 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f8253f2-bafa-4e61-9997-05b9a41adc34" containerName="console" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323756 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8253f2-bafa-4e61-9997-05b9a41adc34" containerName="console" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323766 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9213422d-5c15-4e77-b8ab-c4a7ac41c696" containerName="console" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323773 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9213422d-5c15-4e77-b8ab-c4a7ac41c696" containerName="console" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323832 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9213422d-5c15-4e77-b8ab-c4a7ac41c696" containerName="console" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323845 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="25586ca8-e876-4075-a4d2-c1bc7ea9aba2" containerName="registry" May 28 17:20:41.323953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.323854 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f8253f2-bafa-4e61-9997-05b9a41adc34" containerName="console" May 28 17:20:41.326896 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.326867 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.336704 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.336672 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d9bdcd9c-lvr2x"] May 28 17:20:41.433430 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.433383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-oauth-serving-cert\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.433430 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.433432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg86q\" (UniqueName: \"kubernetes.io/projected/d6130d48-685a-4fe9-b045-7fb0caf80612-kube-api-access-sg86q\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.433681 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.433458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-serving-cert\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.433681 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.433508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-oauth-config\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.433681 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.433557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-console-config\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.433681 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.433588 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-trusted-ca-bundle\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.433681 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.433665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-service-ca\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.534462 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.534420 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-service-ca\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.534644 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.534475 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-oauth-serving-cert\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.534705 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.534687 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sg86q\" (UniqueName: \"kubernetes.io/projected/d6130d48-685a-4fe9-b045-7fb0caf80612-kube-api-access-sg86q\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.534759 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.534749 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-serving-cert\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.534842 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.534776 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-oauth-config\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.534902 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.534846 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-console-config\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.534953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.534897 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-trusted-ca-bundle\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.535236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.535198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-service-ca\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.535236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.535212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-oauth-serving-cert\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.535493 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.535466 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-console-config\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.535654 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.535634 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-trusted-ca-bundle\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.537258 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.537233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-oauth-config\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.537348 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.537324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-serving-cert\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.544775 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.544742 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg86q\" (UniqueName: \"kubernetes.io/projected/d6130d48-685a-4fe9-b045-7fb0caf80612-kube-api-access-sg86q\") pod \"console-d9bdcd9c-lvr2x\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.636963 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.636863 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:41.771176 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:41.771136 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d9bdcd9c-lvr2x"] May 28 17:20:41.774295 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:20:41.774264 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6130d48_685a_4fe9_b045_7fb0caf80612.slice/crio-8a3b5aee727b216e8132970be945ffc787b4b3184586e98e9619abaf1818db8b WatchSource:0}: Error finding container 8a3b5aee727b216e8132970be945ffc787b4b3184586e98e9619abaf1818db8b: Status 404 returned error can't find the container with id 8a3b5aee727b216e8132970be945ffc787b4b3184586e98e9619abaf1818db8b May 28 17:20:42.710369 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:42.710332 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdcd9c-lvr2x" event={"ID":"d6130d48-685a-4fe9-b045-7fb0caf80612","Type":"ContainerStarted","Data":"2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8"} May 28 17:20:42.710369 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:42.710376 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdcd9c-lvr2x" event={"ID":"d6130d48-685a-4fe9-b045-7fb0caf80612","Type":"ContainerStarted","Data":"8a3b5aee727b216e8132970be945ffc787b4b3184586e98e9619abaf1818db8b"} May 28 17:20:42.730698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:42.730645 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d9bdcd9c-lvr2x" podStartSLOduration=1.730630208 podStartE2EDuration="1.730630208s" podCreationTimestamp="2026-05-28 17:20:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:42.730042087 +0000 UTC m=+211.358733579" watchObservedRunningTime="2026-05-28 17:20:42.730630208 +0000 UTC m=+211.359321678" May 28 17:20:51.637024 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:51.636978 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:51.637024 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:51.637024 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:51.641918 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:51.641889 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:51.740213 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:51.740174 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:20:51.791322 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:20:51.791282 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbd5b9d45-m4dql"] May 28 17:21:16.813486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:16.813438 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7bbd5b9d45-m4dql" podUID="613a925d-0cae-4a13-aada-25bd40a20ae5" containerName="console" containerID="cri-o://9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2" gracePeriod=15 May 28 17:21:17.068163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.068095 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bbd5b9d45-m4dql_613a925d-0cae-4a13-aada-25bd40a20ae5/console/0.log" May 28 17:21:17.068163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.068161 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:21:17.231013 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.230970 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-console-config\") pod \"613a925d-0cae-4a13-aada-25bd40a20ae5\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " May 28 17:21:17.231013 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231013 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-trusted-ca-bundle\") pod \"613a925d-0cae-4a13-aada-25bd40a20ae5\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " May 28 17:21:17.231251 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231048 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-oauth-config\") pod \"613a925d-0cae-4a13-aada-25bd40a20ae5\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " May 28 17:21:17.231251 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231219 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-oauth-serving-cert\") pod \"613a925d-0cae-4a13-aada-25bd40a20ae5\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " May 28 17:21:17.231356 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231312 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2zvp\" (UniqueName: \"kubernetes.io/projected/613a925d-0cae-4a13-aada-25bd40a20ae5-kube-api-access-p2zvp\") pod \"613a925d-0cae-4a13-aada-25bd40a20ae5\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " May 28 17:21:17.231356 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231348 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-service-ca\") pod \"613a925d-0cae-4a13-aada-25bd40a20ae5\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " May 28 17:21:17.231459 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231382 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-serving-cert\") pod \"613a925d-0cae-4a13-aada-25bd40a20ae5\" (UID: \"613a925d-0cae-4a13-aada-25bd40a20ae5\") " May 28 17:21:17.231538 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231490 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-console-config" (OuterVolumeSpecName: "console-config") pod "613a925d-0cae-4a13-aada-25bd40a20ae5" (UID: "613a925d-0cae-4a13-aada-25bd40a20ae5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:17.231726 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231578 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "613a925d-0cae-4a13-aada-25bd40a20ae5" (UID: "613a925d-0cae-4a13-aada-25bd40a20ae5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:17.231726 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231664 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-console-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:21:17.231726 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231687 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-trusted-ca-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:21:17.231726 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231661 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "613a925d-0cae-4a13-aada-25bd40a20ae5" (UID: "613a925d-0cae-4a13-aada-25bd40a20ae5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:17.231726 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.231714 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-service-ca" (OuterVolumeSpecName: "service-ca") pod "613a925d-0cae-4a13-aada-25bd40a20ae5" (UID: "613a925d-0cae-4a13-aada-25bd40a20ae5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:17.233388 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.233354 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "613a925d-0cae-4a13-aada-25bd40a20ae5" (UID: "613a925d-0cae-4a13-aada-25bd40a20ae5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:21:17.233508 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.233487 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613a925d-0cae-4a13-aada-25bd40a20ae5-kube-api-access-p2zvp" (OuterVolumeSpecName: "kube-api-access-p2zvp") pod "613a925d-0cae-4a13-aada-25bd40a20ae5" (UID: "613a925d-0cae-4a13-aada-25bd40a20ae5"). InnerVolumeSpecName "kube-api-access-p2zvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:21:17.233604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.233579 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "613a925d-0cae-4a13-aada-25bd40a20ae5" (UID: "613a925d-0cae-4a13-aada-25bd40a20ae5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:21:17.332802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.332702 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-oauth-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:21:17.332802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.332733 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-oauth-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:21:17.332802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.332743 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2zvp\" (UniqueName: \"kubernetes.io/projected/613a925d-0cae-4a13-aada-25bd40a20ae5-kube-api-access-p2zvp\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:21:17.332802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.332753 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/613a925d-0cae-4a13-aada-25bd40a20ae5-service-ca\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:21:17.332802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.332763 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/613a925d-0cae-4a13-aada-25bd40a20ae5-console-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:21:17.813543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.813517 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bbd5b9d45-m4dql_613a925d-0cae-4a13-aada-25bd40a20ae5/console/0.log" May 28 17:21:17.814027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.813559 2558 generic.go:358] "Generic (PLEG): container finished" podID="613a925d-0cae-4a13-aada-25bd40a20ae5" containerID="9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2" exitCode=2 May 28 17:21:17.814027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.813616 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbd5b9d45-m4dql" event={"ID":"613a925d-0cae-4a13-aada-25bd40a20ae5","Type":"ContainerDied","Data":"9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2"} May 28 17:21:17.814027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.813660 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbd5b9d45-m4dql" event={"ID":"613a925d-0cae-4a13-aada-25bd40a20ae5","Type":"ContainerDied","Data":"ca0b08b5422e08154c61ddb4db096d338d65bd29bf74d2d939e11ea29797369d"} May 28 17:21:17.814027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.813675 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbd5b9d45-m4dql" May 28 17:21:17.814027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.813681 2558 scope.go:117] "RemoveContainer" containerID="9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2" May 28 17:21:17.822505 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.822480 2558 scope.go:117] "RemoveContainer" containerID="9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2" May 28 17:21:17.822878 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:21:17.822851 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2\": container with ID starting with 9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2 not found: ID does not exist" containerID="9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2" May 28 17:21:17.822970 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.822887 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2"} err="failed to get container status \"9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2\": rpc error: code = NotFound desc = could not find container \"9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2\": container with ID starting with 9811d7da08740ebca8ed81ddfdcf9a52e30db452e021d487b18627c659720fe2 not found: ID does not exist" May 28 17:21:17.835231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.835193 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbd5b9d45-m4dql"] May 28 17:21:17.840750 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.840722 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bbd5b9d45-m4dql"] May 28 17:21:17.976044 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:17.976008 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="613a925d-0cae-4a13-aada-25bd40a20ae5" path="/var/lib/kubelet/pods/613a925d-0cae-4a13-aada-25bd40a20ae5/volumes" May 28 17:21:55.444866 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.444827 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8cd89b45-qmcjk"] May 28 17:21:55.445313 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.445138 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613a925d-0cae-4a13-aada-25bd40a20ae5" containerName="console" May 28 17:21:55.445313 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.445153 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="613a925d-0cae-4a13-aada-25bd40a20ae5" containerName="console" May 28 17:21:55.445313 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.445203 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="613a925d-0cae-4a13-aada-25bd40a20ae5" containerName="console" May 28 17:21:55.448408 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.448377 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.460331 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.460292 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8cd89b45-qmcjk"] May 28 17:21:55.538624 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.538562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-oauth-serving-cert\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.538624 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.538627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-service-ca\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.538904 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.538656 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-serving-cert\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.538904 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.538673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-oauth-config\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.538904 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.538699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5566\" (UniqueName: \"kubernetes.io/projected/76656abc-a95c-4127-b765-caf00c62eb9e-kube-api-access-m5566\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.538904 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.538787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-trusted-ca-bundle\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.538904 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.538863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-console-config\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.639730 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.639684 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-trusted-ca-bundle\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.639730 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.639735 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-console-config\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.639766 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-oauth-serving-cert\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.639781 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-service-ca\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.639799 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-serving-cert\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.639846 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-oauth-config\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.639881 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5566\" (UniqueName: \"kubernetes.io/projected/76656abc-a95c-4127-b765-caf00c62eb9e-kube-api-access-m5566\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.640675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-oauth-serving-cert\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.640698 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-trusted-ca-bundle\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640927 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.640675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-console-config\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.640927 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.640675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-service-ca\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.642520 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.642485 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-oauth-config\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.642653 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.642577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-serving-cert\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.649323 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.649294 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5566\" (UniqueName: \"kubernetes.io/projected/76656abc-a95c-4127-b765-caf00c62eb9e-kube-api-access-m5566\") pod \"console-5c8cd89b45-qmcjk\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.758503 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.758461 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:21:55.896504 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.896476 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8cd89b45-qmcjk"] May 28 17:21:55.899238 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:21:55.899202 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76656abc_a95c_4127_b765_caf00c62eb9e.slice/crio-35b8415b84c4fdfc6598f222a18ec435295b130f6102127ebfb7dec04d1252fe WatchSource:0}: Error finding container 35b8415b84c4fdfc6598f222a18ec435295b130f6102127ebfb7dec04d1252fe: Status 404 returned error can't find the container with id 35b8415b84c4fdfc6598f222a18ec435295b130f6102127ebfb7dec04d1252fe May 28 17:21:55.927617 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:55.927580 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cd89b45-qmcjk" event={"ID":"76656abc-a95c-4127-b765-caf00c62eb9e","Type":"ContainerStarted","Data":"35b8415b84c4fdfc6598f222a18ec435295b130f6102127ebfb7dec04d1252fe"} May 28 17:21:56.932335 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:56.932298 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cd89b45-qmcjk" event={"ID":"76656abc-a95c-4127-b765-caf00c62eb9e","Type":"ContainerStarted","Data":"fe3c21ba267bc0e43f387ea355c9d053c233becde56c96fd1ffc80e0bc59af90"} May 28 17:21:56.950582 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:21:56.950513 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c8cd89b45-qmcjk" podStartSLOduration=1.950492905 podStartE2EDuration="1.950492905s" podCreationTimestamp="2026-05-28 17:21:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:21:56.949780686 +0000 UTC m=+285.578472156" watchObservedRunningTime="2026-05-28 17:21:56.950492905 +0000 UTC m=+285.579184375" May 28 17:22:05.759445 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:05.759391 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:22:05.759445 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:05.759453 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:22:05.764321 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:05.764291 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:22:05.963365 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:05.963327 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:22:06.013826 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:06.013709 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d9bdcd9c-lvr2x"] May 28 17:22:11.846824 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:11.846780 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:22:11.847277 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:11.846973 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:22:11.849653 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:11.849627 2558 kubelet.go:1628] "Image garbage collection succeeded" May 28 17:22:31.035511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.035445 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d9bdcd9c-lvr2x" podUID="d6130d48-685a-4fe9-b045-7fb0caf80612" containerName="console" containerID="cri-o://2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8" gracePeriod=15 May 28 17:22:31.281320 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.281294 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d9bdcd9c-lvr2x_d6130d48-685a-4fe9-b045-7fb0caf80612/console/0.log" May 28 17:22:31.281463 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.281360 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:22:31.330339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330242 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg86q\" (UniqueName: \"kubernetes.io/projected/d6130d48-685a-4fe9-b045-7fb0caf80612-kube-api-access-sg86q\") pod \"d6130d48-685a-4fe9-b045-7fb0caf80612\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " May 28 17:22:31.330339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330301 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-serving-cert\") pod \"d6130d48-685a-4fe9-b045-7fb0caf80612\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " May 28 17:22:31.330339 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330342 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-oauth-serving-cert\") pod \"d6130d48-685a-4fe9-b045-7fb0caf80612\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " May 28 17:22:31.330612 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330366 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-service-ca\") pod \"d6130d48-685a-4fe9-b045-7fb0caf80612\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " May 28 17:22:31.330612 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330388 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-oauth-config\") pod \"d6130d48-685a-4fe9-b045-7fb0caf80612\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " May 28 17:22:31.330612 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330498 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-console-config\") pod \"d6130d48-685a-4fe9-b045-7fb0caf80612\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " May 28 17:22:31.330612 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330541 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-trusted-ca-bundle\") pod \"d6130d48-685a-4fe9-b045-7fb0caf80612\" (UID: \"d6130d48-685a-4fe9-b045-7fb0caf80612\") " May 28 17:22:31.330841 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330761 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6130d48-685a-4fe9-b045-7fb0caf80612" (UID: "d6130d48-685a-4fe9-b045-7fb0caf80612"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:22:31.330841 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.330802 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6130d48-685a-4fe9-b045-7fb0caf80612" (UID: "d6130d48-685a-4fe9-b045-7fb0caf80612"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:22:31.331080 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.331038 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-console-config" (OuterVolumeSpecName: "console-config") pod "d6130d48-685a-4fe9-b045-7fb0caf80612" (UID: "d6130d48-685a-4fe9-b045-7fb0caf80612"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:22:31.331200 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.331160 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d6130d48-685a-4fe9-b045-7fb0caf80612" (UID: "d6130d48-685a-4fe9-b045-7fb0caf80612"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:22:31.332557 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.332532 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6130d48-685a-4fe9-b045-7fb0caf80612" (UID: "d6130d48-685a-4fe9-b045-7fb0caf80612"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:22:31.332655 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.332559 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6130d48-685a-4fe9-b045-7fb0caf80612-kube-api-access-sg86q" (OuterVolumeSpecName: "kube-api-access-sg86q") pod "d6130d48-685a-4fe9-b045-7fb0caf80612" (UID: "d6130d48-685a-4fe9-b045-7fb0caf80612"). InnerVolumeSpecName "kube-api-access-sg86q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:22:31.332655 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.332622 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6130d48-685a-4fe9-b045-7fb0caf80612" (UID: "d6130d48-685a-4fe9-b045-7fb0caf80612"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:22:31.431348 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.431300 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-console-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:22:31.431348 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.431337 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-trusted-ca-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:22:31.431348 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.431351 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg86q\" (UniqueName: \"kubernetes.io/projected/d6130d48-685a-4fe9-b045-7fb0caf80612-kube-api-access-sg86q\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:22:31.431585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.431361 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:22:31.431585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.431371 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-oauth-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:22:31.431585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.431382 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6130d48-685a-4fe9-b045-7fb0caf80612-service-ca\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:22:31.431585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:31.431395 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6130d48-685a-4fe9-b045-7fb0caf80612-console-oauth-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:22:32.032696 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.032666 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d9bdcd9c-lvr2x_d6130d48-685a-4fe9-b045-7fb0caf80612/console/0.log" May 28 17:22:32.032882 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.032714 2558 generic.go:358] "Generic (PLEG): container finished" podID="d6130d48-685a-4fe9-b045-7fb0caf80612" containerID="2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8" exitCode=2 May 28 17:22:32.032882 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.032786 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdcd9c-lvr2x" event={"ID":"d6130d48-685a-4fe9-b045-7fb0caf80612","Type":"ContainerDied","Data":"2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8"} May 28 17:22:32.032882 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.032838 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d9bdcd9c-lvr2x" May 28 17:22:32.032882 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.032852 2558 scope.go:117] "RemoveContainer" containerID="2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8" May 28 17:22:32.033078 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.032842 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d9bdcd9c-lvr2x" event={"ID":"d6130d48-685a-4fe9-b045-7fb0caf80612","Type":"ContainerDied","Data":"8a3b5aee727b216e8132970be945ffc787b4b3184586e98e9619abaf1818db8b"} May 28 17:22:32.041140 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.040851 2558 scope.go:117] "RemoveContainer" containerID="2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8" May 28 17:22:32.041452 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:22:32.041301 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8\": container with ID starting with 2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8 not found: ID does not exist" containerID="2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8" May 28 17:22:32.041452 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.041329 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8"} err="failed to get container status \"2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8\": rpc error: code = NotFound desc = could not find container \"2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8\": container with ID starting with 2ea8470fbe21dfc9045726fe7341790c56939a6504519258f43e3ff234188fa8 not found: ID does not exist" May 28 17:22:32.050980 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.050940 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d9bdcd9c-lvr2x"] May 28 17:22:32.054731 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:32.054698 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d9bdcd9c-lvr2x"] May 28 17:22:33.976932 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:33.976892 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6130d48-685a-4fe9-b045-7fb0caf80612" path="/var/lib/kubelet/pods/d6130d48-685a-4fe9-b045-7fb0caf80612/volumes" May 28 17:22:59.244056 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.243973 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g"] May 28 17:22:59.244431 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.244295 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6130d48-685a-4fe9-b045-7fb0caf80612" containerName="console" May 28 17:22:59.244431 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.244308 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6130d48-685a-4fe9-b045-7fb0caf80612" containerName="console" May 28 17:22:59.244431 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.244394 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6130d48-685a-4fe9-b045-7fb0caf80612" containerName="console" May 28 17:22:59.247227 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.247206 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.250433 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.250405 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tqdv\"" May 28 17:22:59.250722 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.250703 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:22:59.251199 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.251185 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:22:59.255974 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.255945 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g"] May 28 17:22:59.355108 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.355071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.355288 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.355131 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.355288 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.355183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4vpk\" (UniqueName: \"kubernetes.io/projected/bbbc7157-431f-4b25-94ae-26900a13d4ae-kube-api-access-t4vpk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.456470 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.456425 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.456666 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.456486 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4vpk\" (UniqueName: \"kubernetes.io/projected/bbbc7157-431f-4b25-94ae-26900a13d4ae-kube-api-access-t4vpk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.456666 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.456516 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.456862 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.456843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.456941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.456875 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.467631 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.467589 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4vpk\" (UniqueName: \"kubernetes.io/projected/bbbc7157-431f-4b25-94ae-26900a13d4ae-kube-api-access-t4vpk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.557165 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.557128 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:22:59.693754 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.693722 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g"] May 28 17:22:59.696096 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:22:59.696064 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbc7157_431f_4b25_94ae_26900a13d4ae.slice/crio-958af0c63976225ba7cbaf232f41ad483c7ce9b870ad2078ba5e9bab0084a6a3 WatchSource:0}: Error finding container 958af0c63976225ba7cbaf232f41ad483c7ce9b870ad2078ba5e9bab0084a6a3: Status 404 returned error can't find the container with id 958af0c63976225ba7cbaf232f41ad483c7ce9b870ad2078ba5e9bab0084a6a3 May 28 17:22:59.697965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:22:59.697946 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:23:00.109301 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:00.109264 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" event={"ID":"bbbc7157-431f-4b25-94ae-26900a13d4ae","Type":"ContainerStarted","Data":"958af0c63976225ba7cbaf232f41ad483c7ce9b870ad2078ba5e9bab0084a6a3"} May 28 17:23:06.128076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:06.128032 2558 generic.go:358] "Generic (PLEG): container finished" podID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerID="8dafa48d4feb87306822a88c830679565f14c9ad7e77d36f295ef9e8ab4a750f" exitCode=0 May 28 17:23:06.128483 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:06.128124 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" event={"ID":"bbbc7157-431f-4b25-94ae-26900a13d4ae","Type":"ContainerDied","Data":"8dafa48d4feb87306822a88c830679565f14c9ad7e77d36f295ef9e8ab4a750f"} May 28 17:23:13.148289 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:13.148247 2558 generic.go:358] "Generic (PLEG): container finished" podID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerID="fa95e77d6575f09b0ddb049b6b70f5af4598d69080e04be4814b2eb15b132f50" exitCode=0 May 28 17:23:13.148678 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:13.148315 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" event={"ID":"bbbc7157-431f-4b25-94ae-26900a13d4ae","Type":"ContainerDied","Data":"fa95e77d6575f09b0ddb049b6b70f5af4598d69080e04be4814b2eb15b132f50"} May 28 17:23:20.174847 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:20.174796 2558 generic.go:358] "Generic (PLEG): container finished" podID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerID="46f45cdb8ebd588aaed794b7ddb68c0a1dd559ebafad0438b9676ddf3d9a2ed8" exitCode=0 May 28 17:23:20.175240 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:20.174845 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" event={"ID":"bbbc7157-431f-4b25-94ae-26900a13d4ae","Type":"ContainerDied","Data":"46f45cdb8ebd588aaed794b7ddb68c0a1dd559ebafad0438b9676ddf3d9a2ed8"} May 28 17:23:21.302469 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.302439 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:23:21.445580 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.445466 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-bundle\") pod \"bbbc7157-431f-4b25-94ae-26900a13d4ae\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " May 28 17:23:21.445580 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.445564 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4vpk\" (UniqueName: \"kubernetes.io/projected/bbbc7157-431f-4b25-94ae-26900a13d4ae-kube-api-access-t4vpk\") pod \"bbbc7157-431f-4b25-94ae-26900a13d4ae\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " May 28 17:23:21.445580 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.445594 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-util\") pod \"bbbc7157-431f-4b25-94ae-26900a13d4ae\" (UID: \"bbbc7157-431f-4b25-94ae-26900a13d4ae\") " May 28 17:23:21.446279 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.446250 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-bundle" (OuterVolumeSpecName: "bundle") pod "bbbc7157-431f-4b25-94ae-26900a13d4ae" (UID: "bbbc7157-431f-4b25-94ae-26900a13d4ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:21.447755 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.447719 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbbc7157-431f-4b25-94ae-26900a13d4ae-kube-api-access-t4vpk" (OuterVolumeSpecName: "kube-api-access-t4vpk") pod "bbbc7157-431f-4b25-94ae-26900a13d4ae" (UID: "bbbc7157-431f-4b25-94ae-26900a13d4ae"). InnerVolumeSpecName "kube-api-access-t4vpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:23:21.450460 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.450423 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-util" (OuterVolumeSpecName: "util") pod "bbbc7157-431f-4b25-94ae-26900a13d4ae" (UID: "bbbc7157-431f-4b25-94ae-26900a13d4ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:21.546275 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.546219 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4vpk\" (UniqueName: \"kubernetes.io/projected/bbbc7157-431f-4b25-94ae-26900a13d4ae-kube-api-access-t4vpk\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:21.546275 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.546265 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:21.546275 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:21.546276 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbbc7157-431f-4b25-94ae-26900a13d4ae-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:22.182543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:22.182503 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" event={"ID":"bbbc7157-431f-4b25-94ae-26900a13d4ae","Type":"ContainerDied","Data":"958af0c63976225ba7cbaf232f41ad483c7ce9b870ad2078ba5e9bab0084a6a3"} May 28 17:23:22.182543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:22.182541 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvrf9g" May 28 17:23:22.182543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:22.182548 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="958af0c63976225ba7cbaf232f41ad483c7ce9b870ad2078ba5e9bab0084a6a3" May 28 17:23:27.297321 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297278 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4"] May 28 17:23:27.297723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297572 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerName="extract" May 28 17:23:27.297723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297594 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerName="extract" May 28 17:23:27.297723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297604 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerName="util" May 28 17:23:27.297723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297610 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerName="util" May 28 17:23:27.297723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297618 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerName="pull" May 28 17:23:27.297723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297623 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerName="pull" May 28 17:23:27.297723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.297669 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbbc7157-431f-4b25-94ae-26900a13d4ae" containerName="extract" May 28 17:23:27.300081 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.300062 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.302843 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.302806 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 28 17:23:27.302978 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.302822 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 28 17:23:27.302978 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.302896 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-28fzd\"" May 28 17:23:27.310988 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.310955 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4"] May 28 17:23:27.388420 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.388369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt9mf\" (UniqueName: \"kubernetes.io/projected/e86dd74e-2d00-456d-9e76-427d65047f18-kube-api-access-xt9mf\") pod \"cert-manager-operator-controller-manager-54b9655956-sz5r4\" (UID: \"e86dd74e-2d00-456d-9e76-427d65047f18\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.388605 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.388473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e86dd74e-2d00-456d-9e76-427d65047f18-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-sz5r4\" (UID: \"e86dd74e-2d00-456d-9e76-427d65047f18\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.489716 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.489675 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xt9mf\" (UniqueName: \"kubernetes.io/projected/e86dd74e-2d00-456d-9e76-427d65047f18-kube-api-access-xt9mf\") pod \"cert-manager-operator-controller-manager-54b9655956-sz5r4\" (UID: \"e86dd74e-2d00-456d-9e76-427d65047f18\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.489892 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.489743 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e86dd74e-2d00-456d-9e76-427d65047f18-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-sz5r4\" (UID: \"e86dd74e-2d00-456d-9e76-427d65047f18\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.490133 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.490115 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e86dd74e-2d00-456d-9e76-427d65047f18-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-sz5r4\" (UID: \"e86dd74e-2d00-456d-9e76-427d65047f18\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.499062 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.499035 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt9mf\" (UniqueName: \"kubernetes.io/projected/e86dd74e-2d00-456d-9e76-427d65047f18-kube-api-access-xt9mf\") pod \"cert-manager-operator-controller-manager-54b9655956-sz5r4\" (UID: \"e86dd74e-2d00-456d-9e76-427d65047f18\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.610331 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.610239 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" May 28 17:23:27.752131 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:27.752068 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4"] May 28 17:23:27.756921 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:23:27.756885 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode86dd74e_2d00_456d_9e76_427d65047f18.slice/crio-de2d527c053591561426bce82d00e858999714ff2dd929275a89630c5e44fd98 WatchSource:0}: Error finding container de2d527c053591561426bce82d00e858999714ff2dd929275a89630c5e44fd98: Status 404 returned error can't find the container with id de2d527c053591561426bce82d00e858999714ff2dd929275a89630c5e44fd98 May 28 17:23:28.202356 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:28.202319 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" event={"ID":"e86dd74e-2d00-456d-9e76-427d65047f18","Type":"ContainerStarted","Data":"de2d527c053591561426bce82d00e858999714ff2dd929275a89630c5e44fd98"} May 28 17:23:30.210713 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:30.210672 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" event={"ID":"e86dd74e-2d00-456d-9e76-427d65047f18","Type":"ContainerStarted","Data":"083b44eed908b0471819f7ebc0f557e3ad3663150b04831e99add2f8c8b6a9cf"} May 28 17:23:30.232798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:30.232743 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-sz5r4" podStartSLOduration=1.66846713 podStartE2EDuration="3.232728378s" podCreationTimestamp="2026-05-28 17:23:27 +0000 UTC" firstStartedPulling="2026-05-28 17:23:27.759422146 +0000 UTC m=+376.388113592" lastFinishedPulling="2026-05-28 17:23:29.323683389 +0000 UTC m=+377.952374840" observedRunningTime="2026-05-28 17:23:30.231192978 +0000 UTC m=+378.859884450" watchObservedRunningTime="2026-05-28 17:23:30.232728378 +0000 UTC m=+378.861419847" May 28 17:23:31.811989 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.811950 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8"] May 28 17:23:31.814357 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.814335 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.817050 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.817023 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:23:31.817853 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.817831 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:23:31.817962 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.817866 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tqdv\"" May 28 17:23:31.818027 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.818010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.818077 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.818038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcb69\" (UniqueName: \"kubernetes.io/projected/814faf59-ac6d-4c1f-8f23-c307023d3566-kube-api-access-xcb69\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.818077 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.818071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.824121 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.824090 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8"] May 28 17:23:31.918885 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.918841 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.919088 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.918923 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.919088 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.918958 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcb69\" (UniqueName: \"kubernetes.io/projected/814faf59-ac6d-4c1f-8f23-c307023d3566-kube-api-access-xcb69\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.919282 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.919260 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.919345 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.919302 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:31.931018 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:31.930979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcb69\" (UniqueName: \"kubernetes.io/projected/814faf59-ac6d-4c1f-8f23-c307023d3566-kube-api-access-xcb69\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:32.125177 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.125081 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:32.260292 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.260264 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8"] May 28 17:23:32.262930 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:23:32.262899 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814faf59_ac6d_4c1f_8f23_c307023d3566.slice/crio-8af6d99639209f198a866e418a8b0f666a81e86a14ba1d32634432c6552e8b96 WatchSource:0}: Error finding container 8af6d99639209f198a866e418a8b0f666a81e86a14ba1d32634432c6552e8b96: Status 404 returned error can't find the container with id 8af6d99639209f198a866e418a8b0f666a81e86a14ba1d32634432c6552e8b96 May 28 17:23:32.757881 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.757838 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-2jktr"] May 28 17:23:32.760022 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.760001 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:32.762898 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.762872 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 28 17:23:32.763040 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.762872 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 28 17:23:32.763040 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.762970 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r79p2\"" May 28 17:23:32.769378 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.769349 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-2jktr"] May 28 17:23:32.825968 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.825919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/435d56d3-67a9-4512-9ccb-1f9fae71f7a1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-2jktr\" (UID: \"435d56d3-67a9-4512-9ccb-1f9fae71f7a1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:32.826393 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.826047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hj4t\" (UniqueName: \"kubernetes.io/projected/435d56d3-67a9-4512-9ccb-1f9fae71f7a1-kube-api-access-9hj4t\") pod \"cert-manager-webhook-587ccfb98-2jktr\" (UID: \"435d56d3-67a9-4512-9ccb-1f9fae71f7a1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:32.926687 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.926646 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hj4t\" (UniqueName: \"kubernetes.io/projected/435d56d3-67a9-4512-9ccb-1f9fae71f7a1-kube-api-access-9hj4t\") pod \"cert-manager-webhook-587ccfb98-2jktr\" (UID: \"435d56d3-67a9-4512-9ccb-1f9fae71f7a1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:32.926854 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.926710 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/435d56d3-67a9-4512-9ccb-1f9fae71f7a1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-2jktr\" (UID: \"435d56d3-67a9-4512-9ccb-1f9fae71f7a1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:32.935571 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.935540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/435d56d3-67a9-4512-9ccb-1f9fae71f7a1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-2jktr\" (UID: \"435d56d3-67a9-4512-9ccb-1f9fae71f7a1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:32.935681 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:32.935574 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hj4t\" (UniqueName: \"kubernetes.io/projected/435d56d3-67a9-4512-9ccb-1f9fae71f7a1-kube-api-access-9hj4t\") pod \"cert-manager-webhook-587ccfb98-2jktr\" (UID: \"435d56d3-67a9-4512-9ccb-1f9fae71f7a1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:33.070884 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.070756 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:33.204207 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.203895 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-2jktr"] May 28 17:23:33.206707 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:23:33.206682 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod435d56d3_67a9_4512_9ccb_1f9fae71f7a1.slice/crio-e163e80abeb92396a8aa60285d280d15841675684ec8f100562b158856eb5a5d WatchSource:0}: Error finding container e163e80abeb92396a8aa60285d280d15841675684ec8f100562b158856eb5a5d: Status 404 returned error can't find the container with id e163e80abeb92396a8aa60285d280d15841675684ec8f100562b158856eb5a5d May 28 17:23:33.223944 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.223909 2558 generic.go:358] "Generic (PLEG): container finished" podID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerID="4eee75c99bf7fe62b7a9803104240ab61ca92780648a3251fbf78fadfc1a0473" exitCode=0 May 28 17:23:33.224108 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.224006 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" event={"ID":"814faf59-ac6d-4c1f-8f23-c307023d3566","Type":"ContainerDied","Data":"4eee75c99bf7fe62b7a9803104240ab61ca92780648a3251fbf78fadfc1a0473"} May 28 17:23:33.224108 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.224048 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" event={"ID":"814faf59-ac6d-4c1f-8f23-c307023d3566","Type":"ContainerStarted","Data":"8af6d99639209f198a866e418a8b0f666a81e86a14ba1d32634432c6552e8b96"} May 28 17:23:33.225106 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.225080 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" event={"ID":"435d56d3-67a9-4512-9ccb-1f9fae71f7a1","Type":"ContainerStarted","Data":"e163e80abeb92396a8aa60285d280d15841675684ec8f100562b158856eb5a5d"} May 28 17:23:33.789414 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.789367 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-s8fvd"] May 28 17:23:33.791764 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.791739 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:33.794321 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.794292 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jf4xx\"" May 28 17:23:33.803595 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.803559 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-s8fvd"] May 28 17:23:33.832142 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.832100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrwc2\" (UniqueName: \"kubernetes.io/projected/744db068-b0f3-4399-a68f-86c6446e016e-kube-api-access-vrwc2\") pod \"cert-manager-cainjector-68b757865b-s8fvd\" (UID: \"744db068-b0f3-4399-a68f-86c6446e016e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:33.832600 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.832240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/744db068-b0f3-4399-a68f-86c6446e016e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-s8fvd\" (UID: \"744db068-b0f3-4399-a68f-86c6446e016e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:33.933416 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.933376 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/744db068-b0f3-4399-a68f-86c6446e016e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-s8fvd\" (UID: \"744db068-b0f3-4399-a68f-86c6446e016e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:33.933610 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.933447 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrwc2\" (UniqueName: \"kubernetes.io/projected/744db068-b0f3-4399-a68f-86c6446e016e-kube-api-access-vrwc2\") pod \"cert-manager-cainjector-68b757865b-s8fvd\" (UID: \"744db068-b0f3-4399-a68f-86c6446e016e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:33.942331 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.942296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/744db068-b0f3-4399-a68f-86c6446e016e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-s8fvd\" (UID: \"744db068-b0f3-4399-a68f-86c6446e016e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:33.942532 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:33.942506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrwc2\" (UniqueName: \"kubernetes.io/projected/744db068-b0f3-4399-a68f-86c6446e016e-kube-api-access-vrwc2\") pod \"cert-manager-cainjector-68b757865b-s8fvd\" (UID: \"744db068-b0f3-4399-a68f-86c6446e016e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:34.105323 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:34.105229 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" May 28 17:23:34.266934 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:34.266886 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-s8fvd"] May 28 17:23:34.272747 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:23:34.272706 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod744db068_b0f3_4399_a68f_86c6446e016e.slice/crio-6af81d99723bc82bb2e52a702cc521731bf701cc52c98ec32c82812488557ec8 WatchSource:0}: Error finding container 6af81d99723bc82bb2e52a702cc521731bf701cc52c98ec32c82812488557ec8: Status 404 returned error can't find the container with id 6af81d99723bc82bb2e52a702cc521731bf701cc52c98ec32c82812488557ec8 May 28 17:23:35.238768 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:35.238730 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" event={"ID":"744db068-b0f3-4399-a68f-86c6446e016e","Type":"ContainerStarted","Data":"6af81d99723bc82bb2e52a702cc521731bf701cc52c98ec32c82812488557ec8"} May 28 17:23:36.245078 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:36.244962 2558 generic.go:358] "Generic (PLEG): container finished" podID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerID="9442cb434d2b695d185945f9bf1d2c277590043570d765d96c0345d3ccbeac3e" exitCode=0 May 28 17:23:36.245078 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:36.245019 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" event={"ID":"814faf59-ac6d-4c1f-8f23-c307023d3566","Type":"ContainerDied","Data":"9442cb434d2b695d185945f9bf1d2c277590043570d765d96c0345d3ccbeac3e"} May 28 17:23:37.251007 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:37.250970 2558 generic.go:358] "Generic (PLEG): container finished" podID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerID="8298df9845e6aaec7a82d7093b7593d9e0820db9e3ff2b4e085ed88f7ab29d86" exitCode=0 May 28 17:23:37.251418 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:37.251050 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" event={"ID":"814faf59-ac6d-4c1f-8f23-c307023d3566","Type":"ContainerDied","Data":"8298df9845e6aaec7a82d7093b7593d9e0820db9e3ff2b4e085ed88f7ab29d86"} May 28 17:23:37.252482 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:37.252452 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" event={"ID":"435d56d3-67a9-4512-9ccb-1f9fae71f7a1","Type":"ContainerStarted","Data":"1d3dae245a0c021157b7ab8ecf6b0c3a705701ce3b572ed3566172dea1c39c62"} May 28 17:23:37.252592 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:37.252558 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:37.253794 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:37.253770 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" event={"ID":"744db068-b0f3-4399-a68f-86c6446e016e","Type":"ContainerStarted","Data":"6efbec0b980d0cf79ee8c3010bdffe71703d7e3ff30ce41dfc7d621852a58067"} May 28 17:23:37.290420 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:37.290341 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-s8fvd" podStartSLOduration=2.036096756 podStartE2EDuration="4.290324621s" podCreationTimestamp="2026-05-28 17:23:33 +0000 UTC" firstStartedPulling="2026-05-28 17:23:34.276182325 +0000 UTC m=+382.904873776" lastFinishedPulling="2026-05-28 17:23:36.530410193 +0000 UTC m=+385.159101641" observedRunningTime="2026-05-28 17:23:37.288487551 +0000 UTC m=+385.917179023" watchObservedRunningTime="2026-05-28 17:23:37.290324621 +0000 UTC m=+385.919016089" May 28 17:23:37.305097 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:37.305030 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" podStartSLOduration=1.990138218 podStartE2EDuration="5.305006504s" podCreationTimestamp="2026-05-28 17:23:32 +0000 UTC" firstStartedPulling="2026-05-28 17:23:33.208722768 +0000 UTC m=+381.837414214" lastFinishedPulling="2026-05-28 17:23:36.52359105 +0000 UTC m=+385.152282500" observedRunningTime="2026-05-28 17:23:37.304150046 +0000 UTC m=+385.932841514" watchObservedRunningTime="2026-05-28 17:23:37.305006504 +0000 UTC m=+385.933697974" May 28 17:23:38.389901 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.389874 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:38.473074 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.473031 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-util\") pod \"814faf59-ac6d-4c1f-8f23-c307023d3566\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " May 28 17:23:38.473074 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.473074 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-bundle\") pod \"814faf59-ac6d-4c1f-8f23-c307023d3566\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " May 28 17:23:38.473292 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.473134 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcb69\" (UniqueName: \"kubernetes.io/projected/814faf59-ac6d-4c1f-8f23-c307023d3566-kube-api-access-xcb69\") pod \"814faf59-ac6d-4c1f-8f23-c307023d3566\" (UID: \"814faf59-ac6d-4c1f-8f23-c307023d3566\") " May 28 17:23:38.473511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.473472 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-bundle" (OuterVolumeSpecName: "bundle") pod "814faf59-ac6d-4c1f-8f23-c307023d3566" (UID: "814faf59-ac6d-4c1f-8f23-c307023d3566"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:38.475310 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.475281 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/814faf59-ac6d-4c1f-8f23-c307023d3566-kube-api-access-xcb69" (OuterVolumeSpecName: "kube-api-access-xcb69") pod "814faf59-ac6d-4c1f-8f23-c307023d3566" (UID: "814faf59-ac6d-4c1f-8f23-c307023d3566"). InnerVolumeSpecName "kube-api-access-xcb69". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:23:38.477437 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.477406 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-util" (OuterVolumeSpecName: "util") pod "814faf59-ac6d-4c1f-8f23-c307023d3566" (UID: "814faf59-ac6d-4c1f-8f23-c307023d3566"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:38.574066 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.573961 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcb69\" (UniqueName: \"kubernetes.io/projected/814faf59-ac6d-4c1f-8f23-c307023d3566-kube-api-access-xcb69\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:38.574066 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.573996 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:38.574066 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:38.574011 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814faf59-ac6d-4c1f-8f23-c307023d3566-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:39.261836 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:39.261777 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" event={"ID":"814faf59-ac6d-4c1f-8f23-c307023d3566","Type":"ContainerDied","Data":"8af6d99639209f198a866e418a8b0f666a81e86a14ba1d32634432c6552e8b96"} May 28 17:23:39.261836 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:39.261840 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8af6d99639209f198a866e418a8b0f666a81e86a14ba1d32634432c6552e8b96" May 28 17:23:39.262059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:39.261795 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbl2x8" May 28 17:23:43.258907 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:43.258872 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-2jktr" May 28 17:23:45.051522 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051483 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d"] May 28 17:23:45.051943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051773 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerName="pull" May 28 17:23:45.051943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051783 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerName="pull" May 28 17:23:45.051943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051793 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerName="extract" May 28 17:23:45.051943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051800 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerName="extract" May 28 17:23:45.051943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051830 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerName="util" May 28 17:23:45.051943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051836 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerName="util" May 28 17:23:45.051943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.051881 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="814faf59-ac6d-4c1f-8f23-c307023d3566" containerName="extract" May 28 17:23:45.054589 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.054568 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.057204 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.057180 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 28 17:23:45.057998 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.057980 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 28 17:23:45.058103 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.057985 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kj7rn\"" May 28 17:23:45.065947 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.065910 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d"] May 28 17:23:45.127856 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.127792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2s2n\" (UniqueName: \"kubernetes.io/projected/61332c21-c76a-483d-b262-3039cbb2725b-kube-api-access-x2s2n\") pod \"openshift-lws-operator-bfc7f696d-9v54d\" (UID: \"61332c21-c76a-483d-b262-3039cbb2725b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.128034 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.127872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61332c21-c76a-483d-b262-3039cbb2725b-tmp\") pod \"openshift-lws-operator-bfc7f696d-9v54d\" (UID: \"61332c21-c76a-483d-b262-3039cbb2725b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.228720 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.228675 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2s2n\" (UniqueName: \"kubernetes.io/projected/61332c21-c76a-483d-b262-3039cbb2725b-kube-api-access-x2s2n\") pod \"openshift-lws-operator-bfc7f696d-9v54d\" (UID: \"61332c21-c76a-483d-b262-3039cbb2725b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.228720 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.228726 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61332c21-c76a-483d-b262-3039cbb2725b-tmp\") pod \"openshift-lws-operator-bfc7f696d-9v54d\" (UID: \"61332c21-c76a-483d-b262-3039cbb2725b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.229149 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.229131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61332c21-c76a-483d-b262-3039cbb2725b-tmp\") pod \"openshift-lws-operator-bfc7f696d-9v54d\" (UID: \"61332c21-c76a-483d-b262-3039cbb2725b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.238493 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.238460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2s2n\" (UniqueName: \"kubernetes.io/projected/61332c21-c76a-483d-b262-3039cbb2725b-kube-api-access-x2s2n\") pod \"openshift-lws-operator-bfc7f696d-9v54d\" (UID: \"61332c21-c76a-483d-b262-3039cbb2725b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.364189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.364094 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" May 28 17:23:45.502077 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:45.502045 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d"] May 28 17:23:45.505070 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:23:45.505028 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61332c21_c76a_483d_b262_3039cbb2725b.slice/crio-8ea654b5b0d61a4f0d90ee7398fcd4bf37aff4dec7e85ce24efd98beb8796074 WatchSource:0}: Error finding container 8ea654b5b0d61a4f0d90ee7398fcd4bf37aff4dec7e85ce24efd98beb8796074: Status 404 returned error can't find the container with id 8ea654b5b0d61a4f0d90ee7398fcd4bf37aff4dec7e85ce24efd98beb8796074 May 28 17:23:46.286511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:46.286460 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" event={"ID":"61332c21-c76a-483d-b262-3039cbb2725b","Type":"ContainerStarted","Data":"8ea654b5b0d61a4f0d90ee7398fcd4bf37aff4dec7e85ce24efd98beb8796074"} May 28 17:23:48.296166 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:48.296117 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" event={"ID":"61332c21-c76a-483d-b262-3039cbb2725b","Type":"ContainerStarted","Data":"33630a9effa5cfb45c711f637731db975b1785db4c40ae12cd966e2bbcebfac6"} May 28 17:23:48.313977 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:48.313924 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-9v54d" podStartSLOduration=1.220121737 podStartE2EDuration="3.313909673s" podCreationTimestamp="2026-05-28 17:23:45 +0000 UTC" firstStartedPulling="2026-05-28 17:23:45.506474028 +0000 UTC m=+394.135165476" lastFinishedPulling="2026-05-28 17:23:47.600261965 +0000 UTC m=+396.228953412" observedRunningTime="2026-05-28 17:23:48.313153498 +0000 UTC m=+396.941844969" watchObservedRunningTime="2026-05-28 17:23:48.313909673 +0000 UTC m=+396.942601141" May 28 17:23:50.801296 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.801257 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp"] May 28 17:23:50.847521 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.847477 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp"] May 28 17:23:50.847674 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.847612 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.850341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.850309 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:23:50.851311 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.851289 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tqdv\"" May 28 17:23:50.851429 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.851298 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:23:50.875794 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.875758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b22t\" (UniqueName: \"kubernetes.io/projected/ffc0af26-304a-4f75-a958-c96d1e30c802-kube-api-access-2b22t\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.876015 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.875846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.876015 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.875907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.976340 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.976300 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b22t\" (UniqueName: \"kubernetes.io/projected/ffc0af26-304a-4f75-a958-c96d1e30c802-kube-api-access-2b22t\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.976520 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.976349 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.976520 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.976394 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.976740 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.976721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.976876 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.976855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:50.985290 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:50.985264 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b22t\" (UniqueName: \"kubernetes.io/projected/ffc0af26-304a-4f75-a958-c96d1e30c802-kube-api-access-2b22t\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:51.157839 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:51.157707 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:51.295858 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:51.295799 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp"] May 28 17:23:51.300440 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:23:51.300412 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc0af26_304a_4f75_a958_c96d1e30c802.slice/crio-9c0405a00a823a07847764794af4bdb44adde41604b3e0342e54f8500acc07b2 WatchSource:0}: Error finding container 9c0405a00a823a07847764794af4bdb44adde41604b3e0342e54f8500acc07b2: Status 404 returned error can't find the container with id 9c0405a00a823a07847764794af4bdb44adde41604b3e0342e54f8500acc07b2 May 28 17:23:51.306585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:51.306546 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" event={"ID":"ffc0af26-304a-4f75-a958-c96d1e30c802","Type":"ContainerStarted","Data":"9c0405a00a823a07847764794af4bdb44adde41604b3e0342e54f8500acc07b2"} May 28 17:23:52.311120 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:52.311077 2558 generic.go:358] "Generic (PLEG): container finished" podID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerID="766a4bec5859b078e3acb0b10a35c2e770c0f7044035f177166bbaa9fc2c72f8" exitCode=0 May 28 17:23:52.311639 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:52.311136 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" event={"ID":"ffc0af26-304a-4f75-a958-c96d1e30c802","Type":"ContainerDied","Data":"766a4bec5859b078e3acb0b10a35c2e770c0f7044035f177166bbaa9fc2c72f8"} May 28 17:23:54.319431 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:54.319393 2558 generic.go:358] "Generic (PLEG): container finished" podID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerID="98c026038d35688d24bd8abe4125d463ed2cee91bc815ce2b32ef0bffffc7b74" exitCode=0 May 28 17:23:54.319880 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:54.319448 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" event={"ID":"ffc0af26-304a-4f75-a958-c96d1e30c802","Type":"ContainerDied","Data":"98c026038d35688d24bd8abe4125d463ed2cee91bc815ce2b32ef0bffffc7b74"} May 28 17:23:55.324588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:55.324548 2558 generic.go:358] "Generic (PLEG): container finished" podID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerID="8a426ef4c408cc083d1dccdfe440ffc69a81990f11c53a10f9fe4951ed31d513" exitCode=0 May 28 17:23:55.324990 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:55.324597 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" event={"ID":"ffc0af26-304a-4f75-a958-c96d1e30c802","Type":"ContainerDied","Data":"8a426ef4c408cc083d1dccdfe440ffc69a81990f11c53a10f9fe4951ed31d513"} May 28 17:23:56.457137 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.457110 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:23:56.523504 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.523456 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-bundle\") pod \"ffc0af26-304a-4f75-a958-c96d1e30c802\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " May 28 17:23:56.523710 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.523533 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b22t\" (UniqueName: \"kubernetes.io/projected/ffc0af26-304a-4f75-a958-c96d1e30c802-kube-api-access-2b22t\") pod \"ffc0af26-304a-4f75-a958-c96d1e30c802\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " May 28 17:23:56.523710 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.523572 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-util\") pod \"ffc0af26-304a-4f75-a958-c96d1e30c802\" (UID: \"ffc0af26-304a-4f75-a958-c96d1e30c802\") " May 28 17:23:56.524221 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.524189 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-bundle" (OuterVolumeSpecName: "bundle") pod "ffc0af26-304a-4f75-a958-c96d1e30c802" (UID: "ffc0af26-304a-4f75-a958-c96d1e30c802"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:56.525711 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.525680 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc0af26-304a-4f75-a958-c96d1e30c802-kube-api-access-2b22t" (OuterVolumeSpecName: "kube-api-access-2b22t") pod "ffc0af26-304a-4f75-a958-c96d1e30c802" (UID: "ffc0af26-304a-4f75-a958-c96d1e30c802"). InnerVolumeSpecName "kube-api-access-2b22t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:23:56.529125 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.529075 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-util" (OuterVolumeSpecName: "util") pod "ffc0af26-304a-4f75-a958-c96d1e30c802" (UID: "ffc0af26-304a-4f75-a958-c96d1e30c802"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:56.624888 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.624781 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:56.624888 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.624840 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b22t\" (UniqueName: \"kubernetes.io/projected/ffc0af26-304a-4f75-a958-c96d1e30c802-kube-api-access-2b22t\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:56.624888 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:56.624853 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc0af26-304a-4f75-a958-c96d1e30c802-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:23:57.333226 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:57.333189 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" event={"ID":"ffc0af26-304a-4f75-a958-c96d1e30c802","Type":"ContainerDied","Data":"9c0405a00a823a07847764794af4bdb44adde41604b3e0342e54f8500acc07b2"} May 28 17:23:57.333226 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:57.333226 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c0405a00a823a07847764794af4bdb44adde41604b3e0342e54f8500acc07b2" May 28 17:23:57.333442 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:23:57.333237 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5gnbfp" May 28 17:24:04.811125 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811083 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n"] May 28 17:24:04.811507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811379 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerName="extract" May 28 17:24:04.811507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811390 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerName="extract" May 28 17:24:04.811507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811399 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerName="pull" May 28 17:24:04.811507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811407 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerName="pull" May 28 17:24:04.811507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811414 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerName="util" May 28 17:24:04.811507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811421 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerName="util" May 28 17:24:04.811507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.811470 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffc0af26-304a-4f75-a958-c96d1e30c802" containerName="extract" May 28 17:24:04.813743 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.813718 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.816830 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.816791 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:24:04.816966 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.816844 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:24:04.816966 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.816944 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tqdv\"" May 28 17:24:04.827110 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.827070 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n"] May 28 17:24:04.894720 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.894676 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.894720 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.894718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8pf\" (UniqueName: \"kubernetes.io/projected/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-kube-api-access-wb8pf\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.894975 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.894743 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.996006 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.995956 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.996184 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.996037 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.996184 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.996058 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8pf\" (UniqueName: \"kubernetes.io/projected/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-kube-api-access-wb8pf\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.996355 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.996334 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:04.996449 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:04.996430 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:05.007124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:05.007087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8pf\" (UniqueName: \"kubernetes.io/projected/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-kube-api-access-wb8pf\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:05.124200 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:05.124078 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:05.282435 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:05.282252 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n"] May 28 17:24:05.285363 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:24:05.285326 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbe80c1_a3a3_4a74_9d85_e413dd05cfd8.slice/crio-281fcda44f41a568b441860e6eab8e05ab7e217a00e2088d5fad8d6e0d1e51fb WatchSource:0}: Error finding container 281fcda44f41a568b441860e6eab8e05ab7e217a00e2088d5fad8d6e0d1e51fb: Status 404 returned error can't find the container with id 281fcda44f41a568b441860e6eab8e05ab7e217a00e2088d5fad8d6e0d1e51fb May 28 17:24:05.365177 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:05.365136 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" event={"ID":"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8","Type":"ContainerStarted","Data":"ea51f17cbd730ba8e22c139909f557925cdd9746ddfa0b5b586b702f1e8ad5c3"} May 28 17:24:05.365374 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:05.365186 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" event={"ID":"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8","Type":"ContainerStarted","Data":"281fcda44f41a568b441860e6eab8e05ab7e217a00e2088d5fad8d6e0d1e51fb"} May 28 17:24:06.370529 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:06.370435 2558 generic.go:358] "Generic (PLEG): container finished" podID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerID="ea51f17cbd730ba8e22c139909f557925cdd9746ddfa0b5b586b702f1e8ad5c3" exitCode=0 May 28 17:24:06.370931 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:06.370528 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" event={"ID":"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8","Type":"ContainerDied","Data":"ea51f17cbd730ba8e22c139909f557925cdd9746ddfa0b5b586b702f1e8ad5c3"} May 28 17:24:07.002511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.002476 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg"] May 28 17:24:07.004688 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.004670 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.009910 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.009882 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 17:24:07.010326 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.010305 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 17:24:07.010515 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.010482 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 17:24:07.013081 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.013053 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kmhgz\"" May 28 17:24:07.014303 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.014276 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 17:24:07.028278 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.028216 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg"] May 28 17:24:07.113380 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.113282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bg6z\" (UniqueName: \"kubernetes.io/projected/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-kube-api-access-9bg6z\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.113534 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.113503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.113850 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.113794 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.214716 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.214651 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.214918 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.214728 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bg6z\" (UniqueName: \"kubernetes.io/projected/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-kube-api-access-9bg6z\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.214918 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.214806 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.217380 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.217349 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.217512 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.217353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.231309 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.231267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bg6z\" (UniqueName: \"kubernetes.io/projected/3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d-kube-api-access-9bg6z\") pod \"opendatahub-operator-controller-manager-6795fd7c67-8b6xg\" (UID: \"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.315924 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.315877 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:07.377714 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.377376 2558 generic.go:358] "Generic (PLEG): container finished" podID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerID="dceb5d461c990fab1b197d3968a405567cee72ce5ad72050b28e4cf2e4fc5ff7" exitCode=0 May 28 17:24:07.377714 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.377533 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" event={"ID":"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8","Type":"ContainerDied","Data":"dceb5d461c990fab1b197d3968a405567cee72ce5ad72050b28e4cf2e4fc5ff7"} May 28 17:24:07.480886 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:07.480848 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg"] May 28 17:24:07.483548 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:24:07.483517 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8f4d31_d0f5_44e8_a5c8_1c69ab48472d.slice/crio-3f9289b0103986b9d70ceedd04464576f8a707bdf6e8797571ae41adfb019e7d WatchSource:0}: Error finding container 3f9289b0103986b9d70ceedd04464576f8a707bdf6e8797571ae41adfb019e7d: Status 404 returned error can't find the container with id 3f9289b0103986b9d70ceedd04464576f8a707bdf6e8797571ae41adfb019e7d May 28 17:24:08.384634 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:08.384585 2558 generic.go:358] "Generic (PLEG): container finished" podID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerID="e2551f2c768d6b6333e784186a37939814b4ed0f38d849a1815da54d8c82eb12" exitCode=0 May 28 17:24:08.384634 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:08.384628 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" event={"ID":"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8","Type":"ContainerDied","Data":"e2551f2c768d6b6333e784186a37939814b4ed0f38d849a1815da54d8c82eb12"} May 28 17:24:08.386471 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:08.386413 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" event={"ID":"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d","Type":"ContainerStarted","Data":"3f9289b0103986b9d70ceedd04464576f8a707bdf6e8797571ae41adfb019e7d"} May 28 17:24:09.950648 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:09.950619 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:10.041054 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.041021 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-bundle\") pod \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " May 28 17:24:10.041054 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.041058 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb8pf\" (UniqueName: \"kubernetes.io/projected/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-kube-api-access-wb8pf\") pod \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " May 28 17:24:10.041291 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.041131 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-util\") pod \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\" (UID: \"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8\") " May 28 17:24:10.042542 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.042504 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-bundle" (OuterVolumeSpecName: "bundle") pod "2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" (UID: "2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:10.043493 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.043463 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-kube-api-access-wb8pf" (OuterVolumeSpecName: "kube-api-access-wb8pf") pod "2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" (UID: "2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8"). InnerVolumeSpecName "kube-api-access-wb8pf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:10.046686 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.046655 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-util" (OuterVolumeSpecName: "util") pod "2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" (UID: "2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:10.142145 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.142112 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:10.142145 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.142145 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb8pf\" (UniqueName: \"kubernetes.io/projected/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-kube-api-access-wb8pf\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:10.142352 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.142159 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:10.395657 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.395627 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" May 28 17:24:10.395861 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.395616 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9j7l8n" event={"ID":"2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8","Type":"ContainerDied","Data":"281fcda44f41a568b441860e6eab8e05ab7e217a00e2088d5fad8d6e0d1e51fb"} May 28 17:24:10.395861 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.395743 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="281fcda44f41a568b441860e6eab8e05ab7e217a00e2088d5fad8d6e0d1e51fb" May 28 17:24:10.397206 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.397173 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" event={"ID":"3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d","Type":"ContainerStarted","Data":"25c4a88b552ad293d5468e248f6bb981a03907e8c57b619a856575b126978441"} May 28 17:24:10.397335 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.397234 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:10.427992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:10.427938 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" podStartSLOduration=1.948594692 podStartE2EDuration="4.427920377s" podCreationTimestamp="2026-05-28 17:24:06 +0000 UTC" firstStartedPulling="2026-05-28 17:24:07.485307864 +0000 UTC m=+416.113999312" lastFinishedPulling="2026-05-28 17:24:09.964633548 +0000 UTC m=+418.593324997" observedRunningTime="2026-05-28 17:24:10.425366345 +0000 UTC m=+419.054057824" watchObservedRunningTime="2026-05-28 17:24:10.427920377 +0000 UTC m=+419.056611845" May 28 17:24:11.198129 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198087 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk"] May 28 17:24:11.198511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198390 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerName="extract" May 28 17:24:11.198511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198401 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerName="extract" May 28 17:24:11.198511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198415 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerName="util" May 28 17:24:11.198511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198422 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerName="util" May 28 17:24:11.198511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198432 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerName="pull" May 28 17:24:11.198511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198438 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerName="pull" May 28 17:24:11.198511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.198490 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="2dbe80c1-a3a3-4a74-9d85-e413dd05cfd8" containerName="extract" May 28 17:24:11.201128 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.201106 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.205282 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.205250 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 28 17:24:11.206079 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.206060 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n98lm\"" May 28 17:24:11.207480 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.207453 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 28 17:24:11.208388 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.208371 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 28 17:24:11.271110 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.271072 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk"] May 28 17:24:11.351970 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.351937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscsd\" (UniqueName: \"kubernetes.io/projected/662c0da5-94e3-430c-89b7-11c33ed58ad6-kube-api-access-sscsd\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.351970 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.351975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662c0da5-94e3-430c-89b7-11c33ed58ad6-cert\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.352202 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.352011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/662c0da5-94e3-430c-89b7-11c33ed58ad6-manager-config\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.352202 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.352104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/662c0da5-94e3-430c-89b7-11c33ed58ad6-metrics-cert\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.453492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.453392 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/662c0da5-94e3-430c-89b7-11c33ed58ad6-manager-config\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.453492 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.453454 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/662c0da5-94e3-430c-89b7-11c33ed58ad6-metrics-cert\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.453694 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.453501 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sscsd\" (UniqueName: \"kubernetes.io/projected/662c0da5-94e3-430c-89b7-11c33ed58ad6-kube-api-access-sscsd\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.453694 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.453522 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662c0da5-94e3-430c-89b7-11c33ed58ad6-cert\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.454252 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.454226 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/662c0da5-94e3-430c-89b7-11c33ed58ad6-manager-config\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.456134 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.456102 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662c0da5-94e3-430c-89b7-11c33ed58ad6-cert\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.456134 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.456121 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/662c0da5-94e3-430c-89b7-11c33ed58ad6-metrics-cert\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.464520 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.464488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscsd\" (UniqueName: \"kubernetes.io/projected/662c0da5-94e3-430c-89b7-11c33ed58ad6-kube-api-access-sscsd\") pod \"lws-controller-manager-7954d66c6b-4g6zk\" (UID: \"662c0da5-94e3-430c-89b7-11c33ed58ad6\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.511267 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.511226 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:11.683259 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:11.680466 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk"] May 28 17:24:11.683845 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:24:11.683795 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662c0da5_94e3_430c_89b7_11c33ed58ad6.slice/crio-60cc6dbd2a8798d89531a0b501063d0b19d339a2eb5da7ceca2db51901b1d65c WatchSource:0}: Error finding container 60cc6dbd2a8798d89531a0b501063d0b19d339a2eb5da7ceca2db51901b1d65c: Status 404 returned error can't find the container with id 60cc6dbd2a8798d89531a0b501063d0b19d339a2eb5da7ceca2db51901b1d65c May 28 17:24:12.405205 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:12.405166 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" event={"ID":"662c0da5-94e3-430c-89b7-11c33ed58ad6","Type":"ContainerStarted","Data":"60cc6dbd2a8798d89531a0b501063d0b19d339a2eb5da7ceca2db51901b1d65c"} May 28 17:24:14.413675 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:14.413568 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" event={"ID":"662c0da5-94e3-430c-89b7-11c33ed58ad6","Type":"ContainerStarted","Data":"247dc59781c56c4e76e96d645fbbae6d32145429cd38a3669178b4b182c9a67a"} May 28 17:24:14.414163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:14.413836 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:14.433445 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:14.433385 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" podStartSLOduration=1.061498497 podStartE2EDuration="3.43336674s" podCreationTimestamp="2026-05-28 17:24:11 +0000 UTC" firstStartedPulling="2026-05-28 17:24:11.686074278 +0000 UTC m=+420.314765724" lastFinishedPulling="2026-05-28 17:24:14.057942516 +0000 UTC m=+422.686633967" observedRunningTime="2026-05-28 17:24:14.433086018 +0000 UTC m=+423.061777504" watchObservedRunningTime="2026-05-28 17:24:14.43336674 +0000 UTC m=+423.062058212" May 28 17:24:21.403689 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:21.403654 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-8b6xg" May 28 17:24:23.518011 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.517967 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5"] May 28 17:24:23.520861 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.520838 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.524419 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.524391 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:24:23.525385 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.525364 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:24:23.525466 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.525398 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tqdv\"" May 28 17:24:23.540031 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.539996 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5"] May 28 17:24:23.662457 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.662410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.662649 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.662481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.662649 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.662548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkzwh\" (UniqueName: \"kubernetes.io/projected/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-kube-api-access-qkzwh\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.763076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.763031 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.763331 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.763087 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkzwh\" (UniqueName: \"kubernetes.io/projected/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-kube-api-access-qkzwh\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.763331 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.763132 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.763438 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.763418 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.763506 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.763485 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.772863 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.772763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkzwh\" (UniqueName: \"kubernetes.io/projected/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-kube-api-access-qkzwh\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.830505 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.830452 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:23.982928 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:24:23.982890 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda37df0f_37c4_4833_a73e_e8dfbce8a0b4.slice/crio-f5d6c86e58afb1c4c9869e90d424a32dad750d97ebc22d8fde4c147444de9d02 WatchSource:0}: Error finding container f5d6c86e58afb1c4c9869e90d424a32dad750d97ebc22d8fde4c147444de9d02: Status 404 returned error can't find the container with id f5d6c86e58afb1c4c9869e90d424a32dad750d97ebc22d8fde4c147444de9d02 May 28 17:24:23.983064 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:23.982960 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5"] May 28 17:24:24.455851 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:24.455734 2558 generic.go:358] "Generic (PLEG): container finished" podID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerID="957c6e0777d64f5e82c112d769c6c5624dba17c089a4614074fcd9a72b9bcb94" exitCode=0 May 28 17:24:24.455851 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:24.455779 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" event={"ID":"da37df0f-37c4-4833-a73e-e8dfbce8a0b4","Type":"ContainerDied","Data":"957c6e0777d64f5e82c112d769c6c5624dba17c089a4614074fcd9a72b9bcb94"} May 28 17:24:24.455851 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:24.455803 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" event={"ID":"da37df0f-37c4-4833-a73e-e8dfbce8a0b4","Type":"ContainerStarted","Data":"f5d6c86e58afb1c4c9869e90d424a32dad750d97ebc22d8fde4c147444de9d02"} May 28 17:24:25.420447 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:25.420407 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-4g6zk" May 28 17:24:25.462664 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:25.462629 2558 generic.go:358] "Generic (PLEG): container finished" podID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerID="c44f58ef1228be95337db3038f6b788b1a16041be2fa82bd05d2f20c2474d553" exitCode=0 May 28 17:24:25.462806 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:25.462717 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" event={"ID":"da37df0f-37c4-4833-a73e-e8dfbce8a0b4","Type":"ContainerDied","Data":"c44f58ef1228be95337db3038f6b788b1a16041be2fa82bd05d2f20c2474d553"} May 28 17:24:26.468290 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:26.468254 2558 generic.go:358] "Generic (PLEG): container finished" podID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerID="9a46820e8245db731e10432f23e0994c9a2d41350b2d5d0032b96964a28c21fe" exitCode=0 May 28 17:24:26.468675 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:26.468346 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" event={"ID":"da37df0f-37c4-4833-a73e-e8dfbce8a0b4","Type":"ContainerDied","Data":"9a46820e8245db731e10432f23e0994c9a2d41350b2d5d0032b96964a28c21fe"} May 28 17:24:27.603549 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.603522 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:27.698634 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.698600 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkzwh\" (UniqueName: \"kubernetes.io/projected/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-kube-api-access-qkzwh\") pod \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " May 28 17:24:27.698634 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.698652 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-bundle\") pod \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " May 28 17:24:27.698909 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.698721 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-util\") pod \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\" (UID: \"da37df0f-37c4-4833-a73e-e8dfbce8a0b4\") " May 28 17:24:27.699705 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.699671 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-bundle" (OuterVolumeSpecName: "bundle") pod "da37df0f-37c4-4833-a73e-e8dfbce8a0b4" (UID: "da37df0f-37c4-4833-a73e-e8dfbce8a0b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:27.701005 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.700974 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-kube-api-access-qkzwh" (OuterVolumeSpecName: "kube-api-access-qkzwh") pod "da37df0f-37c4-4833-a73e-e8dfbce8a0b4" (UID: "da37df0f-37c4-4833-a73e-e8dfbce8a0b4"). InnerVolumeSpecName "kube-api-access-qkzwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:27.707765 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.707707 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-util" (OuterVolumeSpecName: "util") pod "da37df0f-37c4-4833-a73e-e8dfbce8a0b4" (UID: "da37df0f-37c4-4833-a73e-e8dfbce8a0b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:27.799924 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.799885 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkzwh\" (UniqueName: \"kubernetes.io/projected/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-kube-api-access-qkzwh\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:27.799924 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.799922 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:27.799924 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:27.799933 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da37df0f-37c4-4833-a73e-e8dfbce8a0b4-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:28.477498 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:28.477461 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" event={"ID":"da37df0f-37c4-4833-a73e-e8dfbce8a0b4","Type":"ContainerDied","Data":"f5d6c86e58afb1c4c9869e90d424a32dad750d97ebc22d8fde4c147444de9d02"} May 28 17:24:28.477498 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:28.477498 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5d6c86e58afb1c4c9869e90d424a32dad750d97ebc22d8fde4c147444de9d02" May 28 17:24:28.482787 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:28.477800 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gzbc5" May 28 17:24:37.652609 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.652513 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj"] May 28 17:24:37.653037 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.652990 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerName="pull" May 28 17:24:37.653037 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.653006 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerName="pull" May 28 17:24:37.653037 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.653028 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerName="extract" May 28 17:24:37.653037 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.653037 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerName="extract" May 28 17:24:37.653175 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.653055 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerName="util" May 28 17:24:37.653175 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.653063 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerName="util" May 28 17:24:37.653175 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.653138 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="da37df0f-37c4-4833-a73e-e8dfbce8a0b4" containerName="extract" May 28 17:24:37.656799 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.656773 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.661622 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.661588 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:24:37.662091 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.662072 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tqdv\"" May 28 17:24:37.662548 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.662531 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:24:37.667126 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.667094 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj"] May 28 17:24:37.679703 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.679653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.679897 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.679783 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6zhz\" (UniqueName: \"kubernetes.io/projected/2208d7fa-0076-4b4e-a088-f812ad2b70c0-kube-api-access-m6zhz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.679956 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.679896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.781270 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.781216 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6zhz\" (UniqueName: \"kubernetes.io/projected/2208d7fa-0076-4b4e-a088-f812ad2b70c0-kube-api-access-m6zhz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.781473 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.781286 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.781473 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.781318 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.781709 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.781691 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.781788 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.781767 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.804748 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.804712 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6zhz\" (UniqueName: \"kubernetes.io/projected/2208d7fa-0076-4b4e-a088-f812ad2b70c0-kube-api-access-m6zhz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:37.968451 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:37.968353 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:38.134497 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:38.134461 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj"] May 28 17:24:38.136469 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:24:38.136440 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2208d7fa_0076_4b4e_a088_f812ad2b70c0.slice/crio-7aeb8f08510623f5b198808ea33c2ee32cedc519ddeda047ea4eea9feab287e1 WatchSource:0}: Error finding container 7aeb8f08510623f5b198808ea33c2ee32cedc519ddeda047ea4eea9feab287e1: Status 404 returned error can't find the container with id 7aeb8f08510623f5b198808ea33c2ee32cedc519ddeda047ea4eea9feab287e1 May 28 17:24:38.516257 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:38.516212 2558 generic.go:358] "Generic (PLEG): container finished" podID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerID="a4067f42730d7d7969af2fadcc556de678cba876a0f9abe51cfbf1588b9c6d2e" exitCode=0 May 28 17:24:38.516448 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:38.516280 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" event={"ID":"2208d7fa-0076-4b4e-a088-f812ad2b70c0","Type":"ContainerDied","Data":"a4067f42730d7d7969af2fadcc556de678cba876a0f9abe51cfbf1588b9c6d2e"} May 28 17:24:38.516448 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:38.516309 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" event={"ID":"2208d7fa-0076-4b4e-a088-f812ad2b70c0","Type":"ContainerStarted","Data":"7aeb8f08510623f5b198808ea33c2ee32cedc519ddeda047ea4eea9feab287e1"} May 28 17:24:40.526426 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:40.526391 2558 generic.go:358] "Generic (PLEG): container finished" podID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerID="9780ba1f87f1cbfcb96ae6031375c1dcb4e2ddebe9994eb383fed466f6630346" exitCode=0 May 28 17:24:40.526930 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:40.526483 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" event={"ID":"2208d7fa-0076-4b4e-a088-f812ad2b70c0","Type":"ContainerDied","Data":"9780ba1f87f1cbfcb96ae6031375c1dcb4e2ddebe9994eb383fed466f6630346"} May 28 17:24:41.532572 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:41.532533 2558 generic.go:358] "Generic (PLEG): container finished" podID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerID="d569593a74e9794c4d41994a72bff6b8b4e5dc7b3fd1261c369fad7766407477" exitCode=0 May 28 17:24:41.532981 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:41.532607 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" event={"ID":"2208d7fa-0076-4b4e-a088-f812ad2b70c0","Type":"ContainerDied","Data":"d569593a74e9794c4d41994a72bff6b8b4e5dc7b3fd1261c369fad7766407477"} May 28 17:24:42.672065 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.672036 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:42.725432 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.725397 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6zhz\" (UniqueName: \"kubernetes.io/projected/2208d7fa-0076-4b4e-a088-f812ad2b70c0-kube-api-access-m6zhz\") pod \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " May 28 17:24:42.725432 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.725451 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-bundle\") pod \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " May 28 17:24:42.725696 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.725497 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-util\") pod \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\" (UID: \"2208d7fa-0076-4b4e-a088-f812ad2b70c0\") " May 28 17:24:42.726521 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.726492 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-bundle" (OuterVolumeSpecName: "bundle") pod "2208d7fa-0076-4b4e-a088-f812ad2b70c0" (UID: "2208d7fa-0076-4b4e-a088-f812ad2b70c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:42.727708 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.727683 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2208d7fa-0076-4b4e-a088-f812ad2b70c0-kube-api-access-m6zhz" (OuterVolumeSpecName: "kube-api-access-m6zhz") pod "2208d7fa-0076-4b4e-a088-f812ad2b70c0" (UID: "2208d7fa-0076-4b4e-a088-f812ad2b70c0"). InnerVolumeSpecName "kube-api-access-m6zhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:42.731553 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.731514 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-util" (OuterVolumeSpecName: "util") pod "2208d7fa-0076-4b4e-a088-f812ad2b70c0" (UID: "2208d7fa-0076-4b4e-a088-f812ad2b70c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:42.826679 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.826566 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6zhz\" (UniqueName: \"kubernetes.io/projected/2208d7fa-0076-4b4e-a088-f812ad2b70c0-kube-api-access-m6zhz\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:42.826679 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.826613 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:42.826679 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:42.826624 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2208d7fa-0076-4b4e-a088-f812ad2b70c0-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:24:43.541901 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:43.541863 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" event={"ID":"2208d7fa-0076-4b4e-a088-f812ad2b70c0","Type":"ContainerDied","Data":"7aeb8f08510623f5b198808ea33c2ee32cedc519ddeda047ea4eea9feab287e1"} May 28 17:24:43.541901 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:43.541905 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7aeb8f08510623f5b198808ea33c2ee32cedc519ddeda047ea4eea9feab287e1" May 28 17:24:43.542163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:43.541871 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axrjcj" May 28 17:24:58.061659 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.061616 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg"] May 28 17:24:58.062212 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.061970 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerName="extract" May 28 17:24:58.062212 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.061982 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerName="extract" May 28 17:24:58.062212 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.061994 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerName="pull" May 28 17:24:58.062212 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.061999 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerName="pull" May 28 17:24:58.062212 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.062010 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerName="util" May 28 17:24:58.062212 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.062015 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerName="util" May 28 17:24:58.062212 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.062066 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="2208d7fa-0076-4b4e-a088-f812ad2b70c0" containerName="extract" May 28 17:24:58.064999 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.064976 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.067646 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.067606 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 28 17:24:58.067789 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.067716 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gk5vz\"" May 28 17:24:58.075660 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.075622 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg"] May 28 17:24:58.158193 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158378 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158378 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158326 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158378 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158500 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158402 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrsw9\" (UniqueName: \"kubernetes.io/projected/3e8d9948-98f2-47f1-9f14-5403d7d96d98-kube-api-access-wrsw9\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158500 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158500 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.158604 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.158581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259240 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259192 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259335 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259397 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259429 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259507 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259461 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrsw9\" (UniqueName: \"kubernetes.io/projected/3e8d9948-98f2-47f1-9f14-5403d7d96d98-kube-api-access-wrsw9\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259603 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259689 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259671 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259739 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259704 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259800 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259767 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.259897 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.259852 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.260106 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.260070 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.260220 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.260190 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.260408 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.260381 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.260472 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.260403 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.261909 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.261879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.262186 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.262163 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.267550 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.267512 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrsw9\" (UniqueName: \"kubernetes.io/projected/3e8d9948-98f2-47f1-9f14-5403d7d96d98-kube-api-access-wrsw9\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.267721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.267693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8d9948-98f2-47f1-9f14-5403d7d96d98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg\" (UID: \"3e8d9948-98f2-47f1-9f14-5403d7d96d98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.377675 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.377564 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:24:58.516949 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.516912 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg"] May 28 17:24:58.519936 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:24:58.519908 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8d9948_98f2_47f1_9f14_5403d7d96d98.slice/crio-3efb0b9533f46bba5f4d584f829dc595ec97d0979446260306a9817138b5686e WatchSource:0}: Error finding container 3efb0b9533f46bba5f4d584f829dc595ec97d0979446260306a9817138b5686e: Status 404 returned error can't find the container with id 3efb0b9533f46bba5f4d584f829dc595ec97d0979446260306a9817138b5686e May 28 17:24:58.598422 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:24:58.598379 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" event={"ID":"3e8d9948-98f2-47f1-9f14-5403d7d96d98","Type":"ContainerStarted","Data":"3efb0b9533f46bba5f4d584f829dc595ec97d0979446260306a9817138b5686e"} May 28 17:25:01.209420 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:01.209378 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 17:25:01.209707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:01.209455 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 17:25:01.209707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:01.209485 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 17:25:01.612080 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:01.612045 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" event={"ID":"3e8d9948-98f2-47f1-9f14-5403d7d96d98","Type":"ContainerStarted","Data":"db8959cfdfc7edbc28818bd2ca35f01057c4a4eeb34926c6e5c0e23a44a55d56"} May 28 17:25:01.633464 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:01.633403 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" podStartSLOduration=0.946116173 podStartE2EDuration="3.633385247s" podCreationTimestamp="2026-05-28 17:24:58 +0000 UTC" firstStartedPulling="2026-05-28 17:24:58.521867667 +0000 UTC m=+467.150559114" lastFinishedPulling="2026-05-28 17:25:01.209136741 +0000 UTC m=+469.837828188" observedRunningTime="2026-05-28 17:25:01.632000328 +0000 UTC m=+470.260691798" watchObservedRunningTime="2026-05-28 17:25:01.633385247 +0000 UTC m=+470.262076716" May 28 17:25:02.378753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:02.378707 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:25:02.383431 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:02.383404 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:25:02.616093 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:02.616060 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:25:02.617059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:02.617043 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg" May 28 17:25:40.287844 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.287789 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66"] May 28 17:25:40.293541 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.293514 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.296509 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.296482 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 17:25:40.296634 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.296484 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nd8c6\"" May 28 17:25:40.297243 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.297227 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 17:25:40.304287 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.304252 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66"] May 28 17:25:40.320445 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.320408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgzxz\" (UniqueName: \"kubernetes.io/projected/3774de16-ea41-4a7f-9f63-fd4447290d3a-kube-api-access-zgzxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.320616 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.320460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.320616 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.320488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.420969 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.420929 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgzxz\" (UniqueName: \"kubernetes.io/projected/3774de16-ea41-4a7f-9f63-fd4447290d3a-kube-api-access-zgzxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.420969 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.420980 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.421236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.421100 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.421400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.421377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.421448 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.421407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.429411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.429380 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgzxz\" (UniqueName: \"kubernetes.io/projected/3774de16-ea41-4a7f-9f63-fd4447290d3a-kube-api-access-zgzxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.603479 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.603392 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:40.743488 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.743458 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66"] May 28 17:25:40.746080 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:25:40.746039 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3774de16_ea41_4a7f_9f63_fd4447290d3a.slice/crio-17a955ca5ce4469189ff015aa35dfd22169ccf936b12521a90d1decdaa6930db WatchSource:0}: Error finding container 17a955ca5ce4469189ff015aa35dfd22169ccf936b12521a90d1decdaa6930db: Status 404 returned error can't find the container with id 17a955ca5ce4469189ff015aa35dfd22169ccf936b12521a90d1decdaa6930db May 28 17:25:40.755629 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:40.755588 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" event={"ID":"3774de16-ea41-4a7f-9f63-fd4447290d3a","Type":"ContainerStarted","Data":"17a955ca5ce4469189ff015aa35dfd22169ccf936b12521a90d1decdaa6930db"} May 28 17:25:41.090382 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.090341 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh"] May 28 17:25:41.093302 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.093281 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.104651 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.104619 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh"] May 28 17:25:41.127365 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.127328 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.127365 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.127368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.127586 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.127392 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhs7\" (UniqueName: \"kubernetes.io/projected/86c9da01-5a76-4bf0-b466-08b1bc6d0743-kube-api-access-bkhs7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.228724 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.228674 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.228724 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.228722 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.228994 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.228747 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhs7\" (UniqueName: \"kubernetes.io/projected/86c9da01-5a76-4bf0-b466-08b1bc6d0743-kube-api-access-bkhs7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.229142 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.229121 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.229203 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.229165 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.242900 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.242867 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhs7\" (UniqueName: \"kubernetes.io/projected/86c9da01-5a76-4bf0-b466-08b1bc6d0743-kube-api-access-bkhs7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.403558 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.403473 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:41.542032 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.542003 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh"] May 28 17:25:41.544268 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:25:41.544230 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c9da01_5a76_4bf0_b466_08b1bc6d0743.slice/crio-9d62681868e7641c3f8d5d1a8ba695dcecf5292190b9c82d3a3764b1417d1588 WatchSource:0}: Error finding container 9d62681868e7641c3f8d5d1a8ba695dcecf5292190b9c82d3a3764b1417d1588: Status 404 returned error can't find the container with id 9d62681868e7641c3f8d5d1a8ba695dcecf5292190b9c82d3a3764b1417d1588 May 28 17:25:41.682142 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.682105 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj"] May 28 17:25:41.684567 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.684546 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.694127 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.694085 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj"] May 28 17:25:41.732928 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.732881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.732928 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.732939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.733134 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.732995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzhb\" (UniqueName: \"kubernetes.io/projected/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-kube-api-access-9kzhb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.760515 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.760479 2558 generic.go:358] "Generic (PLEG): container finished" podID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerID="81f462dd8a13df1d32c64125f954ae980523a06e3e52dcced792913b955a37ef" exitCode=0 May 28 17:25:41.760713 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.760566 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" event={"ID":"86c9da01-5a76-4bf0-b466-08b1bc6d0743","Type":"ContainerDied","Data":"81f462dd8a13df1d32c64125f954ae980523a06e3e52dcced792913b955a37ef"} May 28 17:25:41.760713 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.760606 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" event={"ID":"86c9da01-5a76-4bf0-b466-08b1bc6d0743","Type":"ContainerStarted","Data":"9d62681868e7641c3f8d5d1a8ba695dcecf5292190b9c82d3a3764b1417d1588"} May 28 17:25:41.762248 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.762221 2558 generic.go:358] "Generic (PLEG): container finished" podID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerID="f083e5767822fa74df6941f60a80b47b38af1f48e826d14c7bf233be687e2b0d" exitCode=0 May 28 17:25:41.762363 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.762304 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" event={"ID":"3774de16-ea41-4a7f-9f63-fd4447290d3a","Type":"ContainerDied","Data":"f083e5767822fa74df6941f60a80b47b38af1f48e826d14c7bf233be687e2b0d"} May 28 17:25:41.833707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.833667 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzhb\" (UniqueName: \"kubernetes.io/projected/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-kube-api-access-9kzhb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.833707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.833727 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.834022 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.833781 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.834238 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.834216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.834305 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.834250 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:41.842798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:41.842770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzhb\" (UniqueName: \"kubernetes.io/projected/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-kube-api-access-9kzhb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:42.032000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.031954 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:42.091422 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.091389 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44"] May 28 17:25:42.095068 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.095041 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.104383 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.104344 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44"] May 28 17:25:42.136577 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.136544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6948j\" (UniqueName: \"kubernetes.io/projected/916eedcb-29e1-4e59-bdad-9d718c2e3a12-kube-api-access-6948j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.136577 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.136581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.136800 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.136607 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.180076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.180013 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj"] May 28 17:25:42.182405 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:25:42.182374 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b5b910_f9c1_4e4f_9f0e_118a851c3b67.slice/crio-64c1a5b2cfcbbc2072c315cbbb05751e564c3d6476cab8eb0b3e7ba2f22fb16c WatchSource:0}: Error finding container 64c1a5b2cfcbbc2072c315cbbb05751e564c3d6476cab8eb0b3e7ba2f22fb16c: Status 404 returned error can't find the container with id 64c1a5b2cfcbbc2072c315cbbb05751e564c3d6476cab8eb0b3e7ba2f22fb16c May 28 17:25:42.237124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.237083 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6948j\" (UniqueName: \"kubernetes.io/projected/916eedcb-29e1-4e59-bdad-9d718c2e3a12-kube-api-access-6948j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.237124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.237124 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.237313 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.237155 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.237495 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.237475 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.237534 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.237516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.246800 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.246767 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6948j\" (UniqueName: \"kubernetes.io/projected/916eedcb-29e1-4e59-bdad-9d718c2e3a12-kube-api-access-6948j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.408966 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.408927 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:42.654539 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.654509 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44"] May 28 17:25:42.680198 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:25:42.680164 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916eedcb_29e1_4e59_bdad_9d718c2e3a12.slice/crio-3096e242c97052265733f2846bde31d2f562fa53b635904d40c772c782b36e9e WatchSource:0}: Error finding container 3096e242c97052265733f2846bde31d2f562fa53b635904d40c772c782b36e9e: Status 404 returned error can't find the container with id 3096e242c97052265733f2846bde31d2f562fa53b635904d40c772c782b36e9e May 28 17:25:42.766936 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.766899 2558 generic.go:358] "Generic (PLEG): container finished" podID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerID="eca8c54be608f3e8d8fa1e5281b65315de93b28e27932ec6b89d7d831cd6d099" exitCode=0 May 28 17:25:42.767167 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.766982 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" event={"ID":"30b5b910-f9c1-4e4f-9f0e-118a851c3b67","Type":"ContainerDied","Data":"eca8c54be608f3e8d8fa1e5281b65315de93b28e27932ec6b89d7d831cd6d099"} May 28 17:25:42.767167 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.767017 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" event={"ID":"30b5b910-f9c1-4e4f-9f0e-118a851c3b67","Type":"ContainerStarted","Data":"64c1a5b2cfcbbc2072c315cbbb05751e564c3d6476cab8eb0b3e7ba2f22fb16c"} May 28 17:25:42.768846 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.768797 2558 generic.go:358] "Generic (PLEG): container finished" podID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerID="6818569350c2e6f1aa17987f92e6eafc09797e27c88420ee2b4ed05c09c10b7f" exitCode=0 May 28 17:25:42.768941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.768877 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" event={"ID":"86c9da01-5a76-4bf0-b466-08b1bc6d0743","Type":"ContainerDied","Data":"6818569350c2e6f1aa17987f92e6eafc09797e27c88420ee2b4ed05c09c10b7f"} May 28 17:25:42.770734 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.770662 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" event={"ID":"916eedcb-29e1-4e59-bdad-9d718c2e3a12","Type":"ContainerStarted","Data":"184aeb77e85cdfcabc77fc40a94a4fbab506f6cbae198e7c4109d28c0b1dfe4b"} May 28 17:25:42.770734 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.770698 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" event={"ID":"916eedcb-29e1-4e59-bdad-9d718c2e3a12","Type":"ContainerStarted","Data":"3096e242c97052265733f2846bde31d2f562fa53b635904d40c772c782b36e9e"} May 28 17:25:42.772494 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.772465 2558 generic.go:358] "Generic (PLEG): container finished" podID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerID="86a911f4663080c0affb5cf2d8dad113b14182ae2f4330dba44f2492c46f48ca" exitCode=0 May 28 17:25:42.772623 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:42.772505 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" event={"ID":"3774de16-ea41-4a7f-9f63-fd4447290d3a","Type":"ContainerDied","Data":"86a911f4663080c0affb5cf2d8dad113b14182ae2f4330dba44f2492c46f48ca"} May 28 17:25:43.778275 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.778234 2558 generic.go:358] "Generic (PLEG): container finished" podID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerID="26b29960b0b600e4313f258d8e177e744179e2ebe3be2d6ebfe3a7a8a5922255" exitCode=0 May 28 17:25:43.778716 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.778329 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" event={"ID":"3774de16-ea41-4a7f-9f63-fd4447290d3a","Type":"ContainerDied","Data":"26b29960b0b600e4313f258d8e177e744179e2ebe3be2d6ebfe3a7a8a5922255"} May 28 17:25:43.780003 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.779977 2558 generic.go:358] "Generic (PLEG): container finished" podID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerID="ed157f4d38dfb32ad502584bb4c1feeae6f8e0d0a3c78267f937d36825117ccf" exitCode=0 May 28 17:25:43.780141 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.780059 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" event={"ID":"30b5b910-f9c1-4e4f-9f0e-118a851c3b67","Type":"ContainerDied","Data":"ed157f4d38dfb32ad502584bb4c1feeae6f8e0d0a3c78267f937d36825117ccf"} May 28 17:25:43.781883 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.781859 2558 generic.go:358] "Generic (PLEG): container finished" podID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerID="e35bdc226dae73fd46b463820f95dcc7ae160b0aeb680e7341e33eeb3f03e04e" exitCode=0 May 28 17:25:43.781965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.781946 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" event={"ID":"86c9da01-5a76-4bf0-b466-08b1bc6d0743","Type":"ContainerDied","Data":"e35bdc226dae73fd46b463820f95dcc7ae160b0aeb680e7341e33eeb3f03e04e"} May 28 17:25:43.783263 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.783236 2558 generic.go:358] "Generic (PLEG): container finished" podID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerID="184aeb77e85cdfcabc77fc40a94a4fbab506f6cbae198e7c4109d28c0b1dfe4b" exitCode=0 May 28 17:25:43.783365 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:43.783316 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" event={"ID":"916eedcb-29e1-4e59-bdad-9d718c2e3a12","Type":"ContainerDied","Data":"184aeb77e85cdfcabc77fc40a94a4fbab506f6cbae198e7c4109d28c0b1dfe4b"} May 28 17:25:44.788930 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:44.788891 2558 generic.go:358] "Generic (PLEG): container finished" podID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerID="e7c08fed555ed966970cefd11c15dc47201bff9259abaffe41ab8f0bb22a2a63" exitCode=0 May 28 17:25:44.789400 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:44.788945 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" event={"ID":"916eedcb-29e1-4e59-bdad-9d718c2e3a12","Type":"ContainerDied","Data":"e7c08fed555ed966970cefd11c15dc47201bff9259abaffe41ab8f0bb22a2a63"} May 28 17:25:44.791163 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:44.791139 2558 generic.go:358] "Generic (PLEG): container finished" podID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerID="3d1b2cd1c7c0d4ecbabc5ae1217e22791d3704e70877e9d365e3299bc87637c9" exitCode=0 May 28 17:25:44.791250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:44.791226 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" event={"ID":"30b5b910-f9c1-4e4f-9f0e-118a851c3b67","Type":"ContainerDied","Data":"3d1b2cd1c7c0d4ecbabc5ae1217e22791d3704e70877e9d365e3299bc87637c9"} May 28 17:25:44.950593 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:44.950566 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:44.955580 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:44.955548 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:45.063546 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.063446 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-bundle\") pod \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " May 28 17:25:45.063546 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.063502 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgzxz\" (UniqueName: \"kubernetes.io/projected/3774de16-ea41-4a7f-9f63-fd4447290d3a-kube-api-access-zgzxz\") pod \"3774de16-ea41-4a7f-9f63-fd4447290d3a\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " May 28 17:25:45.063546 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.063531 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkhs7\" (UniqueName: \"kubernetes.io/projected/86c9da01-5a76-4bf0-b466-08b1bc6d0743-kube-api-access-bkhs7\") pod \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " May 28 17:25:45.063854 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.063623 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-bundle\") pod \"3774de16-ea41-4a7f-9f63-fd4447290d3a\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " May 28 17:25:45.063854 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.063658 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-util\") pod \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\" (UID: \"86c9da01-5a76-4bf0-b466-08b1bc6d0743\") " May 28 17:25:45.063854 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.063708 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-util\") pod \"3774de16-ea41-4a7f-9f63-fd4447290d3a\" (UID: \"3774de16-ea41-4a7f-9f63-fd4447290d3a\") " May 28 17:25:45.064257 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.064171 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-bundle" (OuterVolumeSpecName: "bundle") pod "86c9da01-5a76-4bf0-b466-08b1bc6d0743" (UID: "86c9da01-5a76-4bf0-b466-08b1bc6d0743"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:45.064257 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.064210 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-bundle" (OuterVolumeSpecName: "bundle") pod "3774de16-ea41-4a7f-9f63-fd4447290d3a" (UID: "3774de16-ea41-4a7f-9f63-fd4447290d3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:45.066028 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.065999 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c9da01-5a76-4bf0-b466-08b1bc6d0743-kube-api-access-bkhs7" (OuterVolumeSpecName: "kube-api-access-bkhs7") pod "86c9da01-5a76-4bf0-b466-08b1bc6d0743" (UID: "86c9da01-5a76-4bf0-b466-08b1bc6d0743"). InnerVolumeSpecName "kube-api-access-bkhs7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:45.066123 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.066039 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3774de16-ea41-4a7f-9f63-fd4447290d3a-kube-api-access-zgzxz" (OuterVolumeSpecName: "kube-api-access-zgzxz") pod "3774de16-ea41-4a7f-9f63-fd4447290d3a" (UID: "3774de16-ea41-4a7f-9f63-fd4447290d3a"). InnerVolumeSpecName "kube-api-access-zgzxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:45.073030 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.072981 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-util" (OuterVolumeSpecName: "util") pod "3774de16-ea41-4a7f-9f63-fd4447290d3a" (UID: "3774de16-ea41-4a7f-9f63-fd4447290d3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:45.073030 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.073025 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-util" (OuterVolumeSpecName: "util") pod "86c9da01-5a76-4bf0-b466-08b1bc6d0743" (UID: "86c9da01-5a76-4bf0-b466-08b1bc6d0743"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:45.165231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.165170 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgzxz\" (UniqueName: \"kubernetes.io/projected/3774de16-ea41-4a7f-9f63-fd4447290d3a-kube-api-access-zgzxz\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:45.165231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.165223 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkhs7\" (UniqueName: \"kubernetes.io/projected/86c9da01-5a76-4bf0-b466-08b1bc6d0743-kube-api-access-bkhs7\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:45.165231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.165236 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:45.165231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.165245 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:45.165231 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.165255 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3774de16-ea41-4a7f-9f63-fd4447290d3a-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:45.165535 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.165262 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c9da01-5a76-4bf0-b466-08b1bc6d0743-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:45.796653 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.796625 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" May 28 17:25:45.797208 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.796613 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh" event={"ID":"86c9da01-5a76-4bf0-b466-08b1bc6d0743","Type":"ContainerDied","Data":"9d62681868e7641c3f8d5d1a8ba695dcecf5292190b9c82d3a3764b1417d1588"} May 28 17:25:45.797208 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.796724 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d62681868e7641c3f8d5d1a8ba695dcecf5292190b9c82d3a3764b1417d1588" May 28 17:25:45.798690 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.798664 2558 generic.go:358] "Generic (PLEG): container finished" podID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerID="32a9e931b5ab1f4c773bd72d93d66fc23f2242e449985e64e190d3898ee84915" exitCode=0 May 28 17:25:45.798830 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.798728 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" event={"ID":"916eedcb-29e1-4e59-bdad-9d718c2e3a12","Type":"ContainerDied","Data":"32a9e931b5ab1f4c773bd72d93d66fc23f2242e449985e64e190d3898ee84915"} May 28 17:25:45.800499 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.800477 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" May 28 17:25:45.800618 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.800494 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66" event={"ID":"3774de16-ea41-4a7f-9f63-fd4447290d3a","Type":"ContainerDied","Data":"17a955ca5ce4469189ff015aa35dfd22169ccf936b12521a90d1decdaa6930db"} May 28 17:25:45.800618 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.800526 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17a955ca5ce4469189ff015aa35dfd22169ccf936b12521a90d1decdaa6930db" May 28 17:25:45.933887 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.933863 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:45.971930 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.971896 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-bundle\") pod \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " May 28 17:25:45.972123 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.971954 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-util\") pod \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " May 28 17:25:45.972123 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.972008 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kzhb\" (UniqueName: \"kubernetes.io/projected/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-kube-api-access-9kzhb\") pod \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\" (UID: \"30b5b910-f9c1-4e4f-9f0e-118a851c3b67\") " May 28 17:25:45.972502 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.972479 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-bundle" (OuterVolumeSpecName: "bundle") pod "30b5b910-f9c1-4e4f-9f0e-118a851c3b67" (UID: "30b5b910-f9c1-4e4f-9f0e-118a851c3b67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:45.974696 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.974654 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-kube-api-access-9kzhb" (OuterVolumeSpecName: "kube-api-access-9kzhb") pod "30b5b910-f9c1-4e4f-9f0e-118a851c3b67" (UID: "30b5b910-f9c1-4e4f-9f0e-118a851c3b67"). InnerVolumeSpecName "kube-api-access-9kzhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:45.979918 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:45.979875 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-util" (OuterVolumeSpecName: "util") pod "30b5b910-f9c1-4e4f-9f0e-118a851c3b67" (UID: "30b5b910-f9c1-4e4f-9f0e-118a851c3b67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:46.073128 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.073028 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:46.073128 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.073062 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:46.073128 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.073075 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kzhb\" (UniqueName: \"kubernetes.io/projected/30b5b910-f9c1-4e4f-9f0e-118a851c3b67-kube-api-access-9kzhb\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:46.806533 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.806498 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" May 28 17:25:46.807031 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.806504 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj" event={"ID":"30b5b910-f9c1-4e4f-9f0e-118a851c3b67","Type":"ContainerDied","Data":"64c1a5b2cfcbbc2072c315cbbb05751e564c3d6476cab8eb0b3e7ba2f22fb16c"} May 28 17:25:46.807031 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.806618 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64c1a5b2cfcbbc2072c315cbbb05751e564c3d6476cab8eb0b3e7ba2f22fb16c" May 28 17:25:46.942164 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.942138 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:46.979032 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.978991 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-bundle\") pod \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " May 28 17:25:46.979207 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.979054 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6948j\" (UniqueName: \"kubernetes.io/projected/916eedcb-29e1-4e59-bdad-9d718c2e3a12-kube-api-access-6948j\") pod \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " May 28 17:25:46.979207 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.979118 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-util\") pod \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\" (UID: \"916eedcb-29e1-4e59-bdad-9d718c2e3a12\") " May 28 17:25:46.979692 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.979666 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-bundle" (OuterVolumeSpecName: "bundle") pod "916eedcb-29e1-4e59-bdad-9d718c2e3a12" (UID: "916eedcb-29e1-4e59-bdad-9d718c2e3a12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:46.981172 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.981142 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916eedcb-29e1-4e59-bdad-9d718c2e3a12-kube-api-access-6948j" (OuterVolumeSpecName: "kube-api-access-6948j") pod "916eedcb-29e1-4e59-bdad-9d718c2e3a12" (UID: "916eedcb-29e1-4e59-bdad-9d718c2e3a12"). InnerVolumeSpecName "kube-api-access-6948j". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:46.987382 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:46.987333 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-util" (OuterVolumeSpecName: "util") pod "916eedcb-29e1-4e59-bdad-9d718c2e3a12" (UID: "916eedcb-29e1-4e59-bdad-9d718c2e3a12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:47.080332 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.080238 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:47.080332 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.080273 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6948j\" (UniqueName: \"kubernetes.io/projected/916eedcb-29e1-4e59-bdad-9d718c2e3a12-kube-api-access-6948j\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:47.080332 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.080284 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/916eedcb-29e1-4e59-bdad-9d718c2e3a12-util\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:25:47.413078 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.412990 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc576b75-dh88h"] May 28 17:25:47.413439 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413416 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerName="extract" May 28 17:25:47.413486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413443 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerName="extract" May 28 17:25:47.413486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413461 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerName="util" May 28 17:25:47.413486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413470 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerName="util" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413485 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerName="pull" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413494 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerName="pull" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413511 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerName="pull" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413519 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerName="pull" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413527 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerName="extract" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413535 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerName="extract" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413547 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerName="pull" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413563 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerName="pull" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413574 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerName="util" May 28 17:25:47.413588 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413582 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerName="util" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413592 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerName="extract" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413600 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerName="extract" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413612 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerName="util" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413620 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerName="util" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413633 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerName="util" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413641 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerName="util" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413654 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerName="extract" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413663 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerName="extract" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413673 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerName="pull" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413678 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerName="pull" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413735 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="3774de16-ea41-4a7f-9f63-fd4447290d3a" containerName="extract" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413744 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="86c9da01-5a76-4bf0-b466-08b1bc6d0743" containerName="extract" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413752 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="916eedcb-29e1-4e59-bdad-9d718c2e3a12" containerName="extract" May 28 17:25:47.413925 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.413759 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="30b5b910-f9c1-4e4f-9f0e-118a851c3b67" containerName="extract" May 28 17:25:47.416802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.416778 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.428687 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.428650 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc576b75-dh88h"] May 28 17:25:47.483788 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.483750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-oauth-serving-cert\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.483992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.483835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-config\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.483992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.483857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-serving-cert\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.483992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.483907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-oauth-config\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.483992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.483947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-service-ca\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.484179 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.484029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-trusted-ca-bundle\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.484179 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.484071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq627\" (UniqueName: \"kubernetes.io/projected/e1595721-86b5-4b08-982b-b9dd582ee1b2-kube-api-access-nq627\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.585370 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.585315 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-trusted-ca-bundle\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.585370 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.585375 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nq627\" (UniqueName: \"kubernetes.io/projected/e1595721-86b5-4b08-982b-b9dd582ee1b2-kube-api-access-nq627\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.585640 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.585508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-oauth-serving-cert\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.585640 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.585609 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-config\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.585782 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.585653 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-serving-cert\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.585782 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.585682 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-oauth-config\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.585782 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.585712 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-service-ca\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.586316 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.586282 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-trusted-ca-bundle\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.586316 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.586312 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-oauth-serving-cert\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.586467 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.586406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-config\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.586467 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.586407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1595721-86b5-4b08-982b-b9dd582ee1b2-service-ca\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.588439 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.588402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-oauth-config\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.588530 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.588419 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1595721-86b5-4b08-982b-b9dd582ee1b2-console-serving-cert\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.593674 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.593644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq627\" (UniqueName: \"kubernetes.io/projected/e1595721-86b5-4b08-982b-b9dd582ee1b2-kube-api-access-nq627\") pod \"console-5cc576b75-dh88h\" (UID: \"e1595721-86b5-4b08-982b-b9dd582ee1b2\") " pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.727732 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.727637 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:47.812425 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.812364 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" event={"ID":"916eedcb-29e1-4e59-bdad-9d718c2e3a12","Type":"ContainerDied","Data":"3096e242c97052265733f2846bde31d2f562fa53b635904d40c772c782b36e9e"} May 28 17:25:47.812425 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.812415 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3096e242c97052265733f2846bde31d2f562fa53b635904d40c772c782b36e9e" May 28 17:25:47.812425 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.812383 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44" May 28 17:25:47.872512 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:47.872340 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc576b75-dh88h"] May 28 17:25:47.874883 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:25:47.874854 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1595721_86b5_4b08_982b_b9dd582ee1b2.slice/crio-52e2edcd46eadfeacece04489ee99a2c783206ea9ba015e18e4934d9cab5ba5f WatchSource:0}: Error finding container 52e2edcd46eadfeacece04489ee99a2c783206ea9ba015e18e4934d9cab5ba5f: Status 404 returned error can't find the container with id 52e2edcd46eadfeacece04489ee99a2c783206ea9ba015e18e4934d9cab5ba5f May 28 17:25:48.817225 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:48.817185 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc576b75-dh88h" event={"ID":"e1595721-86b5-4b08-982b-b9dd582ee1b2","Type":"ContainerStarted","Data":"86ade9ec8a431a872670cf2a46a489ab811ce7eed3c89480649943bb29943531"} May 28 17:25:48.817225 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:48.817224 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc576b75-dh88h" event={"ID":"e1595721-86b5-4b08-982b-b9dd582ee1b2","Type":"ContainerStarted","Data":"52e2edcd46eadfeacece04489ee99a2c783206ea9ba015e18e4934d9cab5ba5f"} May 28 17:25:48.837707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:48.837644 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5cc576b75-dh88h" podStartSLOduration=1.837627954 podStartE2EDuration="1.837627954s" podCreationTimestamp="2026-05-28 17:25:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:25:48.835717284 +0000 UTC m=+517.464408752" watchObservedRunningTime="2026-05-28 17:25:48.837627954 +0000 UTC m=+517.466319422" May 28 17:25:56.714601 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.714558 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v"] May 28 17:25:56.717279 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.717255 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" May 28 17:25:56.719893 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.719867 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ghnpm\"" May 28 17:25:56.720014 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.719868 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 28 17:25:56.720775 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.720751 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 17:25:56.720893 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.720751 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 17:25:56.728737 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.728706 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v"] May 28 17:25:56.776541 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.776489 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5psl\" (UniqueName: \"kubernetes.io/projected/0b5e463c-6bb1-4468-99d4-06d55446ccae-kube-api-access-t5psl\") pod \"dns-operator-controller-manager-648d5c98bc-5wd9v\" (UID: \"0b5e463c-6bb1-4468-99d4-06d55446ccae\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" May 28 17:25:56.877728 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.877685 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5psl\" (UniqueName: \"kubernetes.io/projected/0b5e463c-6bb1-4468-99d4-06d55446ccae-kube-api-access-t5psl\") pod \"dns-operator-controller-manager-648d5c98bc-5wd9v\" (UID: \"0b5e463c-6bb1-4468-99d4-06d55446ccae\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" May 28 17:25:56.897282 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:56.897240 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5psl\" (UniqueName: \"kubernetes.io/projected/0b5e463c-6bb1-4468-99d4-06d55446ccae-kube-api-access-t5psl\") pod \"dns-operator-controller-manager-648d5c98bc-5wd9v\" (UID: \"0b5e463c-6bb1-4468-99d4-06d55446ccae\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" May 28 17:25:57.029632 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.029594 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" May 28 17:25:57.173311 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.173283 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v"] May 28 17:25:57.175616 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:25:57.175581 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5e463c_6bb1_4468_99d4_06d55446ccae.slice/crio-1436ee38f564ed63efe3f9892693d48349616745cdf491bc267d9cc12dcfb414 WatchSource:0}: Error finding container 1436ee38f564ed63efe3f9892693d48349616745cdf491bc267d9cc12dcfb414: Status 404 returned error can't find the container with id 1436ee38f564ed63efe3f9892693d48349616745cdf491bc267d9cc12dcfb414 May 28 17:25:57.728250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.728205 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:57.728250 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.728258 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:57.732992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.732966 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:57.857249 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.857208 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" event={"ID":"0b5e463c-6bb1-4468-99d4-06d55446ccae","Type":"ContainerStarted","Data":"1436ee38f564ed63efe3f9892693d48349616745cdf491bc267d9cc12dcfb414"} May 28 17:25:57.861790 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.861758 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc576b75-dh88h" May 28 17:25:57.927373 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:57.927334 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8cd89b45-qmcjk"] May 28 17:25:59.868173 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:59.868136 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" event={"ID":"0b5e463c-6bb1-4468-99d4-06d55446ccae","Type":"ContainerStarted","Data":"837b805b400acee674fe1b80f7cdc92eee00e7a922d3bafc1e1e7426a673794a"} May 28 17:25:59.868541 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:59.868253 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" May 28 17:25:59.885804 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:25:59.885745 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" podStartSLOduration=2.094556497 podStartE2EDuration="3.885727652s" podCreationTimestamp="2026-05-28 17:25:56 +0000 UTC" firstStartedPulling="2026-05-28 17:25:57.17791772 +0000 UTC m=+525.806609167" lastFinishedPulling="2026-05-28 17:25:58.969088858 +0000 UTC m=+527.597780322" observedRunningTime="2026-05-28 17:25:59.885461907 +0000 UTC m=+528.514153412" watchObservedRunningTime="2026-05-28 17:25:59.885727652 +0000 UTC m=+528.514419122" May 28 17:26:02.002110 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.002073 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk"] May 28 17:26:02.004911 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.004877 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.007416 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.007390 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4ckss\"" May 28 17:26:02.016607 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.016573 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk"] May 28 17:26:02.133952 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.133909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqsgp\" (UniqueName: \"kubernetes.io/projected/2931231b-2f5e-4751-bd69-33023b033873-kube-api-access-dqsgp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.134142 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.133969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2931231b-2f5e-4751-bd69-33023b033873-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.234888 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.234842 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqsgp\" (UniqueName: \"kubernetes.io/projected/2931231b-2f5e-4751-bd69-33023b033873-kube-api-access-dqsgp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.235065 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.234907 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2931231b-2f5e-4751-bd69-33023b033873-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.235320 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.235297 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2931231b-2f5e-4751-bd69-33023b033873-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.252695 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.252606 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqsgp\" (UniqueName: \"kubernetes.io/projected/2931231b-2f5e-4751-bd69-33023b033873-kube-api-access-dqsgp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.318483 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.318433 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:02.473539 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.473509 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk"] May 28 17:26:02.475593 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:26:02.475559 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2931231b_2f5e_4751_bd69_33023b033873.slice/crio-0803abc015c0cc7b27febf4609ff53c61d832e1f6b3f5723f669fa17598e2455 WatchSource:0}: Error finding container 0803abc015c0cc7b27febf4609ff53c61d832e1f6b3f5723f669fa17598e2455: Status 404 returned error can't find the container with id 0803abc015c0cc7b27febf4609ff53c61d832e1f6b3f5723f669fa17598e2455 May 28 17:26:02.880645 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:02.880606 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" event={"ID":"2931231b-2f5e-4751-bd69-33023b033873","Type":"ContainerStarted","Data":"0803abc015c0cc7b27febf4609ff53c61d832e1f6b3f5723f669fa17598e2455"} May 28 17:26:06.900790 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:06.900750 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" event={"ID":"2931231b-2f5e-4751-bd69-33023b033873","Type":"ContainerStarted","Data":"cd488c970b03f3a55c6e39fbaccaac8ee3ab0f2086634dd78487b1f1c18b0b66"} May 28 17:26:06.901192 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:06.900889 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:06.930043 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:06.929969 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" podStartSLOduration=1.92062161 podStartE2EDuration="5.929944417s" podCreationTimestamp="2026-05-28 17:26:01 +0000 UTC" firstStartedPulling="2026-05-28 17:26:02.481607101 +0000 UTC m=+531.110298547" lastFinishedPulling="2026-05-28 17:26:06.490929902 +0000 UTC m=+535.119621354" observedRunningTime="2026-05-28 17:26:06.926472426 +0000 UTC m=+535.555163909" watchObservedRunningTime="2026-05-28 17:26:06.929944417 +0000 UTC m=+535.558635886" May 28 17:26:09.515029 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.514990 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2"] May 28 17:26:09.518618 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.518591 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.521309 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.521276 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 28 17:26:09.521433 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.521314 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nd8c6\"" May 28 17:26:09.521433 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.521284 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 28 17:26:09.525725 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.525693 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2"] May 28 17:26:09.607246 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.607186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2769323e-df79-4f39-af09-8519c3cd0340-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.607472 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.607279 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87fd4\" (UniqueName: \"kubernetes.io/projected/2769323e-df79-4f39-af09-8519c3cd0340-kube-api-access-87fd4\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.607472 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.607375 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2769323e-df79-4f39-af09-8519c3cd0340-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.708728 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.708666 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2769323e-df79-4f39-af09-8519c3cd0340-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.708903 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.708770 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2769323e-df79-4f39-af09-8519c3cd0340-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.708903 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.708802 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87fd4\" (UniqueName: \"kubernetes.io/projected/2769323e-df79-4f39-af09-8519c3cd0340-kube-api-access-87fd4\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.708999 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:26:09.708922 2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 28 17:26:09.708999 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:26:09.708995 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2769323e-df79-4f39-af09-8519c3cd0340-plugin-serving-cert podName:2769323e-df79-4f39-af09-8519c3cd0340 nodeName:}" failed. No retries permitted until 2026-05-28 17:26:10.20897818 +0000 UTC m=+538.837669632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2769323e-df79-4f39-af09-8519c3cd0340-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-5t4x2" (UID: "2769323e-df79-4f39-af09-8519c3cd0340") : secret "plugin-serving-cert" not found May 28 17:26:09.709428 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.709405 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2769323e-df79-4f39-af09-8519c3cd0340-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:09.720896 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:09.720861 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87fd4\" (UniqueName: \"kubernetes.io/projected/2769323e-df79-4f39-af09-8519c3cd0340-kube-api-access-87fd4\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:10.212766 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:10.212724 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2769323e-df79-4f39-af09-8519c3cd0340-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:10.215246 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:10.215222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2769323e-df79-4f39-af09-8519c3cd0340-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-5t4x2\" (UID: \"2769323e-df79-4f39-af09-8519c3cd0340\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:10.431753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:10.431699 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" May 28 17:26:10.574287 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:10.574258 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2"] May 28 17:26:10.576767 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:26:10.576732 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2769323e_df79_4f39_af09_8519c3cd0340.slice/crio-008d10b9b537bce9ca3d0816b07f3a5af260dd025b386c8cd92cdd1b460b1716 WatchSource:0}: Error finding container 008d10b9b537bce9ca3d0816b07f3a5af260dd025b386c8cd92cdd1b460b1716: Status 404 returned error can't find the container with id 008d10b9b537bce9ca3d0816b07f3a5af260dd025b386c8cd92cdd1b460b1716 May 28 17:26:10.874910 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:10.874878 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5wd9v" May 28 17:26:10.923847 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:10.923789 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" event={"ID":"2769323e-df79-4f39-af09-8519c3cd0340","Type":"ContainerStarted","Data":"008d10b9b537bce9ca3d0816b07f3a5af260dd025b386c8cd92cdd1b460b1716"} May 28 17:26:17.907197 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:17.907165 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:19.438239 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.438194 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw"] May 28 17:26:19.443431 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.443403 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.455563 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.455521 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw"] May 28 17:26:19.485712 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.485667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47630c96-faa2-4a32-9dc3-45d7025095d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.485924 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.485763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kcbp\" (UniqueName: \"kubernetes.io/projected/47630c96-faa2-4a32-9dc3-45d7025095d1-kube-api-access-6kcbp\") pod \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.587110 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.587057 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kcbp\" (UniqueName: \"kubernetes.io/projected/47630c96-faa2-4a32-9dc3-45d7025095d1-kube-api-access-6kcbp\") pod \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.587313 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.587171 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47630c96-faa2-4a32-9dc3-45d7025095d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.587600 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.587580 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47630c96-faa2-4a32-9dc3-45d7025095d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.600086 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.600054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kcbp\" (UniqueName: \"kubernetes.io/projected/47630c96-faa2-4a32-9dc3-45d7025095d1-kube-api-access-6kcbp\") pod \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.626872 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.626825 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk"] May 28 17:26:19.627168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.627101 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" podUID="2931231b-2f5e-4751-bd69-33023b033873" containerName="manager" containerID="cri-o://cd488c970b03f3a55c6e39fbaccaac8ee3ab0f2086634dd78487b1f1c18b0b66" gracePeriod=2 May 28 17:26:19.629599 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.629533 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:19.630538 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.630503 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk"] May 28 17:26:19.652628 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.652592 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk"] May 28 17:26:19.653290 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.653264 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2931231b-2f5e-4751-bd69-33023b033873" containerName="manager" May 28 17:26:19.653290 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.653292 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2931231b-2f5e-4751-bd69-33023b033873" containerName="manager" May 28 17:26:19.653466 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.653379 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="2931231b-2f5e-4751-bd69-33023b033873" containerName="manager" May 28 17:26:19.656861 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.656830 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:19.667280 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.667235 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk"] May 28 17:26:19.680104 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.680065 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw"] May 28 17:26:19.680434 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.680415 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:19.686325 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.686254 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:19.689531 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.688045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c944d5b6-0514-4ac7-9309-c4ab34d9919e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qkqrk\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:19.689531 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.688654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbwl\" (UniqueName: \"kubernetes.io/projected/c944d5b6-0514-4ac7-9309-c4ab34d9919e-kube-api-access-9fbwl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qkqrk\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:19.696117 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.696083 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw"] May 28 17:26:19.789483 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.789447 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbwl\" (UniqueName: \"kubernetes.io/projected/c944d5b6-0514-4ac7-9309-c4ab34d9919e-kube-api-access-9fbwl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qkqrk\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:19.789706 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.789538 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c944d5b6-0514-4ac7-9309-c4ab34d9919e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qkqrk\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:19.790005 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.789982 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c944d5b6-0514-4ac7-9309-c4ab34d9919e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qkqrk\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:19.804559 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.804522 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbwl\" (UniqueName: \"kubernetes.io/projected/c944d5b6-0514-4ac7-9309-c4ab34d9919e-kube-api-access-9fbwl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qkqrk\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:19.964333 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.964235 2558 generic.go:358] "Generic (PLEG): container finished" podID="2931231b-2f5e-4751-bd69-33023b033873" containerID="cd488c970b03f3a55c6e39fbaccaac8ee3ab0f2086634dd78487b1f1c18b0b66" exitCode=0 May 28 17:26:19.999760 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:19.999722 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:22.952584 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:22.952527 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c8cd89b45-qmcjk" podUID="76656abc-a95c-4127-b765-caf00c62eb9e" containerName="console" containerID="cri-o://fe3c21ba267bc0e43f387ea355c9d053c233becde56c96fd1ffc80e0bc59af90" gracePeriod=15 May 28 17:26:25.960391 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:25.960345 2558 patch_prober.go:28] interesting pod/console-5c8cd89b45-qmcjk container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= May 28 17:26:25.960950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:25.960423 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5c8cd89b45-qmcjk" podUID="76656abc-a95c-4127-b765-caf00c62eb9e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" May 28 17:26:34.860277 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:26:34.860234 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47630c96_faa2_4a32_9dc3_45d7025095d1.slice/crio-10e6e3061a86975506d1f86667ac5da46b4edca9a703dd01b8973621333029fc WatchSource:0}: Error finding container 10e6e3061a86975506d1f86667ac5da46b4edca9a703dd01b8973621333029fc: Status 404 returned error can't find the container with id 10e6e3061a86975506d1f86667ac5da46b4edca9a703dd01b8973621333029fc May 28 17:26:34.932411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:34.932332 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk"] May 28 17:26:35.032280 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.032249 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0803abc015c0cc7b27febf4609ff53c61d832e1f6b3f5723f669fa17598e2455" May 28 17:26:35.034121 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.034036 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" containerName="manager" containerID="cri-o://7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321" gracePeriod=2 May 28 17:26:35.034121 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.034096 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:35.035739 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.035714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c8cd89b45-qmcjk_76656abc-a95c-4127-b765-caf00c62eb9e/console/0.log" May 28 17:26:35.035870 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.035761 2558 generic.go:358] "Generic (PLEG): container finished" podID="76656abc-a95c-4127-b765-caf00c62eb9e" containerID="fe3c21ba267bc0e43f387ea355c9d053c233becde56c96fd1ffc80e0bc59af90" exitCode=2 May 28 17:26:35.035870 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.035848 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cd89b45-qmcjk" event={"ID":"76656abc-a95c-4127-b765-caf00c62eb9e","Type":"ContainerDied","Data":"fe3c21ba267bc0e43f387ea355c9d053c233becde56c96fd1ffc80e0bc59af90"} May 28 17:26:35.036550 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.036523 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.038354 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.038310 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.040189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.040158 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.042090 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.042053 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.135072 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.134990 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2931231b-2f5e-4751-bd69-33023b033873-extensions-socket-volume\") pod \"2931231b-2f5e-4751-bd69-33023b033873\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " May 28 17:26:35.135072 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.135063 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqsgp\" (UniqueName: \"kubernetes.io/projected/2931231b-2f5e-4751-bd69-33023b033873-kube-api-access-dqsgp\") pod \"2931231b-2f5e-4751-bd69-33023b033873\" (UID: \"2931231b-2f5e-4751-bd69-33023b033873\") " May 28 17:26:35.135443 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.135414 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2931231b-2f5e-4751-bd69-33023b033873-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2931231b-2f5e-4751-bd69-33023b033873" (UID: "2931231b-2f5e-4751-bd69-33023b033873"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:26:35.137189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.137153 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2931231b-2f5e-4751-bd69-33023b033873-kube-api-access-dqsgp" (OuterVolumeSpecName: "kube-api-access-dqsgp") pod "2931231b-2f5e-4751-bd69-33023b033873" (UID: "2931231b-2f5e-4751-bd69-33023b033873"). InnerVolumeSpecName "kube-api-access-dqsgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:26:35.156354 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.156315 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p"] May 28 17:26:35.156665 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.156652 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" containerName="manager" May 28 17:26:35.156710 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.156666 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" containerName="manager" May 28 17:26:35.156748 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.156728 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" containerName="manager" May 28 17:26:35.180141 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.180111 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p"] May 28 17:26:35.180307 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.180237 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.204729 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.204690 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.206711 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.206679 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.236461 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.236424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9303a32-cf0d-4de3-9ca9-f02d6153369f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vp92p\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.236461 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.236469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24n4j\" (UniqueName: \"kubernetes.io/projected/d9303a32-cf0d-4de3-9ca9-f02d6153369f-kube-api-access-24n4j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vp92p\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.236683 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.236607 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2931231b-2f5e-4751-bd69-33023b033873-extensions-socket-volume\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.236683 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.236631 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqsgp\" (UniqueName: \"kubernetes.io/projected/2931231b-2f5e-4751-bd69-33023b033873-kube-api-access-dqsgp\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.250099 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.250070 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk"] May 28 17:26:35.252343 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:26:35.252307 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc944d5b6_0514_4ac7_9309_c4ab34d9919e.slice/crio-053d4fab8a92c1448de88a811bec079ec9b6fa820c384d54d4a920f1165ffafe WatchSource:0}: Error finding container 053d4fab8a92c1448de88a811bec079ec9b6fa820c384d54d4a920f1165ffafe: Status 404 returned error can't find the container with id 053d4fab8a92c1448de88a811bec079ec9b6fa820c384d54d4a920f1165ffafe May 28 17:26:35.254663 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.254644 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c8cd89b45-qmcjk_76656abc-a95c-4127-b765-caf00c62eb9e/console/0.log" May 28 17:26:35.254735 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.254706 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:26:35.257247 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.257208 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.279673 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.279623 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.303763 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.303728 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:35.306483 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.306441 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.308701 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.308651 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:35.337766 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.337733 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-oauth-serving-cert\") pod \"76656abc-a95c-4127-b765-caf00c62eb9e\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " May 28 17:26:35.337950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.337775 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-serving-cert\") pod \"76656abc-a95c-4127-b765-caf00c62eb9e\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " May 28 17:26:35.337950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.337829 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-console-config\") pod \"76656abc-a95c-4127-b765-caf00c62eb9e\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " May 28 17:26:35.337950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.337860 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-trusted-ca-bundle\") pod \"76656abc-a95c-4127-b765-caf00c62eb9e\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " May 28 17:26:35.337950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.337883 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5566\" (UniqueName: \"kubernetes.io/projected/76656abc-a95c-4127-b765-caf00c62eb9e-kube-api-access-m5566\") pod \"76656abc-a95c-4127-b765-caf00c62eb9e\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " May 28 17:26:35.337950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.337920 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-oauth-config\") pod \"76656abc-a95c-4127-b765-caf00c62eb9e\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " May 28 17:26:35.338206 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.337984 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-service-ca\") pod \"76656abc-a95c-4127-b765-caf00c62eb9e\" (UID: \"76656abc-a95c-4127-b765-caf00c62eb9e\") " May 28 17:26:35.338206 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338183 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9303a32-cf0d-4de3-9ca9-f02d6153369f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vp92p\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.338342 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338219 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24n4j\" (UniqueName: \"kubernetes.io/projected/d9303a32-cf0d-4de3-9ca9-f02d6153369f-kube-api-access-24n4j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vp92p\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.338342 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338232 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76656abc-a95c-4127-b765-caf00c62eb9e" (UID: "76656abc-a95c-4127-b765-caf00c62eb9e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:35.338342 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338322 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-console-config" (OuterVolumeSpecName: "console-config") pod "76656abc-a95c-4127-b765-caf00c62eb9e" (UID: "76656abc-a95c-4127-b765-caf00c62eb9e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:35.338342 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338336 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76656abc-a95c-4127-b765-caf00c62eb9e" (UID: "76656abc-a95c-4127-b765-caf00c62eb9e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:35.338543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338342 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-oauth-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.338769 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338743 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-service-ca" (OuterVolumeSpecName: "service-ca") pod "76656abc-a95c-4127-b765-caf00c62eb9e" (UID: "76656abc-a95c-4127-b765-caf00c62eb9e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:35.338866 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.338771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9303a32-cf0d-4de3-9ca9-f02d6153369f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vp92p\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.340341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.340315 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76656abc-a95c-4127-b765-caf00c62eb9e" (UID: "76656abc-a95c-4127-b765-caf00c62eb9e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:26:35.340341 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.340326 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76656abc-a95c-4127-b765-caf00c62eb9e" (UID: "76656abc-a95c-4127-b765-caf00c62eb9e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:26:35.340520 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.340341 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76656abc-a95c-4127-b765-caf00c62eb9e-kube-api-access-m5566" (OuterVolumeSpecName: "kube-api-access-m5566") pod "76656abc-a95c-4127-b765-caf00c62eb9e" (UID: "76656abc-a95c-4127-b765-caf00c62eb9e"). InnerVolumeSpecName "kube-api-access-m5566". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:26:35.347669 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.347635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24n4j\" (UniqueName: \"kubernetes.io/projected/d9303a32-cf0d-4de3-9ca9-f02d6153369f-kube-api-access-24n4j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vp92p\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.439360 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439322 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47630c96-faa2-4a32-9dc3-45d7025095d1-extensions-socket-volume\") pod \"47630c96-faa2-4a32-9dc3-45d7025095d1\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " May 28 17:26:35.439525 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439457 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kcbp\" (UniqueName: \"kubernetes.io/projected/47630c96-faa2-4a32-9dc3-45d7025095d1-kube-api-access-6kcbp\") pod \"47630c96-faa2-4a32-9dc3-45d7025095d1\" (UID: \"47630c96-faa2-4a32-9dc3-45d7025095d1\") " May 28 17:26:35.439608 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439573 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47630c96-faa2-4a32-9dc3-45d7025095d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47630c96-faa2-4a32-9dc3-45d7025095d1" (UID: "47630c96-faa2-4a32-9dc3-45d7025095d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:26:35.439655 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439596 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-console-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.439698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439652 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-trusted-ca-bundle\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.439698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439670 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5566\" (UniqueName: \"kubernetes.io/projected/76656abc-a95c-4127-b765-caf00c62eb9e-kube-api-access-m5566\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.439698 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439691 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-oauth-config\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.439801 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439705 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76656abc-a95c-4127-b765-caf00c62eb9e-service-ca\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.439801 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.439721 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76656abc-a95c-4127-b765-caf00c62eb9e-console-serving-cert\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.441489 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.441464 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47630c96-faa2-4a32-9dc3-45d7025095d1-kube-api-access-6kcbp" (OuterVolumeSpecName: "kube-api-access-6kcbp") pod "47630c96-faa2-4a32-9dc3-45d7025095d1" (UID: "47630c96-faa2-4a32-9dc3-45d7025095d1"). InnerVolumeSpecName "kube-api-access-6kcbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:26:35.491721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.491678 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:35.540376 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.540337 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kcbp\" (UniqueName: \"kubernetes.io/projected/47630c96-faa2-4a32-9dc3-45d7025095d1-kube-api-access-6kcbp\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.540376 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.540368 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47630c96-faa2-4a32-9dc3-45d7025095d1-extensions-socket-volume\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:35.646497 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.646457 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p"] May 28 17:26:35.648723 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:26:35.648694 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9303a32_cf0d_4de3_9ca9_f02d6153369f.slice/crio-85e8bdab59751012f5d88ead63ed5bd2d8c3e25264be12a482d6f6c38ea5f680 WatchSource:0}: Error finding container 85e8bdab59751012f5d88ead63ed5bd2d8c3e25264be12a482d6f6c38ea5f680: Status 404 returned error can't find the container with id 85e8bdab59751012f5d88ead63ed5bd2d8c3e25264be12a482d6f6c38ea5f680 May 28 17:26:35.977845 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.977734 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2931231b-2f5e-4751-bd69-33023b033873" path="/var/lib/kubelet/pods/2931231b-2f5e-4751-bd69-33023b033873/volumes" May 28 17:26:35.978313 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:35.978259 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" path="/var/lib/kubelet/pods/47630c96-faa2-4a32-9dc3-45d7025095d1/volumes" May 28 17:26:36.041274 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.041237 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" event={"ID":"d9303a32-cf0d-4de3-9ca9-f02d6153369f","Type":"ContainerStarted","Data":"e30e3576977f50a36044e21b1e05145186310b2717ef9af5999ba0af8e54c7e7"} May 28 17:26:36.041274 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.041286 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:36.041505 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.041302 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" event={"ID":"d9303a32-cf0d-4de3-9ca9-f02d6153369f","Type":"ContainerStarted","Data":"85e8bdab59751012f5d88ead63ed5bd2d8c3e25264be12a482d6f6c38ea5f680"} May 28 17:26:36.042665 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.042626 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" event={"ID":"2769323e-df79-4f39-af09-8519c3cd0340","Type":"ContainerStarted","Data":"a9df2357cc50952ff4bbfbc5139c0369d43bb9cbca5578d1b488e5e67db197b6"} May 28 17:26:36.043678 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.043651 2558 generic.go:358] "Generic (PLEG): container finished" podID="47630c96-faa2-4a32-9dc3-45d7025095d1" containerID="7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321" exitCode=2 May 28 17:26:36.043782 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.043683 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" May 28 17:26:36.043782 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.043728 2558 scope.go:117] "RemoveContainer" containerID="7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321" May 28 17:26:36.053137 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.053094 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" event={"ID":"c944d5b6-0514-4ac7-9309-c4ab34d9919e","Type":"ContainerStarted","Data":"31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b"} May 28 17:26:36.053316 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.053151 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" event={"ID":"c944d5b6-0514-4ac7-9309-c4ab34d9919e","Type":"ContainerStarted","Data":"053d4fab8a92c1448de88a811bec079ec9b6fa820c384d54d4a920f1165ffafe"} May 28 17:26:36.053393 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.053313 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" podUID="c944d5b6-0514-4ac7-9309-c4ab34d9919e" containerName="manager" containerID="cri-o://31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b" gracePeriod=10 May 28 17:26:36.053393 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.053383 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:36.054735 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.054711 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c8cd89b45-qmcjk_76656abc-a95c-4127-b765-caf00c62eb9e/console/0.log" May 28 17:26:36.054896 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.054852 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cd89b45-qmcjk" event={"ID":"76656abc-a95c-4127-b765-caf00c62eb9e","Type":"ContainerDied","Data":"35b8415b84c4fdfc6598f222a18ec435295b130f6102127ebfb7dec04d1252fe"} May 28 17:26:36.054896 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.054875 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" May 28 17:26:36.055012 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.054873 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cd89b45-qmcjk" May 28 17:26:36.057936 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.057797 2558 scope.go:117] "RemoveContainer" containerID="7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321" May 28 17:26:36.058303 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:26:36.058277 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321\": container with ID starting with 7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321 not found: ID does not exist" containerID="7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321" May 28 17:26:36.058421 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.058313 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321"} err="failed to get container status \"7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321\": rpc error: code = NotFound desc = could not find container \"7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321\": container with ID starting with 7653b355f000437056b9f1fbd3c7ce9b107c6734f0e3b37af3cdc860749e3321 not found: ID does not exist" May 28 17:26:36.058421 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.058338 2558 scope.go:117] "RemoveContainer" containerID="fe3c21ba267bc0e43f387ea355c9d053c233becde56c96fd1ffc80e0bc59af90" May 28 17:26:36.062983 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.062922 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" podStartSLOduration=1.062900658 podStartE2EDuration="1.062900658s" podCreationTimestamp="2026-05-28 17:26:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:26:36.060606836 +0000 UTC m=+564.689298304" watchObservedRunningTime="2026-05-28 17:26:36.062900658 +0000 UTC m=+564.691592128" May 28 17:26:36.063157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.063109 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:36.084206 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.084148 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5t4x2" podStartSLOduration=2.346685425 podStartE2EDuration="27.084132996s" podCreationTimestamp="2026-05-28 17:26:09 +0000 UTC" firstStartedPulling="2026-05-28 17:26:10.578274941 +0000 UTC m=+539.206966391" lastFinishedPulling="2026-05-28 17:26:35.315722511 +0000 UTC m=+563.944413962" observedRunningTime="2026-05-28 17:26:36.081929733 +0000 UTC m=+564.710621204" watchObservedRunningTime="2026-05-28 17:26:36.084132996 +0000 UTC m=+564.712824464" May 28 17:26:36.101270 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.101224 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8cd89b45-qmcjk"] May 28 17:26:36.105030 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.104990 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8cd89b45-qmcjk"] May 28 17:26:36.121771 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.121703 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" podStartSLOduration=17.12168228 podStartE2EDuration="17.12168228s" podCreationTimestamp="2026-05-28 17:26:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:26:36.119189672 +0000 UTC m=+564.747881148" watchObservedRunningTime="2026-05-28 17:26:36.12168228 +0000 UTC m=+564.750373753" May 28 17:26:36.124021 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.123973 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:36.333979 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.333953 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:36.336858 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.336822 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:36.360055 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.360005 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:36.449517 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.449471 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fbwl\" (UniqueName: \"kubernetes.io/projected/c944d5b6-0514-4ac7-9309-c4ab34d9919e-kube-api-access-9fbwl\") pod \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " May 28 17:26:36.449697 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.449540 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c944d5b6-0514-4ac7-9309-c4ab34d9919e-extensions-socket-volume\") pod \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\" (UID: \"c944d5b6-0514-4ac7-9309-c4ab34d9919e\") " May 28 17:26:36.449891 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.449868 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c944d5b6-0514-4ac7-9309-c4ab34d9919e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c944d5b6-0514-4ac7-9309-c4ab34d9919e" (UID: "c944d5b6-0514-4ac7-9309-c4ab34d9919e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:26:36.451637 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.451608 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c944d5b6-0514-4ac7-9309-c4ab34d9919e-kube-api-access-9fbwl" (OuterVolumeSpecName: "kube-api-access-9fbwl") pod "c944d5b6-0514-4ac7-9309-c4ab34d9919e" (UID: "c944d5b6-0514-4ac7-9309-c4ab34d9919e"). InnerVolumeSpecName "kube-api-access-9fbwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:26:36.551028 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.550931 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fbwl\" (UniqueName: \"kubernetes.io/projected/c944d5b6-0514-4ac7-9309-c4ab34d9919e-kube-api-access-9fbwl\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:36.551028 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:36.550964 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c944d5b6-0514-4ac7-9309-c4ab34d9919e-extensions-socket-volume\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:26:37.064675 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.064638 2558 generic.go:358] "Generic (PLEG): container finished" podID="c944d5b6-0514-4ac7-9309-c4ab34d9919e" containerID="31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b" exitCode=0 May 28 17:26:37.065152 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.064718 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" May 28 17:26:37.065152 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.064729 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" event={"ID":"c944d5b6-0514-4ac7-9309-c4ab34d9919e","Type":"ContainerDied","Data":"31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b"} May 28 17:26:37.065152 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.064765 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk" event={"ID":"c944d5b6-0514-4ac7-9309-c4ab34d9919e","Type":"ContainerDied","Data":"053d4fab8a92c1448de88a811bec079ec9b6fa820c384d54d4a920f1165ffafe"} May 28 17:26:37.065152 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.064789 2558 scope.go:117] "RemoveContainer" containerID="31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b" May 28 17:26:37.071157 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.071117 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:37.073058 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.073022 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:37.074255 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.074232 2558 scope.go:117] "RemoveContainer" containerID="31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b" May 28 17:26:37.074675 ip-10-0-130-182 kubenswrapper[2558]: E0528 17:26:37.074657 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b\": container with ID starting with 31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b not found: ID does not exist" containerID="31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b" May 28 17:26:37.074734 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.074682 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b"} err="failed to get container status \"31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b\": rpc error: code = NotFound desc = could not find container \"31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b\": container with ID starting with 31bb7e4e0265e06d40332cdb4cf65d83a7a0472d5dbb97f552858cefc244398b not found: ID does not exist" May 28 17:26:37.090402 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.090363 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk"] May 28 17:26:37.093941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.093901 2558 status_manager.go:895] "Failed to get status for pod" podUID="47630c96-faa2-4a32-9dc3-45d7025095d1" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fvjhw" err="pods \"kuadrant-operator-controller-manager-84b657d985-fvjhw\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:37.094753 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.094726 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qkqrk"] May 28 17:26:37.095837 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.095802 2558 status_manager.go:895] "Failed to get status for pod" podUID="2931231b-2f5e-4751-bd69-33023b033873" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4z6sk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-4z6sk\" is forbidden: User \"system:node:ip-10-0-130-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-182.ec2.internal' and this object" May 28 17:26:37.977623 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.977582 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76656abc-a95c-4127-b765-caf00c62eb9e" path="/var/lib/kubelet/pods/76656abc-a95c-4127-b765-caf00c62eb9e/volumes" May 28 17:26:37.977992 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:37.977974 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c944d5b6-0514-4ac7-9309-c4ab34d9919e" path="/var/lib/kubelet/pods/c944d5b6-0514-4ac7-9309-c4ab34d9919e/volumes" May 28 17:26:47.068034 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:47.067996 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:26:51.321138 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.321093 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd"] May 28 17:26:51.321529 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.321451 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76656abc-a95c-4127-b765-caf00c62eb9e" containerName="console" May 28 17:26:51.321529 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.321465 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="76656abc-a95c-4127-b765-caf00c62eb9e" containerName="console" May 28 17:26:51.321529 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.321480 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c944d5b6-0514-4ac7-9309-c4ab34d9919e" containerName="manager" May 28 17:26:51.321529 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.321485 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c944d5b6-0514-4ac7-9309-c4ab34d9919e" containerName="manager" May 28 17:26:51.321675 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.321552 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="76656abc-a95c-4127-b765-caf00c62eb9e" containerName="console" May 28 17:26:51.321675 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.321576 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="c944d5b6-0514-4ac7-9309-c4ab34d9919e" containerName="manager" May 28 17:26:51.331879 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.331848 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.336055 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.336021 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zwqwr\"" May 28 17:26:51.344667 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.344625 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd"] May 28 17:26:51.485009 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.484964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485009 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485049 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485083 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485106 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4287\" (UniqueName: \"kubernetes.io/projected/fc11436a-572f-44de-96fd-5c2c64bfb9c2-kube-api-access-k4287\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485236 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.485424 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.485285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586261 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586153 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586261 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586326 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586381 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586402 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586419 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4287\" (UniqueName: \"kubernetes.io/projected/fc11436a-572f-44de-96fd-5c2c64bfb9c2-kube-api-access-k4287\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586448 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586487 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586533 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586569 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586647 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.586721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.587000 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.586980 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.587142 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.587123 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.589037 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.589011 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.589192 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.589173 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.595668 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.595625 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc11436a-572f-44de-96fd-5c2c64bfb9c2-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.595936 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.595911 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4287\" (UniqueName: \"kubernetes.io/projected/fc11436a-572f-44de-96fd-5c2c64bfb9c2-kube-api-access-k4287\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8zjxd\" (UID: \"fc11436a-572f-44de-96fd-5c2c64bfb9c2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.646598 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.646551 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:51.789186 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.789157 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd"] May 28 17:26:51.790391 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:26:51.790362 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc11436a_572f_44de_96fd_5c2c64bfb9c2.slice/crio-b0b48727e98ccc8ad207456bafbba6a66c29576ff7df1528f7872407c13addb1 WatchSource:0}: Error finding container b0b48727e98ccc8ad207456bafbba6a66c29576ff7df1528f7872407c13addb1: Status 404 returned error can't find the container with id b0b48727e98ccc8ad207456bafbba6a66c29576ff7df1528f7872407c13addb1 May 28 17:26:51.792718 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.792682 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 17:26:51.792845 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.792751 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 17:26:51.792845 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:51.792783 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 17:26:52.130180 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:52.130088 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" event={"ID":"fc11436a-572f-44de-96fd-5c2c64bfb9c2","Type":"ContainerStarted","Data":"c3d41e5a7e4820b1c94c3ac7e17ddb74050b2c4df1c52d27ec86cdfdd7759ef8"} May 28 17:26:52.130180 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:52.130134 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" event={"ID":"fc11436a-572f-44de-96fd-5c2c64bfb9c2","Type":"ContainerStarted","Data":"b0b48727e98ccc8ad207456bafbba6a66c29576ff7df1528f7872407c13addb1"} May 28 17:26:52.155277 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:52.155213 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" podStartSLOduration=1.155194563 podStartE2EDuration="1.155194563s" podCreationTimestamp="2026-05-28 17:26:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:26:52.153434617 +0000 UTC m=+580.782126123" watchObservedRunningTime="2026-05-28 17:26:52.155194563 +0000 UTC m=+580.783886105" May 28 17:26:52.647697 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:52.647644 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:52.652793 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:52.652762 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:53.134496 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:53.134463 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:26:53.135615 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:26:53.135596 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8zjxd" May 28 17:27:07.402450 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.402407 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:27:07.502511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.502469 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:27:07.502511 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.502503 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:27:07.502768 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.502649 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.505798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.505769 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 28 17:27:07.533654 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.533612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmfz\" (UniqueName: \"kubernetes.io/projected/25bf5a36-cbfd-4a48-aca4-417f241dd933-kube-api-access-8vmfz\") pod \"limitador-limitador-78c99df468-kqchk\" (UID: \"25bf5a36-cbfd-4a48-aca4-417f241dd933\") " pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.533874 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.533699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bf5a36-cbfd-4a48-aca4-417f241dd933-config-file\") pod \"limitador-limitador-78c99df468-kqchk\" (UID: \"25bf5a36-cbfd-4a48-aca4-417f241dd933\") " pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.634399 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.634356 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bf5a36-cbfd-4a48-aca4-417f241dd933-config-file\") pod \"limitador-limitador-78c99df468-kqchk\" (UID: \"25bf5a36-cbfd-4a48-aca4-417f241dd933\") " pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.634585 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.634501 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmfz\" (UniqueName: \"kubernetes.io/projected/25bf5a36-cbfd-4a48-aca4-417f241dd933-kube-api-access-8vmfz\") pod \"limitador-limitador-78c99df468-kqchk\" (UID: \"25bf5a36-cbfd-4a48-aca4-417f241dd933\") " pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.635089 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.635067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bf5a36-cbfd-4a48-aca4-417f241dd933-config-file\") pod \"limitador-limitador-78c99df468-kqchk\" (UID: \"25bf5a36-cbfd-4a48-aca4-417f241dd933\") " pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.643546 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.643508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmfz\" (UniqueName: \"kubernetes.io/projected/25bf5a36-cbfd-4a48-aca4-417f241dd933-kube-api-access-8vmfz\") pod \"limitador-limitador-78c99df468-kqchk\" (UID: \"25bf5a36-cbfd-4a48-aca4-417f241dd933\") " pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.814017 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.813976 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:07.959388 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:07.959349 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:27:07.961230 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:27:07.961200 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bf5a36_cbfd_4a48_aca4_417f241dd933.slice/crio-66322090d50ab87c65e3651aa35355a4039fcd6fd05cdc068d368314802963a2 WatchSource:0}: Error finding container 66322090d50ab87c65e3651aa35355a4039fcd6fd05cdc068d368314802963a2: Status 404 returned error can't find the container with id 66322090d50ab87c65e3651aa35355a4039fcd6fd05cdc068d368314802963a2 May 28 17:27:08.197709 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:08.197622 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" event={"ID":"25bf5a36-cbfd-4a48-aca4-417f241dd933","Type":"ContainerStarted","Data":"66322090d50ab87c65e3651aa35355a4039fcd6fd05cdc068d368314802963a2"} May 28 17:27:11.214755 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:11.214715 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" event={"ID":"25bf5a36-cbfd-4a48-aca4-417f241dd933","Type":"ContainerStarted","Data":"8a148aca2ae2e88144fce908dcc598c20bf1f1146dc6fef605ad9a8f9eb10891"} May 28 17:27:11.215155 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:11.214840 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:27:11.234366 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:11.234300 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" podStartSLOduration=1.84387809 podStartE2EDuration="4.234281232s" podCreationTimestamp="2026-05-28 17:27:07 +0000 UTC" firstStartedPulling="2026-05-28 17:27:07.963253978 +0000 UTC m=+596.591945425" lastFinishedPulling="2026-05-28 17:27:10.353657121 +0000 UTC m=+598.982348567" observedRunningTime="2026-05-28 17:27:11.234198879 +0000 UTC m=+599.862890349" watchObservedRunningTime="2026-05-28 17:27:11.234281232 +0000 UTC m=+599.862972715" May 28 17:27:11.879972 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:11.879943 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:27:11.880587 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:11.880567 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:27:22.219933 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:27:22.219899 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-kqchk" May 28 17:28:19.329308 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:28:19.329266 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:28:32.166544 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:28:32.166505 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:28:48.249691 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:28:48.249652 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:29:04.554928 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:29:04.554836 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:29:09.960543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:29:09.960503 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:29:19.760666 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:29:19.760628 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:29:24.052431 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:29:24.052390 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:30:00.142120 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.142071 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-9dncb"] May 28 17:30:00.145485 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.145462 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" May 28 17:30:00.148229 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.148204 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nf2kl\"" May 28 17:30:00.153015 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.152981 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-9dncb"] May 28 17:30:00.204579 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.204538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb74q\" (UniqueName: \"kubernetes.io/projected/10ce889c-06da-41c0-b0e0-c3e86018c689-kube-api-access-bb74q\") pod \"maas-api-key-cleanup-29666490-9dncb\" (UID: \"10ce889c-06da-41c0-b0e0-c3e86018c689\") " pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" May 28 17:30:00.305978 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.305936 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bb74q\" (UniqueName: \"kubernetes.io/projected/10ce889c-06da-41c0-b0e0-c3e86018c689-kube-api-access-bb74q\") pod \"maas-api-key-cleanup-29666490-9dncb\" (UID: \"10ce889c-06da-41c0-b0e0-c3e86018c689\") " pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" May 28 17:30:00.315105 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.315065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb74q\" (UniqueName: \"kubernetes.io/projected/10ce889c-06da-41c0-b0e0-c3e86018c689-kube-api-access-bb74q\") pod \"maas-api-key-cleanup-29666490-9dncb\" (UID: \"10ce889c-06da-41c0-b0e0-c3e86018c689\") " pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" May 28 17:30:00.457137 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.457044 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" May 28 17:30:00.600653 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.600622 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-9dncb"] May 28 17:30:00.603364 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:30:00.603333 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ce889c_06da_41c0_b0e0_c3e86018c689.slice/crio-f026f6a6fa9a24f31a70acf78d8c0b4eabf9ab5daa19ca21f8b24e0e6bdc1bc5 WatchSource:0}: Error finding container f026f6a6fa9a24f31a70acf78d8c0b4eabf9ab5daa19ca21f8b24e0e6bdc1bc5: Status 404 returned error can't find the container with id f026f6a6fa9a24f31a70acf78d8c0b4eabf9ab5daa19ca21f8b24e0e6bdc1bc5 May 28 17:30:00.605621 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.605592 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:30:00.930014 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:00.929980 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" event={"ID":"10ce889c-06da-41c0-b0e0-c3e86018c689","Type":"ContainerStarted","Data":"f026f6a6fa9a24f31a70acf78d8c0b4eabf9ab5daa19ca21f8b24e0e6bdc1bc5"} May 28 17:30:04.949660 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:04.949617 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" event={"ID":"10ce889c-06da-41c0-b0e0-c3e86018c689","Type":"ContainerStarted","Data":"8f3eb2f3b814e799ccf0023f72ca8f1181e68f5ad16be98da8538ec831683660"} May 28 17:30:04.967561 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:04.967493 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" podStartSLOduration=1.7120475019999999 podStartE2EDuration="4.9674772s" podCreationTimestamp="2026-05-28 17:30:00 +0000 UTC" firstStartedPulling="2026-05-28 17:30:00.605758209 +0000 UTC m=+769.234449656" lastFinishedPulling="2026-05-28 17:30:03.861187907 +0000 UTC m=+772.489879354" observedRunningTime="2026-05-28 17:30:04.965065152 +0000 UTC m=+773.593756621" watchObservedRunningTime="2026-05-28 17:30:04.9674772 +0000 UTC m=+773.596168700" May 28 17:30:05.955572 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:05.955535 2558 generic.go:358] "Generic (PLEG): container finished" podID="10ce889c-06da-41c0-b0e0-c3e86018c689" containerID="8f3eb2f3b814e799ccf0023f72ca8f1181e68f5ad16be98da8538ec831683660" exitCode=0 May 28 17:30:05.955985 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:05.955597 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" event={"ID":"10ce889c-06da-41c0-b0e0-c3e86018c689","Type":"ContainerDied","Data":"8f3eb2f3b814e799ccf0023f72ca8f1181e68f5ad16be98da8538ec831683660"} May 28 17:30:07.097255 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:07.097228 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" May 28 17:30:07.168114 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:07.168069 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb74q\" (UniqueName: \"kubernetes.io/projected/10ce889c-06da-41c0-b0e0-c3e86018c689-kube-api-access-bb74q\") pod \"10ce889c-06da-41c0-b0e0-c3e86018c689\" (UID: \"10ce889c-06da-41c0-b0e0-c3e86018c689\") " May 28 17:30:07.170321 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:07.170289 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ce889c-06da-41c0-b0e0-c3e86018c689-kube-api-access-bb74q" (OuterVolumeSpecName: "kube-api-access-bb74q") pod "10ce889c-06da-41c0-b0e0-c3e86018c689" (UID: "10ce889c-06da-41c0-b0e0-c3e86018c689"). InnerVolumeSpecName "kube-api-access-bb74q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:30:07.268888 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:07.268805 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb74q\" (UniqueName: \"kubernetes.io/projected/10ce889c-06da-41c0-b0e0-c3e86018c689-kube-api-access-bb74q\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:30:07.965598 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:07.965553 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" event={"ID":"10ce889c-06da-41c0-b0e0-c3e86018c689","Type":"ContainerDied","Data":"f026f6a6fa9a24f31a70acf78d8c0b4eabf9ab5daa19ca21f8b24e0e6bdc1bc5"} May 28 17:30:07.965598 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:07.965586 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-9dncb" May 28 17:30:07.965598 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:07.965600 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f026f6a6fa9a24f31a70acf78d8c0b4eabf9ab5daa19ca21f8b24e0e6bdc1bc5" May 28 17:30:39.953756 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:39.953662 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:30:49.462232 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:49.462186 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:30:59.452152 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:30:59.452088 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:31:08.950493 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:31:08.950444 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:31:18.466798 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:31:18.466749 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:31:27.549184 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:31:27.549136 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:31:59.964074 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:31:59.963968 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:32:05.968719 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:32:05.968677 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:32:11.914111 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:32:11.914080 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:32:11.916543 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:32:11.916516 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:32:12.268491 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:32:12.268453 2558 scope.go:117] "RemoveContainer" containerID="cd488c970b03f3a55c6e39fbaccaac8ee3ab0f2086634dd78487b1f1c18b0b66" May 28 17:32:41.454877 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:32:41.454834 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:32:56.649181 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:32:56.649136 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:33:36.455882 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:33:36.455762 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:33:52.848913 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:33:52.848866 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:34:08.654965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:34:08.654927 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:34:23.848099 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:34:23.848045 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:34:51.677187 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:34:51.677150 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:34:56.048124 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:34:56.048072 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:35:31.267060 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:35:31.266970 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:35:41.057600 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:35:41.057542 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:35:57.050719 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:35:57.050678 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:36:05.248483 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:36:05.248439 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:36:22.849001 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:36:22.848947 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:36:31.355775 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:36:31.355682 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:37:02.951789 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:02.951747 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:37:11.950411 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:11.950382 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:37:11.954068 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:11.954043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:37:12.385667 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:12.385620 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:37:20.153897 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:20.153851 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:37:29.147565 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:29.147523 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:37:36.556088 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:36.556036 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:37:54.552865 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:37:54.552821 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:38:07.543873 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:38:07.543767 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:38:54.344274 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:38:54.344230 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:38:59.649422 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:38:59.649374 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:39:07.953728 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:39:07.953681 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:39:17.155707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:39:17.155656 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:39:26.745070 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:39:26.745030 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:39:34.547485 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:39:34.547391 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:39:42.648053 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:39:42.648012 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:39:47.853260 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:39:47.853221 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:39:52.346281 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:39:52.346236 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:40:00.554396 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:40:00.554348 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:40:09.853045 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:40:09.852993 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:40:18.250245 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:40:18.250195 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:40:27.344118 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:40:27.344074 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:40:35.747424 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:40:35.747372 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:40:44.247558 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:40:44.247514 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:40:52.659070 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:40:52.659033 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:41:02.270714 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:41:02.270602 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:41:10.545452 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:41:10.545405 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:41:18.847245 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:41:18.847205 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:42:10.447099 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:10.447058 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p"] May 28 17:42:10.447647 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:10.447330 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" podUID="d9303a32-cf0d-4de3-9ca9-f02d6153369f" containerName="manager" containerID="cri-o://e30e3576977f50a36044e21b1e05145186310b2717ef9af5999ba0af8e54c7e7" gracePeriod=10 May 28 17:42:10.965211 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:10.965173 2558 generic.go:358] "Generic (PLEG): container finished" podID="d9303a32-cf0d-4de3-9ca9-f02d6153369f" containerID="e30e3576977f50a36044e21b1e05145186310b2717ef9af5999ba0af8e54c7e7" exitCode=0 May 28 17:42:10.965387 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:10.965216 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" event={"ID":"d9303a32-cf0d-4de3-9ca9-f02d6153369f","Type":"ContainerDied","Data":"e30e3576977f50a36044e21b1e05145186310b2717ef9af5999ba0af8e54c7e7"} May 28 17:42:11.202570 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.202541 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:42:11.263266 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.263224 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24n4j\" (UniqueName: \"kubernetes.io/projected/d9303a32-cf0d-4de3-9ca9-f02d6153369f-kube-api-access-24n4j\") pod \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " May 28 17:42:11.263475 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.263337 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9303a32-cf0d-4de3-9ca9-f02d6153369f-extensions-socket-volume\") pod \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\" (UID: \"d9303a32-cf0d-4de3-9ca9-f02d6153369f\") " May 28 17:42:11.263803 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.263770 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9303a32-cf0d-4de3-9ca9-f02d6153369f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9303a32-cf0d-4de3-9ca9-f02d6153369f" (UID: "d9303a32-cf0d-4de3-9ca9-f02d6153369f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:42:11.265474 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.265437 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9303a32-cf0d-4de3-9ca9-f02d6153369f-kube-api-access-24n4j" (OuterVolumeSpecName: "kube-api-access-24n4j") pod "d9303a32-cf0d-4de3-9ca9-f02d6153369f" (UID: "d9303a32-cf0d-4de3-9ca9-f02d6153369f"). InnerVolumeSpecName "kube-api-access-24n4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:42:11.364792 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.364755 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24n4j\" (UniqueName: \"kubernetes.io/projected/d9303a32-cf0d-4de3-9ca9-f02d6153369f-kube-api-access-24n4j\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:42:11.364792 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.364786 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9303a32-cf0d-4de3-9ca9-f02d6153369f-extensions-socket-volume\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:42:11.970179 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.970139 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" event={"ID":"d9303a32-cf0d-4de3-9ca9-f02d6153369f","Type":"ContainerDied","Data":"85e8bdab59751012f5d88ead63ed5bd2d8c3e25264be12a482d6f6c38ea5f680"} May 28 17:42:11.970639 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.970191 2558 scope.go:117] "RemoveContainer" containerID="e30e3576977f50a36044e21b1e05145186310b2717ef9af5999ba0af8e54c7e7" May 28 17:42:11.970639 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.970213 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p" May 28 17:42:11.998916 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.998878 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p"] May 28 17:42:11.999689 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:11.999667 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:42:12.001881 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:12.001848 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vp92p"] May 28 17:42:12.006482 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:12.006455 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:42:13.977047 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:42:13.977004 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9303a32-cf0d-4de3-9ca9-f02d6153369f" path="/var/lib/kubelet/pods/d9303a32-cf0d-4de3-9ca9-f02d6153369f/volumes" May 28 17:43:16.564423 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.564378 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c"] May 28 17:43:16.567052 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.564949 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9303a32-cf0d-4de3-9ca9-f02d6153369f" containerName="manager" May 28 17:43:16.567052 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.564965 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9303a32-cf0d-4de3-9ca9-f02d6153369f" containerName="manager" May 28 17:43:16.567052 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.564989 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ce889c-06da-41c0-b0e0-c3e86018c689" containerName="cleanup" May 28 17:43:16.567052 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.564995 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ce889c-06da-41c0-b0e0-c3e86018c689" containerName="cleanup" May 28 17:43:16.567052 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.565053 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9303a32-cf0d-4de3-9ca9-f02d6153369f" containerName="manager" May 28 17:43:16.567052 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.565063 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="10ce889c-06da-41c0-b0e0-c3e86018c689" containerName="cleanup" May 28 17:43:16.568045 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.568019 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:16.570790 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.570757 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4ckss\"" May 28 17:43:16.578828 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.578780 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c"] May 28 17:43:16.753965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.753913 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8973d78d-7eb2-4b2b-90f0-b557bbb1c991-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9w58c\" (UID: \"8973d78d-7eb2-4b2b-90f0-b557bbb1c991\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:16.754155 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.753985 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496m2\" (UniqueName: \"kubernetes.io/projected/8973d78d-7eb2-4b2b-90f0-b557bbb1c991-kube-api-access-496m2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9w58c\" (UID: \"8973d78d-7eb2-4b2b-90f0-b557bbb1c991\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:16.855390 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.855284 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8973d78d-7eb2-4b2b-90f0-b557bbb1c991-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9w58c\" (UID: \"8973d78d-7eb2-4b2b-90f0-b557bbb1c991\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:16.855390 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.855364 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-496m2\" (UniqueName: \"kubernetes.io/projected/8973d78d-7eb2-4b2b-90f0-b557bbb1c991-kube-api-access-496m2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9w58c\" (UID: \"8973d78d-7eb2-4b2b-90f0-b557bbb1c991\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:16.855779 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.855755 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8973d78d-7eb2-4b2b-90f0-b557bbb1c991-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9w58c\" (UID: \"8973d78d-7eb2-4b2b-90f0-b557bbb1c991\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:16.864414 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.864380 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-496m2\" (UniqueName: \"kubernetes.io/projected/8973d78d-7eb2-4b2b-90f0-b557bbb1c991-kube-api-access-496m2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9w58c\" (UID: \"8973d78d-7eb2-4b2b-90f0-b557bbb1c991\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:16.880329 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:16.880284 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:17.030014 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:17.029981 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c"] May 28 17:43:17.031441 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:43:17.031413 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8973d78d_7eb2_4b2b_90f0_b557bbb1c991.slice/crio-0f06a9390219978270854ad3cd906b4d1c42e0867bab05f9fb45f592ead2f36c WatchSource:0}: Error finding container 0f06a9390219978270854ad3cd906b4d1c42e0867bab05f9fb45f592ead2f36c: Status 404 returned error can't find the container with id 0f06a9390219978270854ad3cd906b4d1c42e0867bab05f9fb45f592ead2f36c May 28 17:43:17.034063 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:17.034045 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:43:17.233941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:17.233843 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" event={"ID":"8973d78d-7eb2-4b2b-90f0-b557bbb1c991","Type":"ContainerStarted","Data":"c8292b17e33182d16c045bdb9987a362fd02c33606dd6d1ada0426e63e93c3e4"} May 28 17:43:17.233941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:17.233889 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" event={"ID":"8973d78d-7eb2-4b2b-90f0-b557bbb1c991","Type":"ContainerStarted","Data":"0f06a9390219978270854ad3cd906b4d1c42e0867bab05f9fb45f592ead2f36c"} May 28 17:43:17.233941 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:17.233910 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:17.255276 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:17.255214 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" podStartSLOduration=1.255193925 podStartE2EDuration="1.255193925s" podCreationTimestamp="2026-05-28 17:43:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:43:17.253029686 +0000 UTC m=+1565.881721156" watchObservedRunningTime="2026-05-28 17:43:17.255193925 +0000 UTC m=+1565.883885394" May 28 17:43:28.242537 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:28.242502 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9w58c" May 28 17:43:37.355330 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:37.355289 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:43:44.341386 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:43:44.341344 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:44:07.160069 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:44:07.159974 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:44:14.249219 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:44:14.249172 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:44:23.752736 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:44:23.752682 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:44:33.048002 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:44:33.047959 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:44:42.551441 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:44:42.551396 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:44:53.952026 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:44:53.951973 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:45:00.137646 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.137597 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-gbr72"] May 28 17:45:00.141351 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.141326 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" May 28 17:45:00.143793 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.143768 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nf2kl\"" May 28 17:45:00.157381 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.157344 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-gbr72"] May 28 17:45:00.236825 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.236775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8cr8\" (UniqueName: \"kubernetes.io/projected/c71bd236-88a2-49c2-b337-e3f23b239922-kube-api-access-d8cr8\") pod \"maas-api-key-cleanup-29666505-gbr72\" (UID: \"c71bd236-88a2-49c2-b337-e3f23b239922\") " pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" May 28 17:45:00.338246 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.338204 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cr8\" (UniqueName: \"kubernetes.io/projected/c71bd236-88a2-49c2-b337-e3f23b239922-kube-api-access-d8cr8\") pod \"maas-api-key-cleanup-29666505-gbr72\" (UID: \"c71bd236-88a2-49c2-b337-e3f23b239922\") " pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" May 28 17:45:00.346162 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.346120 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8cr8\" (UniqueName: \"kubernetes.io/projected/c71bd236-88a2-49c2-b337-e3f23b239922-kube-api-access-d8cr8\") pod \"maas-api-key-cleanup-29666505-gbr72\" (UID: \"c71bd236-88a2-49c2-b337-e3f23b239922\") " pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" May 28 17:45:00.452348 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.452247 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" May 28 17:45:00.600689 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.600649 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-gbr72"] May 28 17:45:00.602250 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:45:00.602193 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71bd236_88a2_49c2_b337_e3f23b239922.slice/crio-9338d239b5d1e30bc64bc85ea99dfde184645b51453f1f16e6c756da1a592d96 WatchSource:0}: Error finding container 9338d239b5d1e30bc64bc85ea99dfde184645b51453f1f16e6c756da1a592d96: Status 404 returned error can't find the container with id 9338d239b5d1e30bc64bc85ea99dfde184645b51453f1f16e6c756da1a592d96 May 28 17:45:00.664541 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:00.664502 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" event={"ID":"c71bd236-88a2-49c2-b337-e3f23b239922","Type":"ContainerStarted","Data":"9338d239b5d1e30bc64bc85ea99dfde184645b51453f1f16e6c756da1a592d96"} May 28 17:45:01.671433 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:01.671391 2558 generic.go:358] "Generic (PLEG): container finished" podID="c71bd236-88a2-49c2-b337-e3f23b239922" containerID="2e479922b22138805c0115c8f9106e4b84814ed900d0bcabe2c26b839908b002" exitCode=0 May 28 17:45:01.671826 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:01.671477 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" event={"ID":"c71bd236-88a2-49c2-b337-e3f23b239922","Type":"ContainerDied","Data":"2e479922b22138805c0115c8f9106e4b84814ed900d0bcabe2c26b839908b002"} May 28 17:45:02.446684 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:02.446635 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:45:02.823535 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:02.823508 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" May 28 17:45:02.960494 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:02.960453 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8cr8\" (UniqueName: \"kubernetes.io/projected/c71bd236-88a2-49c2-b337-e3f23b239922-kube-api-access-d8cr8\") pod \"c71bd236-88a2-49c2-b337-e3f23b239922\" (UID: \"c71bd236-88a2-49c2-b337-e3f23b239922\") " May 28 17:45:02.962653 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:02.962622 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c71bd236-88a2-49c2-b337-e3f23b239922-kube-api-access-d8cr8" (OuterVolumeSpecName: "kube-api-access-d8cr8") pod "c71bd236-88a2-49c2-b337-e3f23b239922" (UID: "c71bd236-88a2-49c2-b337-e3f23b239922"). InnerVolumeSpecName "kube-api-access-d8cr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:45:03.061723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:03.061681 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8cr8\" (UniqueName: \"kubernetes.io/projected/c71bd236-88a2-49c2-b337-e3f23b239922-kube-api-access-d8cr8\") on node \"ip-10-0-130-182.ec2.internal\" DevicePath \"\"" May 28 17:45:03.681483 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:03.681435 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" event={"ID":"c71bd236-88a2-49c2-b337-e3f23b239922","Type":"ContainerDied","Data":"9338d239b5d1e30bc64bc85ea99dfde184645b51453f1f16e6c756da1a592d96"} May 28 17:45:03.681483 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:03.681475 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9338d239b5d1e30bc64bc85ea99dfde184645b51453f1f16e6c756da1a592d96" May 28 17:45:03.681715 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:03.681485 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gbr72" May 28 17:45:12.050081 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:12.050035 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:45:21.647679 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:21.647624 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:45:31.651486 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:31.651387 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:45:40.448409 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:40.448365 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:45:46.047036 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:45:46.046995 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:46:13.340036 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:46:13.339991 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:46:56.645121 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:46:56.645074 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:47:05.151975 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:05.151875 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:47:12.034553 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:12.034518 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:47:12.042394 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:12.042367 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:47:14.847096 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:14.847060 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:47:22.643172 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:22.643128 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:47:32.648404 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:32.648358 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:47:41.948686 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:41.948635 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:47:52.039849 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:52.039797 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:47:57.645076 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:47:57.645031 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:48:07.545189 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:48:07.545137 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:48:15.748915 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:48:15.748862 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:48:24.249476 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:48:24.249429 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:48:35.248683 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:48:35.248586 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:48:53.049726 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:48:53.049679 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:49:00.750943 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:49:00.750904 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:49:09.148397 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:49:09.148347 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:49:17.643733 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:49:17.643690 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:49:35.650390 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:49:35.650344 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:49:42.648350 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:49:42.648303 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:49:53.143802 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:49:53.143762 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:50:00.939392 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:50:00.939290 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:50:09.147362 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:50:09.147314 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:50:18.144105 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:50:18.144066 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:50:28.344728 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:50:28.344679 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:50:38.050313 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:50:38.050268 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:50:47.741348 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:50:47.741302 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:50:58.348079 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:50:58.348030 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:51:09.044959 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:51:09.044911 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:51:17.151534 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:51:17.151484 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:51:27.247797 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:51:27.247740 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:51:33.048703 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:51:33.048588 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:51:50.248167 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:51:50.248124 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:51:59.149428 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:51:59.149388 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:52:07.449468 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:52:07.449419 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:52:12.071945 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:52:12.071917 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:52:12.079490 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:52:12.079463 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzncx_d2417ece-b70b-4476-9f06-cc37c636f24a/ovn-acl-logging/0.log" May 28 17:52:17.944319 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:52:17.944276 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:52:41.545674 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:52:41.545622 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:52:54.347219 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:52:54.347172 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kqchk"] May 28 17:53:03.026389 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:03.026239 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666490-9dncb_10ce889c-06da-41c0-b0e0-c3e86018c689/cleanup/0.log" May 28 17:53:03.139950 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:03.139922 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666505-gbr72_c71bd236-88a2-49c2-b337-e3f23b239922/cleanup/0.log" May 28 17:53:03.506636 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:03.506602 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795fd7c67-8b6xg_3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d/manager/0.log" May 28 17:53:04.615318 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.615291 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh_86c9da01-5a76-4bf0-b466-08b1bc6d0743/pull/0.log" May 28 17:53:04.622911 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.622885 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh_86c9da01-5a76-4bf0-b466-08b1bc6d0743/extract/0.log" May 28 17:53:04.629343 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.629320 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh_86c9da01-5a76-4bf0-b466-08b1bc6d0743/util/0.log" May 28 17:53:04.743965 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.743939 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66_3774de16-ea41-4a7f-9f63-fd4447290d3a/pull/0.log" May 28 17:53:04.751425 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.751395 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66_3774de16-ea41-4a7f-9f63-fd4447290d3a/extract/0.log" May 28 17:53:04.758889 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.758861 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66_3774de16-ea41-4a7f-9f63-fd4447290d3a/util/0.log" May 28 17:53:04.866891 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.866788 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44_916eedcb-29e1-4e59-bdad-9d718c2e3a12/util/0.log" May 28 17:53:04.874370 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.874339 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44_916eedcb-29e1-4e59-bdad-9d718c2e3a12/pull/0.log" May 28 17:53:04.881215 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.881184 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44_916eedcb-29e1-4e59-bdad-9d718c2e3a12/extract/0.log" May 28 17:53:04.994615 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:04.994583 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj_30b5b910-f9c1-4e4f-9f0e-118a851c3b67/util/0.log" May 28 17:53:05.002321 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:05.002295 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj_30b5b910-f9c1-4e4f-9f0e-118a851c3b67/pull/0.log" May 28 17:53:05.010032 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:05.010005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj_30b5b910-f9c1-4e4f-9f0e-118a851c3b67/extract/0.log" May 28 17:53:05.356466 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:05.356436 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5wd9v_0b5e463c-6bb1-4468-99d4-06d55446ccae/manager/0.log" May 28 17:53:05.464312 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:05.464282 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-5t4x2_2769323e-df79-4f39-af09-8519c3cd0340/kuadrant-console-plugin/0.log" May 28 17:53:05.690791 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:05.690707 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9w58c_8973d78d-7eb2-4b2b-90f0-b557bbb1c991/manager/0.log" May 28 17:53:05.799366 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:05.799328 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-kqchk_25bf5a36-cbfd-4a48-aca4-417f241dd933/limitador/0.log" May 28 17:53:06.263062 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:06.263027 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg_3e8d9948-98f2-47f1-9f14-5403d7d96d98/istio-proxy/0.log" May 28 17:53:06.728572 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:06.728486 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-8zjxd_fc11436a-572f-44de-96fd-5c2c64bfb9c2/istio-proxy/0.log" May 28 17:53:06.958392 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:06.958363 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9f45d9458-x5rqw_ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae/router/0.log" May 28 17:53:11.844093 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.844057 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7hsz9/must-gather-gkv2x"] May 28 17:53:11.844537 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.844403 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71bd236-88a2-49c2-b337-e3f23b239922" containerName="cleanup" May 28 17:53:11.844537 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.844414 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71bd236-88a2-49c2-b337-e3f23b239922" containerName="cleanup" May 28 17:53:11.844537 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.844486 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="c71bd236-88a2-49c2-b337-e3f23b239922" containerName="cleanup" May 28 17:53:11.847590 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.847566 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:11.852493 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.852469 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7hsz9\"/\"default-dockercfg-dlls8\"" May 28 17:53:11.852859 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.852842 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hsz9\"/\"openshift-service-ca.crt\"" May 28 17:53:11.853440 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.853424 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hsz9\"/\"kube-root-ca.crt\"" May 28 17:53:11.856480 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.856454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/244ce1a2-3cde-43b4-93f6-58f0a1dd7976-must-gather-output\") pod \"must-gather-gkv2x\" (UID: \"244ce1a2-3cde-43b4-93f6-58f0a1dd7976\") " pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:11.856619 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.856597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ktmg\" (UniqueName: \"kubernetes.io/projected/244ce1a2-3cde-43b4-93f6-58f0a1dd7976-kube-api-access-9ktmg\") pod \"must-gather-gkv2x\" (UID: \"244ce1a2-3cde-43b4-93f6-58f0a1dd7976\") " pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:11.879048 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.879007 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hsz9/must-gather-gkv2x"] May 28 17:53:11.957707 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.957652 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ktmg\" (UniqueName: \"kubernetes.io/projected/244ce1a2-3cde-43b4-93f6-58f0a1dd7976-kube-api-access-9ktmg\") pod \"must-gather-gkv2x\" (UID: \"244ce1a2-3cde-43b4-93f6-58f0a1dd7976\") " pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:11.957909 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.957721 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/244ce1a2-3cde-43b4-93f6-58f0a1dd7976-must-gather-output\") pod \"must-gather-gkv2x\" (UID: \"244ce1a2-3cde-43b4-93f6-58f0a1dd7976\") " pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:11.958060 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.958044 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/244ce1a2-3cde-43b4-93f6-58f0a1dd7976-must-gather-output\") pod \"must-gather-gkv2x\" (UID: \"244ce1a2-3cde-43b4-93f6-58f0a1dd7976\") " pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:11.967327 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:11.967292 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ktmg\" (UniqueName: \"kubernetes.io/projected/244ce1a2-3cde-43b4-93f6-58f0a1dd7976-kube-api-access-9ktmg\") pod \"must-gather-gkv2x\" (UID: \"244ce1a2-3cde-43b4-93f6-58f0a1dd7976\") " pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:12.158721 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:12.158627 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hsz9/must-gather-gkv2x" May 28 17:53:12.312842 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:12.312784 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hsz9/must-gather-gkv2x"] May 28 17:53:12.314155 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:53:12.314122 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod244ce1a2_3cde_43b4_93f6_58f0a1dd7976.slice/crio-beda5f8760f8e0e12a0ddb582f1c351df7306bd1c952cf2cc8a804b010549230 WatchSource:0}: Error finding container beda5f8760f8e0e12a0ddb582f1c351df7306bd1c952cf2cc8a804b010549230: Status 404 returned error can't find the container with id beda5f8760f8e0e12a0ddb582f1c351df7306bd1c952cf2cc8a804b010549230 May 28 17:53:12.316723 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:12.316700 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:53:12.699662 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:12.699625 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hsz9/must-gather-gkv2x" event={"ID":"244ce1a2-3cde-43b4-93f6-58f0a1dd7976","Type":"ContainerStarted","Data":"beda5f8760f8e0e12a0ddb582f1c351df7306bd1c952cf2cc8a804b010549230"} May 28 17:53:13.706716 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:13.706667 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hsz9/must-gather-gkv2x" event={"ID":"244ce1a2-3cde-43b4-93f6-58f0a1dd7976","Type":"ContainerStarted","Data":"890fb86a2393a5f1b92eac256fe65c2dfadc8f383b40bc71b7f709c91a3bc601"} May 28 17:53:13.706716 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:13.706723 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hsz9/must-gather-gkv2x" event={"ID":"244ce1a2-3cde-43b4-93f6-58f0a1dd7976","Type":"ContainerStarted","Data":"c570e3b3b2841dfe301ec9eac17fda144a23e91d500fd2573aa11f6b128e78ba"} May 28 17:53:13.741071 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:13.741014 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7hsz9/must-gather-gkv2x" podStartSLOduration=1.960192683 podStartE2EDuration="2.740992055s" podCreationTimestamp="2026-05-28 17:53:11 +0000 UTC" firstStartedPulling="2026-05-28 17:53:12.316920882 +0000 UTC m=+2160.945612349" lastFinishedPulling="2026-05-28 17:53:13.09772027 +0000 UTC m=+2161.726411721" observedRunningTime="2026-05-28 17:53:13.740585913 +0000 UTC m=+2162.369277398" watchObservedRunningTime="2026-05-28 17:53:13.740992055 +0000 UTC m=+2162.369683523" May 28 17:53:15.030008 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:15.029962 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mc9xw_78e38760-b1d6-404c-a607-7acd976da96b/global-pull-secret-syncer/0.log" May 28 17:53:15.250375 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:15.250341 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g966j_e46bbf10-a66d-4752-8215-f65b0656d4ee/konnectivity-agent/0.log" May 28 17:53:15.280715 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:15.280630 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-182.ec2.internal_6c1b0bd7a552c99e08577a389f430b84/haproxy/0.log" May 28 17:53:19.248007 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.247968 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh_86c9da01-5a76-4bf0-b466-08b1bc6d0743/extract/0.log" May 28 17:53:19.299769 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.299656 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh_86c9da01-5a76-4bf0-b466-08b1bc6d0743/util/0.log" May 28 17:53:19.373461 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.373421 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrcwh_86c9da01-5a76-4bf0-b466-08b1bc6d0743/pull/0.log" May 28 17:53:19.432796 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.432751 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66_3774de16-ea41-4a7f-9f63-fd4447290d3a/extract/0.log" May 28 17:53:19.501058 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.501024 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66_3774de16-ea41-4a7f-9f63-fd4447290d3a/util/0.log" May 28 17:53:19.550664 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.550543 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rdh66_3774de16-ea41-4a7f-9f63-fd4447290d3a/pull/0.log" May 28 17:53:19.604404 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.604345 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44_916eedcb-29e1-4e59-bdad-9d718c2e3a12/extract/0.log" May 28 17:53:19.660279 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.660243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44_916eedcb-29e1-4e59-bdad-9d718c2e3a12/util/0.log" May 28 17:53:19.720329 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.720287 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qtm44_916eedcb-29e1-4e59-bdad-9d718c2e3a12/pull/0.log" May 28 17:53:19.781538 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.781498 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj_30b5b910-f9c1-4e4f-9f0e-118a851c3b67/extract/0.log" May 28 17:53:19.861924 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.861789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj_30b5b910-f9c1-4e4f-9f0e-118a851c3b67/util/0.log" May 28 17:53:19.914357 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:19.914314 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t8bsj_30b5b910-f9c1-4e4f-9f0e-118a851c3b67/pull/0.log" May 28 17:53:20.320334 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:20.320296 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5wd9v_0b5e463c-6bb1-4468-99d4-06d55446ccae/manager/0.log" May 28 17:53:20.373395 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:20.373348 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-5t4x2_2769323e-df79-4f39-af09-8519c3cd0340/kuadrant-console-plugin/0.log" May 28 17:53:20.585353 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:20.585243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9w58c_8973d78d-7eb2-4b2b-90f0-b557bbb1c991/manager/0.log" May 28 17:53:20.652167 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:20.652130 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-kqchk_25bf5a36-cbfd-4a48-aca4-417f241dd933/limitador/0.log" May 28 17:53:22.966667 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:22.966639 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-4k8j7_334787c0-676d-48ee-be2c-064eada9d3aa/monitoring-plugin/0.log" May 28 17:53:23.002112 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.002078 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f98fg_910c40f4-e741-4d3b-b671-0659c0986e1f/node-exporter/0.log" May 28 17:53:23.028177 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.028149 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f98fg_910c40f4-e741-4d3b-b671-0659c0986e1f/kube-rbac-proxy/0.log" May 28 17:53:23.051742 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.051714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f98fg_910c40f4-e741-4d3b-b671-0659c0986e1f/init-textfile/0.log" May 28 17:53:23.251886 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.251854 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-txt6d_a2b433ae-181d-49c3-94db-61f8b864b274/kube-rbac-proxy-main/0.log" May 28 17:53:23.278335 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.278304 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-txt6d_a2b433ae-181d-49c3-94db-61f8b864b274/kube-rbac-proxy-self/0.log" May 28 17:53:23.311349 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.311322 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-txt6d_a2b433ae-181d-49c3-94db-61f8b864b274/openshift-state-metrics/0.log" May 28 17:53:23.535747 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.535662 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gp6pj_c22ad3a6-83c8-4aeb-afc1-09a8b89650c2/prometheus-operator/0.log" May 28 17:53:23.560322 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.560293 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gp6pj_c22ad3a6-83c8-4aeb-afc1-09a8b89650c2/kube-rbac-proxy/0.log" May 28 17:53:23.705284 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.705254 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7996fdc58f-d72f8_42cc39fa-9b31-471b-9138-a86e99743b0d/thanos-query/0.log" May 28 17:53:23.731904 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.731871 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7996fdc58f-d72f8_42cc39fa-9b31-471b-9138-a86e99743b0d/kube-rbac-proxy-web/0.log" May 28 17:53:23.757137 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.757092 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5"] May 28 17:53:23.761841 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.761787 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.772059 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.771972 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7996fdc58f-d72f8_42cc39fa-9b31-471b-9138-a86e99743b0d/kube-rbac-proxy/0.log" May 28 17:53:23.772551 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.772521 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5"] May 28 17:53:23.808875 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.808782 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7996fdc58f-d72f8_42cc39fa-9b31-471b-9138-a86e99743b0d/prom-label-proxy/0.log" May 28 17:53:23.837017 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.836983 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7996fdc58f-d72f8_42cc39fa-9b31-471b-9138-a86e99743b0d/kube-rbac-proxy-rules/0.log" May 28 17:53:23.865406 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.865360 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7996fdc58f-d72f8_42cc39fa-9b31-471b-9138-a86e99743b0d/kube-rbac-proxy-metrics/0.log" May 28 17:53:23.874611 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.874575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-sys\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.874801 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.874619 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw6d9\" (UniqueName: \"kubernetes.io/projected/041e7549-a8a2-4359-9762-f152569238e9-kube-api-access-lw6d9\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.874801 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.874713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-podres\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.874923 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.874844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-proc\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.874923 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.874876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-lib-modules\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.975597 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975547 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-sys\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.975597 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975601 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lw6d9\" (UniqueName: \"kubernetes.io/projected/041e7549-a8a2-4359-9762-f152569238e9-kube-api-access-lw6d9\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.976168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975659 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-podres\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.976168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-sys\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.976168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975827 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-podres\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.976168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975864 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-proc\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.976168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975914 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-lib-modules\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.976168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.975959 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-proc\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.976168 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.976066 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041e7549-a8a2-4359-9762-f152569238e9-lib-modules\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:23.987845 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:23.987776 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw6d9\" (UniqueName: \"kubernetes.io/projected/041e7549-a8a2-4359-9762-f152569238e9-kube-api-access-lw6d9\") pod \"perf-node-gather-daemonset-42rm5\" (UID: \"041e7549-a8a2-4359-9762-f152569238e9\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:24.075684 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:24.075579 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:24.261794 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:24.254399 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5"] May 28 17:53:24.261794 ip-10-0-130-182 kubenswrapper[2558]: W0528 17:53:24.257393 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod041e7549_a8a2_4359_9762_f152569238e9.slice/crio-3386e28d5b4d603f1e9f40d93c29e2cd8bc61e1a27c421b4c2531599cbb79f16 WatchSource:0}: Error finding container 3386e28d5b4d603f1e9f40d93c29e2cd8bc61e1a27c421b4c2531599cbb79f16: Status 404 returned error can't find the container with id 3386e28d5b4d603f1e9f40d93c29e2cd8bc61e1a27c421b4c2531599cbb79f16 May 28 17:53:24.789663 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:24.789621 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" event={"ID":"041e7549-a8a2-4359-9762-f152569238e9","Type":"ContainerStarted","Data":"f49dd80046cc074725782b238706de5591b97868c1e31e00edb8fd36008da6ec"} May 28 17:53:24.789663 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:24.789670 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" event={"ID":"041e7549-a8a2-4359-9762-f152569238e9","Type":"ContainerStarted","Data":"3386e28d5b4d603f1e9f40d93c29e2cd8bc61e1a27c421b4c2531599cbb79f16"} May 28 17:53:24.790549 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:24.790507 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:24.813868 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:24.813789 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" podStartSLOduration=1.813771231 podStartE2EDuration="1.813771231s" podCreationTimestamp="2026-05-28 17:53:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:53:24.8106252 +0000 UTC m=+2173.439316663" watchObservedRunningTime="2026-05-28 17:53:24.813771231 +0000 UTC m=+2173.442462723" May 28 17:53:26.066065 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:26.066028 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cc576b75-dh88h_e1595721-86b5-4b08-982b-b9dd582ee1b2/console/0.log" May 28 17:53:26.659454 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:26.659420 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-qxlzr_e671a0c8-bd51-4bb8-aae8-ef1ebe3e3ac9/volume-data-source-validator/0.log" May 28 17:53:27.526068 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:27.526032 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gn8kg_45be3247-7b50-440f-be65-9e36f2ca7aaf/dns/0.log" May 28 17:53:27.549722 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:27.549688 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gn8kg_45be3247-7b50-440f-be65-9e36f2ca7aaf/kube-rbac-proxy/0.log" May 28 17:53:27.674953 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:27.674922 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7nzbr_9a7c3076-39c0-4727-af6d-e1230ea2cb75/dns-node-resolver/0.log" May 28 17:53:28.331349 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:28.331314 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vw5ws_576367f2-ba4c-4aec-8ce0-8028b106885a/node-ca/0.log" May 28 17:53:29.363421 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:29.363391 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bk9lxg_3e8d9948-98f2-47f1-9f14-5403d7d96d98/istio-proxy/0.log" May 28 17:53:29.628898 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:29.628784 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-8zjxd_fc11436a-572f-44de-96fd-5c2c64bfb9c2/istio-proxy/0.log" May 28 17:53:29.721435 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:29.721407 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9f45d9458-x5rqw_ea1cbd8b-dbe9-474f-aa57-3847e4ee00ae/router/0.log" May 28 17:53:30.337046 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:30.337018 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2hfhm_aadac7af-4c9a-4c76-83c7-9461b9d01dfb/serve-healthcheck-canary/0.log" May 28 17:53:31.008571 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:31.008541 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bvjr_75389e13-d5ea-4f3e-80b7-efe00b95da7b/kube-rbac-proxy/0.log" May 28 17:53:31.050505 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:31.050474 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bvjr_75389e13-d5ea-4f3e-80b7-efe00b95da7b/exporter/0.log" May 28 17:53:31.093747 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:31.093711 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bvjr_75389e13-d5ea-4f3e-80b7-efe00b95da7b/extractor/0.log" May 28 17:53:31.811246 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:31.811217 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-42rm5" May 28 17:53:33.736592 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:33.736561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666490-9dncb_10ce889c-06da-41c0-b0e0-c3e86018c689/cleanup/0.log" May 28 17:53:33.773447 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:33.773410 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666505-gbr72_c71bd236-88a2-49c2-b337-e3f23b239922/cleanup/0.log" May 28 17:53:33.965498 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:33.965422 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795fd7c67-8b6xg_3b8f4d31-d0f5-44e8-a5c8-1c69ab48472d/manager/0.log" May 28 17:53:35.444796 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:35.444761 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7954d66c6b-4g6zk_662c0da5-94e3-430c-89b7-11c33ed58ad6/manager/0.log" May 28 17:53:35.538831 ip-10-0-130-182 kubenswrapper[2558]: I0528 17:53:35.538771 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-9v54d_61332c21-c76a-483d-b262-3039cbb2725b/openshift-lws-operator/0.log"