May 28 17:15:16.297586 ip-10-0-141-59 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 17:15:16.297599 ip-10-0-141-59 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 17:15:16.297609 ip-10-0-141-59 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 17:15:16.297941 ip-10-0-141-59 systemd[1]: Failed to start Kubernetes Kubelet. May 28 17:15:26.330676 ip-10-0-141-59 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 17:15:26.330693 ip-10-0-141-59 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 75a74d0470c44f5cba9d845ee3286fc4 -- May 28 17:17:56.957757 ip-10-0-141-59 systemd[1]: Starting Kubernetes Kubelet... May 28 17:17:57.443014 ip-10-0-141-59 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:17:57.443014 ip-10-0-141-59 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 17:17:57.443014 ip-10-0-141-59 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:17:57.443014 ip-10-0-141-59 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 17:17:57.443014 ip-10-0-141-59 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:17:57.444623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.444537 2577 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 17:17:57.448340 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448325 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448342 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448345 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448349 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448352 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448355 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448358 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448360 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448363 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448376 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448380 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448383 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448385 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448389 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448392 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448396 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448398 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448401 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448404 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:57.448486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448407 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448409 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448412 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448415 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448418 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448420 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448423 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448426 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448428 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448431 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448434 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448436 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448438 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448441 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448444 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448448 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448464 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448467 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448470 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448473 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:57.448956 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448477 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448480 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448482 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448485 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448488 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448491 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448493 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448496 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448499 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448502 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448504 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448507 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448510 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448512 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448515 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448517 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448520 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448522 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448525 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:57.449510 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448527 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448530 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448534 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448538 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448541 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448543 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448546 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448549 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448552 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448555 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448558 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448560 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448563 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448571 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448574 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448578 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448581 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448584 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448587 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:57.450008 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448589 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448592 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448594 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448597 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448600 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448603 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448605 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448608 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448610 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448970 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448981 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448984 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448987 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448989 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448992 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448995 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.448997 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449000 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449002 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449005 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:57.450486 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449009 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449012 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449014 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449017 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449020 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449022 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449025 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449028 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449030 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449032 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449035 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449038 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449040 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449043 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449046 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449048 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449051 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449054 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449056 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449059 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:57.450980 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449061 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449064 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449066 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449069 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449072 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449074 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449077 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449079 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449081 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449084 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449086 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449090 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449092 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449095 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449098 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449101 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449104 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449106 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449109 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:57.451481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449113 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449117 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449120 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449123 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449126 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449129 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449132 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449134 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449137 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449140 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449143 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449146 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449148 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449152 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449156 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449158 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449161 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449163 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449166 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449168 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:57.451977 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449171 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449174 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449176 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449179 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449182 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449184 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449187 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449190 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449192 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449195 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449197 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449200 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449202 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449205 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449207 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.449210 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450156 2577 flags.go:64] FLAG: --address="0.0.0.0" May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450166 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450172 2577 flags.go:64] FLAG: --anonymous-auth="true" May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450177 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450181 2577 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 17:17:57.452498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450185 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450189 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450194 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450197 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450201 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450204 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450207 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450211 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450214 2577 flags.go:64] FLAG: --cgroup-root="" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450217 2577 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450220 2577 flags.go:64] FLAG: --client-ca-file="" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450222 2577 flags.go:64] FLAG: --cloud-config="" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450225 2577 flags.go:64] FLAG: --cloud-provider="external" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450228 2577 flags.go:64] FLAG: --cluster-dns="[]" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450232 2577 flags.go:64] FLAG: --cluster-domain="" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450235 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450238 2577 flags.go:64] FLAG: --config-dir="" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450242 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450245 2577 flags.go:64] FLAG: --container-log-max-files="5" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450249 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450252 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450255 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450259 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450262 2577 flags.go:64] FLAG: --contention-profiling="false" May 28 17:17:57.453005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450264 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450267 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450271 2577 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450273 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450277 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450280 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450283 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450286 2577 flags.go:64] FLAG: --enable-load-reader="false" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450289 2577 flags.go:64] FLAG: --enable-server="true" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450292 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450297 2577 flags.go:64] FLAG: --event-burst="100" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450300 2577 flags.go:64] FLAG: --event-qps="50" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450303 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450307 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450309 2577 flags.go:64] FLAG: --eviction-hard="" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450313 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450316 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450319 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450322 2577 flags.go:64] FLAG: --eviction-soft="" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450325 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450327 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450330 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450333 2577 flags.go:64] FLAG: --experimental-mounter-path="" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450336 2577 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450339 2577 flags.go:64] FLAG: --fail-swap-on="true" May 28 17:17:57.453623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450342 2577 flags.go:64] FLAG: --feature-gates="" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450346 2577 flags.go:64] FLAG: --file-check-frequency="20s" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450349 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450352 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450355 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450358 2577 flags.go:64] FLAG: --healthz-port="10248" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450361 2577 flags.go:64] FLAG: --help="false" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450364 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-59.ec2.internal" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450368 2577 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450371 2577 flags.go:64] FLAG: --http-check-frequency="20s" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450374 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450377 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450381 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450383 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450386 2577 flags.go:64] FLAG: --image-service-endpoint="" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450389 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450392 2577 flags.go:64] FLAG: --kube-api-burst="100" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450395 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450398 2577 flags.go:64] FLAG: --kube-api-qps="50" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450401 2577 flags.go:64] FLAG: --kube-reserved="" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450404 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450407 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450410 2577 flags.go:64] FLAG: --kubelet-cgroups="" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450413 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 17:17:57.454231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450416 2577 flags.go:64] FLAG: --lock-file="" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450418 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450421 2577 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450424 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450429 2577 flags.go:64] FLAG: --log-json-split-stream="false" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450432 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450435 2577 flags.go:64] FLAG: --log-text-split-stream="false" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450440 2577 flags.go:64] FLAG: --logging-format="text" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450443 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450446 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450449 2577 flags.go:64] FLAG: --manifest-url="" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450464 2577 flags.go:64] FLAG: --manifest-url-header="" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450469 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450472 2577 flags.go:64] FLAG: --max-open-files="1000000" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450483 2577 flags.go:64] FLAG: --max-pods="110" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450486 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450489 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450492 2577 flags.go:64] FLAG: --memory-manager-policy="None" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450495 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450498 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450501 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450504 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450512 2577 flags.go:64] FLAG: --node-status-max-images="50" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450515 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450518 2577 flags.go:64] FLAG: --oom-score-adj="-999" May 28 17:17:57.454825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450521 2577 flags.go:64] FLAG: --pod-cidr="" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450524 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450529 2577 flags.go:64] FLAG: --pod-manifest-path="" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450532 2577 flags.go:64] FLAG: --pod-max-pids="-1" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450536 2577 flags.go:64] FLAG: --pods-per-core="0" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450538 2577 flags.go:64] FLAG: --port="10250" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450541 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450544 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c6cc741e86af529" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450548 2577 flags.go:64] FLAG: --qos-reserved="" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450551 2577 flags.go:64] FLAG: --read-only-port="10255" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450554 2577 flags.go:64] FLAG: --register-node="true" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450556 2577 flags.go:64] FLAG: --register-schedulable="true" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450559 2577 flags.go:64] FLAG: --register-with-taints="" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450562 2577 flags.go:64] FLAG: --registry-burst="10" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450567 2577 flags.go:64] FLAG: --registry-qps="5" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450570 2577 flags.go:64] FLAG: --reserved-cpus="" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450572 2577 flags.go:64] FLAG: --reserved-memory="" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450576 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450579 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450582 2577 flags.go:64] FLAG: --rotate-certificates="false" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450585 2577 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450588 2577 flags.go:64] FLAG: --runonce="false" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450590 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450593 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450596 2577 flags.go:64] FLAG: --seccomp-default="false" May 28 17:17:57.455432 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450599 2577 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450602 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450605 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450608 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450611 2577 flags.go:64] FLAG: --storage-driver-password="root" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450614 2577 flags.go:64] FLAG: --storage-driver-secure="false" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450617 2577 flags.go:64] FLAG: --storage-driver-table="stats" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450619 2577 flags.go:64] FLAG: --storage-driver-user="root" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450622 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450625 2577 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450628 2577 flags.go:64] FLAG: --system-cgroups="" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450632 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450637 2577 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450640 2577 flags.go:64] FLAG: --tls-cert-file="" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450643 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450647 2577 flags.go:64] FLAG: --tls-min-version="" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450649 2577 flags.go:64] FLAG: --tls-private-key-file="" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450652 2577 flags.go:64] FLAG: --topology-manager-policy="none" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450655 2577 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450658 2577 flags.go:64] FLAG: --topology-manager-scope="container" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450661 2577 flags.go:64] FLAG: --v="2" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450672 2577 flags.go:64] FLAG: --version="false" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450676 2577 flags.go:64] FLAG: --vmodule="" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450680 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.450684 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 17:17:57.456060 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450780 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450785 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450787 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450790 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450793 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450796 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450799 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450802 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450804 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450807 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450809 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450812 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450815 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450817 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450820 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450822 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450825 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450827 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450830 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450833 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:57.456717 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450836 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450838 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450841 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450844 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450846 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450849 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450851 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450854 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450859 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450862 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450864 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450867 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450870 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450872 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450875 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450877 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450880 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450882 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450885 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450887 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:57.457295 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450890 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450892 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450895 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450898 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450900 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450903 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450905 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450908 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450910 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450913 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450915 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450918 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450920 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450923 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450926 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450928 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450930 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450935 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450938 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:57.458035 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450941 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450946 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450949 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450952 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450954 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450957 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450961 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450964 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450967 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450970 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450972 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450975 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450978 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450980 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450983 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450986 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450989 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450991 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450994 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:57.458819 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.450997 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.451000 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.451002 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.451005 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.451008 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.451010 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.451013 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.451015 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:57.459322 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.451798 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:17:57.460613 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.460496 2577 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 17:17:57.460646 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.460616 2577 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 17:17:57.460682 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460669 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:57.460682 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460674 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:57.460682 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460679 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460684 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460688 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460691 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460694 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460696 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460700 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460703 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460706 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460708 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460711 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460714 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460716 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460720 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460724 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460727 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460730 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460732 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460735 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460737 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:57.460765 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460740 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460743 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460747 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460749 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460752 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460755 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460757 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460760 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460763 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460765 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460768 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460771 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460774 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460776 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460779 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460782 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460784 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460787 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460789 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460792 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:57.461275 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460794 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460796 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460799 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460801 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460804 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460806 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460809 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460812 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460814 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460817 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460820 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460822 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460824 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460827 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460830 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460833 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460835 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460838 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460840 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460843 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:57.461870 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460845 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460848 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460850 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460853 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460855 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460858 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460860 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460863 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460865 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460867 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460870 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460873 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460875 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460877 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460881 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460883 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460886 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460888 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460891 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460894 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:57.462354 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460896 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460899 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460901 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.460904 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.460909 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461004 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461010 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461013 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461017 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461020 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461023 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461026 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461030 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461034 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461037 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:17:57.462883 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461039 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461042 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461044 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461046 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461049 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461052 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461054 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461056 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461059 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461061 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461064 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461066 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461069 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461072 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461075 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461077 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461080 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461082 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461085 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461087 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:17:57.463270 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461090 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461092 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461095 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461097 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461100 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461103 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461105 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461108 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461110 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461113 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461115 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461118 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461120 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461123 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461125 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461128 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461130 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461133 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461135 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461138 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:17:57.463770 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461140 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461142 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461145 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461147 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461150 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461154 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461156 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461159 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461161 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461164 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461166 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461169 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461171 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461174 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461176 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461179 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461181 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461184 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461186 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461189 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:17:57.464257 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461191 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461194 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461196 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461199 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461201 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461204 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461207 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461211 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461214 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461217 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461219 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461222 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461224 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461227 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461229 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:17:57.464771 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:57.461232 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:17:57.465137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.461236 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:17:57.465137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.461971 2577 server.go:962] "Client rotation is on, will bootstrap in background" May 28 17:17:57.467053 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.467040 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 17:17:57.468099 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.468087 2577 server.go:1019] "Starting client certificate rotation" May 28 17:17:57.468200 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.468186 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 17:17:57.468235 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.468221 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 17:17:57.497466 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.497435 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 17:17:57.504812 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.504722 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 17:17:57.517559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.517540 2577 log.go:25] "Validated CRI v1 runtime API" May 28 17:17:57.523588 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.523565 2577 log.go:25] "Validated CRI v1 image API" May 28 17:17:57.524777 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.524758 2577 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 17:17:57.528133 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.528106 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e07b633a-7922-466a-b926-6dc7a8843c2b:/dev/nvme0n1p3 e8a3d8bd-8c4b-4c3f-bc5c-ec4d30b0e224:/dev/nvme0n1p4] May 28 17:17:57.528208 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.528132 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 17:17:57.532661 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.532560 2577 manager.go:217] Machine: {Timestamp:2026-05-28 17:17:57.532060926 +0000 UTC m=+0.445953750 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100250 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c2b146bc7622059a9968d49091f3f SystemUUID:ec2c2b14-6bc7-6220-59a9-968d49091f3f BootID:75a74d04-70c4-4f5c-ba9d-845ee3286fc4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:33:cd:6c:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:33:cd:6c:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:ce:bd:9f:8d:00 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 17:17:57.533267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.533257 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 17:17:57.533352 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.533341 2577 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 17:17:57.534135 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.534119 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 17:17:57.536975 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.536950 2577 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 17:17:57.537117 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.536978 2577 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-59.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 17:17:57.537165 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.537127 2577 topology_manager.go:138] "Creating topology manager with none policy" May 28 17:17:57.537165 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.537135 2577 container_manager_linux.go:306] "Creating device plugin manager" May 28 17:17:57.537165 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.537142 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 17:17:57.537983 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.537973 2577 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 17:17:57.538851 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.538842 2577 state_mem.go:36] "Initialized new in-memory state store" May 28 17:17:57.538958 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.538950 2577 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 17:17:57.541717 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.541708 2577 kubelet.go:491] "Attempting to sync node with API server" May 28 17:17:57.541756 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.541723 2577 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 17:17:57.541756 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.541735 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 17:17:57.541756 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.541743 2577 kubelet.go:397] "Adding apiserver pod source" May 28 17:17:57.541756 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.541752 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 17:17:57.543599 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.543582 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 17:17:57.543664 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.543612 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 17:17:57.546973 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.546956 2577 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 17:17:57.548857 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.548842 2577 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 17:17:57.550443 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550431 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550449 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550472 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550478 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550486 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550491 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550497 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550502 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 17:17:57.550506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550510 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 17:17:57.550725 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550515 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 17:17:57.550725 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550525 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 17:17:57.550725 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.550530 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 17:17:57.551996 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.551983 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 17:17:57.552042 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.552000 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 17:17:57.560591 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.560566 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 17:17:57.560707 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.560694 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kn84n" May 28 17:17:57.561086 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.560568 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 17:17:57.562370 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.562358 2577 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 17:17:57.562412 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.562400 2577 server.go:1295] "Started kubelet" May 28 17:17:57.562538 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.562492 2577 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 17:17:57.562590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.562576 2577 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 17:17:57.562634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.562624 2577 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-59.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 17:17:57.562682 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.562655 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 17:17:57.563259 ip-10-0-141-59 systemd[1]: Started Kubernetes Kubelet. May 28 17:17:57.563696 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.563687 2577 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 17:17:57.565733 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.565715 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kn84n" May 28 17:17:57.565825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.565765 2577 server.go:317] "Adding debug handlers to kubelet server" May 28 17:17:57.572005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.571990 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 17:17:57.572069 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.572026 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 17:17:57.572589 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.572122 2577 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 17:17:57.572589 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.572137 2577 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 17:17:57.572589 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.572252 2577 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 17:17:57.572589 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.572322 2577 reconstruct.go:97] "Volume reconstruction finished" May 28 17:17:57.572589 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.572340 2577 reconciler.go:26] "Reconciler: start to sync state" May 28 17:17:57.573059 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.573029 2577 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 17:17:57.573189 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.573174 2577 factory.go:55] Registering systemd factory May 28 17:17:57.573247 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.573194 2577 factory.go:223] Registration of the systemd container factory successfully May 28 17:17:57.573319 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.573297 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:57.573490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.573477 2577 factory.go:153] Registering CRI-O factory May 28 17:17:57.573544 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.573494 2577 factory.go:223] Registration of the crio container factory successfully May 28 17:17:57.573544 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.573542 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 17:17:57.573643 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.573557 2577 factory.go:103] Registering Raw factory May 28 17:17:57.573643 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.573576 2577 manager.go:1196] Started watching for new ooms in manager May 28 17:17:57.574504 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.574488 2577 manager.go:319] Starting recovery of all containers May 28 17:17:57.578552 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.578530 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:57.583869 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.583850 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" May 28 17:17:57.588436 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.588420 2577 manager.go:324] Recovery completed May 28 17:17:57.592794 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.592781 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:57.594733 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.594720 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:57.594802 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.594745 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:57.594802 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.594756 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:57.595222 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.595206 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 17:17:57.595222 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.595218 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 17:17:57.595330 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.595238 2577 state_mem.go:36] "Initialized new in-memory state store" May 28 17:17:57.597487 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.597475 2577 policy_none.go:49] "None policy: Start" May 28 17:17:57.597523 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.597491 2577 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 17:17:57.597523 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.597501 2577 state_mem.go:35] "Initializing new in-memory state store" May 28 17:17:57.641075 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.641058 2577 manager.go:341] "Starting Device Plugin manager" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.641100 2577 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.641113 2577 server.go:85] "Starting device plugin registration server" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.641363 2577 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.641376 2577 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.641474 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.642076 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.642092 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.642241 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 17:17:57.656350 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.642277 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:57.720994 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.720926 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 17:17:57.722274 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.722254 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 17:17:57.722274 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.722279 2577 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 17:17:57.722419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.722313 2577 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 17:17:57.722419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.722322 2577 kubelet.go:2451] "Starting kubelet main sync loop" May 28 17:17:57.722419 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.722408 2577 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 17:17:57.726690 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.726670 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:57.742391 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.742370 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:57.743325 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.743311 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:57.743372 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.743339 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:57.743372 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.743349 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:57.743372 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.743371 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-59.ec2.internal" May 28 17:17:57.756604 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.756591 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-59.ec2.internal" May 28 17:17:57.756647 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.756612 2577 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-59.ec2.internal\": node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:57.775466 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.775436 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:57.822675 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.822647 2577 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal"] May 28 17:17:57.822778 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.822727 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:57.825250 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.825226 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:57.825337 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.825257 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:57.825337 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.825267 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:57.826493 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.826481 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:57.826649 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.826632 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:57.826708 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.826666 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:57.827231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.827213 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:57.827310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.827244 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:57.827310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.827256 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:57.827310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.827216 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:57.827310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.827294 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:57.827310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.827306 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:57.828370 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.828354 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 28 17:17:57.828434 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.828382 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:17:57.829483 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.829467 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 28 17:17:57.829556 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.829498 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:17:57.829556 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.829511 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 28 17:17:57.860995 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.860970 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" May 28 17:17:57.865522 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.865508 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" May 28 17:17:57.873776 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.873756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:57.873846 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.873781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/865c2e3735c54eea4d9ac88d1c24d330-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"865c2e3735c54eea4d9ac88d1c24d330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 28 17:17:57.873846 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.873798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:57.875854 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.875839 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:57.974542 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.974477 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:57.974542 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.974512 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:57.974680 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.974531 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/865c2e3735c54eea4d9ac88d1c24d330-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"865c2e3735c54eea4d9ac88d1c24d330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 28 17:17:57.974680 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.974574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/865c2e3735c54eea4d9ac88d1c24d330-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"865c2e3735c54eea4d9ac88d1c24d330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 28 17:17:57.974680 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.974582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:57.974680 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:57.974575 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:57.976713 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:57.976697 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.077507 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.077449 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.163675 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.163642 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:58.168545 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.168297 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 28 17:17:58.177578 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.177556 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.278059 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.277984 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.378482 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.378438 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.436977 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.436949 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:58.468112 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.468075 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 17:17:58.468810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.468250 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 17:17:58.468810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.468281 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 17:17:58.468810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.468281 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 17:17:58.479501 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.479483 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.569243 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.569170 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 17:12:57 +0000 UTC" deadline="2028-01-12 21:27:28.276670994 +0000 UTC" May 28 17:17:58.569243 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.569195 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14260h9m29.70747776s" May 28 17:17:58.572914 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.572893 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 17:17:58.580025 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.580009 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.583903 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.583884 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 17:17:58.605471 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.605438 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gxds2" May 28 17:17:58.614447 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.614426 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gxds2" May 28 17:17:58.681053 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.681028 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.698017 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:58.697990 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865c2e3735c54eea4d9ac88d1c24d330.slice/crio-a1edb5d8bc33806ed3e1efaaae596b545cd14738b869e21444066737c64c409d WatchSource:0}: Error finding container a1edb5d8bc33806ed3e1efaaae596b545cd14738b869e21444066737c64c409d: Status 404 returned error can't find the container with id a1edb5d8bc33806ed3e1efaaae596b545cd14738b869e21444066737c64c409d May 28 17:17:58.698195 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:17:58.698181 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74b687aae66fdce85b9519c288ee8b1.slice/crio-210712356d0920b618a9c2a7bfd8937247b9cc271cfe7fdbc2780a31d465f706 WatchSource:0}: Error finding container 210712356d0920b618a9c2a7bfd8937247b9cc271cfe7fdbc2780a31d465f706: Status 404 returned error can't find the container with id 210712356d0920b618a9c2a7bfd8937247b9cc271cfe7fdbc2780a31d465f706 May 28 17:17:58.701995 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.701981 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:17:58.724789 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.724743 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"c74b687aae66fdce85b9519c288ee8b1","Type":"ContainerStarted","Data":"210712356d0920b618a9c2a7bfd8937247b9cc271cfe7fdbc2780a31d465f706"} May 28 17:17:58.725659 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.725638 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" event={"ID":"865c2e3735c54eea4d9ac88d1c24d330","Type":"ContainerStarted","Data":"a1edb5d8bc33806ed3e1efaaae596b545cd14738b869e21444066737c64c409d"} May 28 17:17:58.782128 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.782090 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.882628 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:58.882563 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 28 17:17:58.898818 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.898798 2577 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:58.972540 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.972510 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 28 17:17:58.986242 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.986091 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 17:17:58.987136 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.987122 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 28 17:17:58.999246 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:58.999225 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 17:17:59.543471 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.543434 2577 apiserver.go:52] "Watching apiserver" May 28 17:17:59.550693 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.550663 2577 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 17:17:59.552789 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.552757 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5x8jt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-sd6sz","kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl","openshift-cluster-node-tuning-operator/tuned-vhbk4","openshift-multus/multus-additional-cni-plugins-mk7tl","openshift-multus/multus-vvgs4","openshift-multus/network-metrics-daemon-hwp99","openshift-network-diagnostics/network-check-target-ncjj5","openshift-network-operator/iptables-alerter-n2zx6","kube-system/konnectivity-agent-tcv7p"] May 28 17:17:59.554357 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.554334 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.555755 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.555734 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.557079 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.556880 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 17:17:59.557079 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.556990 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5cg7\"" May 28 17:17:59.557079 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.557000 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.557283 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.557087 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 17:17:59.557283 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.557098 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 17:17:59.557764 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.557746 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 17:17:59.557875 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.557795 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 17:17:59.558580 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.558559 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.559115 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.558719 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 17:17:59.559115 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.558725 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 17:17:59.559115 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.559077 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 17:17:59.559310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.559078 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-75wtz\"" May 28 17:17:59.559400 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.559381 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 17:17:59.559496 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.559433 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 17:17:59.559496 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.559482 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4fbkm\"" May 28 17:17:59.559802 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.559785 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 17:17:59.559884 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.559823 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 17:17:59.560974 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.560955 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.562076 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.562053 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 17:17:59.563018 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.562998 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 17:17:59.563325 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.563304 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wvvgj\"" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.563689 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.564133 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvgs4" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.564959 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.565253 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.565554 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.565586 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v29sc\"" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.565625 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.565679 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 17:17:59.565858 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.565780 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:17:59.566681 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.566650 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 17:17:59.566792 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.566731 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zpmzj\"" May 28 17:17:59.567495 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.567475 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:17:59.567584 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.567528 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:17:59.568792 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.568774 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.570129 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.570110 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tcv7p" May 28 17:17:59.570901 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.570884 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 17:17:59.571705 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.571142 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 17:17:59.571705 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.571167 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 17:17:59.571705 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.571145 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mghxx\"" May 28 17:17:59.572080 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.572061 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 17:17:59.572294 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.572277 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-62cvb\"" May 28 17:17:59.572351 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.572330 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 17:17:59.573322 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.573304 2577 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 17:17:59.583906 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.583888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-cni-binary-copy\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.583992 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.583915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-conf-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.583992 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.583933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-daemon-config\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.583992 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.583949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-sys-fs\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.583992 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.583986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-systemd\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.584181 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-var-lib-kubelet\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.584181 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-host\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.584181 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-etc-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584181 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584181 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-lib-modules\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.584181 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-socket-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.584181 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-kubelet\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-run-netns\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a555954e-e046-4a2c-86be-e413388972e8-ovn-node-metrics-cert\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-host\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-os-release\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-cni-bin\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.584469 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-cni-multus\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6849dc3c-e2eb-4226-8b85-2012fe634b35-tmp\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72mn\" (UniqueName: \"kubernetes.io/projected/6849dc3c-e2eb-4226-8b85-2012fe634b35-kube-api-access-m72mn\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm7ww\" (UniqueName: \"kubernetes.io/projected/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-kube-api-access-xm7ww\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8jv9\" (UniqueName: \"kubernetes.io/projected/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-kube-api-access-n8jv9\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-etc-kubernetes\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-cnibin\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-run\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bb609db-c2dd-413c-aae2-c6c2b1fae027-agent-certs\") pod \"konnectivity-agent-tcv7p\" (UID: \"2bb609db-c2dd-413c-aae2-c6c2b1fae027\") " pod="kube-system/konnectivity-agent-tcv7p" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-var-lib-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-ovn\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-env-overrides\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.584810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-kubelet\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/775b2267-f891-4e65-a160-5f4f7deacc4d-iptables-alerter-script\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/775b2267-f891-4e65-a160-5f4f7deacc4d-host-slash\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysconfig\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2slv\" (UniqueName: \"kubernetes.io/projected/775b2267-f891-4e65-a160-5f4f7deacc4d-kube-api-access-r2slv\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-device-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-ovnkube-script-lib\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.584996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-hostroot\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpq78\" (UniqueName: \"kubernetes.io/projected/93378644-31ce-43b9-b617-52af13dd2825-kube-api-access-jpq78\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-modprobe-d\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n2wc\" (UniqueName: \"kubernetes.io/projected/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-kube-api-access-7n2wc\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-socket-dir-parent\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-registration-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysctl-conf\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-sys\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.585438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-serviceca\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns8jv\" (UniqueName: \"kubernetes.io/projected/a555954e-e046-4a2c-86be-e413388972e8-kube-api-access-ns8jv\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cnibin\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-cni-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-netns\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-systemd-units\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-slash\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-cni-bin\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-multus-certs\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bb609db-c2dd-413c-aae2-c6c2b1fae027-konnectivity-ca\") pod \"konnectivity-agent-tcv7p\" (UID: \"2bb609db-c2dd-413c-aae2-c6c2b1fae027\") " pod="kube-system/konnectivity-agent-tcv7p" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-system-cni-dir\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-kubernetes\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-tuned\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-os-release\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.586025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr9hc\" (UniqueName: \"kubernetes.io/projected/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-kube-api-access-zr9hc\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-systemd\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-node-log\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-log-socket\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-cni-netd\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-ovnkube-config\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-system-cni-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-k8s-cni-cncf-io\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysctl-d\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.586586 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.585792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.615328 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.615295 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:58 +0000 UTC" deadline="2027-12-29 08:58:52.217303079 +0000 UTC" May 28 17:17:59.615417 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.615329 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13911h40m52.601978923s" May 28 17:17:59.686919 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.686887 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-socket-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.686919 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.686923 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.686942 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.686962 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-kubelet\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.686984 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-run-netns\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-kubelet\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.687075 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687106 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a555954e-e046-4a2c-86be-e413388972e8-ovn-node-metrics-cert\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-socket-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.687148 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.687152 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs podName:7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a nodeName:}" failed. No retries permitted until 2026-05-28 17:18:00.187120024 +0000 UTC m=+3.101012831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs") pod "network-metrics-daemon-hwp99" (UID: "7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-run-netns\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687218 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-host\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687248 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-os-release\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687276 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687301 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-cni-bin\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-host\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687324 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-cni-multus\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687367 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-cni-bin\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-cni-multus\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-os-release\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687362 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6849dc3c-e2eb-4226-8b85-2012fe634b35-tmp\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687425 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m72mn\" (UniqueName: \"kubernetes.io/projected/6849dc3c-e2eb-4226-8b85-2012fe634b35-kube-api-access-m72mn\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687473 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xm7ww\" (UniqueName: \"kubernetes.io/projected/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-kube-api-access-xm7ww\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687503 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8jv9\" (UniqueName: \"kubernetes.io/projected/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-kube-api-access-n8jv9\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.687566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687532 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-etc-kubernetes\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-etc-kubernetes\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687675 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687701 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687707 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687766 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-cnibin\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687791 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-run\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687828 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bb609db-c2dd-413c-aae2-c6c2b1fae027-agent-certs\") pod \"konnectivity-agent-tcv7p\" (UID: \"2bb609db-c2dd-413c-aae2-c6c2b1fae027\") " pod="kube-system/konnectivity-agent-tcv7p" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687849 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-var-lib-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-cnibin\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687869 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-ovn\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687891 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-env-overrides\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-run\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687919 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-var-lib-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687943 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-kubelet\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.688213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-ovn\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.687971 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/775b2267-f891-4e65-a160-5f4f7deacc4d-iptables-alerter-script\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688016 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/775b2267-f891-4e65-a160-5f4f7deacc4d-host-slash\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688043 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysconfig\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688038 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-var-lib-kubelet\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688073 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2slv\" (UniqueName: \"kubernetes.io/projected/775b2267-f891-4e65-a160-5f4f7deacc4d-kube-api-access-r2slv\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688101 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-device-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/775b2267-f891-4e65-a160-5f4f7deacc4d-host-slash\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688125 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688150 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-ovnkube-script-lib\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688174 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-hostroot\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688207 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpq78\" (UniqueName: \"kubernetes.io/projected/93378644-31ce-43b9-b617-52af13dd2825-kube-api-access-jpq78\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688240 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-modprobe-d\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688263 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7n2wc\" (UniqueName: \"kubernetes.io/projected/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-kube-api-access-7n2wc\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688288 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-socket-dir-parent\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688312 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-registration-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688336 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysctl-conf\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.689071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-env-overrides\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688388 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-sys\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688485 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-hostroot\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-device-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688575 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-serviceca\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysconfig\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688600 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8jv\" (UniqueName: \"kubernetes.io/projected/a555954e-e046-4a2c-86be-e413388972e8-kube-api-access-ns8jv\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688627 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cnibin\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688647 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-cni-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688667 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-netns\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688686 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-systemd-units\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688705 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-slash\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/775b2267-f891-4e65-a160-5f4f7deacc4d-iptables-alerter-script\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688727 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-cni-bin\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688749 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-multus-certs\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688769 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bb609db-c2dd-413c-aae2-c6c2b1fae027-konnectivity-ca\") pod \"konnectivity-agent-tcv7p\" (UID: \"2bb609db-c2dd-413c-aae2-c6c2b1fae027\") " pod="kube-system/konnectivity-agent-tcv7p" May 28 17:17:59.689849 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688795 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-system-cni-dir\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688825 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-socket-dir-parent\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688852 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688882 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-kubernetes\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688927 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-tuned\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688953 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-os-release\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.688978 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zr9hc\" (UniqueName: \"kubernetes.io/projected/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-kube-api-access-zr9hc\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689007 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-systemd\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689033 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-node-log\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689058 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-log-socket\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689085 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-cni-netd\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-modprobe-d\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689111 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-ovnkube-config\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689137 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-system-cni-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689160 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-k8s-cni-cncf-io\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689183 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-serviceca\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.690559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cnibin\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-system-cni-dir\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-cni-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-registration-dir\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689327 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-netns\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-systemd-units\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-kubernetes\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysctl-conf\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-sys\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689186 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysctl-d\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689544 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689571 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-cni-binary-copy\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689592 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bb609db-c2dd-413c-aae2-c6c2b1fae027-konnectivity-ca\") pod \"konnectivity-agent-tcv7p\" (UID: \"2bb609db-c2dd-413c-aae2-c6c2b1fae027\") " pod="kube-system/konnectivity-agent-tcv7p" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689597 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-conf-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-conf-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689645 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-daemon-config\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689670 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-sys-fs\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.691267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689696 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-systemd\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689722 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-var-lib-kubelet\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-sysctl-d\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689750 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-host\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689776 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-etc-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689802 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689828 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-lib-modules\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.691187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-lib-modules\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.691823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-os-release\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.692090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.689008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-ovnkube-script-lib\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-node-log\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-tuned\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-log-socket\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a555954e-e046-4a2c-86be-e413388972e8-ovn-node-metrics-cert\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692330 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-cni-netd\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-system-cni-dir\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6849dc3c-e2eb-4226-8b85-2012fe634b35-tmp\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-multus-certs\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-slash\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.692593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.693047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-host-cni-bin\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.693047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-host\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.693047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-etc-systemd\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.693047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6849dc3c-e2eb-4226-8b85-2012fe634b35-var-lib-kubelet\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.693047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a555954e-e046-4a2c-86be-e413388972e8-ovnkube-config\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.693047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.692953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-host-run-k8s-cni-cncf-io\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.693047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-etc-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.693347 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93378644-31ce-43b9-b617-52af13dd2825-sys-fs\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.693347 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-openvswitch\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.693347 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-cni-binary-copy\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.693347 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-multus-daemon-config\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.693539 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a555954e-e046-4a2c-86be-e413388972e8-run-systemd\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.694393 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.694393 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.693638 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bb609db-c2dd-413c-aae2-c6c2b1fae027-agent-certs\") pod \"konnectivity-agent-tcv7p\" (UID: \"2bb609db-c2dd-413c-aae2-c6c2b1fae027\") " pod="kube-system/konnectivity-agent-tcv7p" May 28 17:17:59.695251 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.695225 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:17:59.695340 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.695259 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:17:59.695340 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.695273 2577 projected.go:194] Error preparing data for projected volume kube-api-access-4zlqq for pod openshift-network-diagnostics/network-check-target-ncjj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:59.695340 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:17:59.695335 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq podName:a8fe0ae1-c004-44e3-afaf-2a6895d2a455 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:00.195316548 +0000 UTC m=+3.109209371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4zlqq" (UniqueName: "kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq") pod "network-check-target-ncjj5" (UID: "a8fe0ae1-c004-44e3-afaf-2a6895d2a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:17:59.696418 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.696394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8jv9\" (UniqueName: \"kubernetes.io/projected/a4f8262f-8675-4bff-8ef1-d55b8b36e8c2-kube-api-access-n8jv9\") pod \"multus-additional-cni-plugins-mk7tl\" (UID: \"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2\") " pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.696964 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.696941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72mn\" (UniqueName: \"kubernetes.io/projected/6849dc3c-e2eb-4226-8b85-2012fe634b35-kube-api-access-m72mn\") pod \"tuned-vhbk4\" (UID: \"6849dc3c-e2eb-4226-8b85-2012fe634b35\") " pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.697543 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.697523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm7ww\" (UniqueName: \"kubernetes.io/projected/dc3e38ef-5c1d-41b1-bde6-df40dc097d5a-kube-api-access-xm7ww\") pod \"node-ca-5x8jt\" (UID: \"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a\") " pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.698995 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.698975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2slv\" (UniqueName: \"kubernetes.io/projected/775b2267-f891-4e65-a160-5f4f7deacc4d-kube-api-access-r2slv\") pod \"iptables-alerter-n2zx6\" (UID: \"775b2267-f891-4e65-a160-5f4f7deacc4d\") " pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.699105 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.699046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8jv\" (UniqueName: \"kubernetes.io/projected/a555954e-e046-4a2c-86be-e413388972e8-kube-api-access-ns8jv\") pod \"ovnkube-node-sd6sz\" (UID: \"a555954e-e046-4a2c-86be-e413388972e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.700068 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.700050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpq78\" (UniqueName: \"kubernetes.io/projected/93378644-31ce-43b9-b617-52af13dd2825-kube-api-access-jpq78\") pod \"aws-ebs-csi-driver-node-xnzjl\" (UID: \"93378644-31ce-43b9-b617-52af13dd2825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.701038 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.701021 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr9hc\" (UniqueName: \"kubernetes.io/projected/a1bd670c-b6b7-4905-95d7-a54b9fd20e8a-kube-api-access-zr9hc\") pod \"multus-vvgs4\" (UID: \"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a\") " pod="openshift-multus/multus-vvgs4" May 28 17:17:59.702085 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.702061 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n2wc\" (UniqueName: \"kubernetes.io/projected/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-kube-api-access-7n2wc\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:17:59.709085 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.709065 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:59.751776 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.751753 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:17:59.868055 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.867943 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5x8jt" May 28 17:17:59.874773 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.874750 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" May 28 17:17:59.882403 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.882381 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:17:59.895217 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.895196 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" May 28 17:17:59.901065 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.901047 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" May 28 17:17:59.907847 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.907827 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvgs4" May 28 17:17:59.914354 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.914336 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2zx6" May 28 17:17:59.917914 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:17:59.917898 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tcv7p" May 28 17:18:00.193730 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.193645 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:00.193892 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.193790 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:00.193892 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.193860 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs podName:7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a nodeName:}" failed. No retries permitted until 2026-05-28 17:18:01.193840028 +0000 UTC m=+4.107732859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs") pod "network-metrics-daemon-hwp99" (UID: "7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:00.281264 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:00.281221 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775b2267_f891_4e65_a160_5f4f7deacc4d.slice/crio-d70e57fce3bc8de3057637937cc71bb90fecc32b570f225833ea2ae47585cc53 WatchSource:0}: Error finding container d70e57fce3bc8de3057637937cc71bb90fecc32b570f225833ea2ae47585cc53: Status 404 returned error can't find the container with id d70e57fce3bc8de3057637937cc71bb90fecc32b570f225833ea2ae47585cc53 May 28 17:18:00.282741 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:00.282651 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda555954e_e046_4a2c_86be_e413388972e8.slice/crio-ab6b93cb138a18610cd5b0f71a13f4c3190b2049d8c518eda24a93e0211d725b WatchSource:0}: Error finding container ab6b93cb138a18610cd5b0f71a13f4c3190b2049d8c518eda24a93e0211d725b: Status 404 returned error can't find the container with id ab6b93cb138a18610cd5b0f71a13f4c3190b2049d8c518eda24a93e0211d725b May 28 17:18:00.286832 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:00.286565 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bd670c_b6b7_4905_95d7_a54b9fd20e8a.slice/crio-e6d25b6fb4616f5fd1fbc63944659bd6a813a60880ba591b07f04ceed0fe402c WatchSource:0}: Error finding container e6d25b6fb4616f5fd1fbc63944659bd6a813a60880ba591b07f04ceed0fe402c: Status 404 returned error can't find the container with id e6d25b6fb4616f5fd1fbc63944659bd6a813a60880ba591b07f04ceed0fe402c May 28 17:18:00.288506 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:00.288202 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6849dc3c_e2eb_4226_8b85_2012fe634b35.slice/crio-f1af19b1bf096e1f332a7db4d642a9185d8b0d05cba4069696509ca415fbdc83 WatchSource:0}: Error finding container f1af19b1bf096e1f332a7db4d642a9185d8b0d05cba4069696509ca415fbdc83: Status 404 returned error can't find the container with id f1af19b1bf096e1f332a7db4d642a9185d8b0d05cba4069696509ca415fbdc83 May 28 17:18:00.291317 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:00.291244 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3e38ef_5c1d_41b1_bde6_df40dc097d5a.slice/crio-c43492bd1a97ca613d3ae74f2fbb712c7f9def120d6662799061d12e28187486 WatchSource:0}: Error finding container c43492bd1a97ca613d3ae74f2fbb712c7f9def120d6662799061d12e28187486: Status 404 returned error can't find the container with id c43492bd1a97ca613d3ae74f2fbb712c7f9def120d6662799061d12e28187486 May 28 17:18:00.293791 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:00.292943 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f8262f_8675_4bff_8ef1_d55b8b36e8c2.slice/crio-06bc1fdbf05ddee0aca1f09a424dfabb32a16af188f046983dd162706af1961d WatchSource:0}: Error finding container 06bc1fdbf05ddee0aca1f09a424dfabb32a16af188f046983dd162706af1961d: Status 404 returned error can't find the container with id 06bc1fdbf05ddee0aca1f09a424dfabb32a16af188f046983dd162706af1961d May 28 17:18:00.293912 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.293889 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:00.294005 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.293990 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:18:00.294044 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.294008 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:18:00.294044 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.294018 2577 projected.go:194] Error preparing data for projected volume kube-api-access-4zlqq for pod openshift-network-diagnostics/network-check-target-ncjj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:00.294105 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.294057 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq podName:a8fe0ae1-c004-44e3-afaf-2a6895d2a455 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:01.294043839 +0000 UTC m=+4.207936653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zlqq" (UniqueName: "kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq") pod "network-check-target-ncjj5" (UID: "a8fe0ae1-c004-44e3-afaf-2a6895d2a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:00.487142 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.487069 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:18:00.616027 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.615991 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:58 +0000 UTC" deadline="2027-12-12 02:12:17.424963957 +0000 UTC" May 28 17:18:00.616027 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.616024 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13496h54m16.808942296s" May 28 17:18:00.723126 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.723099 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:00.723299 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.723214 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:00.727867 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.727611 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:00.727867 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:00.727729 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:00.738008 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.737907 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"ab6b93cb138a18610cd5b0f71a13f4c3190b2049d8c518eda24a93e0211d725b"} May 28 17:18:00.739344 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.739287 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2zx6" event={"ID":"775b2267-f891-4e65-a160-5f4f7deacc4d","Type":"ContainerStarted","Data":"d70e57fce3bc8de3057637937cc71bb90fecc32b570f225833ea2ae47585cc53"} May 28 17:18:00.741884 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.741835 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" event={"ID":"6849dc3c-e2eb-4226-8b85-2012fe634b35","Type":"ContainerStarted","Data":"f1af19b1bf096e1f332a7db4d642a9185d8b0d05cba4069696509ca415fbdc83"} May 28 17:18:00.745160 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.745135 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvgs4" event={"ID":"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a","Type":"ContainerStarted","Data":"e6d25b6fb4616f5fd1fbc63944659bd6a813a60880ba591b07f04ceed0fe402c"} May 28 17:18:00.752715 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.751913 2577 generic.go:358] "Generic (PLEG): container finished" podID="c74b687aae66fdce85b9519c288ee8b1" containerID="84a90011f90940f9232803012fb95e6064871443e0225603984924efe00b182e" exitCode=0 May 28 17:18:00.752715 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.751976 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"c74b687aae66fdce85b9519c288ee8b1","Type":"ContainerDied","Data":"84a90011f90940f9232803012fb95e6064871443e0225603984924efe00b182e"} May 28 17:18:00.755516 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.755086 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" event={"ID":"865c2e3735c54eea4d9ac88d1c24d330","Type":"ContainerStarted","Data":"c55606153c16a3b4116c4809af8e12433426d8bdc6c666ab6b5f521d34f160af"} May 28 17:18:00.758319 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.758208 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerStarted","Data":"06bc1fdbf05ddee0aca1f09a424dfabb32a16af188f046983dd162706af1961d"} May 28 17:18:00.763221 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.762956 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5x8jt" event={"ID":"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a","Type":"ContainerStarted","Data":"c43492bd1a97ca613d3ae74f2fbb712c7f9def120d6662799061d12e28187486"} May 28 17:18:00.765089 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.764946 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tcv7p" event={"ID":"2bb609db-c2dd-413c-aae2-c6c2b1fae027","Type":"ContainerStarted","Data":"e6087d72d2ccaa07ae330d87120654aaef59b518ac84f4e59eef7e0a08731bec"} May 28 17:18:00.766604 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:00.766552 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" event={"ID":"93378644-31ce-43b9-b617-52af13dd2825","Type":"ContainerStarted","Data":"767a046ee7d4501e8ca08e5499d096b3954eb07beb23807a0b2479c0ec3dd65a"} May 28 17:18:01.200187 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:01.200148 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:01.200366 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:01.200321 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:01.200440 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:01.200386 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs podName:7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a nodeName:}" failed. No retries permitted until 2026-05-28 17:18:03.200367607 +0000 UTC m=+6.114260416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs") pod "network-metrics-daemon-hwp99" (UID: "7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:01.301424 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:01.300762 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:01.301424 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:01.300952 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:18:01.301424 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:01.300971 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:18:01.301424 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:01.300984 2577 projected.go:194] Error preparing data for projected volume kube-api-access-4zlqq for pod openshift-network-diagnostics/network-check-target-ncjj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:01.301424 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:01.301040 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq podName:a8fe0ae1-c004-44e3-afaf-2a6895d2a455 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:03.301021181 +0000 UTC m=+6.214913989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zlqq" (UniqueName: "kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq") pod "network-check-target-ncjj5" (UID: "a8fe0ae1-c004-44e3-afaf-2a6895d2a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:01.786271 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:01.786203 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"c74b687aae66fdce85b9519c288ee8b1","Type":"ContainerStarted","Data":"5f2724c3993ec45ef97b9713128ce28e81223bb698c3b1f6e29019a350c5d103"} May 28 17:18:01.806025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:01.805975 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" podStartSLOduration=3.8059559370000002 podStartE2EDuration="3.805955937s" podCreationTimestamp="2026-05-28 17:17:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:00.782984058 +0000 UTC m=+3.696876889" watchObservedRunningTime="2026-05-28 17:18:01.805955937 +0000 UTC m=+4.719848770" May 28 17:18:01.806741 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:01.806679 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" podStartSLOduration=3.806668361 podStartE2EDuration="3.806668361s" podCreationTimestamp="2026-05-28 17:17:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:01.805783114 +0000 UTC m=+4.719675944" watchObservedRunningTime="2026-05-28 17:18:01.806668361 +0000 UTC m=+4.720561196" May 28 17:18:02.047360 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.046496 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-stbzw"] May 28 17:18:02.049048 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.048528 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.051697 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.051053 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d5645\"" May 28 17:18:02.051697 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.051539 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 17:18:02.051697 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.051570 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 17:18:02.107895 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.107706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-tmp-dir\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.107895 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.107759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-hosts-file\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.107895 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.107796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgp7r\" (UniqueName: \"kubernetes.io/projected/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-kube-api-access-zgp7r\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.209149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.208380 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp7r\" (UniqueName: \"kubernetes.io/projected/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-kube-api-access-zgp7r\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.209149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.208494 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-tmp-dir\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.209149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.208530 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-hosts-file\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.209149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.208615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-hosts-file\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.209584 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.209191 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-tmp-dir\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.236249 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.236208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgp7r\" (UniqueName: \"kubernetes.io/projected/4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58-kube-api-access-zgp7r\") pod \"node-resolver-stbzw\" (UID: \"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58\") " pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.361839 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.361748 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stbzw" May 28 17:18:02.723420 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.723341 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:02.723601 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:02.723474 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:02.723890 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:02.723856 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:02.723993 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:02.723966 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:03.215200 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:03.215151 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:03.215715 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:03.215343 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:03.215715 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:03.215408 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs podName:7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a nodeName:}" failed. No retries permitted until 2026-05-28 17:18:07.21538921 +0000 UTC m=+10.129282021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs") pod "network-metrics-daemon-hwp99" (UID: "7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:03.315672 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:03.315548 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:03.316702 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:03.316577 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:18:03.316702 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:03.316624 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:18:03.316702 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:03.316637 2577 projected.go:194] Error preparing data for projected volume kube-api-access-4zlqq for pod openshift-network-diagnostics/network-check-target-ncjj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:03.316702 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:03.316707 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq podName:a8fe0ae1-c004-44e3-afaf-2a6895d2a455 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:07.316685766 +0000 UTC m=+10.230578580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zlqq" (UniqueName: "kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq") pod "network-check-target-ncjj5" (UID: "a8fe0ae1-c004-44e3-afaf-2a6895d2a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:04.723215 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:04.723179 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:04.723693 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:04.723310 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:04.723693 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:04.723576 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:04.723693 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:04.723682 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:04.955692 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:04.955648 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k2prg"] May 28 17:18:04.957720 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:04.957696 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:04.957871 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:04.957779 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:05.029317 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.029163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.029317 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.029232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-dbus\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.029317 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.029252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-kubelet-config\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.130235 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.130193 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.130409 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.130315 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-dbus\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.130409 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:05.130332 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:18:05.130409 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.130347 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-kubelet-config\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.130409 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:05.130401 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret podName:87ee72a8-f2b8-4a38-8618-f8d6f6898a28 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:05.630383108 +0000 UTC m=+8.544275940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret") pod "global-pull-secret-syncer-k2prg" (UID: "87ee72a8-f2b8-4a38-8618-f8d6f6898a28") : object "kube-system"/"original-pull-secret" not registered May 28 17:18:05.130649 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.130447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-kubelet-config\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.130649 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.130500 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-dbus\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.635643 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:05.635602 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:05.635833 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:05.635803 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:18:05.635900 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:05.635871 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret podName:87ee72a8-f2b8-4a38-8618-f8d6f6898a28 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:06.635850433 +0000 UTC m=+9.549743264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret") pod "global-pull-secret-syncer-k2prg" (UID: "87ee72a8-f2b8-4a38-8618-f8d6f6898a28") : object "kube-system"/"original-pull-secret" not registered May 28 17:18:06.643953 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:06.643913 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:06.644353 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:06.644135 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:18:06.644353 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:06.644200 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret podName:87ee72a8-f2b8-4a38-8618-f8d6f6898a28 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:08.644180989 +0000 UTC m=+11.558073814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret") pod "global-pull-secret-syncer-k2prg" (UID: "87ee72a8-f2b8-4a38-8618-f8d6f6898a28") : object "kube-system"/"original-pull-secret" not registered May 28 17:18:06.723762 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:06.723262 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:06.723762 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:06.723404 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:06.723762 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:06.723525 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:06.723762 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:06.723402 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:06.723762 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:06.723524 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:06.723762 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:06.723621 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:07.250244 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:07.249709 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:07.250244 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:07.249846 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:07.250244 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:07.249906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs podName:7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a nodeName:}" failed. No retries permitted until 2026-05-28 17:18:15.249888132 +0000 UTC m=+18.163780954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs") pod "network-metrics-daemon-hwp99" (UID: "7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:07.350498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:07.350445 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:07.350686 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:07.350618 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:18:07.350686 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:07.350636 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:18:07.350686 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:07.350648 2577 projected.go:194] Error preparing data for projected volume kube-api-access-4zlqq for pod openshift-network-diagnostics/network-check-target-ncjj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:07.350839 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:07.350695 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq podName:a8fe0ae1-c004-44e3-afaf-2a6895d2a455 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:15.350681529 +0000 UTC m=+18.264574337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zlqq" (UniqueName: "kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq") pod "network-check-target-ncjj5" (UID: "a8fe0ae1-c004-44e3-afaf-2a6895d2a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:08.662136 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:08.662027 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:08.662585 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:08.662185 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:18:08.662585 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:08.662268 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret podName:87ee72a8-f2b8-4a38-8618-f8d6f6898a28 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:12.662246246 +0000 UTC m=+15.576139055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret") pod "global-pull-secret-syncer-k2prg" (UID: "87ee72a8-f2b8-4a38-8618-f8d6f6898a28") : object "kube-system"/"original-pull-secret" not registered May 28 17:18:08.722763 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:08.722726 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:08.722936 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:08.722830 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:08.722936 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:08.722846 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:08.722936 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:08.722875 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:08.723063 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:08.722941 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:08.723063 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:08.723032 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:10.723058 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:10.722833 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:10.723517 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:10.722833 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:10.723517 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:10.723160 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:10.723517 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:10.722836 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:10.723517 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:10.723240 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:10.723689 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:10.723630 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:12.693317 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:12.693284 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:12.693723 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:12.693417 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:18:12.693723 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:12.693481 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret podName:87ee72a8-f2b8-4a38-8618-f8d6f6898a28 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:20.693468642 +0000 UTC m=+23.607361449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret") pod "global-pull-secret-syncer-k2prg" (UID: "87ee72a8-f2b8-4a38-8618-f8d6f6898a28") : object "kube-system"/"original-pull-secret" not registered May 28 17:18:12.722688 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:12.722653 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:12.722688 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:12.722673 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:12.722890 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:12.722699 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:12.722890 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:12.722793 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:12.722890 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:12.722847 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:12.723006 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:12.722928 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:14.723466 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:14.722952 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:14.723466 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:14.723000 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:14.723466 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:14.722951 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:14.723466 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:14.723103 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:14.723466 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:14.723182 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:14.723466 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:14.723263 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:15.312743 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:15.312701 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:15.312921 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:15.312869 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:15.312982 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:15.312946 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs podName:7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a nodeName:}" failed. No retries permitted until 2026-05-28 17:18:31.312926656 +0000 UTC m=+34.226819478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs") pod "network-metrics-daemon-hwp99" (UID: "7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:15.413827 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:15.413786 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:15.414019 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:15.413939 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:18:15.414019 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:15.413957 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:18:15.414019 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:15.413971 2577 projected.go:194] Error preparing data for projected volume kube-api-access-4zlqq for pod openshift-network-diagnostics/network-check-target-ncjj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:15.414149 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:15.414034 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq podName:a8fe0ae1-c004-44e3-afaf-2a6895d2a455 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:31.414020608 +0000 UTC m=+34.327913416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zlqq" (UniqueName: "kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq") pod "network-check-target-ncjj5" (UID: "a8fe0ae1-c004-44e3-afaf-2a6895d2a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:16.722990 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:16.722957 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:16.723386 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:16.722969 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:16.723386 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:16.723055 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:16.723386 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:16.722969 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:16.723386 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:16.723128 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:16.723386 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:16.723196 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:18.085933 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:18.085904 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4c20a1_5e3d_45bd_b93f_8bf72ef52a58.slice/crio-326b6430d4fca62c5045da688b5b3ed72ee7b69684126f8d0438665e23129f67 WatchSource:0}: Error finding container 326b6430d4fca62c5045da688b5b3ed72ee7b69684126f8d0438665e23129f67: Status 404 returned error can't find the container with id 326b6430d4fca62c5045da688b5b3ed72ee7b69684126f8d0438665e23129f67 May 28 17:18:18.723503 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.723330 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:18.723625 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.723337 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:18.723625 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:18.723587 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:18.723708 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.723354 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:18.723708 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:18.723660 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:18.723785 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:18.723754 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:18.815112 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.815069 2577 generic.go:358] "Generic (PLEG): container finished" podID="a4f8262f-8675-4bff-8ef1-d55b8b36e8c2" containerID="bcde79623913eb59d243be709977e8926ad974cc0ff5f7d5b1d1983531c903e3" exitCode=0 May 28 17:18:18.815216 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.815154 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerDied","Data":"bcde79623913eb59d243be709977e8926ad974cc0ff5f7d5b1d1983531c903e3"} May 28 17:18:18.817034 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.816984 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5x8jt" event={"ID":"dc3e38ef-5c1d-41b1-bde6-df40dc097d5a","Type":"ContainerStarted","Data":"cf37d9206e6f4e2ea240994beb3fbf1c9d53fb9f319f71a30d3d4b7e2063fe6a"} May 28 17:18:18.818490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.818448 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tcv7p" event={"ID":"2bb609db-c2dd-413c-aae2-c6c2b1fae027","Type":"ContainerStarted","Data":"df59c9b700a5bde75049b55715a3bec8b8af45364e29c019892e081c1eb5ee23"} May 28 17:18:18.819952 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.819928 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" event={"ID":"93378644-31ce-43b9-b617-52af13dd2825","Type":"ContainerStarted","Data":"12ab9c9325334e83b37d443355cecfd96066b919ff47d3872bff1462dda034fd"} May 28 17:18:18.823935 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.823908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:18:18.824234 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.824201 2577 generic.go:358] "Generic (PLEG): container finished" podID="a555954e-e046-4a2c-86be-e413388972e8" containerID="6a709206875d38cdae0ad25c880c305eb547b4ededc12b1304aa029f22208c7d" exitCode=1 May 28 17:18:18.824335 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.824286 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"5286bec8ca43b232c41d44083dc25bef61e79de7090779c919c199fb9009d4ff"} May 28 17:18:18.824335 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.824321 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"f68aeb7e58749dbe8c0ec4bd1753c78c17b1ee4b1c47a33882e3193524cf16bd"} May 28 17:18:18.824444 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.824335 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerDied","Data":"6a709206875d38cdae0ad25c880c305eb547b4ededc12b1304aa029f22208c7d"} May 28 17:18:18.824444 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.824351 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"2cdd9b83fe97d3c9ad33cc3d0e50af017128edb9e176fd318518d2dcd5047a00"} May 28 17:18:18.825704 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.825685 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" event={"ID":"6849dc3c-e2eb-4226-8b85-2012fe634b35","Type":"ContainerStarted","Data":"8833e020b4e5786a323e9eed9d1db94df652e5f775b334dbfed67f7abbfea071"} May 28 17:18:18.827176 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.827153 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvgs4" event={"ID":"a1bd670c-b6b7-4905-95d7-a54b9fd20e8a","Type":"ContainerStarted","Data":"b443635b941fca42e8f319807a4f9cfcd6a941b84ff54b0508060b1758288776"} May 28 17:18:18.829149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.828775 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stbzw" event={"ID":"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58","Type":"ContainerStarted","Data":"4d6cffdd919f0a66bbce68a7b3b1a464fb90b03ffa855336ac44660fbe2b5d7c"} May 28 17:18:18.829149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.828803 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stbzw" event={"ID":"4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58","Type":"ContainerStarted","Data":"326b6430d4fca62c5045da688b5b3ed72ee7b69684126f8d0438665e23129f67"} May 28 17:18:18.854426 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.854361 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5x8jt" podStartSLOduration=8.787113667 podStartE2EDuration="21.85434542s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.292915826 +0000 UTC m=+3.206808649" lastFinishedPulling="2026-05-28 17:18:13.360147591 +0000 UTC m=+16.274040402" observedRunningTime="2026-05-28 17:18:18.853661064 +0000 UTC m=+21.767553894" watchObservedRunningTime="2026-05-28 17:18:18.85434542 +0000 UTC m=+21.768238261" May 28 17:18:18.871047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.871010 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vhbk4" podStartSLOduration=4.033615616 podStartE2EDuration="21.87099462s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.290230661 +0000 UTC m=+3.204123484" lastFinishedPulling="2026-05-28 17:18:18.127609674 +0000 UTC m=+21.041502488" observedRunningTime="2026-05-28 17:18:18.870730502 +0000 UTC m=+21.784623331" watchObservedRunningTime="2026-05-28 17:18:18.87099462 +0000 UTC m=+21.784887452" May 28 17:18:18.887596 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.887556 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vvgs4" podStartSLOduration=4.036090262 podStartE2EDuration="21.88753813s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.289363632 +0000 UTC m=+3.203256443" lastFinishedPulling="2026-05-28 17:18:18.140811504 +0000 UTC m=+21.054704311" observedRunningTime="2026-05-28 17:18:18.887426845 +0000 UTC m=+21.801319675" watchObservedRunningTime="2026-05-28 17:18:18.88753813 +0000 UTC m=+21.801430960" May 28 17:18:18.908028 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.907992 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tcv7p" podStartSLOduration=4.073615755 podStartE2EDuration="21.907980548s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.29158008 +0000 UTC m=+3.205472902" lastFinishedPulling="2026-05-28 17:18:18.125944881 +0000 UTC m=+21.039837695" observedRunningTime="2026-05-28 17:18:18.907860197 +0000 UTC m=+21.821753027" watchObservedRunningTime="2026-05-28 17:18:18.907980548 +0000 UTC m=+21.821873378" May 28 17:18:18.924640 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:18.924606 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-stbzw" podStartSLOduration=16.924595799 podStartE2EDuration="16.924595799s" podCreationTimestamp="2026-05-28 17:18:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:18.924328807 +0000 UTC m=+21.838221637" watchObservedRunningTime="2026-05-28 17:18:18.924595799 +0000 UTC m=+21.838488628" May 28 17:18:19.344051 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.343800 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 17:18:19.655996 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.655865 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T17:18:19.344043181Z","UUID":"ef637f5a-cf90-413b-be24-07f6c59f062c","Handler":null,"Name":"","Endpoint":""} May 28 17:18:19.659869 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.659816 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 17:18:19.659869 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.659847 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 17:18:19.834036 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.834003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:18:19.834463 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.834427 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"585abfb9446e6b5d37a2de81ebbd24097de6ef535e40d8ad559fc0db382f1c7f"} May 28 17:18:19.834588 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.834489 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"59d67fa759564b4f86a3086901d7905a73c239720c84a2854cc7e4e4429b9b36"} May 28 17:18:19.836150 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.836120 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2zx6" event={"ID":"775b2267-f891-4e65-a160-5f4f7deacc4d","Type":"ContainerStarted","Data":"8f4cdc43a0bcc9186177635ce3f66d32460c8da2a4006d123472839f3106df75"} May 28 17:18:19.838109 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.838083 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" event={"ID":"93378644-31ce-43b9-b617-52af13dd2825","Type":"ContainerStarted","Data":"8ec0e744653b5df4bb522a33fe6fd214863f0cd1c1809be436c782c38d8a22b2"} May 28 17:18:19.854521 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:19.854475 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n2zx6" podStartSLOduration=5.012162644 podStartE2EDuration="22.85444706s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.284827045 +0000 UTC m=+3.198719858" lastFinishedPulling="2026-05-28 17:18:18.127111451 +0000 UTC m=+21.041004274" observedRunningTime="2026-05-28 17:18:19.853970468 +0000 UTC m=+22.767863299" watchObservedRunningTime="2026-05-28 17:18:19.85444706 +0000 UTC m=+22.768339890" May 28 17:18:20.723514 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:20.723432 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:20.723514 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:20.723479 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:20.724296 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:20.723523 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:20.724296 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:20.723619 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:20.724296 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:20.723746 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:20.724296 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:20.723851 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:20.755939 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:20.755905 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:20.756103 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:20.756065 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:18:20.756171 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:20.756124 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret podName:87ee72a8-f2b8-4a38-8618-f8d6f6898a28 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:36.756109649 +0000 UTC m=+39.670002457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret") pod "global-pull-secret-syncer-k2prg" (UID: "87ee72a8-f2b8-4a38-8618-f8d6f6898a28") : object "kube-system"/"original-pull-secret" not registered May 28 17:18:20.842058 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:20.842020 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" event={"ID":"93378644-31ce-43b9-b617-52af13dd2825","Type":"ContainerStarted","Data":"e726e25470c502f157506e70ad35927ece6a6a185c9e039968a960df67514f9f"} May 28 17:18:20.860799 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:20.860752 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnzjl" podStartSLOduration=3.713976391 podStartE2EDuration="23.860738529s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.293186497 +0000 UTC m=+3.207079320" lastFinishedPulling="2026-05-28 17:18:20.439948646 +0000 UTC m=+23.353841458" observedRunningTime="2026-05-28 17:18:20.859980558 +0000 UTC m=+23.773873388" watchObservedRunningTime="2026-05-28 17:18:20.860738529 +0000 UTC m=+23.774631359" May 28 17:18:21.595691 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:21.595649 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tcv7p" May 28 17:18:21.596410 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:21.596385 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tcv7p" May 28 17:18:21.846330 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:21.846257 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:18:21.846824 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:21.846710 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"1f3944f2237ce2ff08d9589185ce4e0bc4b120d6b9a2133df5ddec3d4817d89d"} May 28 17:18:21.847178 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:21.847152 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tcv7p" May 28 17:18:21.847883 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:21.847867 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tcv7p" May 28 17:18:22.621133 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:22.621106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stbzw_4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58/dns-node-resolver/0.log" May 28 17:18:22.723410 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:22.723379 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:22.723590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:22.723421 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:22.723590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:22.723385 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:22.723590 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:22.723557 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:22.723734 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:22.723635 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:22.723734 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:22.723705 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:23.403347 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.403204 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5x8jt_dc3e38ef-5c1d-41b1-bde6-df40dc097d5a/node-ca/0.log" May 28 17:18:23.852537 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.852502 2577 generic.go:358] "Generic (PLEG): container finished" podID="a4f8262f-8675-4bff-8ef1-d55b8b36e8c2" containerID="5cdebb7a835bfb30269cbdba4acf7adbb270751c13c18436b05fcc0295a45019" exitCode=0 May 28 17:18:23.852715 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.852593 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerDied","Data":"5cdebb7a835bfb30269cbdba4acf7adbb270751c13c18436b05fcc0295a45019"} May 28 17:18:23.855380 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.855363 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:18:23.855730 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.855708 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"1b1084c9fab12e0e1256a4b6bedb1263e1f758fd638616a20a6c57407d41002a"} May 28 17:18:23.856187 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.856168 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:18:23.856339 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.856320 2577 scope.go:117] "RemoveContainer" containerID="6a709206875d38cdae0ad25c880c305eb547b4ededc12b1304aa029f22208c7d" May 28 17:18:23.875022 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:23.874997 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:18:24.723186 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.723154 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:24.723567 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.723154 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:24.723567 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.723172 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:24.723567 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:24.723353 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:24.723567 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:24.723410 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:24.723567 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:24.723288 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:24.859981 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.859783 2577 generic.go:358] "Generic (PLEG): container finished" podID="a4f8262f-8675-4bff-8ef1-d55b8b36e8c2" containerID="bbaeafcb69b481a466a4f1bdba1b666432f43581313e48ff89d9ffe5bd202304" exitCode=0 May 28 17:18:24.860129 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.859866 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerDied","Data":"bbaeafcb69b481a466a4f1bdba1b666432f43581313e48ff89d9ffe5bd202304"} May 28 17:18:24.863506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.863486 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:18:24.863799 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.863780 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" event={"ID":"a555954e-e046-4a2c-86be-e413388972e8","Type":"ContainerStarted","Data":"d88beae9d561052fa1298e5b67a210a9136a1737688a9d0e3dc60bacf9dbafd5"} May 28 17:18:24.863937 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.863922 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 28 17:18:24.864170 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.864150 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:18:24.879419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.879399 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:18:24.916363 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:24.916315 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" podStartSLOduration=10.022875587 podStartE2EDuration="27.916296393s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.285943861 +0000 UTC m=+3.199836683" lastFinishedPulling="2026-05-28 17:18:18.179364669 +0000 UTC m=+21.093257489" observedRunningTime="2026-05-28 17:18:24.9147745 +0000 UTC m=+27.828667328" watchObservedRunningTime="2026-05-28 17:18:24.916296393 +0000 UTC m=+27.830189225" May 28 17:18:25.176103 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.176067 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ncjj5"] May 28 17:18:25.176316 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.176180 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:25.176316 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:25.176286 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:25.178877 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.178653 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2prg"] May 28 17:18:25.178877 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.178759 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:25.179059 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:25.178909 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:25.179363 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.179342 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hwp99"] May 28 17:18:25.179468 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.179432 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:25.179585 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:25.179566 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:25.683590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.683509 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:18:25.869927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.869893 2577 generic.go:358] "Generic (PLEG): container finished" podID="a4f8262f-8675-4bff-8ef1-d55b8b36e8c2" containerID="fbcb457bbb6dd0f3312cb4e635c518f05e891284fa016629ca2aa6cb93792abb" exitCode=0 May 28 17:18:25.870435 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:25.869977 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerDied","Data":"fbcb457bbb6dd0f3312cb4e635c518f05e891284fa016629ca2aa6cb93792abb"} May 28 17:18:26.722589 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:26.722551 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:26.722754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:26.722664 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:26.722817 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:26.722777 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:26.722817 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:26.722670 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:26.722916 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:26.722833 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:26.722975 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:26.722919 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:28.722623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:28.722590 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:28.723375 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:28.722646 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:28.723375 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:28.722676 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:28.723375 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:28.722739 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:28.723375 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:28.722822 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:28.723375 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:28.722874 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:30.722738 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:30.722701 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:30.723227 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:30.722809 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:30.723227 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:30.722707 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:30.723227 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:30.722886 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:30.723227 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:30.722702 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:30.723227 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:30.722946 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:31.334062 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:31.334026 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:31.334256 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:31.334186 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:31.334256 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:31.334255 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs podName:7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a nodeName:}" failed. No retries permitted until 2026-05-28 17:19:03.334238041 +0000 UTC m=+66.248130850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs") pod "network-metrics-daemon-hwp99" (UID: "7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:18:31.434960 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:31.434935 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:31.435109 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:31.435066 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:18:31.435109 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:31.435080 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:18:31.435109 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:31.435088 2577 projected.go:194] Error preparing data for projected volume kube-api-access-4zlqq for pod openshift-network-diagnostics/network-check-target-ncjj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:31.435223 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:31.435140 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq podName:a8fe0ae1-c004-44e3-afaf-2a6895d2a455 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:03.435126223 +0000 UTC m=+66.349019031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zlqq" (UniqueName: "kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq") pod "network-check-target-ncjj5" (UID: "a8fe0ae1-c004-44e3-afaf-2a6895d2a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:18:32.723173 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:32.722997 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:32.723582 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:32.722998 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:32.723582 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:32.723238 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:32.723582 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:32.723005 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:32.723582 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:32.723345 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:32.723582 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:32.723406 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:32.889014 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:32.888977 2577 generic.go:358] "Generic (PLEG): container finished" podID="a4f8262f-8675-4bff-8ef1-d55b8b36e8c2" containerID="f58b649c03d4f85e0d1b7425e9424c9e89167cf36e5e21b83c924193709828fc" exitCode=0 May 28 17:18:32.889161 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:32.889028 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerDied","Data":"f58b649c03d4f85e0d1b7425e9424c9e89167cf36e5e21b83c924193709828fc"} May 28 17:18:33.893533 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:33.893503 2577 generic.go:358] "Generic (PLEG): container finished" podID="a4f8262f-8675-4bff-8ef1-d55b8b36e8c2" containerID="5d4230201b9ca8e5a42f21b74b65072c5f431635ef5740a1ffa817a8917e0616" exitCode=0 May 28 17:18:33.893876 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:33.893559 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerDied","Data":"5d4230201b9ca8e5a42f21b74b65072c5f431635ef5740a1ffa817a8917e0616"} May 28 17:18:34.722641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:34.722603 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:34.722824 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:34.722718 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:34.722824 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:34.722734 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:34.722824 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:34.722717 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:34.722987 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:34.722836 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:34.722987 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:34.722881 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:34.897963 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:34.897934 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" event={"ID":"a4f8262f-8675-4bff-8ef1-d55b8b36e8c2","Type":"ContainerStarted","Data":"db3e2090efbce9d1d641d0bcb49a2ea7b9971761d79a3d23f9f6744dfa19d2ec"} May 28 17:18:34.923711 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:34.923666 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mk7tl" podStartSLOduration=6.387035488 podStartE2EDuration="37.923652101s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.294376137 +0000 UTC m=+3.208268948" lastFinishedPulling="2026-05-28 17:18:31.830992754 +0000 UTC m=+34.744885561" observedRunningTime="2026-05-28 17:18:34.923531719 +0000 UTC m=+37.837424549" watchObservedRunningTime="2026-05-28 17:18:34.923652101 +0000 UTC m=+37.837544931" May 28 17:18:36.723476 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:36.723435 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:36.723871 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:36.723435 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:36.723871 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:36.723562 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:36.723871 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:36.723588 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:36.723871 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:36.723688 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:36.723871 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:36.723787 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:36.779258 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:36.779237 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:36.779362 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:36.779339 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:18:36.779396 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:36.779389 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret podName:87ee72a8-f2b8-4a38-8618-f8d6f6898a28 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:08.779369648 +0000 UTC m=+71.693262457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret") pod "global-pull-secret-syncer-k2prg" (UID: "87ee72a8-f2b8-4a38-8618-f8d6f6898a28") : object "kube-system"/"original-pull-secret" not registered May 28 17:18:38.723380 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:38.723342 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:38.723761 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:38.723342 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:38.723761 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:38.723536 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:38.723761 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:38.723442 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:38.723761 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:38.723351 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:38.723761 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:38.723607 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:40.722680 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:40.722652 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:40.723049 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:40.722764 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:40.723049 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:40.722765 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:40.723049 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:40.722783 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:40.723049 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:40.722841 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:40.723049 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:40.722926 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:42.723280 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:42.723253 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:42.723685 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:42.723355 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:42.723685 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:42.723371 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:42.723685 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:42.723448 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:42.723685 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:42.723507 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:42.723685 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:42.723557 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:44.723128 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:44.723091 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:44.723128 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:44.723130 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:44.723704 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:44.723150 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:44.723704 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:44.723241 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:44.723704 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:44.723374 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:44.723704 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:44.723420 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:46.723390 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.723360 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:46.723852 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.723360 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:46.723852 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:46.723494 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncjj5" podUID="a8fe0ae1-c004-44e3-afaf-2a6895d2a455" May 28 17:18:46.723852 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.723360 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:46.723852 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:46.723565 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp99" podUID="7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a" May 28 17:18:46.723852 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:18:46.723621 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2prg" podUID="87ee72a8-f2b8-4a38-8618-f8d6f6898a28" May 28 17:18:46.904535 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.904509 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeReady" May 28 17:18:46.904653 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.904620 2577 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 17:18:46.947489 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.947449 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d7548c674-smbgk"] May 28 17:18:46.982773 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.982716 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4279m"] May 28 17:18:46.982877 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.982859 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:46.985376 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.985328 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 17:18:46.985551 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.985534 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 17:18:46.985654 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.985596 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qwghp\"" May 28 17:18:46.985922 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.985893 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 17:18:46.992997 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.992977 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 17:18:46.994513 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.994495 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7548c674-smbgk"] May 28 17:18:46.994590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.994518 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4r267"] May 28 17:18:46.994666 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.994648 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:46.996793 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.996769 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 17:18:46.996880 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.996831 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 17:18:46.996880 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.996857 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 17:18:46.997061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.997049 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pgcvd\"" May 28 17:18:46.997151 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:46.997133 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 17:18:47.012629 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.012607 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4279m"] May 28 17:18:47.012629 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.012628 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4r267"] May 28 17:18:47.012748 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.012709 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.016157 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.016141 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pscq4\"" May 28 17:18:47.016519 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.016378 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 17:18:47.016519 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.016393 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 17:18:47.016519 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.016475 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 17:18:47.066439 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.066405 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6xmcq"] May 28 17:18:47.087705 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.087681 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xmcq"] May 28 17:18:47.087831 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.087808 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.090498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.090439 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mxfnd\"" May 28 17:18:47.090498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.090440 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 17:18:47.090636 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.090446 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 17:18:47.159472 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-bound-sa-token\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159595 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e451b982-f085-4e36-8572-fbdca5cce77a-data-volume\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.159595 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24372b91-a4cb-41d7-b327-c05797292962-cert\") pod \"ingress-canary-4r267\" (UID: \"24372b91-a4cb-41d7-b327-c05797292962\") " pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.159595 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvs4d\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-kube-api-access-zvs4d\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159698 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e451b982-f085-4e36-8572-fbdca5cce77a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.159698 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/e451b982-f085-4e36-8572-fbdca5cce77a-kube-api-access-vq9sd\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.159698 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3f92e06-10a1-4413-88b3-916a96f7ed3a-trusted-ca\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159698 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-992ss\" (UniqueName: \"kubernetes.io/projected/24372b91-a4cb-41d7-b327-c05797292962-kube-api-access-992ss\") pod \"ingress-canary-4r267\" (UID: \"24372b91-a4cb-41d7-b327-c05797292962\") " pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.159815 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3f92e06-10a1-4413-88b3-916a96f7ed3a-registry-certificates\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159815 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-registry-tls\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159815 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3f92e06-10a1-4413-88b3-916a96f7ed3a-image-registry-private-configuration\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159815 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3f92e06-10a1-4413-88b3-916a96f7ed3a-ca-trust-extracted\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159815 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e451b982-f085-4e36-8572-fbdca5cce77a-crio-socket\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.159955 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3f92e06-10a1-4413-88b3-916a96f7ed3a-installation-pull-secrets\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.159955 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.159862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e451b982-f085-4e36-8572-fbdca5cce77a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.260746 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260728 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e451b982-f085-4e36-8572-fbdca5cce77a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.260862 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260754 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/e451b982-f085-4e36-8572-fbdca5cce77a-kube-api-access-vq9sd\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.260862 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260774 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3f92e06-10a1-4413-88b3-916a96f7ed3a-trusted-ca\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.260862 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260796 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-992ss\" (UniqueName: \"kubernetes.io/projected/24372b91-a4cb-41d7-b327-c05797292962-kube-api-access-992ss\") pod \"ingress-canary-4r267\" (UID: \"24372b91-a4cb-41d7-b327-c05797292962\") " pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.260862 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eed58bbd-c24e-46b9-a979-37acb52be93a-config-volume\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.260862 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eed58bbd-c24e-46b9-a979-37acb52be93a-metrics-tls\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.261067 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260902 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3f92e06-10a1-4413-88b3-916a96f7ed3a-registry-certificates\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261067 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260937 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-registry-tls\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261067 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260971 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3f92e06-10a1-4413-88b3-916a96f7ed3a-image-registry-private-configuration\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261067 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.260998 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3f92e06-10a1-4413-88b3-916a96f7ed3a-ca-trust-extracted\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261067 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261048 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e451b982-f085-4e36-8572-fbdca5cce77a-crio-socket\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261094 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3f92e06-10a1-4413-88b3-916a96f7ed3a-installation-pull-secrets\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261126 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e451b982-f085-4e36-8572-fbdca5cce77a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxmkk\" (UniqueName: \"kubernetes.io/projected/eed58bbd-c24e-46b9-a979-37acb52be93a-kube-api-access-lxmkk\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261211 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-bound-sa-token\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261239 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e451b982-f085-4e36-8572-fbdca5cce77a-data-volume\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e451b982-f085-4e36-8572-fbdca5cce77a-crio-socket\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261264 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24372b91-a4cb-41d7-b327-c05797292962-cert\") pod \"ingress-canary-4r267\" (UID: \"24372b91-a4cb-41d7-b327-c05797292962\") " pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.261304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3f92e06-10a1-4413-88b3-916a96f7ed3a-ca-trust-extracted\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261723 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261326 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvs4d\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-kube-api-access-zvs4d\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.261723 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed58bbd-c24e-46b9-a979-37acb52be93a-tmp-dir\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.261876 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.261854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3f92e06-10a1-4413-88b3-916a96f7ed3a-trusted-ca\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.262044 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.262025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3f92e06-10a1-4413-88b3-916a96f7ed3a-registry-certificates\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.262175 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.262143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e451b982-f085-4e36-8572-fbdca5cce77a-data-volume\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.262399 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.262375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e451b982-f085-4e36-8572-fbdca5cce77a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.265124 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.265098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e451b982-f085-4e36-8572-fbdca5cce77a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.265266 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.265244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3f92e06-10a1-4413-88b3-916a96f7ed3a-image-registry-private-configuration\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.265332 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.265313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-registry-tls\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.265385 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.265319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24372b91-a4cb-41d7-b327-c05797292962-cert\") pod \"ingress-canary-4r267\" (UID: \"24372b91-a4cb-41d7-b327-c05797292962\") " pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.265385 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.265350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3f92e06-10a1-4413-88b3-916a96f7ed3a-installation-pull-secrets\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.269899 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.269872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-992ss\" (UniqueName: \"kubernetes.io/projected/24372b91-a4cb-41d7-b327-c05797292962-kube-api-access-992ss\") pod \"ingress-canary-4r267\" (UID: \"24372b91-a4cb-41d7-b327-c05797292962\") " pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.269994 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.269980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-bound-sa-token\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.270197 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.270178 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/e451b982-f085-4e36-8572-fbdca5cce77a-kube-api-access-vq9sd\") pod \"insights-runtime-extractor-4279m\" (UID: \"e451b982-f085-4e36-8572-fbdca5cce77a\") " pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.270930 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.270913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvs4d\" (UniqueName: \"kubernetes.io/projected/c3f92e06-10a1-4413-88b3-916a96f7ed3a-kube-api-access-zvs4d\") pod \"image-registry-5d7548c674-smbgk\" (UID: \"c3f92e06-10a1-4413-88b3-916a96f7ed3a\") " pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.295816 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.295792 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.302558 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.302539 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4279m" May 28 17:18:47.321652 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.321272 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4r267" May 28 17:18:47.362340 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.362300 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxmkk\" (UniqueName: \"kubernetes.io/projected/eed58bbd-c24e-46b9-a979-37acb52be93a-kube-api-access-lxmkk\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.362488 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.362383 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed58bbd-c24e-46b9-a979-37acb52be93a-tmp-dir\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.362488 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.362443 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eed58bbd-c24e-46b9-a979-37acb52be93a-config-volume\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.362610 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.362488 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eed58bbd-c24e-46b9-a979-37acb52be93a-metrics-tls\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.362817 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.362795 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eed58bbd-c24e-46b9-a979-37acb52be93a-tmp-dir\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.363001 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.362984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eed58bbd-c24e-46b9-a979-37acb52be93a-config-volume\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.365338 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.365317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eed58bbd-c24e-46b9-a979-37acb52be93a-metrics-tls\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.374948 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.374655 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxmkk\" (UniqueName: \"kubernetes.io/projected/eed58bbd-c24e-46b9-a979-37acb52be93a-kube-api-access-lxmkk\") pod \"dns-default-6xmcq\" (UID: \"eed58bbd-c24e-46b9-a979-37acb52be93a\") " pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.396923 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.396888 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xmcq" May 28 17:18:47.494002 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.493970 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7548c674-smbgk"] May 28 17:18:47.497053 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:47.497031 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f92e06_10a1_4413_88b3_916a96f7ed3a.slice/crio-dd0387cdf8b2c635cf5b3fdfdea187794500cc9c38d4c244bc3f48c308078481 WatchSource:0}: Error finding container dd0387cdf8b2c635cf5b3fdfdea187794500cc9c38d4c244bc3f48c308078481: Status 404 returned error can't find the container with id dd0387cdf8b2c635cf5b3fdfdea187794500cc9c38d4c244bc3f48c308078481 May 28 17:18:47.554742 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.554715 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xmcq"] May 28 17:18:47.557683 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:47.557654 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed58bbd_c24e_46b9_a979_37acb52be93a.slice/crio-d900ac92ac4d81fe4e7814352cf31a2e8f658b2fc29c907591189f02359b0806 WatchSource:0}: Error finding container d900ac92ac4d81fe4e7814352cf31a2e8f658b2fc29c907591189f02359b0806: Status 404 returned error can't find the container with id d900ac92ac4d81fe4e7814352cf31a2e8f658b2fc29c907591189f02359b0806 May 28 17:18:47.707584 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.707515 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4r267"] May 28 17:18:47.710012 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:47.709987 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24372b91_a4cb_41d7_b327_c05797292962.slice/crio-662a148038246e787fc81c66b5925cd2b1e6b175a60fdfe2765b0bfd87018068 WatchSource:0}: Error finding container 662a148038246e787fc81c66b5925cd2b1e6b175a60fdfe2765b0bfd87018068: Status 404 returned error can't find the container with id 662a148038246e787fc81c66b5925cd2b1e6b175a60fdfe2765b0bfd87018068 May 28 17:18:47.712308 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.712287 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4279m"] May 28 17:18:47.719919 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:47.719897 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode451b982_f085_4e36_8572_fbdca5cce77a.slice/crio-8d3e3c15f799ec3ed21e0176edf5fc952df24b5bb81a83bc06686202e51f7d58 WatchSource:0}: Error finding container 8d3e3c15f799ec3ed21e0176edf5fc952df24b5bb81a83bc06686202e51f7d58: Status 404 returned error can't find the container with id 8d3e3c15f799ec3ed21e0176edf5fc952df24b5bb81a83bc06686202e51f7d58 May 28 17:18:47.920835 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.920792 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xmcq" event={"ID":"eed58bbd-c24e-46b9-a979-37acb52be93a","Type":"ContainerStarted","Data":"d900ac92ac4d81fe4e7814352cf31a2e8f658b2fc29c907591189f02359b0806"} May 28 17:18:47.921866 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.921830 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4r267" event={"ID":"24372b91-a4cb-41d7-b327-c05797292962","Type":"ContainerStarted","Data":"662a148038246e787fc81c66b5925cd2b1e6b175a60fdfe2765b0bfd87018068"} May 28 17:18:47.923095 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.923075 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4279m" event={"ID":"e451b982-f085-4e36-8572-fbdca5cce77a","Type":"ContainerStarted","Data":"a2715d3b6d231289241edfe2f6acc437084e8318666ac5f8c524909a5d841221"} May 28 17:18:47.923198 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.923102 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4279m" event={"ID":"e451b982-f085-4e36-8572-fbdca5cce77a","Type":"ContainerStarted","Data":"8d3e3c15f799ec3ed21e0176edf5fc952df24b5bb81a83bc06686202e51f7d58"} May 28 17:18:47.924360 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.924339 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7548c674-smbgk" event={"ID":"c3f92e06-10a1-4413-88b3-916a96f7ed3a","Type":"ContainerStarted","Data":"0767a31c5cbffe94788449b28598b398dcccb1f543bcdc98fda2873408c3b9b4"} May 28 17:18:47.924470 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.924364 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7548c674-smbgk" event={"ID":"c3f92e06-10a1-4413-88b3-916a96f7ed3a","Type":"ContainerStarted","Data":"dd0387cdf8b2c635cf5b3fdfdea187794500cc9c38d4c244bc3f48c308078481"} May 28 17:18:47.924659 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.924645 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:18:47.948641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:47.948588 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d7548c674-smbgk" podStartSLOduration=1.9485709199999999 podStartE2EDuration="1.94857092s" podCreationTimestamp="2026-05-28 17:18:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:47.948137301 +0000 UTC m=+50.862030131" watchObservedRunningTime="2026-05-28 17:18:47.94857092 +0000 UTC m=+50.862463751" May 28 17:18:48.722883 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.722847 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:18:48.722883 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.722880 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:18:48.723089 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.723006 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:18:48.726367 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.726346 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 17:18:48.726504 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.726407 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4msh\"" May 28 17:18:48.726504 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.726426 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7xh7t\"" May 28 17:18:48.726504 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.726450 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 17:18:48.726679 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.726347 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 17:18:48.726679 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:48.726582 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 17:18:49.469129 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.469090 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7564f7fb54-6sgm8"] May 28 17:18:49.483466 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.483417 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.486264 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.486242 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7564f7fb54-6sgm8"] May 28 17:18:49.487600 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.487579 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-flwtn\"" May 28 17:18:49.487706 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.487612 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 28 17:18:49.487811 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.487790 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 28 17:18:49.487922 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.487825 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 28 17:18:49.488005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.487986 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 28 17:18:49.488168 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.488152 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 28 17:18:49.488252 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.488208 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 28 17:18:49.488367 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.488352 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 28 17:18:49.579695 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.579615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-config\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.579695 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.579671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-serving-cert\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.579931 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.579715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-oauth-config\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.579931 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.579738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-service-ca\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.579931 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.579763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-oauth-serving-cert\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.579931 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.579782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2clm\" (UniqueName: \"kubernetes.io/projected/2e41dfdf-b929-4f0a-91a4-dc062b348de3-kube-api-access-j2clm\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.680687 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.680651 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-oauth-serving-cert\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.680687 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.680691 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2clm\" (UniqueName: \"kubernetes.io/projected/2e41dfdf-b929-4f0a-91a4-dc062b348de3-kube-api-access-j2clm\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.680924 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.680766 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-config\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.680924 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.680808 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-serving-cert\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.680924 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.680852 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-oauth-config\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.680924 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.680874 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-service-ca\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.681414 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.681386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-oauth-serving-cert\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.681937 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.681916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-config\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.682263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.682243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-service-ca\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.683779 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.683759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-serving-cert\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.683863 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.683794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-oauth-config\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.692089 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.692068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2clm\" (UniqueName: \"kubernetes.io/projected/2e41dfdf-b929-4f0a-91a4-dc062b348de3-kube-api-access-j2clm\") pod \"console-7564f7fb54-6sgm8\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:49.795858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:49.795828 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:50.301206 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.301183 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7564f7fb54-6sgm8"] May 28 17:18:50.305669 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:18:50.305582 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e41dfdf_b929_4f0a_91a4_dc062b348de3.slice/crio-a25f4e2661b1598d954cc50860279a071e189b32b6c8b206d6dbafd21d26c39c WatchSource:0}: Error finding container a25f4e2661b1598d954cc50860279a071e189b32b6c8b206d6dbafd21d26c39c: Status 404 returned error can't find the container with id a25f4e2661b1598d954cc50860279a071e189b32b6c8b206d6dbafd21d26c39c May 28 17:18:50.933633 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.933594 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4279m" event={"ID":"e451b982-f085-4e36-8572-fbdca5cce77a","Type":"ContainerStarted","Data":"9fb7dd866c61bd0e17996941d4841a36a6b178284b21003bccb72c5c32a4f584"} May 28 17:18:50.934709 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.934677 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7564f7fb54-6sgm8" event={"ID":"2e41dfdf-b929-4f0a-91a4-dc062b348de3","Type":"ContainerStarted","Data":"a25f4e2661b1598d954cc50860279a071e189b32b6c8b206d6dbafd21d26c39c"} May 28 17:18:50.936393 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.936336 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xmcq" event={"ID":"eed58bbd-c24e-46b9-a979-37acb52be93a","Type":"ContainerStarted","Data":"d81f390c2479e0a64e23f8b9870a2d067eb9b6ed931c68852e7659527f8ce6c2"} May 28 17:18:50.936393 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.936368 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xmcq" event={"ID":"eed58bbd-c24e-46b9-a979-37acb52be93a","Type":"ContainerStarted","Data":"fc0ff7ade6f8203d61c6a276cdf002f35245b17661e04e38e2fc45fd8a0a2504"} May 28 17:18:50.936631 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.936470 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6xmcq" May 28 17:18:50.941102 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.941078 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4r267" event={"ID":"24372b91-a4cb-41d7-b327-c05797292962","Type":"ContainerStarted","Data":"97b86c6ceb260295ecdec31d7ec378466b6dba23523c4127af1ba7285b2e81c7"} May 28 17:18:50.955282 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.955233 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6xmcq" podStartSLOduration=1.34747643 podStartE2EDuration="3.955221865s" podCreationTimestamp="2026-05-28 17:18:47 +0000 UTC" firstStartedPulling="2026-05-28 17:18:47.559657858 +0000 UTC m=+50.473550683" lastFinishedPulling="2026-05-28 17:18:50.167403297 +0000 UTC m=+53.081296118" observedRunningTime="2026-05-28 17:18:50.954261011 +0000 UTC m=+53.868153842" watchObservedRunningTime="2026-05-28 17:18:50.955221865 +0000 UTC m=+53.869114727" May 28 17:18:50.971153 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:50.970852 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4r267" podStartSLOduration=2.511586705 podStartE2EDuration="4.970838211s" podCreationTimestamp="2026-05-28 17:18:46 +0000 UTC" firstStartedPulling="2026-05-28 17:18:47.713093639 +0000 UTC m=+50.626986455" lastFinishedPulling="2026-05-28 17:18:50.172345153 +0000 UTC m=+53.086237961" observedRunningTime="2026-05-28 17:18:50.970363114 +0000 UTC m=+53.884255944" watchObservedRunningTime="2026-05-28 17:18:50.970838211 +0000 UTC m=+53.884731045" May 28 17:18:52.949605 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:52.949565 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4279m" event={"ID":"e451b982-f085-4e36-8572-fbdca5cce77a","Type":"ContainerStarted","Data":"1f188cbe32891688561e390d211de12550f3d37b32534e469465d4ecae11ba8b"} May 28 17:18:52.972562 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:52.972506 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4279m" podStartSLOduration=2.8463181950000003 podStartE2EDuration="6.972487196s" podCreationTimestamp="2026-05-28 17:18:46 +0000 UTC" firstStartedPulling="2026-05-28 17:18:47.786565165 +0000 UTC m=+50.700457975" lastFinishedPulling="2026-05-28 17:18:51.912734169 +0000 UTC m=+54.826626976" observedRunningTime="2026-05-28 17:18:52.971481273 +0000 UTC m=+55.885374103" watchObservedRunningTime="2026-05-28 17:18:52.972487196 +0000 UTC m=+55.886380027" May 28 17:18:53.956608 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:53.956577 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7564f7fb54-6sgm8" event={"ID":"2e41dfdf-b929-4f0a-91a4-dc062b348de3","Type":"ContainerStarted","Data":"a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3"} May 28 17:18:54.981517 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:54.981444 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7564f7fb54-6sgm8" podStartSLOduration=2.456043733 podStartE2EDuration="5.981425242s" podCreationTimestamp="2026-05-28 17:18:49 +0000 UTC" firstStartedPulling="2026-05-28 17:18:50.307618483 +0000 UTC m=+53.221511291" lastFinishedPulling="2026-05-28 17:18:53.832999989 +0000 UTC m=+56.746892800" observedRunningTime="2026-05-28 17:18:54.980525273 +0000 UTC m=+57.894418103" watchObservedRunningTime="2026-05-28 17:18:54.981425242 +0000 UTC m=+57.895318072" May 28 17:18:56.883588 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:56.883561 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd6sz" May 28 17:18:59.628929 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.628898 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65cdd5b7cd-ccs8b"] May 28 17:18:59.638034 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.638013 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.640417 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.640391 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cdd5b7cd-ccs8b"] May 28 17:18:59.646387 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.646368 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 28 17:18:59.650238 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.650221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-config\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.650307 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.650263 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-serving-cert\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.650307 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.650289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-oauth-config\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.650307 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.650305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k44rc\" (UniqueName: \"kubernetes.io/projected/1ef2267a-2aad-4a39-82a8-554e0ac11541-kube-api-access-k44rc\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.650426 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.650356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-service-ca\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.650426 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.650412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-oauth-serving-cert\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.650541 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.650508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-trusted-ca-bundle\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.750978 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.750949 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-serving-cert\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.750989 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-oauth-config\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.751006 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k44rc\" (UniqueName: \"kubernetes.io/projected/1ef2267a-2aad-4a39-82a8-554e0ac11541-kube-api-access-k44rc\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.751029 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-service-ca\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.751083 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-oauth-serving-cert\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.751115 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-trusted-ca-bundle\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751360 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.751153 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-config\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751818 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.751781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-config\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.751973 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.751948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-service-ca\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.752092 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.752077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-trusted-ca-bundle\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.752197 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.752174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-oauth-serving-cert\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.753554 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.753526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-oauth-config\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.753656 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.753639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-serving-cert\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.761223 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.761204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k44rc\" (UniqueName: \"kubernetes.io/projected/1ef2267a-2aad-4a39-82a8-554e0ac11541-kube-api-access-k44rc\") pod \"console-65cdd5b7cd-ccs8b\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.796033 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.796000 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:59.796141 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.796124 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:59.801684 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.801667 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:18:59.948424 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.948343 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:18:59.975212 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:18:59.975190 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:19:00.078008 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:00.077981 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cdd5b7cd-ccs8b"] May 28 17:19:00.081209 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:00.081177 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef2267a_2aad_4a39_82a8_554e0ac11541.slice/crio-9c786a94735803a420b5b455f97b1d6bc81dce4150fc86b7f10af8cf1303f1cf WatchSource:0}: Error finding container 9c786a94735803a420b5b455f97b1d6bc81dce4150fc86b7f10af8cf1303f1cf: Status 404 returned error can't find the container with id 9c786a94735803a420b5b455f97b1d6bc81dce4150fc86b7f10af8cf1303f1cf May 28 17:19:00.946480 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:00.946433 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6xmcq" May 28 17:19:00.975095 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:00.975064 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cdd5b7cd-ccs8b" event={"ID":"1ef2267a-2aad-4a39-82a8-554e0ac11541","Type":"ContainerStarted","Data":"f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553"} May 28 17:19:00.975095 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:00.975103 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cdd5b7cd-ccs8b" event={"ID":"1ef2267a-2aad-4a39-82a8-554e0ac11541","Type":"ContainerStarted","Data":"9c786a94735803a420b5b455f97b1d6bc81dce4150fc86b7f10af8cf1303f1cf"} May 28 17:19:01.007738 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:01.007651 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65cdd5b7cd-ccs8b" podStartSLOduration=2.007631171 podStartE2EDuration="2.007631171s" podCreationTimestamp="2026-05-28 17:18:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:19:01.006839601 +0000 UTC m=+63.920732431" watchObservedRunningTime="2026-05-28 17:19:01.007631171 +0000 UTC m=+63.921524002" May 28 17:19:03.379215 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.379169 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:19:03.381549 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.381531 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 17:19:03.392818 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.392797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a-metrics-certs\") pod \"network-metrics-daemon-hwp99\" (UID: \"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a\") " pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:19:03.444513 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.444488 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4msh\"" May 28 17:19:03.452726 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.452708 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp99" May 28 17:19:03.479889 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.479865 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:19:03.482739 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.482725 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 17:19:03.492945 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.492922 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 17:19:03.504881 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.504860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zlqq\" (UniqueName: \"kubernetes.io/projected/a8fe0ae1-c004-44e3-afaf-2a6895d2a455-kube-api-access-4zlqq\") pod \"network-check-target-ncjj5\" (UID: \"a8fe0ae1-c004-44e3-afaf-2a6895d2a455\") " pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:19:03.577508 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.577480 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hwp99"] May 28 17:19:03.580266 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:03.580227 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbb10d2_af0b_43c4_a96a_a0fe18b6a16a.slice/crio-4f23eecd4c83711a060a50e8ad70c194104f3ef8d6a3acd65002fa3fe27fc2d7 WatchSource:0}: Error finding container 4f23eecd4c83711a060a50e8ad70c194104f3ef8d6a3acd65002fa3fe27fc2d7: Status 404 returned error can't find the container with id 4f23eecd4c83711a060a50e8ad70c194104f3ef8d6a3acd65002fa3fe27fc2d7 May 28 17:19:03.738038 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.737961 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7xh7t\"" May 28 17:19:03.746232 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.746218 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:19:03.868009 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.867977 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ncjj5"] May 28 17:19:03.871075 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:03.871046 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fe0ae1_c004_44e3_afaf_2a6895d2a455.slice/crio-df57a058b689580aff2b206af5680de3bc3302137c26d9c36f47d08d26dc3bf6 WatchSource:0}: Error finding container df57a058b689580aff2b206af5680de3bc3302137c26d9c36f47d08d26dc3bf6: Status 404 returned error can't find the container with id df57a058b689580aff2b206af5680de3bc3302137c26d9c36f47d08d26dc3bf6 May 28 17:19:03.982823 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.982791 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ncjj5" event={"ID":"a8fe0ae1-c004-44e3-afaf-2a6895d2a455","Type":"ContainerStarted","Data":"df57a058b689580aff2b206af5680de3bc3302137c26d9c36f47d08d26dc3bf6"} May 28 17:19:03.983825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:03.983802 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hwp99" event={"ID":"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a","Type":"ContainerStarted","Data":"4f23eecd4c83711a060a50e8ad70c194104f3ef8d6a3acd65002fa3fe27fc2d7"} May 28 17:19:04.990149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:04.990064 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hwp99" event={"ID":"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a","Type":"ContainerStarted","Data":"cf429690160cb6b6f04b6a7ca54ef607c60fe3f65536f5961bea30eace6f45c5"} May 28 17:19:04.990149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:04.990108 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hwp99" event={"ID":"7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a","Type":"ContainerStarted","Data":"e967794dadc37e27dfa9ae929b8d953add6f956aaff5d5a2350e99bb62fd680b"} May 28 17:19:05.013665 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:05.013590 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hwp99" podStartSLOduration=66.962647898 podStartE2EDuration="1m8.013575927s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:19:03.58208385 +0000 UTC m=+66.495976661" lastFinishedPulling="2026-05-28 17:19:04.633011878 +0000 UTC m=+67.546904690" observedRunningTime="2026-05-28 17:19:05.013106761 +0000 UTC m=+67.926999590" watchObservedRunningTime="2026-05-28 17:19:05.013575927 +0000 UTC m=+67.927468756" May 28 17:19:07.999697 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:07.999660 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ncjj5" event={"ID":"a8fe0ae1-c004-44e3-afaf-2a6895d2a455","Type":"ContainerStarted","Data":"514aa42987fddd34ce745ccd036ed975924e03712c259b8d27a74c27f25f26e5"} May 28 17:19:08.000111 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:07.999834 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:19:08.023962 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:08.023917 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ncjj5" podStartSLOduration=67.85706934 podStartE2EDuration="1m11.023903715s" podCreationTimestamp="2026-05-28 17:17:57 +0000 UTC" firstStartedPulling="2026-05-28 17:19:03.872865512 +0000 UTC m=+66.786758320" lastFinishedPulling="2026-05-28 17:19:07.039699882 +0000 UTC m=+69.953592695" observedRunningTime="2026-05-28 17:19:08.022552052 +0000 UTC m=+70.936444882" watchObservedRunningTime="2026-05-28 17:19:08.023903715 +0000 UTC m=+70.937796562" May 28 17:19:08.823521 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:08.823490 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:19:08.826205 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:08.826185 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 17:19:08.836751 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:08.836728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87ee72a8-f2b8-4a38-8618-f8d6f6898a28-original-pull-secret\") pod \"global-pull-secret-syncer-k2prg\" (UID: \"87ee72a8-f2b8-4a38-8618-f8d6f6898a28\") " pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:19:08.847801 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:08.847778 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2prg" May 28 17:19:08.930900 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:08.930874 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d7548c674-smbgk" May 28 17:19:08.976959 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:08.976928 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2prg"] May 28 17:19:08.980118 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:08.980085 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ee72a8_f2b8_4a38_8618_f8d6f6898a28.slice/crio-54c408f8d9fb7c6063285cb242b655c56971989089f29d22e9b445449e04a30e WatchSource:0}: Error finding container 54c408f8d9fb7c6063285cb242b655c56971989089f29d22e9b445449e04a30e: Status 404 returned error can't find the container with id 54c408f8d9fb7c6063285cb242b655c56971989089f29d22e9b445449e04a30e May 28 17:19:09.004501 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:09.004472 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2prg" event={"ID":"87ee72a8-f2b8-4a38-8618-f8d6f6898a28","Type":"ContainerStarted","Data":"54c408f8d9fb7c6063285cb242b655c56971989089f29d22e9b445449e04a30e"} May 28 17:19:09.948971 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:09.948939 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:19:09.949173 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:09.948990 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:19:09.954751 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:09.954715 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:19:10.012346 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:10.012285 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:19:10.074931 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:10.074902 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7564f7fb54-6sgm8"] May 28 17:19:13.017532 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:13.017498 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2prg" event={"ID":"87ee72a8-f2b8-4a38-8618-f8d6f6898a28","Type":"ContainerStarted","Data":"4a534ff12f100ca7256fcf9799469aff31172610d9d298782c014fd1d834caaf"} May 28 17:19:13.033381 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:13.033326 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k2prg" podStartSLOduration=65.333588077 podStartE2EDuration="1m9.033309086s" podCreationTimestamp="2026-05-28 17:18:04 +0000 UTC" firstStartedPulling="2026-05-28 17:19:08.98222543 +0000 UTC m=+71.896118245" lastFinishedPulling="2026-05-28 17:19:12.681946444 +0000 UTC m=+75.595839254" observedRunningTime="2026-05-28 17:19:13.033295558 +0000 UTC m=+75.947188391" watchObservedRunningTime="2026-05-28 17:19:13.033309086 +0000 UTC m=+75.947201893" May 28 17:19:18.868276 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.868234 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8db98"] May 28 17:19:18.872812 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.872792 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:18.875663 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.875638 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 28 17:19:18.875783 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.875681 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 17:19:18.875847 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.875809 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 17:19:18.875990 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.875966 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sxpj2\"" May 28 17:19:18.875990 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.875983 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 28 17:19:18.876147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.876009 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 17:19:18.876337 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.876317 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5"] May 28 17:19:18.879483 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.879192 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:18.881904 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.881886 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 28 17:19:18.882004 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.881931 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 28 17:19:18.882065 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.881886 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-srqmp\"" May 28 17:19:18.882949 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.882926 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8db98"] May 28 17:19:18.883187 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.883167 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 28 17:19:18.895413 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.895393 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2vmw4"] May 28 17:19:18.898905 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.898884 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5"] May 28 17:19:18.899045 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.899003 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.901662 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.901639 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gxkhh\"" May 28 17:19:18.901760 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.901665 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 17:19:18.901760 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.901639 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 17:19:18.901872 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.901834 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 17:19:18.989287 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:18.989287 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da1e854b-0ab8-4711-af22-a836b7033493-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:18.989490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:18.989490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ee06866-a35b-4f01-ac3e-4340adc202f0-metrics-client-ca\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-sys\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bkl4\" (UniqueName: \"kubernetes.io/projected/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-api-access-8bkl4\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:18.989490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:18.989490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-tls\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-wtmp\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2w2c\" (UniqueName: \"kubernetes.io/projected/da1e854b-0ab8-4711-af22-a836b7033493-kube-api-access-k2w2c\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:18.989677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-textfile\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:18.989677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-root\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:18.989880 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989880 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmznr\" (UniqueName: \"kubernetes.io/projected/5ee06866-a35b-4f01-ac3e-4340adc202f0-kube-api-access-tmznr\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:18.989880 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:18.989880 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:18.989762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.090512 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090480 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.090689 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090517 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-root\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.090689 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090545 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.090689 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090578 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.090689 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090602 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmznr\" (UniqueName: \"kubernetes.io/projected/5ee06866-a35b-4f01-ac3e-4340adc202f0-kube-api-access-tmznr\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.090689 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090630 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-root\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.090927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090637 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.090927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090769 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.090927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090820 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.090927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090847 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da1e854b-0ab8-4711-af22-a836b7033493-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.090927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090876 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.090927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090908 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ee06866-a35b-4f01-ac3e-4340adc202f0-metrics-client-ca\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090938 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-sys\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.090969 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bkl4\" (UniqueName: \"kubernetes.io/projected/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-api-access-8bkl4\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091003 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091056 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-tls\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091084 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091114 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-wtmp\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091141 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2w2c\" (UniqueName: \"kubernetes.io/projected/da1e854b-0ab8-4711-af22-a836b7033493-kube-api-access-k2w2c\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091163 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-textfile\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:19:19.091318 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:19:19.091568 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-tls podName:da1e854b-0ab8-4711-af22-a836b7033493 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:19.591547417 +0000 UTC m=+82.505440226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-8db98" (UID: "da1e854b-0ab8-4711-af22-a836b7033493") : secret "openshift-state-metrics-tls" not found May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da1e854b-0ab8-4711-af22-a836b7033493-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-textfile\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-sys\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:19:19.091756 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:19:19.091806 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-tls podName:5ee06866-a35b-4f01-ac3e-4340adc202f0 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:19.591788814 +0000 UTC m=+82.505681636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-tls") pod "node-exporter-2vmw4" (UID: "5ee06866-a35b-4f01-ac3e-4340adc202f0") : secret "node-exporter-tls" not found May 28 17:19:19.091917 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-wtmp\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.092395 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.091926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.092395 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.092146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ee06866-a35b-4f01-ac3e-4340adc202f0-metrics-client-ca\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.092523 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.092391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.093357 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.093328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.093477 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.093368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.093592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.093571 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.094061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.094040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.101151 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.101126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmznr\" (UniqueName: \"kubernetes.io/projected/5ee06866-a35b-4f01-ac3e-4340adc202f0-kube-api-access-tmznr\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.102410 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.102380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bkl4\" (UniqueName: \"kubernetes.io/projected/c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9-kube-api-access-8bkl4\") pod \"kube-state-metrics-54fd6bc5c4-pqhg5\" (UID: \"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.102809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.102788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2w2c\" (UniqueName: \"kubernetes.io/projected/da1e854b-0ab8-4711-af22-a836b7033493-kube-api-access-k2w2c\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.189345 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.189262 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" May 28 17:19:19.315326 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.315304 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5"] May 28 17:19:19.317804 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:19.317775 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b3e42d_da48_41a4_8ac5_a5425bcbd8f9.slice/crio-f1f6098f0f3c9894546ee33d2ea5ea51a6cfe133d11aed9cf1b16d7347e4c3be WatchSource:0}: Error finding container f1f6098f0f3c9894546ee33d2ea5ea51a6cfe133d11aed9cf1b16d7347e4c3be: Status 404 returned error can't find the container with id f1f6098f0f3c9894546ee33d2ea5ea51a6cfe133d11aed9cf1b16d7347e4c3be May 28 17:19:19.595836 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.595786 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.596002 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.595870 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-tls\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.598222 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.598196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ee06866-a35b-4f01-ac3e-4340adc202f0-node-exporter-tls\") pod \"node-exporter-2vmw4\" (UID: \"5ee06866-a35b-4f01-ac3e-4340adc202f0\") " pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.598352 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.598335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da1e854b-0ab8-4711-af22-a836b7033493-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8db98\" (UID: \"da1e854b-0ab8-4711-af22-a836b7033493\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.783128 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.783098 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" May 28 17:19:19.808018 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.807978 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2vmw4" May 28 17:19:19.816748 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:19.816719 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee06866_a35b_4f01_ac3e_4340adc202f0.slice/crio-6c41e65774fa326ded4cc65f7cd1b7e4ea9d6273f54706da9fe55a73fdafa52a WatchSource:0}: Error finding container 6c41e65774fa326ded4cc65f7cd1b7e4ea9d6273f54706da9fe55a73fdafa52a: Status 404 returned error can't find the container with id 6c41e65774fa326ded4cc65f7cd1b7e4ea9d6273f54706da9fe55a73fdafa52a May 28 17:19:19.946136 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:19.946110 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8db98"] May 28 17:19:19.948952 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:19.948920 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1e854b_0ab8_4711_af22_a836b7033493.slice/crio-d640739db10b6c770062f944ae178ee2c8ceabb6de7ce590ffc1df45e84bf3ff WatchSource:0}: Error finding container d640739db10b6c770062f944ae178ee2c8ceabb6de7ce590ffc1df45e84bf3ff: Status 404 returned error can't find the container with id d640739db10b6c770062f944ae178ee2c8ceabb6de7ce590ffc1df45e84bf3ff May 28 17:19:20.038720 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:20.038673 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vmw4" event={"ID":"5ee06866-a35b-4f01-ac3e-4340adc202f0","Type":"ContainerStarted","Data":"6c41e65774fa326ded4cc65f7cd1b7e4ea9d6273f54706da9fe55a73fdafa52a"} May 28 17:19:20.040273 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:20.040233 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" event={"ID":"da1e854b-0ab8-4711-af22-a836b7033493","Type":"ContainerStarted","Data":"2493468bf9cdaa484f07ed2b1a43ce077bd1699f6b47e03123f31e5c93af3887"} May 28 17:19:20.040360 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:20.040274 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" event={"ID":"da1e854b-0ab8-4711-af22-a836b7033493","Type":"ContainerStarted","Data":"d640739db10b6c770062f944ae178ee2c8ceabb6de7ce590ffc1df45e84bf3ff"} May 28 17:19:20.042097 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:20.042060 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" event={"ID":"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9","Type":"ContainerStarted","Data":"f1f6098f0f3c9894546ee33d2ea5ea51a6cfe133d11aed9cf1b16d7347e4c3be"} May 28 17:19:21.047137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:21.047049 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" event={"ID":"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9","Type":"ContainerStarted","Data":"d9f29cd270ceda1e456abce7cc57286ef20a9e0c616c5bbe78595971314a39ad"} May 28 17:19:21.048449 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:21.048421 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vmw4" event={"ID":"5ee06866-a35b-4f01-ac3e-4340adc202f0","Type":"ContainerStarted","Data":"643aa2f4ab74107283d2f9dc6883cd1134e1ddc0110d67248ed60f2453990e12"} May 28 17:19:21.050143 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:21.050120 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" event={"ID":"da1e854b-0ab8-4711-af22-a836b7033493","Type":"ContainerStarted","Data":"e63f0e15c611b64752dce989e301d11fa64324749b99fea72420c2e2591d86fd"} May 28 17:19:22.053662 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:22.053629 2577 generic.go:358] "Generic (PLEG): container finished" podID="5ee06866-a35b-4f01-ac3e-4340adc202f0" containerID="643aa2f4ab74107283d2f9dc6883cd1134e1ddc0110d67248ed60f2453990e12" exitCode=0 May 28 17:19:22.054086 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:22.053698 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vmw4" event={"ID":"5ee06866-a35b-4f01-ac3e-4340adc202f0","Type":"ContainerDied","Data":"643aa2f4ab74107283d2f9dc6883cd1134e1ddc0110d67248ed60f2453990e12"} May 28 17:19:22.055817 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:22.055786 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" event={"ID":"da1e854b-0ab8-4711-af22-a836b7033493","Type":"ContainerStarted","Data":"9aadadf38b07894599d3359d9045b0efb97d2ab3ff4d187d6bcc5913eeb22d0c"} May 28 17:19:22.057646 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:22.057621 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" event={"ID":"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9","Type":"ContainerStarted","Data":"a2d02c7c63b47439064de3c08825e9182536bdf2dee0628598427418aee28660"} May 28 17:19:22.057726 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:22.057651 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" event={"ID":"c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9","Type":"ContainerStarted","Data":"2fbc004eb8cbc91371cd959eaf3e414d4ea488c944f1efec0d086a9fbcc70746"} May 28 17:19:22.100215 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:22.100174 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pqhg5" podStartSLOduration=2.646251733 podStartE2EDuration="4.100160265s" podCreationTimestamp="2026-05-28 17:19:18 +0000 UTC" firstStartedPulling="2026-05-28 17:19:19.319600879 +0000 UTC m=+82.233493690" lastFinishedPulling="2026-05-28 17:19:20.7735094 +0000 UTC m=+83.687402222" observedRunningTime="2026-05-28 17:19:22.09901785 +0000 UTC m=+85.012910680" watchObservedRunningTime="2026-05-28 17:19:22.100160265 +0000 UTC m=+85.014053088" May 28 17:19:22.118754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:22.118681 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8db98" podStartSLOduration=3.13289848 podStartE2EDuration="4.118664288s" podCreationTimestamp="2026-05-28 17:19:18 +0000 UTC" firstStartedPulling="2026-05-28 17:19:20.100375626 +0000 UTC m=+83.014268443" lastFinishedPulling="2026-05-28 17:19:21.086141255 +0000 UTC m=+84.000034251" observedRunningTime="2026-05-28 17:19:22.118369115 +0000 UTC m=+85.032261946" watchObservedRunningTime="2026-05-28 17:19:22.118664288 +0000 UTC m=+85.032557119" May 28 17:19:23.061934 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.061893 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vmw4" event={"ID":"5ee06866-a35b-4f01-ac3e-4340adc202f0","Type":"ContainerStarted","Data":"6e24bfbf7fc491cf0286d49cd80b9ba71de8c1e4007445d04af90099a6d47e59"} May 28 17:19:23.061934 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.061939 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vmw4" event={"ID":"5ee06866-a35b-4f01-ac3e-4340adc202f0","Type":"ContainerStarted","Data":"882d042777f4026bd9d0bd3f26d4ed788d6fb32b8825b24afbc66fcb6580f2ba"} May 28 17:19:23.085649 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.085582 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2vmw4" podStartSLOduration=4.127937273 podStartE2EDuration="5.08556551s" podCreationTimestamp="2026-05-28 17:19:18 +0000 UTC" firstStartedPulling="2026-05-28 17:19:19.81873956 +0000 UTC m=+82.732632382" lastFinishedPulling="2026-05-28 17:19:20.776367802 +0000 UTC m=+83.690260619" observedRunningTime="2026-05-28 17:19:23.085092313 +0000 UTC m=+85.998985154" watchObservedRunningTime="2026-05-28 17:19:23.08556551 +0000 UTC m=+85.999458341" May 28 17:19:23.665094 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.665059 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-87888bb75-nhmh5"] May 28 17:19:23.695348 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.695320 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87888bb75-nhmh5"] May 28 17:19:23.695487 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.695428 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.833682 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.833646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-serving-cert\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.833831 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.833691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n5q7\" (UniqueName: \"kubernetes.io/projected/f13e3af1-734e-4530-a487-6d5aefd2d4d7-kube-api-access-2n5q7\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.833831 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.833745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-oauth-config\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.833831 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.833792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-trusted-ca-bundle\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.833831 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.833813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-config\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.834017 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.833838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-oauth-serving-cert\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.834017 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.833856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-service-ca\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.934949 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.934847 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-oauth-serving-cert\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.934949 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.934902 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-service-ca\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.934949 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.934942 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-serving-cert\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.935293 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.934970 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n5q7\" (UniqueName: \"kubernetes.io/projected/f13e3af1-734e-4530-a487-6d5aefd2d4d7-kube-api-access-2n5q7\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.935293 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.935000 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-oauth-config\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.935293 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.935033 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-trusted-ca-bundle\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.935293 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.935064 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-config\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.935718 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.935691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-service-ca\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.935804 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.935716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-oauth-serving-cert\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.935804 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.935694 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-config\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.936497 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.936449 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-trusted-ca-bundle\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.938315 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.938271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-oauth-config\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.938315 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.938301 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-serving-cert\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:23.945059 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:23.945021 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n5q7\" (UniqueName: \"kubernetes.io/projected/f13e3af1-734e-4530-a487-6d5aefd2d4d7-kube-api-access-2n5q7\") pod \"console-87888bb75-nhmh5\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:24.004076 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:24.004048 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:24.133438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:24.133396 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87888bb75-nhmh5"] May 28 17:19:24.136774 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:19:24.136745 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13e3af1_734e_4530_a487_6d5aefd2d4d7.slice/crio-687802dd0b6ba6c8fd40a59012276129e2e5883b3d4f2d8fa7937121a583b33a WatchSource:0}: Error finding container 687802dd0b6ba6c8fd40a59012276129e2e5883b3d4f2d8fa7937121a583b33a: Status 404 returned error can't find the container with id 687802dd0b6ba6c8fd40a59012276129e2e5883b3d4f2d8fa7937121a583b33a May 28 17:19:25.069007 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:25.068975 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87888bb75-nhmh5" event={"ID":"f13e3af1-734e-4530-a487-6d5aefd2d4d7","Type":"ContainerStarted","Data":"f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2"} May 28 17:19:25.069167 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:25.069016 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87888bb75-nhmh5" event={"ID":"f13e3af1-734e-4530-a487-6d5aefd2d4d7","Type":"ContainerStarted","Data":"687802dd0b6ba6c8fd40a59012276129e2e5883b3d4f2d8fa7937121a583b33a"} May 28 17:19:25.090685 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:25.090637 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-87888bb75-nhmh5" podStartSLOduration=2.090621929 podStartE2EDuration="2.090621929s" podCreationTimestamp="2026-05-28 17:19:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:19:25.089009211 +0000 UTC m=+88.002902041" watchObservedRunningTime="2026-05-28 17:19:25.090621929 +0000 UTC m=+88.004514758" May 28 17:19:34.004967 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:34.004932 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:34.004967 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:34.004975 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:34.009683 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:34.009661 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:34.095923 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:34.095897 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:19:34.143800 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:34.143772 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cdd5b7cd-ccs8b"] May 28 17:19:35.098951 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.098918 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7564f7fb54-6sgm8" podUID="2e41dfdf-b929-4f0a-91a4-dc062b348de3" containerName="console" containerID="cri-o://a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3" gracePeriod=15 May 28 17:19:35.341725 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.341705 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7564f7fb54-6sgm8_2e41dfdf-b929-4f0a-91a4-dc062b348de3/console/0.log" May 28 17:19:35.341835 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.341774 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:19:35.422766 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.422686 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-service-ca\") pod \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " May 28 17:19:35.422766 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.422742 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-oauth-serving-cert\") pod \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " May 28 17:19:35.422972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.422778 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2clm\" (UniqueName: \"kubernetes.io/projected/2e41dfdf-b929-4f0a-91a4-dc062b348de3-kube-api-access-j2clm\") pod \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " May 28 17:19:35.422972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.422832 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-config\") pod \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " May 28 17:19:35.422972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.422856 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-serving-cert\") pod \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " May 28 17:19:35.422972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.422884 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-oauth-config\") pod \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\" (UID: \"2e41dfdf-b929-4f0a-91a4-dc062b348de3\") " May 28 17:19:35.423146 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.423116 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e41dfdf-b929-4f0a-91a4-dc062b348de3" (UID: "2e41dfdf-b929-4f0a-91a4-dc062b348de3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:35.423213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.423192 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-config" (OuterVolumeSpecName: "console-config") pod "2e41dfdf-b929-4f0a-91a4-dc062b348de3" (UID: "2e41dfdf-b929-4f0a-91a4-dc062b348de3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:35.423256 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.423206 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e41dfdf-b929-4f0a-91a4-dc062b348de3" (UID: "2e41dfdf-b929-4f0a-91a4-dc062b348de3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:35.425389 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.425364 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e41dfdf-b929-4f0a-91a4-dc062b348de3" (UID: "2e41dfdf-b929-4f0a-91a4-dc062b348de3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:35.425389 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.425377 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e41dfdf-b929-4f0a-91a4-dc062b348de3-kube-api-access-j2clm" (OuterVolumeSpecName: "kube-api-access-j2clm") pod "2e41dfdf-b929-4f0a-91a4-dc062b348de3" (UID: "2e41dfdf-b929-4f0a-91a4-dc062b348de3"). InnerVolumeSpecName "kube-api-access-j2clm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:19:35.425533 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.425428 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e41dfdf-b929-4f0a-91a4-dc062b348de3" (UID: "2e41dfdf-b929-4f0a-91a4-dc062b348de3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:35.524044 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.524006 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2clm\" (UniqueName: \"kubernetes.io/projected/2e41dfdf-b929-4f0a-91a4-dc062b348de3-kube-api-access-j2clm\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:35.524044 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.524042 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:35.524044 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.524053 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:35.524234 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.524062 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e41dfdf-b929-4f0a-91a4-dc062b348de3-console-oauth-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:35.524234 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.524071 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-service-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:35.524234 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:35.524079 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e41dfdf-b929-4f0a-91a4-dc062b348de3-oauth-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:36.101928 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.101902 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7564f7fb54-6sgm8_2e41dfdf-b929-4f0a-91a4-dc062b348de3/console/0.log" May 28 17:19:36.102381 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.101941 2577 generic.go:358] "Generic (PLEG): container finished" podID="2e41dfdf-b929-4f0a-91a4-dc062b348de3" containerID="a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3" exitCode=2 May 28 17:19:36.102381 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.102010 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7564f7fb54-6sgm8" May 28 17:19:36.102381 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.102011 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7564f7fb54-6sgm8" event={"ID":"2e41dfdf-b929-4f0a-91a4-dc062b348de3","Type":"ContainerDied","Data":"a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3"} May 28 17:19:36.102381 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.102139 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7564f7fb54-6sgm8" event={"ID":"2e41dfdf-b929-4f0a-91a4-dc062b348de3","Type":"ContainerDied","Data":"a25f4e2661b1598d954cc50860279a071e189b32b6c8b206d6dbafd21d26c39c"} May 28 17:19:36.102381 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.102174 2577 scope.go:117] "RemoveContainer" containerID="a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3" May 28 17:19:36.110024 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.110009 2577 scope.go:117] "RemoveContainer" containerID="a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3" May 28 17:19:36.110280 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:19:36.110260 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3\": container with ID starting with a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3 not found: ID does not exist" containerID="a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3" May 28 17:19:36.110350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.110288 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3"} err="failed to get container status \"a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3\": rpc error: code = NotFound desc = could not find container \"a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3\": container with ID starting with a09c43c088a814c32869a641a058240e1d1c594a36d6c873971aab72ebd39ab3 not found: ID does not exist" May 28 17:19:36.120396 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.120356 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7564f7fb54-6sgm8"] May 28 17:19:36.125309 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:36.125288 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7564f7fb54-6sgm8"] May 28 17:19:37.726784 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:37.726753 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e41dfdf-b929-4f0a-91a4-dc062b348de3" path="/var/lib/kubelet/pods/2e41dfdf-b929-4f0a-91a4-dc062b348de3/volumes" May 28 17:19:39.007521 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:39.007485 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ncjj5" May 28 17:19:59.162744 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.162666 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65cdd5b7cd-ccs8b" podUID="1ef2267a-2aad-4a39-82a8-554e0ac11541" containerName="console" containerID="cri-o://f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553" gracePeriod=15 May 28 17:19:59.429904 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.429883 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65cdd5b7cd-ccs8b_1ef2267a-2aad-4a39-82a8-554e0ac11541/console/0.log" May 28 17:19:59.430006 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.429943 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:19:59.606635 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.606606 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-oauth-config\") pod \"1ef2267a-2aad-4a39-82a8-554e0ac11541\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " May 28 17:19:59.606809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.606642 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-service-ca\") pod \"1ef2267a-2aad-4a39-82a8-554e0ac11541\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " May 28 17:19:59.606809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.606679 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-config\") pod \"1ef2267a-2aad-4a39-82a8-554e0ac11541\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " May 28 17:19:59.606809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.606737 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-serving-cert\") pod \"1ef2267a-2aad-4a39-82a8-554e0ac11541\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " May 28 17:19:59.606809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.606777 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-trusted-ca-bundle\") pod \"1ef2267a-2aad-4a39-82a8-554e0ac11541\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " May 28 17:19:59.607007 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.606808 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k44rc\" (UniqueName: \"kubernetes.io/projected/1ef2267a-2aad-4a39-82a8-554e0ac11541-kube-api-access-k44rc\") pod \"1ef2267a-2aad-4a39-82a8-554e0ac11541\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " May 28 17:19:59.607007 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.606851 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-oauth-serving-cert\") pod \"1ef2267a-2aad-4a39-82a8-554e0ac11541\" (UID: \"1ef2267a-2aad-4a39-82a8-554e0ac11541\") " May 28 17:19:59.607101 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.607052 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-config" (OuterVolumeSpecName: "console-config") pod "1ef2267a-2aad-4a39-82a8-554e0ac11541" (UID: "1ef2267a-2aad-4a39-82a8-554e0ac11541"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:59.607101 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.607066 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ef2267a-2aad-4a39-82a8-554e0ac11541" (UID: "1ef2267a-2aad-4a39-82a8-554e0ac11541"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:59.607205 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.607108 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1ef2267a-2aad-4a39-82a8-554e0ac11541" (UID: "1ef2267a-2aad-4a39-82a8-554e0ac11541"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:59.607471 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.607293 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ef2267a-2aad-4a39-82a8-554e0ac11541" (UID: "1ef2267a-2aad-4a39-82a8-554e0ac11541"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:19:59.609331 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.609306 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ef2267a-2aad-4a39-82a8-554e0ac11541" (UID: "1ef2267a-2aad-4a39-82a8-554e0ac11541"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:59.609695 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.609669 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef2267a-2aad-4a39-82a8-554e0ac11541-kube-api-access-k44rc" (OuterVolumeSpecName: "kube-api-access-k44rc") pod "1ef2267a-2aad-4a39-82a8-554e0ac11541" (UID: "1ef2267a-2aad-4a39-82a8-554e0ac11541"). InnerVolumeSpecName "kube-api-access-k44rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:19:59.609792 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.609702 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ef2267a-2aad-4a39-82a8-554e0ac11541" (UID: "1ef2267a-2aad-4a39-82a8-554e0ac11541"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:19:59.708172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.708101 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:59.708172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.708128 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:59.708172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.708138 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:59.708172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.708147 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k44rc\" (UniqueName: \"kubernetes.io/projected/1ef2267a-2aad-4a39-82a8-554e0ac11541-kube-api-access-k44rc\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:59.708172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.708156 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-oauth-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:59.708172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.708165 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ef2267a-2aad-4a39-82a8-554e0ac11541-console-oauth-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:19:59.708172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:19:59.708173 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef2267a-2aad-4a39-82a8-554e0ac11541-service-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:20:00.168802 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.168778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65cdd5b7cd-ccs8b_1ef2267a-2aad-4a39-82a8-554e0ac11541/console/0.log" May 28 17:20:00.169194 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.168819 2577 generic.go:358] "Generic (PLEG): container finished" podID="1ef2267a-2aad-4a39-82a8-554e0ac11541" containerID="f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553" exitCode=2 May 28 17:20:00.169194 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.168892 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cdd5b7cd-ccs8b" event={"ID":"1ef2267a-2aad-4a39-82a8-554e0ac11541","Type":"ContainerDied","Data":"f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553"} May 28 17:20:00.169194 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.168920 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cdd5b7cd-ccs8b" event={"ID":"1ef2267a-2aad-4a39-82a8-554e0ac11541","Type":"ContainerDied","Data":"9c786a94735803a420b5b455f97b1d6bc81dce4150fc86b7f10af8cf1303f1cf"} May 28 17:20:00.169194 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.168935 2577 scope.go:117] "RemoveContainer" containerID="f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553" May 28 17:20:00.169194 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.168895 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cdd5b7cd-ccs8b" May 28 17:20:00.178389 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.177473 2577 scope.go:117] "RemoveContainer" containerID="f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553" May 28 17:20:00.178777 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:20:00.178748 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553\": container with ID starting with f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553 not found: ID does not exist" containerID="f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553" May 28 17:20:00.178853 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.178788 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553"} err="failed to get container status \"f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553\": rpc error: code = NotFound desc = could not find container \"f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553\": container with ID starting with f46eb7cdbce0177c4d315582f020b39c6a3caf969716169f0d0b79891c06b553 not found: ID does not exist" May 28 17:20:00.188788 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.188757 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cdd5b7cd-ccs8b"] May 28 17:20:00.193471 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:00.193436 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65cdd5b7cd-ccs8b"] May 28 17:20:01.728080 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:01.728044 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef2267a-2aad-4a39-82a8-554e0ac11541" path="/var/lib/kubelet/pods/1ef2267a-2aad-4a39-82a8-554e0ac11541/volumes" May 28 17:20:43.329253 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.329163 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bb54c69c5-7cp8s"] May 28 17:20:43.329746 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.329511 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e41dfdf-b929-4f0a-91a4-dc062b348de3" containerName="console" May 28 17:20:43.329746 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.329528 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e41dfdf-b929-4f0a-91a4-dc062b348de3" containerName="console" May 28 17:20:43.329746 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.329556 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef2267a-2aad-4a39-82a8-554e0ac11541" containerName="console" May 28 17:20:43.329746 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.329565 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef2267a-2aad-4a39-82a8-554e0ac11541" containerName="console" May 28 17:20:43.329746 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.329611 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e41dfdf-b929-4f0a-91a4-dc062b348de3" containerName="console" May 28 17:20:43.329746 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.329623 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ef2267a-2aad-4a39-82a8-554e0ac11541" containerName="console" May 28 17:20:43.331988 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.331973 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.334780 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.334757 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 28 17:20:43.334907 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.334781 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 28 17:20:43.334907 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.334838 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 28 17:20:43.335096 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.335068 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 28 17:20:43.335299 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.335281 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p5d46\"" May 28 17:20:43.335399 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.335301 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 28 17:20:43.340905 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.340875 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 28 17:20:43.346162 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.346136 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb54c69c5-7cp8s"] May 28 17:20:43.412787 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-federate-client-tls\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.412940 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-telemeter-client-tls\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.412940 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-metrics-client-ca\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.412940 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwnbp\" (UniqueName: \"kubernetes.io/projected/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-kube-api-access-xwnbp\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.412940 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-serving-certs-ca-bundle\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.412940 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.412940 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.413138 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.412951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-secret-telemeter-client\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.513665 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513627 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-serving-certs-ca-bundle\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.513767 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513678 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.513767 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513704 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.513767 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513725 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-secret-telemeter-client\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.513767 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513743 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-federate-client-tls\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.513767 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513760 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-telemeter-client-tls\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.514007 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513782 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-metrics-client-ca\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.514007 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.513821 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwnbp\" (UniqueName: \"kubernetes.io/projected/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-kube-api-access-xwnbp\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.514481 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.514432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-serving-certs-ca-bundle\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.514639 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.514537 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-metrics-client-ca\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.514881 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.514858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.516421 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.516392 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-federate-client-tls\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.516563 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.516540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-secret-telemeter-client\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.516616 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.516597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.516670 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.516653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-telemeter-client-tls\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.523871 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.523850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwnbp\" (UniqueName: \"kubernetes.io/projected/7de4920e-5dee-4768-9ef1-c02e4bc0c20f-kube-api-access-xwnbp\") pod \"telemeter-client-bb54c69c5-7cp8s\" (UID: \"7de4920e-5dee-4768-9ef1-c02e4bc0c20f\") " pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.643059 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.642991 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" May 28 17:20:43.774208 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:43.774181 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb54c69c5-7cp8s"] May 28 17:20:43.775946 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:20:43.775919 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de4920e_5dee_4768_9ef1_c02e4bc0c20f.slice/crio-b27850a675411c16447db7fcd3bd748a3d4b5f308e302e2355ce286b82fbeb6f WatchSource:0}: Error finding container b27850a675411c16447db7fcd3bd748a3d4b5f308e302e2355ce286b82fbeb6f: Status 404 returned error can't find the container with id b27850a675411c16447db7fcd3bd748a3d4b5f308e302e2355ce286b82fbeb6f May 28 17:20:44.283077 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:44.283046 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" event={"ID":"7de4920e-5dee-4768-9ef1-c02e4bc0c20f","Type":"ContainerStarted","Data":"b27850a675411c16447db7fcd3bd748a3d4b5f308e302e2355ce286b82fbeb6f"} May 28 17:20:47.291833 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:47.291796 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" event={"ID":"7de4920e-5dee-4768-9ef1-c02e4bc0c20f","Type":"ContainerStarted","Data":"bb8f8989982f2f43a527b08cb15b3259195ab38bdc94ccd75bf3702643985e08"} May 28 17:20:48.296056 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:48.295970 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" event={"ID":"7de4920e-5dee-4768-9ef1-c02e4bc0c20f","Type":"ContainerStarted","Data":"67d3daa7b7bb3e96f913424e2d8abdc56a943d3d15f25300c28675e79caea0cf"} May 28 17:20:48.296056 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:48.296006 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" event={"ID":"7de4920e-5dee-4768-9ef1-c02e4bc0c20f","Type":"ContainerStarted","Data":"e6b6e447c39f40aad84de7ac926c535ff3cb3420592b7a4c0b54669dafac4dc6"} May 28 17:20:48.321985 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:48.321938 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bb54c69c5-7cp8s" podStartSLOduration=1.068114573 podStartE2EDuration="5.321926629s" podCreationTimestamp="2026-05-28 17:20:43 +0000 UTC" firstStartedPulling="2026-05-28 17:20:43.777607291 +0000 UTC m=+166.691500099" lastFinishedPulling="2026-05-28 17:20:48.03141933 +0000 UTC m=+170.945312155" observedRunningTime="2026-05-28 17:20:48.320234347 +0000 UTC m=+171.234127177" watchObservedRunningTime="2026-05-28 17:20:48.321926629 +0000 UTC m=+171.235819497" May 28 17:20:49.105481 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.105430 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8c64f4d-n6hwm"] May 28 17:20:49.108534 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.108512 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.118866 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.118841 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8c64f4d-n6hwm"] May 28 17:20:49.155654 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.155624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-oauth-config\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.155782 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.155661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-service-ca\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.155782 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.155691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lgpd\" (UniqueName: \"kubernetes.io/projected/da2cd1a2-7db4-4722-af84-2690f1879704-kube-api-access-4lgpd\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.155782 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.155763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-console-config\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.155885 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.155807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-trusted-ca-bundle\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.155885 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.155879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-oauth-serving-cert\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.155941 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.155921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-serving-cert\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.256931 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.256897 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-serving-cert\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.256942 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-oauth-config\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.256958 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-service-ca\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.256977 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lgpd\" (UniqueName: \"kubernetes.io/projected/da2cd1a2-7db4-4722-af84-2690f1879704-kube-api-access-4lgpd\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.257003 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-console-config\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.257042 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-trusted-ca-bundle\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257342 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.257104 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-oauth-serving-cert\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257819 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.257795 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-console-config\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257905 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.257804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-oauth-serving-cert\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.257905 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.257859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-service-ca\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.258630 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.258607 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-trusted-ca-bundle\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.259546 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.259527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-oauth-config\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.259760 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.259745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-serving-cert\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.267928 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.267911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lgpd\" (UniqueName: \"kubernetes.io/projected/da2cd1a2-7db4-4722-af84-2690f1879704-kube-api-access-4lgpd\") pod \"console-6b8c64f4d-n6hwm\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.417191 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.417111 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:20:49.545946 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:49.544773 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8c64f4d-n6hwm"] May 28 17:20:50.303292 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:50.303257 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8c64f4d-n6hwm" event={"ID":"da2cd1a2-7db4-4722-af84-2690f1879704","Type":"ContainerStarted","Data":"de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d"} May 28 17:20:50.303292 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:50.303293 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8c64f4d-n6hwm" event={"ID":"da2cd1a2-7db4-4722-af84-2690f1879704","Type":"ContainerStarted","Data":"04c547b44b23d44716649c6cb710ab55ec4579c64374522fc6e4a137f7bf1e05"} May 28 17:20:50.324339 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:50.324297 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b8c64f4d-n6hwm" podStartSLOduration=1.324284472 podStartE2EDuration="1.324284472s" podCreationTimestamp="2026-05-28 17:20:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:50.322390739 +0000 UTC m=+173.236283570" watchObservedRunningTime="2026-05-28 17:20:50.324284472 +0000 UTC m=+173.238177303" May 28 17:20:58.346990 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.346957 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8c64f4d-n6hwm"] May 28 17:20:58.379216 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.379186 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd9bb848-cf2qd"] May 28 17:20:58.383679 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.383656 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.393430 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.393405 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd9bb848-cf2qd"] May 28 17:20:58.531159 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.531130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-trusted-ca-bundle\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.531159 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.531163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-oauth-serving-cert\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.531343 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.531188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-config\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.531343 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.531247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-oauth-config\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.531343 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.531298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-serving-cert\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.531343 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.531322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-service-ca\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.531343 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.531339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq4nc\" (UniqueName: \"kubernetes.io/projected/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-kube-api-access-vq4nc\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.632513 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.632429 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-oauth-serving-cert\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.632513 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.632485 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-config\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.632513 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.632513 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-oauth-config\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.632749 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.632546 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-serving-cert\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.632749 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.632568 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-service-ca\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.632749 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.632585 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq4nc\" (UniqueName: \"kubernetes.io/projected/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-kube-api-access-vq4nc\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.632749 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.632617 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-trusted-ca-bundle\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.633238 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.633195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-service-ca\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.633337 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.633316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-config\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.633423 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.633401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-oauth-serving-cert\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.633527 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.633512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-trusted-ca-bundle\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.634943 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.634924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-oauth-config\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.635157 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.635139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-serving-cert\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.641906 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.641885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq4nc\" (UniqueName: \"kubernetes.io/projected/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-kube-api-access-vq4nc\") pod \"console-5bd9bb848-cf2qd\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.692439 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.692416 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:20:58.816958 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:58.816921 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd9bb848-cf2qd"] May 28 17:20:58.819945 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:20:58.819921 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64ff2b0_2eae_4452_ac96_e002a66ec9f4.slice/crio-231ae29d9bc3ef49a49c3b3ef721c8474792ab4422aba1168a21e55d1b5416f4 WatchSource:0}: Error finding container 231ae29d9bc3ef49a49c3b3ef721c8474792ab4422aba1168a21e55d1b5416f4: Status 404 returned error can't find the container with id 231ae29d9bc3ef49a49c3b3ef721c8474792ab4422aba1168a21e55d1b5416f4 May 28 17:20:59.330680 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:59.330634 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd9bb848-cf2qd" event={"ID":"f64ff2b0-2eae-4452-ac96-e002a66ec9f4","Type":"ContainerStarted","Data":"ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693"} May 28 17:20:59.330680 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:59.330677 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd9bb848-cf2qd" event={"ID":"f64ff2b0-2eae-4452-ac96-e002a66ec9f4","Type":"ContainerStarted","Data":"231ae29d9bc3ef49a49c3b3ef721c8474792ab4422aba1168a21e55d1b5416f4"} May 28 17:20:59.349298 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:59.349243 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5bd9bb848-cf2qd" podStartSLOduration=1.349227929 podStartE2EDuration="1.349227929s" podCreationTimestamp="2026-05-28 17:20:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:59.34898776 +0000 UTC m=+182.262880590" watchObservedRunningTime="2026-05-28 17:20:59.349227929 +0000 UTC m=+182.263120760" May 28 17:20:59.418212 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:20:59.418185 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:21:08.693566 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:08.693519 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:21:08.693965 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:08.693620 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:21:08.698205 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:08.698186 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:21:09.361246 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:09.361221 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:21:09.417577 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:09.417544 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87888bb75-nhmh5"] May 28 17:21:23.366050 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.365987 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b8c64f4d-n6hwm" podUID="da2cd1a2-7db4-4722-af84-2690f1879704" containerName="console" containerID="cri-o://de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d" gracePeriod=15 May 28 17:21:23.604355 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.604336 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b8c64f4d-n6hwm_da2cd1a2-7db4-4722-af84-2690f1879704/console/0.log" May 28 17:21:23.604479 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.604398 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:21:23.620952 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.620896 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-trusted-ca-bundle\") pod \"da2cd1a2-7db4-4722-af84-2690f1879704\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " May 28 17:21:23.620952 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.620932 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-console-config\") pod \"da2cd1a2-7db4-4722-af84-2690f1879704\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " May 28 17:21:23.621079 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.620968 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-service-ca\") pod \"da2cd1a2-7db4-4722-af84-2690f1879704\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " May 28 17:21:23.621079 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.620994 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-oauth-serving-cert\") pod \"da2cd1a2-7db4-4722-af84-2690f1879704\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " May 28 17:21:23.621079 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.621036 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-oauth-config\") pod \"da2cd1a2-7db4-4722-af84-2690f1879704\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " May 28 17:21:23.621079 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.621071 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-serving-cert\") pod \"da2cd1a2-7db4-4722-af84-2690f1879704\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " May 28 17:21:23.621236 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.621117 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lgpd\" (UniqueName: \"kubernetes.io/projected/da2cd1a2-7db4-4722-af84-2690f1879704-kube-api-access-4lgpd\") pod \"da2cd1a2-7db4-4722-af84-2690f1879704\" (UID: \"da2cd1a2-7db4-4722-af84-2690f1879704\") " May 28 17:21:23.621314 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.621275 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da2cd1a2-7db4-4722-af84-2690f1879704" (UID: "da2cd1a2-7db4-4722-af84-2690f1879704"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:23.621417 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.621368 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-service-ca" (OuterVolumeSpecName: "service-ca") pod "da2cd1a2-7db4-4722-af84-2690f1879704" (UID: "da2cd1a2-7db4-4722-af84-2690f1879704"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:23.621417 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.621374 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da2cd1a2-7db4-4722-af84-2690f1879704" (UID: "da2cd1a2-7db4-4722-af84-2690f1879704"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:23.621643 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.621625 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-console-config" (OuterVolumeSpecName: "console-config") pod "da2cd1a2-7db4-4722-af84-2690f1879704" (UID: "da2cd1a2-7db4-4722-af84-2690f1879704"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:23.623226 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.623198 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da2cd1a2-7db4-4722-af84-2690f1879704" (UID: "da2cd1a2-7db4-4722-af84-2690f1879704"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:21:23.623311 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.623248 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da2cd1a2-7db4-4722-af84-2690f1879704" (UID: "da2cd1a2-7db4-4722-af84-2690f1879704"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:21:23.623311 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.623266 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2cd1a2-7db4-4722-af84-2690f1879704-kube-api-access-4lgpd" (OuterVolumeSpecName: "kube-api-access-4lgpd") pod "da2cd1a2-7db4-4722-af84-2690f1879704" (UID: "da2cd1a2-7db4-4722-af84-2690f1879704"). InnerVolumeSpecName "kube-api-access-4lgpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:21:23.722661 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.722633 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:23.722661 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.722658 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-console-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:23.722808 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.722669 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-service-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:23.722808 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.722677 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2cd1a2-7db4-4722-af84-2690f1879704-oauth-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:23.722808 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.722687 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-oauth-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:23.722808 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.722696 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2cd1a2-7db4-4722-af84-2690f1879704-console-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:23.722808 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:23.722704 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lgpd\" (UniqueName: \"kubernetes.io/projected/da2cd1a2-7db4-4722-af84-2690f1879704-kube-api-access-4lgpd\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:24.402203 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.402176 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b8c64f4d-n6hwm_da2cd1a2-7db4-4722-af84-2690f1879704/console/0.log" May 28 17:21:24.402608 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.402216 2577 generic.go:358] "Generic (PLEG): container finished" podID="da2cd1a2-7db4-4722-af84-2690f1879704" containerID="de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d" exitCode=2 May 28 17:21:24.402608 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.402255 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8c64f4d-n6hwm" event={"ID":"da2cd1a2-7db4-4722-af84-2690f1879704","Type":"ContainerDied","Data":"de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d"} May 28 17:21:24.402608 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.402277 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8c64f4d-n6hwm" event={"ID":"da2cd1a2-7db4-4722-af84-2690f1879704","Type":"ContainerDied","Data":"04c547b44b23d44716649c6cb710ab55ec4579c64374522fc6e4a137f7bf1e05"} May 28 17:21:24.402608 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.402286 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8c64f4d-n6hwm" May 28 17:21:24.402608 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.402290 2577 scope.go:117] "RemoveContainer" containerID="de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d" May 28 17:21:24.409782 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.409763 2577 scope.go:117] "RemoveContainer" containerID="de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d" May 28 17:21:24.410044 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:21:24.410018 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d\": container with ID starting with de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d not found: ID does not exist" containerID="de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d" May 28 17:21:24.410088 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.410053 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d"} err="failed to get container status \"de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d\": rpc error: code = NotFound desc = could not find container \"de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d\": container with ID starting with de1cd3e3b216b95c8e4318072fea7f3975f0e71450ed746c8e07a8d998526b6d not found: ID does not exist" May 28 17:21:24.421977 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.421957 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8c64f4d-n6hwm"] May 28 17:21:24.426679 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:24.426659 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b8c64f4d-n6hwm"] May 28 17:21:25.726950 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:25.726918 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2cd1a2-7db4-4722-af84-2690f1879704" path="/var/lib/kubelet/pods/da2cd1a2-7db4-4722-af84-2690f1879704/volumes" May 28 17:21:34.436289 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.436229 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-87888bb75-nhmh5" podUID="f13e3af1-734e-4530-a487-6d5aefd2d4d7" containerName="console" containerID="cri-o://f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2" gracePeriod=15 May 28 17:21:34.685033 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.685013 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-87888bb75-nhmh5_f13e3af1-734e-4530-a487-6d5aefd2d4d7/console/0.log" May 28 17:21:34.685147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.685074 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:21:34.698250 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698207 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n5q7\" (UniqueName: \"kubernetes.io/projected/f13e3af1-734e-4530-a487-6d5aefd2d4d7-kube-api-access-2n5q7\") pod \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " May 28 17:21:34.698250 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698241 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-serving-cert\") pod \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " May 28 17:21:34.698342 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698257 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-oauth-config\") pod \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " May 28 17:21:34.698342 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698276 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-service-ca\") pod \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " May 28 17:21:34.698446 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698425 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-trusted-ca-bundle\") pod \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " May 28 17:21:34.698544 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698528 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-config\") pod \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " May 28 17:21:34.698615 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698599 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-oauth-serving-cert\") pod \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\" (UID: \"f13e3af1-734e-4530-a487-6d5aefd2d4d7\") " May 28 17:21:34.698615 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698603 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "f13e3af1-734e-4530-a487-6d5aefd2d4d7" (UID: "f13e3af1-734e-4530-a487-6d5aefd2d4d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:34.698846 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698829 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-service-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:34.698846 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698831 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f13e3af1-734e-4530-a487-6d5aefd2d4d7" (UID: "f13e3af1-734e-4530-a487-6d5aefd2d4d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:34.698984 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.698865 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-config" (OuterVolumeSpecName: "console-config") pod "f13e3af1-734e-4530-a487-6d5aefd2d4d7" (UID: "f13e3af1-734e-4530-a487-6d5aefd2d4d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:34.699034 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.699005 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f13e3af1-734e-4530-a487-6d5aefd2d4d7" (UID: "f13e3af1-734e-4530-a487-6d5aefd2d4d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:21:34.700394 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.700363 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13e3af1-734e-4530-a487-6d5aefd2d4d7-kube-api-access-2n5q7" (OuterVolumeSpecName: "kube-api-access-2n5q7") pod "f13e3af1-734e-4530-a487-6d5aefd2d4d7" (UID: "f13e3af1-734e-4530-a487-6d5aefd2d4d7"). InnerVolumeSpecName "kube-api-access-2n5q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:21:34.700992 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.700971 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f13e3af1-734e-4530-a487-6d5aefd2d4d7" (UID: "f13e3af1-734e-4530-a487-6d5aefd2d4d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:21:34.701075 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.700990 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f13e3af1-734e-4530-a487-6d5aefd2d4d7" (UID: "f13e3af1-734e-4530-a487-6d5aefd2d4d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:21:34.799341 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.799316 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-oauth-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:34.799341 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.799339 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n5q7\" (UniqueName: \"kubernetes.io/projected/f13e3af1-734e-4530-a487-6d5aefd2d4d7-kube-api-access-2n5q7\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:34.799487 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.799349 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:34.799487 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.799358 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-oauth-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:34.799487 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.799368 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:34.799487 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:34.799376 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f13e3af1-734e-4530-a487-6d5aefd2d4d7-console-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:21:35.436098 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.436073 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-87888bb75-nhmh5_f13e3af1-734e-4530-a487-6d5aefd2d4d7/console/0.log" May 28 17:21:35.436269 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.436113 2577 generic.go:358] "Generic (PLEG): container finished" podID="f13e3af1-734e-4530-a487-6d5aefd2d4d7" containerID="f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2" exitCode=2 May 28 17:21:35.436269 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.436144 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87888bb75-nhmh5" event={"ID":"f13e3af1-734e-4530-a487-6d5aefd2d4d7","Type":"ContainerDied","Data":"f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2"} May 28 17:21:35.436269 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.436179 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87888bb75-nhmh5" event={"ID":"f13e3af1-734e-4530-a487-6d5aefd2d4d7","Type":"ContainerDied","Data":"687802dd0b6ba6c8fd40a59012276129e2e5883b3d4f2d8fa7937121a583b33a"} May 28 17:21:35.436269 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.436191 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87888bb75-nhmh5" May 28 17:21:35.436844 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.436194 2577 scope.go:117] "RemoveContainer" containerID="f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2" May 28 17:21:35.444394 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.444376 2577 scope.go:117] "RemoveContainer" containerID="f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2" May 28 17:21:35.444645 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:21:35.444628 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2\": container with ID starting with f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2 not found: ID does not exist" containerID="f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2" May 28 17:21:35.444699 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.444653 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2"} err="failed to get container status \"f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2\": rpc error: code = NotFound desc = could not find container \"f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2\": container with ID starting with f247ef06f728c3de364c2b774dce752e55b59748e433a81adb8a05afffb872f2 not found: ID does not exist" May 28 17:21:35.458911 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.458863 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87888bb75-nhmh5"] May 28 17:21:35.463889 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.463869 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-87888bb75-nhmh5"] May 28 17:21:35.726623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:35.726550 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13e3af1-734e-4530-a487-6d5aefd2d4d7" path="/var/lib/kubelet/pods/f13e3af1-734e-4530-a487-6d5aefd2d4d7/volumes" May 28 17:21:51.331165 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.331128 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx"] May 28 17:21:51.331572 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.331416 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2cd1a2-7db4-4722-af84-2690f1879704" containerName="console" May 28 17:21:51.331572 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.331428 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2cd1a2-7db4-4722-af84-2690f1879704" containerName="console" May 28 17:21:51.331572 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.331438 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13e3af1-734e-4530-a487-6d5aefd2d4d7" containerName="console" May 28 17:21:51.331572 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.331442 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13e3af1-734e-4530-a487-6d5aefd2d4d7" containerName="console" May 28 17:21:51.331572 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.331508 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="da2cd1a2-7db4-4722-af84-2690f1879704" containerName="console" May 28 17:21:51.331572 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.331519 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="f13e3af1-734e-4530-a487-6d5aefd2d4d7" containerName="console" May 28 17:21:51.334579 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.334562 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.340331 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.340308 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:21:51.341228 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.341212 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nvwt6\"" May 28 17:21:51.341579 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.341559 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:21:51.351388 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.351365 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx"] May 28 17:21:51.416526 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.416502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvb9\" (UniqueName: \"kubernetes.io/projected/8d921c20-195c-44c2-9143-c65253822ac0-kube-api-access-4cvb9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.416646 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.416537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.416646 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.416561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.517664 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.517634 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvb9\" (UniqueName: \"kubernetes.io/projected/8d921c20-195c-44c2-9143-c65253822ac0-kube-api-access-4cvb9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.517817 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.517671 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.517817 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.517693 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.518016 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.517998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.518085 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.518071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.529711 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.529686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvb9\" (UniqueName: \"kubernetes.io/projected/8d921c20-195c-44c2-9143-c65253822ac0-kube-api-access-4cvb9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.643065 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.642978 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:21:51.775653 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:51.775612 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx"] May 28 17:21:51.777757 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:21:51.777731 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d921c20_195c_44c2_9143_c65253822ac0.slice/crio-c37b10830629b173c035af1ba09df703968564cc1e9c8600737ac79dcd41448c WatchSource:0}: Error finding container c37b10830629b173c035af1ba09df703968564cc1e9c8600737ac79dcd41448c: Status 404 returned error can't find the container with id c37b10830629b173c035af1ba09df703968564cc1e9c8600737ac79dcd41448c May 28 17:21:52.482785 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:52.482748 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" event={"ID":"8d921c20-195c-44c2-9143-c65253822ac0","Type":"ContainerStarted","Data":"c37b10830629b173c035af1ba09df703968564cc1e9c8600737ac79dcd41448c"} May 28 17:21:57.497034 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:57.496944 2577 generic.go:358] "Generic (PLEG): container finished" podID="8d921c20-195c-44c2-9143-c65253822ac0" containerID="74f839537fd06c397d29f07d912f56a34f8a53563f9652574fedb4c9378c5033" exitCode=0 May 28 17:21:57.497503 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:57.497026 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" event={"ID":"8d921c20-195c-44c2-9143-c65253822ac0","Type":"ContainerDied","Data":"74f839537fd06c397d29f07d912f56a34f8a53563f9652574fedb4c9378c5033"} May 28 17:21:59.504581 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:59.504489 2577 generic.go:358] "Generic (PLEG): container finished" podID="8d921c20-195c-44c2-9143-c65253822ac0" containerID="8032bbe753d98ebf3152d228eab63495e2f4fe182101c5f0c6c921450cb26e8f" exitCode=0 May 28 17:21:59.504581 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:21:59.504529 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" event={"ID":"8d921c20-195c-44c2-9143-c65253822ac0","Type":"ContainerDied","Data":"8032bbe753d98ebf3152d228eab63495e2f4fe182101c5f0c6c921450cb26e8f"} May 28 17:22:05.523638 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:05.523607 2577 generic.go:358] "Generic (PLEG): container finished" podID="8d921c20-195c-44c2-9143-c65253822ac0" containerID="e56648a9e87770d1a33119738ec1e146c8ea24c95f56b5b3bc7eaa11f8e350e9" exitCode=0 May 28 17:22:05.523982 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:05.523653 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" event={"ID":"8d921c20-195c-44c2-9143-c65253822ac0","Type":"ContainerDied","Data":"e56648a9e87770d1a33119738ec1e146c8ea24c95f56b5b3bc7eaa11f8e350e9"} May 28 17:22:06.652590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.652565 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:22:06.743712 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.743683 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-util\") pod \"8d921c20-195c-44c2-9143-c65253822ac0\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " May 28 17:22:06.743712 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.743719 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cvb9\" (UniqueName: \"kubernetes.io/projected/8d921c20-195c-44c2-9143-c65253822ac0-kube-api-access-4cvb9\") pod \"8d921c20-195c-44c2-9143-c65253822ac0\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " May 28 17:22:06.743901 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.743754 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-bundle\") pod \"8d921c20-195c-44c2-9143-c65253822ac0\" (UID: \"8d921c20-195c-44c2-9143-c65253822ac0\") " May 28 17:22:06.744393 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.744322 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-bundle" (OuterVolumeSpecName: "bundle") pod "8d921c20-195c-44c2-9143-c65253822ac0" (UID: "8d921c20-195c-44c2-9143-c65253822ac0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:22:06.745950 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.745927 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d921c20-195c-44c2-9143-c65253822ac0-kube-api-access-4cvb9" (OuterVolumeSpecName: "kube-api-access-4cvb9") pod "8d921c20-195c-44c2-9143-c65253822ac0" (UID: "8d921c20-195c-44c2-9143-c65253822ac0"). InnerVolumeSpecName "kube-api-access-4cvb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:22:06.749316 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.749289 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-util" (OuterVolumeSpecName: "util") pod "8d921c20-195c-44c2-9143-c65253822ac0" (UID: "8d921c20-195c-44c2-9143-c65253822ac0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:22:06.845294 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.845202 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:06.845294 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.845244 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cvb9\" (UniqueName: \"kubernetes.io/projected/8d921c20-195c-44c2-9143-c65253822ac0-kube-api-access-4cvb9\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:06.845294 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:06.845255 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d921c20-195c-44c2-9143-c65253822ac0-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:07.530688 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:07.530648 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" event={"ID":"8d921c20-195c-44c2-9143-c65253822ac0","Type":"ContainerDied","Data":"c37b10830629b173c035af1ba09df703968564cc1e9c8600737ac79dcd41448c"} May 28 17:22:07.530688 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:07.530691 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c37b10830629b173c035af1ba09df703968564cc1e9c8600737ac79dcd41448c" May 28 17:22:07.530952 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:07.530717 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn7hmx" May 28 17:22:14.273391 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273315 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5"] May 28 17:22:14.273754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273602 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d921c20-195c-44c2-9143-c65253822ac0" containerName="extract" May 28 17:22:14.273754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273614 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d921c20-195c-44c2-9143-c65253822ac0" containerName="extract" May 28 17:22:14.273754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273627 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d921c20-195c-44c2-9143-c65253822ac0" containerName="util" May 28 17:22:14.273754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273632 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d921c20-195c-44c2-9143-c65253822ac0" containerName="util" May 28 17:22:14.273754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273644 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d921c20-195c-44c2-9143-c65253822ac0" containerName="pull" May 28 17:22:14.273754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273652 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d921c20-195c-44c2-9143-c65253822ac0" containerName="pull" May 28 17:22:14.273754 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.273727 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d921c20-195c-44c2-9143-c65253822ac0" containerName="extract" May 28 17:22:14.276591 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.276576 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.279081 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.279061 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 28 17:22:14.279081 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.279074 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2wb4x\"" May 28 17:22:14.279233 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.279061 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 28 17:22:14.288768 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.288750 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5"] May 28 17:22:14.406868 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.406833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e939b7-6137-4786-8cd2-e8afcc0387b4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-24vn5\" (UID: \"93e939b7-6137-4786-8cd2-e8afcc0387b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.407043 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.406921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkkcl\" (UniqueName: \"kubernetes.io/projected/93e939b7-6137-4786-8cd2-e8afcc0387b4-kube-api-access-vkkcl\") pod \"cert-manager-operator-controller-manager-54b9655956-24vn5\" (UID: \"93e939b7-6137-4786-8cd2-e8afcc0387b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.508193 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.508166 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkkcl\" (UniqueName: \"kubernetes.io/projected/93e939b7-6137-4786-8cd2-e8afcc0387b4-kube-api-access-vkkcl\") pod \"cert-manager-operator-controller-manager-54b9655956-24vn5\" (UID: \"93e939b7-6137-4786-8cd2-e8afcc0387b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.508313 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.508213 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e939b7-6137-4786-8cd2-e8afcc0387b4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-24vn5\" (UID: \"93e939b7-6137-4786-8cd2-e8afcc0387b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.508594 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.508578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e939b7-6137-4786-8cd2-e8afcc0387b4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-24vn5\" (UID: \"93e939b7-6137-4786-8cd2-e8afcc0387b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.517118 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.517101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkkcl\" (UniqueName: \"kubernetes.io/projected/93e939b7-6137-4786-8cd2-e8afcc0387b4-kube-api-access-vkkcl\") pod \"cert-manager-operator-controller-manager-54b9655956-24vn5\" (UID: \"93e939b7-6137-4786-8cd2-e8afcc0387b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.585735 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.585653 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" May 28 17:22:14.724020 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:14.723989 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5"] May 28 17:22:14.726226 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:22:14.726198 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e939b7_6137_4786_8cd2_e8afcc0387b4.slice/crio-16a25b947502f45b01d9043b39c9eddeb1f2fdfff22fe778cb090f81e11dc804 WatchSource:0}: Error finding container 16a25b947502f45b01d9043b39c9eddeb1f2fdfff22fe778cb090f81e11dc804: Status 404 returned error can't find the container with id 16a25b947502f45b01d9043b39c9eddeb1f2fdfff22fe778cb090f81e11dc804 May 28 17:22:15.551804 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:15.551770 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" event={"ID":"93e939b7-6137-4786-8cd2-e8afcc0387b4","Type":"ContainerStarted","Data":"16a25b947502f45b01d9043b39c9eddeb1f2fdfff22fe778cb090f81e11dc804"} May 28 17:22:24.576945 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:24.576906 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" event={"ID":"93e939b7-6137-4786-8cd2-e8afcc0387b4","Type":"ContainerStarted","Data":"6e559e1eb51504daa4d34ec402e0f5bb7065671e62847cc50cdd2f0f51ac6d7c"} May 28 17:22:24.602204 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:24.602146 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-24vn5" podStartSLOduration=1.265675299 podStartE2EDuration="10.602133s" podCreationTimestamp="2026-05-28 17:22:14 +0000 UTC" firstStartedPulling="2026-05-28 17:22:14.730403446 +0000 UTC m=+257.644296254" lastFinishedPulling="2026-05-28 17:22:24.066861144 +0000 UTC m=+266.980753955" observedRunningTime="2026-05-28 17:22:24.599928105 +0000 UTC m=+267.513820934" watchObservedRunningTime="2026-05-28 17:22:24.602133 +0000 UTC m=+267.516025830" May 28 17:22:26.942498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:26.942443 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth"] May 28 17:22:26.945827 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:26.945810 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:26.948420 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:26.948400 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:22:26.948557 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:26.948427 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:22:26.949185 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:26.949169 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nvwt6\"" May 28 17:22:26.954174 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:26.954152 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth"] May 28 17:22:27.106583 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.106542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.106742 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.106609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.106742 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.106643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lg2\" (UniqueName: \"kubernetes.io/projected/8dca84eb-8417-464b-af88-fcbdecf71581-kube-api-access-m2lg2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.207907 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.207824 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.207907 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.207877 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lg2\" (UniqueName: \"kubernetes.io/projected/8dca84eb-8417-464b-af88-fcbdecf71581-kube-api-access-m2lg2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.208047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.207930 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.208231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.208211 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.208280 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.208259 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.217637 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.217607 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lg2\" (UniqueName: \"kubernetes.io/projected/8dca84eb-8417-464b-af88-fcbdecf71581-kube-api-access-m2lg2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.255404 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.255375 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:27.278584 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.278558 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xd6bz"] May 28 17:22:27.282835 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.282817 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.285404 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.285379 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 28 17:22:27.285404 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.285389 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 28 17:22:27.285561 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.285408 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z42vj\"" May 28 17:22:27.292259 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.292234 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xd6bz"] May 28 17:22:27.391992 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.391813 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth"] May 28 17:22:27.394171 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:22:27.394142 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dca84eb_8417_464b_af88_fcbdecf71581.slice/crio-e73153ab0e8dd24b10bcf735094a1a7fb6d04c007a83bd2b2fd5d445766b8c47 WatchSource:0}: Error finding container e73153ab0e8dd24b10bcf735094a1a7fb6d04c007a83bd2b2fd5d445766b8c47: Status 404 returned error can't find the container with id e73153ab0e8dd24b10bcf735094a1a7fb6d04c007a83bd2b2fd5d445766b8c47 May 28 17:22:27.409694 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.409674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f657885e-cb14-4302-a9e2-34f0b50b3ac5-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xd6bz\" (UID: \"f657885e-cb14-4302-a9e2-34f0b50b3ac5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.409757 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.409706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x66w\" (UniqueName: \"kubernetes.io/projected/f657885e-cb14-4302-a9e2-34f0b50b3ac5-kube-api-access-9x66w\") pod \"cert-manager-webhook-587ccfb98-xd6bz\" (UID: \"f657885e-cb14-4302-a9e2-34f0b50b3ac5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.510115 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.510090 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f657885e-cb14-4302-a9e2-34f0b50b3ac5-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xd6bz\" (UID: \"f657885e-cb14-4302-a9e2-34f0b50b3ac5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.510221 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.510123 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9x66w\" (UniqueName: \"kubernetes.io/projected/f657885e-cb14-4302-a9e2-34f0b50b3ac5-kube-api-access-9x66w\") pod \"cert-manager-webhook-587ccfb98-xd6bz\" (UID: \"f657885e-cb14-4302-a9e2-34f0b50b3ac5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.519768 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.519748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x66w\" (UniqueName: \"kubernetes.io/projected/f657885e-cb14-4302-a9e2-34f0b50b3ac5-kube-api-access-9x66w\") pod \"cert-manager-webhook-587ccfb98-xd6bz\" (UID: \"f657885e-cb14-4302-a9e2-34f0b50b3ac5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.519854 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.519843 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f657885e-cb14-4302-a9e2-34f0b50b3ac5-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xd6bz\" (UID: \"f657885e-cb14-4302-a9e2-34f0b50b3ac5\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.586480 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.586437 2577 generic.go:358] "Generic (PLEG): container finished" podID="8dca84eb-8417-464b-af88-fcbdecf71581" containerID="b6162926a49e664a1789b56b73016f77362f645e44cd9de96934948c1f8135b8" exitCode=0 May 28 17:22:27.586599 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.586499 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" event={"ID":"8dca84eb-8417-464b-af88-fcbdecf71581","Type":"ContainerDied","Data":"b6162926a49e664a1789b56b73016f77362f645e44cd9de96934948c1f8135b8"} May 28 17:22:27.586599 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.586521 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" event={"ID":"8dca84eb-8417-464b-af88-fcbdecf71581","Type":"ContainerStarted","Data":"e73153ab0e8dd24b10bcf735094a1a7fb6d04c007a83bd2b2fd5d445766b8c47"} May 28 17:22:27.602723 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.602701 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:27.727315 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:27.727292 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xd6bz"] May 28 17:22:27.729567 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:22:27.729536 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf657885e_cb14_4302_a9e2_34f0b50b3ac5.slice/crio-58ad589fb1e5293572099c49153ca7d537984dc8296196b725076f6bcf83e912 WatchSource:0}: Error finding container 58ad589fb1e5293572099c49153ca7d537984dc8296196b725076f6bcf83e912: Status 404 returned error can't find the container with id 58ad589fb1e5293572099c49153ca7d537984dc8296196b725076f6bcf83e912 May 28 17:22:28.591593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:28.591554 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" event={"ID":"f657885e-cb14-4302-a9e2-34f0b50b3ac5","Type":"ContainerStarted","Data":"58ad589fb1e5293572099c49153ca7d537984dc8296196b725076f6bcf83e912"} May 28 17:22:30.073242 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.073205 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-68tcl"] May 28 17:22:30.091354 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.091324 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-68tcl"] May 28 17:22:30.091518 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.091469 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:30.093894 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.093871 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pqx52\"" May 28 17:22:30.130974 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.130943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlkvt\" (UniqueName: \"kubernetes.io/projected/26b03614-c952-4568-b972-e0e69a02bd22-kube-api-access-xlkvt\") pod \"cert-manager-cainjector-68b757865b-68tcl\" (UID: \"26b03614-c952-4568-b972-e0e69a02bd22\") " pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:30.131120 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.131069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26b03614-c952-4568-b972-e0e69a02bd22-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-68tcl\" (UID: \"26b03614-c952-4568-b972-e0e69a02bd22\") " pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:30.232295 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.232263 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26b03614-c952-4568-b972-e0e69a02bd22-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-68tcl\" (UID: \"26b03614-c952-4568-b972-e0e69a02bd22\") " pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:30.232506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.232319 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlkvt\" (UniqueName: \"kubernetes.io/projected/26b03614-c952-4568-b972-e0e69a02bd22-kube-api-access-xlkvt\") pod \"cert-manager-cainjector-68b757865b-68tcl\" (UID: \"26b03614-c952-4568-b972-e0e69a02bd22\") " pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:30.242335 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.242304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26b03614-c952-4568-b972-e0e69a02bd22-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-68tcl\" (UID: \"26b03614-c952-4568-b972-e0e69a02bd22\") " pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:30.242612 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.242582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlkvt\" (UniqueName: \"kubernetes.io/projected/26b03614-c952-4568-b972-e0e69a02bd22-kube-api-access-xlkvt\") pod \"cert-manager-cainjector-68b757865b-68tcl\" (UID: \"26b03614-c952-4568-b972-e0e69a02bd22\") " pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:30.400247 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:30.400164 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" May 28 17:22:31.128657 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.128630 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-68tcl"] May 28 17:22:31.130481 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:22:31.130441 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26b03614_c952_4568_b972_e0e69a02bd22.slice/crio-c1956d79080171aaee54d00e5a48fb878c335df2ae7913a0f214d7de2c11608d WatchSource:0}: Error finding container c1956d79080171aaee54d00e5a48fb878c335df2ae7913a0f214d7de2c11608d: Status 404 returned error can't find the container with id c1956d79080171aaee54d00e5a48fb878c335df2ae7913a0f214d7de2c11608d May 28 17:22:31.607259 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.607221 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" event={"ID":"f657885e-cb14-4302-a9e2-34f0b50b3ac5","Type":"ContainerStarted","Data":"81f4f29c0cf62af8861147e5f5320f8ff9d753995be06b852eb60d27d71fcecc"} May 28 17:22:31.607472 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.607283 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:31.608582 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.608555 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" event={"ID":"26b03614-c952-4568-b972-e0e69a02bd22","Type":"ContainerStarted","Data":"8ae746f33b3717b877ccee035e78f015a143e2731dcd1bae6e10366e4aa98811"} May 28 17:22:31.608690 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.608587 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" event={"ID":"26b03614-c952-4568-b972-e0e69a02bd22","Type":"ContainerStarted","Data":"c1956d79080171aaee54d00e5a48fb878c335df2ae7913a0f214d7de2c11608d"} May 28 17:22:31.610078 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.610049 2577 generic.go:358] "Generic (PLEG): container finished" podID="8dca84eb-8417-464b-af88-fcbdecf71581" containerID="899f9779717548192954aed69bdd80be927f219641d9f25fc60764441a050bc3" exitCode=0 May 28 17:22:31.610148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.610088 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" event={"ID":"8dca84eb-8417-464b-af88-fcbdecf71581","Type":"ContainerDied","Data":"899f9779717548192954aed69bdd80be927f219641d9f25fc60764441a050bc3"} May 28 17:22:31.627154 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.627109 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" podStartSLOduration=1.375114182 podStartE2EDuration="4.62709351s" podCreationTimestamp="2026-05-28 17:22:27 +0000 UTC" firstStartedPulling="2026-05-28 17:22:27.731327547 +0000 UTC m=+270.645220354" lastFinishedPulling="2026-05-28 17:22:30.983306871 +0000 UTC m=+273.897199682" observedRunningTime="2026-05-28 17:22:31.626126217 +0000 UTC m=+274.540019047" watchObservedRunningTime="2026-05-28 17:22:31.62709351 +0000 UTC m=+274.540986340" May 28 17:22:31.664595 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:31.664543 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-68tcl" podStartSLOduration=1.664527163 podStartE2EDuration="1.664527163s" podCreationTimestamp="2026-05-28 17:22:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:22:31.661840444 +0000 UTC m=+274.575733274" watchObservedRunningTime="2026-05-28 17:22:31.664527163 +0000 UTC m=+274.578419994" May 28 17:22:32.614769 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:32.614736 2577 generic.go:358] "Generic (PLEG): container finished" podID="8dca84eb-8417-464b-af88-fcbdecf71581" containerID="eb0123a1aeb5f6f02a36a3e6d4c7146d0ee531cedcd7292a1c9af1548b37b920" exitCode=0 May 28 17:22:32.615156 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:32.614814 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" event={"ID":"8dca84eb-8417-464b-af88-fcbdecf71581","Type":"ContainerDied","Data":"eb0123a1aeb5f6f02a36a3e6d4c7146d0ee531cedcd7292a1c9af1548b37b920"} May 28 17:22:33.737258 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.737236 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:33.766538 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.766512 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2lg2\" (UniqueName: \"kubernetes.io/projected/8dca84eb-8417-464b-af88-fcbdecf71581-kube-api-access-m2lg2\") pod \"8dca84eb-8417-464b-af88-fcbdecf71581\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " May 28 17:22:33.766685 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.766569 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-util\") pod \"8dca84eb-8417-464b-af88-fcbdecf71581\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " May 28 17:22:33.766685 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.766602 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-bundle\") pod \"8dca84eb-8417-464b-af88-fcbdecf71581\" (UID: \"8dca84eb-8417-464b-af88-fcbdecf71581\") " May 28 17:22:33.767171 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.767147 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-bundle" (OuterVolumeSpecName: "bundle") pod "8dca84eb-8417-464b-af88-fcbdecf71581" (UID: "8dca84eb-8417-464b-af88-fcbdecf71581"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:22:33.769234 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.769215 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dca84eb-8417-464b-af88-fcbdecf71581-kube-api-access-m2lg2" (OuterVolumeSpecName: "kube-api-access-m2lg2") pod "8dca84eb-8417-464b-af88-fcbdecf71581" (UID: "8dca84eb-8417-464b-af88-fcbdecf71581"). InnerVolumeSpecName "kube-api-access-m2lg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:22:33.772103 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.772080 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-util" (OuterVolumeSpecName: "util") pod "8dca84eb-8417-464b-af88-fcbdecf71581" (UID: "8dca84eb-8417-464b-af88-fcbdecf71581"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:22:33.867660 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.867586 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2lg2\" (UniqueName: \"kubernetes.io/projected/8dca84eb-8417-464b-af88-fcbdecf71581-kube-api-access-m2lg2\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:33.867660 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.867626 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:33.867660 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:33.867637 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dca84eb-8417-464b-af88-fcbdecf71581-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:34.621734 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:34.621700 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" event={"ID":"8dca84eb-8417-464b-af88-fcbdecf71581","Type":"ContainerDied","Data":"e73153ab0e8dd24b10bcf735094a1a7fb6d04c007a83bd2b2fd5d445766b8c47"} May 28 17:22:34.621734 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:34.621732 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e73153ab0e8dd24b10bcf735094a1a7fb6d04c007a83bd2b2fd5d445766b8c47" May 28 17:22:34.621734 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:34.621737 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f82mth" May 28 17:22:37.616955 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:37.616926 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xd6bz" May 28 17:22:45.974468 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974419 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp"] May 28 17:22:45.974920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974717 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dca84eb-8417-464b-af88-fcbdecf71581" containerName="pull" May 28 17:22:45.974920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974729 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dca84eb-8417-464b-af88-fcbdecf71581" containerName="pull" May 28 17:22:45.974920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974747 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dca84eb-8417-464b-af88-fcbdecf71581" containerName="extract" May 28 17:22:45.974920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974752 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dca84eb-8417-464b-af88-fcbdecf71581" containerName="extract" May 28 17:22:45.974920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974758 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dca84eb-8417-464b-af88-fcbdecf71581" containerName="util" May 28 17:22:45.974920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974764 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dca84eb-8417-464b-af88-fcbdecf71581" containerName="util" May 28 17:22:45.974920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.974819 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dca84eb-8417-464b-af88-fcbdecf71581" containerName="extract" May 28 17:22:45.976744 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.976729 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:45.979634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.979613 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:22:45.980407 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.980390 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nvwt6\"" May 28 17:22:45.980510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.980449 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:22:45.987031 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:45.987010 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp"] May 28 17:22:46.059747 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.059699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.059938 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.059755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8jfl\" (UniqueName: \"kubernetes.io/projected/8a878b05-ad40-4334-9529-39b5d26740f3-kube-api-access-k8jfl\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.059938 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.059788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.160810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.160767 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.161002 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.160817 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8jfl\" (UniqueName: \"kubernetes.io/projected/8a878b05-ad40-4334-9529-39b5d26740f3-kube-api-access-k8jfl\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.161002 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.160851 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.161151 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.161130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.161234 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.161215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.173645 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.173613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8jfl\" (UniqueName: \"kubernetes.io/projected/8a878b05-ad40-4334-9529-39b5d26740f3-kube-api-access-k8jfl\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.286402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.286372 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:46.427905 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.427879 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp"] May 28 17:22:46.429692 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:22:46.429658 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a878b05_ad40_4334_9529_39b5d26740f3.slice/crio-57876fab2e9bebdd24e2ec76e167cfb772b6a5db2d1b2de174a0c557965f0bdf WatchSource:0}: Error finding container 57876fab2e9bebdd24e2ec76e167cfb772b6a5db2d1b2de174a0c557965f0bdf: Status 404 returned error can't find the container with id 57876fab2e9bebdd24e2ec76e167cfb772b6a5db2d1b2de174a0c557965f0bdf May 28 17:22:46.432035 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.432015 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-lsc9c"] May 28 17:22:46.434761 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.434738 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.437996 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.437977 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5lsb6\"" May 28 17:22:46.447529 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.447507 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-lsc9c"] May 28 17:22:46.563797 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.563757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5935f20c-0f99-45b8-b0c4-7533b50747b4-bound-sa-token\") pod \"cert-manager-79c8d999ff-lsc9c\" (UID: \"5935f20c-0f99-45b8-b0c4-7533b50747b4\") " pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.563965 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.563814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6xwf\" (UniqueName: \"kubernetes.io/projected/5935f20c-0f99-45b8-b0c4-7533b50747b4-kube-api-access-q6xwf\") pod \"cert-manager-79c8d999ff-lsc9c\" (UID: \"5935f20c-0f99-45b8-b0c4-7533b50747b4\") " pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.658329 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.658295 2577 generic.go:358] "Generic (PLEG): container finished" podID="8a878b05-ad40-4334-9529-39b5d26740f3" containerID="d0944a071c42ff7d3e7875db8909a0a4737a67890469436643c15fc8bec5131f" exitCode=0 May 28 17:22:46.658511 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.658373 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" event={"ID":"8a878b05-ad40-4334-9529-39b5d26740f3","Type":"ContainerDied","Data":"d0944a071c42ff7d3e7875db8909a0a4737a67890469436643c15fc8bec5131f"} May 28 17:22:46.658511 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.658397 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" event={"ID":"8a878b05-ad40-4334-9529-39b5d26740f3","Type":"ContainerStarted","Data":"57876fab2e9bebdd24e2ec76e167cfb772b6a5db2d1b2de174a0c557965f0bdf"} May 28 17:22:46.664505 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.664481 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6xwf\" (UniqueName: \"kubernetes.io/projected/5935f20c-0f99-45b8-b0c4-7533b50747b4-kube-api-access-q6xwf\") pod \"cert-manager-79c8d999ff-lsc9c\" (UID: \"5935f20c-0f99-45b8-b0c4-7533b50747b4\") " pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.664596 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.664555 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5935f20c-0f99-45b8-b0c4-7533b50747b4-bound-sa-token\") pod \"cert-manager-79c8d999ff-lsc9c\" (UID: \"5935f20c-0f99-45b8-b0c4-7533b50747b4\") " pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.673632 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.673599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5935f20c-0f99-45b8-b0c4-7533b50747b4-bound-sa-token\") pod \"cert-manager-79c8d999ff-lsc9c\" (UID: \"5935f20c-0f99-45b8-b0c4-7533b50747b4\") " pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.673737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.673599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6xwf\" (UniqueName: \"kubernetes.io/projected/5935f20c-0f99-45b8-b0c4-7533b50747b4-kube-api-access-q6xwf\") pod \"cert-manager-79c8d999ff-lsc9c\" (UID: \"5935f20c-0f99-45b8-b0c4-7533b50747b4\") " pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.746903 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.746863 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-lsc9c" May 28 17:22:46.876263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:46.876239 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-lsc9c"] May 28 17:22:46.878641 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:22:46.878607 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5935f20c_0f99_45b8_b0c4_7533b50747b4.slice/crio-e13813b810cdbb4fa649cc484ef5c1ef229306310d0f5cd18401a71b1d380f5c WatchSource:0}: Error finding container e13813b810cdbb4fa649cc484ef5c1ef229306310d0f5cd18401a71b1d380f5c: Status 404 returned error can't find the container with id e13813b810cdbb4fa649cc484ef5c1ef229306310d0f5cd18401a71b1d380f5c May 28 17:22:47.663314 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:47.663278 2577 generic.go:358] "Generic (PLEG): container finished" podID="8a878b05-ad40-4334-9529-39b5d26740f3" containerID="38a738d9624830795b873238a4774ef08eedde1f0e9f73005d685e19bbf8cb98" exitCode=0 May 28 17:22:47.663741 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:47.663351 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" event={"ID":"8a878b05-ad40-4334-9529-39b5d26740f3","Type":"ContainerDied","Data":"38a738d9624830795b873238a4774ef08eedde1f0e9f73005d685e19bbf8cb98"} May 28 17:22:47.664737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:47.664712 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-lsc9c" event={"ID":"5935f20c-0f99-45b8-b0c4-7533b50747b4","Type":"ContainerStarted","Data":"1882748b38449348c4f13bf72d8d0c1823ddc1c9342f580fe05edabd79aea20e"} May 28 17:22:47.664819 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:47.664743 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-lsc9c" event={"ID":"5935f20c-0f99-45b8-b0c4-7533b50747b4","Type":"ContainerStarted","Data":"e13813b810cdbb4fa649cc484ef5c1ef229306310d0f5cd18401a71b1d380f5c"} May 28 17:22:47.698520 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:47.698450 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-lsc9c" podStartSLOduration=1.6984315909999999 podStartE2EDuration="1.698431591s" podCreationTimestamp="2026-05-28 17:22:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:22:47.698313738 +0000 UTC m=+290.612206570" watchObservedRunningTime="2026-05-28 17:22:47.698431591 +0000 UTC m=+290.612324424" May 28 17:22:48.669436 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:48.669403 2577 generic.go:358] "Generic (PLEG): container finished" podID="8a878b05-ad40-4334-9529-39b5d26740f3" containerID="d69907ebbd0831047b820e1c37a8f38920dd88c38e4efdc84a6939c585df74f6" exitCode=0 May 28 17:22:48.669855 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:48.669502 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" event={"ID":"8a878b05-ad40-4334-9529-39b5d26740f3","Type":"ContainerDied","Data":"d69907ebbd0831047b820e1c37a8f38920dd88c38e4efdc84a6939c585df74f6"} May 28 17:22:49.794083 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.794061 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:49.889861 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.889820 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-util\") pod \"8a878b05-ad40-4334-9529-39b5d26740f3\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " May 28 17:22:49.889861 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.889866 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8jfl\" (UniqueName: \"kubernetes.io/projected/8a878b05-ad40-4334-9529-39b5d26740f3-kube-api-access-k8jfl\") pod \"8a878b05-ad40-4334-9529-39b5d26740f3\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " May 28 17:22:49.890058 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.889914 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-bundle\") pod \"8a878b05-ad40-4334-9529-39b5d26740f3\" (UID: \"8a878b05-ad40-4334-9529-39b5d26740f3\") " May 28 17:22:49.890690 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.890664 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-bundle" (OuterVolumeSpecName: "bundle") pod "8a878b05-ad40-4334-9529-39b5d26740f3" (UID: "8a878b05-ad40-4334-9529-39b5d26740f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:22:49.892169 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.892151 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a878b05-ad40-4334-9529-39b5d26740f3-kube-api-access-k8jfl" (OuterVolumeSpecName: "kube-api-access-k8jfl") pod "8a878b05-ad40-4334-9529-39b5d26740f3" (UID: "8a878b05-ad40-4334-9529-39b5d26740f3"). InnerVolumeSpecName "kube-api-access-k8jfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:22:49.895515 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.895493 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-util" (OuterVolumeSpecName: "util") pod "8a878b05-ad40-4334-9529-39b5d26740f3" (UID: "8a878b05-ad40-4334-9529-39b5d26740f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:22:49.991170 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.991082 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:49.991170 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.991121 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8jfl\" (UniqueName: \"kubernetes.io/projected/8a878b05-ad40-4334-9529-39b5d26740f3-kube-api-access-k8jfl\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:49.991170 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:49.991132 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a878b05-ad40-4334-9529-39b5d26740f3-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:22:50.677421 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:50.677392 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" May 28 17:22:50.677604 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:50.677395 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c52x5zp" event={"ID":"8a878b05-ad40-4334-9529-39b5d26740f3","Type":"ContainerDied","Data":"57876fab2e9bebdd24e2ec76e167cfb772b6a5db2d1b2de174a0c557965f0bdf"} May 28 17:22:50.677604 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:50.677490 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57876fab2e9bebdd24e2ec76e167cfb772b6a5db2d1b2de174a0c557965f0bdf" May 28 17:22:57.595236 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:57.595198 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:22:57.600216 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:57.600196 2577 kubelet.go:1628] "Image garbage collection succeeded" May 28 17:22:57.600368 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:57.600316 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:22:59.800491 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800443 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h"] May 28 17:22:59.801972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800726 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a878b05-ad40-4334-9529-39b5d26740f3" containerName="pull" May 28 17:22:59.801972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800735 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a878b05-ad40-4334-9529-39b5d26740f3" containerName="pull" May 28 17:22:59.801972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800754 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a878b05-ad40-4334-9529-39b5d26740f3" containerName="util" May 28 17:22:59.801972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800760 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a878b05-ad40-4334-9529-39b5d26740f3" containerName="util" May 28 17:22:59.801972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800772 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a878b05-ad40-4334-9529-39b5d26740f3" containerName="extract" May 28 17:22:59.801972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800777 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a878b05-ad40-4334-9529-39b5d26740f3" containerName="extract" May 28 17:22:59.801972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.800819 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a878b05-ad40-4334-9529-39b5d26740f3" containerName="extract" May 28 17:22:59.802847 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.802831 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.805549 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.805530 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:22:59.805642 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.805618 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:22:59.805740 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.805723 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nvwt6\"" May 28 17:22:59.816729 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.816708 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h"] May 28 17:22:59.870613 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.870573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.870788 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.870618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8p8t\" (UniqueName: \"kubernetes.io/projected/99691725-7a31-49d2-9961-5e882a232a6b-kube-api-access-j8p8t\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.870788 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.870693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.972241 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.972201 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.972445 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.972278 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8p8t\" (UniqueName: \"kubernetes.io/projected/99691725-7a31-49d2-9961-5e882a232a6b-kube-api-access-j8p8t\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.972445 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.972347 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.972615 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.972589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.972732 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.972713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:22:59.982339 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:22:59.982312 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8p8t\" (UniqueName: \"kubernetes.io/projected/99691725-7a31-49d2-9961-5e882a232a6b-kube-api-access-j8p8t\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:23:00.111685 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.111590 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:23:00.248048 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.248025 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h"] May 28 17:23:00.250041 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:23:00.250015 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99691725_7a31_49d2_9961_5e882a232a6b.slice/crio-9e7d2a5cb25149cd301c53e59db4aee4bd89220ebc2617d269f246bb92630ad9 WatchSource:0}: Error finding container 9e7d2a5cb25149cd301c53e59db4aee4bd89220ebc2617d269f246bb92630ad9: Status 404 returned error can't find the container with id 9e7d2a5cb25149cd301c53e59db4aee4bd89220ebc2617d269f246bb92630ad9 May 28 17:23:00.252440 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.252422 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:23:00.483211 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.483176 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6"] May 28 17:23:00.489749 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.489724 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.492914 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.492895 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hhx7v\"" May 28 17:23:00.493137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.493122 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 17:23:00.493137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.493131 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 17:23:00.493231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.493147 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 17:23:00.493441 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.493427 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 17:23:00.498827 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.498807 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6"] May 28 17:23:00.579569 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.579532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83eeb1f3-bd93-49c4-8633-eed90304321c-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.579569 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.579570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbhln\" (UniqueName: \"kubernetes.io/projected/83eeb1f3-bd93-49c4-8633-eed90304321c-kube-api-access-wbhln\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.579750 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.579610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83eeb1f3-bd93-49c4-8633-eed90304321c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.680519 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.680414 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83eeb1f3-bd93-49c4-8633-eed90304321c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.680673 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.680532 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83eeb1f3-bd93-49c4-8633-eed90304321c-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.680673 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.680579 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbhln\" (UniqueName: \"kubernetes.io/projected/83eeb1f3-bd93-49c4-8633-eed90304321c-kube-api-access-wbhln\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.683005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.682981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83eeb1f3-bd93-49c4-8633-eed90304321c-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.683113 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.683014 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83eeb1f3-bd93-49c4-8633-eed90304321c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.689735 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.689718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbhln\" (UniqueName: \"kubernetes.io/projected/83eeb1f3-bd93-49c4-8633-eed90304321c-kube-api-access-wbhln\") pod \"opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6\" (UID: \"83eeb1f3-bd93-49c4-8633-eed90304321c\") " pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.709964 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.709941 2577 generic.go:358] "Generic (PLEG): container finished" podID="99691725-7a31-49d2-9961-5e882a232a6b" containerID="d4356144d0cda397c5997f2e51d516b5895181a3ce4ea619a3b5faa207ac1e6d" exitCode=0 May 28 17:23:00.710070 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.710027 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" event={"ID":"99691725-7a31-49d2-9961-5e882a232a6b","Type":"ContainerDied","Data":"d4356144d0cda397c5997f2e51d516b5895181a3ce4ea619a3b5faa207ac1e6d"} May 28 17:23:00.710115 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.710076 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" event={"ID":"99691725-7a31-49d2-9961-5e882a232a6b","Type":"ContainerStarted","Data":"9e7d2a5cb25149cd301c53e59db4aee4bd89220ebc2617d269f246bb92630ad9"} May 28 17:23:00.800442 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.800413 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:00.929967 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:00.929901 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6"] May 28 17:23:00.932157 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:23:00.932089 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eeb1f3_bd93_49c4_8633_eed90304321c.slice/crio-cfef12de9c05659a93fb3ef163c5620a9f0fbedac4e5db9fd0c03de8d9cdee16 WatchSource:0}: Error finding container cfef12de9c05659a93fb3ef163c5620a9f0fbedac4e5db9fd0c03de8d9cdee16: Status 404 returned error can't find the container with id cfef12de9c05659a93fb3ef163c5620a9f0fbedac4e5db9fd0c03de8d9cdee16 May 28 17:23:01.714985 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:01.714832 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" event={"ID":"83eeb1f3-bd93-49c4-8633-eed90304321c","Type":"ContainerStarted","Data":"cfef12de9c05659a93fb3ef163c5620a9f0fbedac4e5db9fd0c03de8d9cdee16"} May 28 17:23:01.716953 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:01.716924 2577 generic.go:358] "Generic (PLEG): container finished" podID="99691725-7a31-49d2-9961-5e882a232a6b" containerID="8085e43c6c27b35f8240058ff8d0b47f3beb69610ce03d3b430e5b1c5f392c85" exitCode=0 May 28 17:23:01.717092 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:01.717047 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" event={"ID":"99691725-7a31-49d2-9961-5e882a232a6b","Type":"ContainerDied","Data":"8085e43c6c27b35f8240058ff8d0b47f3beb69610ce03d3b430e5b1c5f392c85"} May 28 17:23:02.723463 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:02.723423 2577 generic.go:358] "Generic (PLEG): container finished" podID="99691725-7a31-49d2-9961-5e882a232a6b" containerID="7f174a50463b1cdb473f0e31f1e02b98121a7d0ada4a613341ed1394d523cbcb" exitCode=0 May 28 17:23:02.723895 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:02.723503 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" event={"ID":"99691725-7a31-49d2-9961-5e882a232a6b","Type":"ContainerDied","Data":"7f174a50463b1cdb473f0e31f1e02b98121a7d0ada4a613341ed1394d523cbcb"} May 28 17:23:03.728706 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:03.728621 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" event={"ID":"83eeb1f3-bd93-49c4-8633-eed90304321c","Type":"ContainerStarted","Data":"2d72016d6cfa31e558951460398fcae57d98446020101b47d4bca3cabf277a73"} May 28 17:23:03.761538 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:03.761487 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" podStartSLOduration=1.305849129 podStartE2EDuration="3.7614721s" podCreationTimestamp="2026-05-28 17:23:00 +0000 UTC" firstStartedPulling="2026-05-28 17:23:00.935901332 +0000 UTC m=+303.849794139" lastFinishedPulling="2026-05-28 17:23:03.391524299 +0000 UTC m=+306.305417110" observedRunningTime="2026-05-28 17:23:03.758386519 +0000 UTC m=+306.672279349" watchObservedRunningTime="2026-05-28 17:23:03.7614721 +0000 UTC m=+306.675364931" May 28 17:23:03.851636 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:03.851610 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:23:04.013190 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.013162 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8p8t\" (UniqueName: \"kubernetes.io/projected/99691725-7a31-49d2-9961-5e882a232a6b-kube-api-access-j8p8t\") pod \"99691725-7a31-49d2-9961-5e882a232a6b\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " May 28 17:23:04.013357 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.013227 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-util\") pod \"99691725-7a31-49d2-9961-5e882a232a6b\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " May 28 17:23:04.013357 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.013253 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-bundle\") pod \"99691725-7a31-49d2-9961-5e882a232a6b\" (UID: \"99691725-7a31-49d2-9961-5e882a232a6b\") " May 28 17:23:04.014160 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.014133 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-bundle" (OuterVolumeSpecName: "bundle") pod "99691725-7a31-49d2-9961-5e882a232a6b" (UID: "99691725-7a31-49d2-9961-5e882a232a6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:04.015512 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.015487 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99691725-7a31-49d2-9961-5e882a232a6b-kube-api-access-j8p8t" (OuterVolumeSpecName: "kube-api-access-j8p8t") pod "99691725-7a31-49d2-9961-5e882a232a6b" (UID: "99691725-7a31-49d2-9961-5e882a232a6b"). InnerVolumeSpecName "kube-api-access-j8p8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:23:04.019071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.019045 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-util" (OuterVolumeSpecName: "util") pod "99691725-7a31-49d2-9961-5e882a232a6b" (UID: "99691725-7a31-49d2-9961-5e882a232a6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:04.114101 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.114072 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:04.114101 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.114098 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8p8t\" (UniqueName: \"kubernetes.io/projected/99691725-7a31-49d2-9961-5e882a232a6b-kube-api-access-j8p8t\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:04.114101 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.114110 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99691725-7a31-49d2-9961-5e882a232a6b-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:04.733373 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.733340 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" May 28 17:23:04.733373 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.733350 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hcx8h" event={"ID":"99691725-7a31-49d2-9961-5e882a232a6b","Type":"ContainerDied","Data":"9e7d2a5cb25149cd301c53e59db4aee4bd89220ebc2617d269f246bb92630ad9"} May 28 17:23:04.733821 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.733383 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e7d2a5cb25149cd301c53e59db4aee4bd89220ebc2617d269f246bb92630ad9" May 28 17:23:04.733821 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:04.733445 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:15.739098 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:15.739070 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6" May 28 17:23:22.496068 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496032 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-5xv9h"] May 28 17:23:22.496592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496321 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99691725-7a31-49d2-9961-5e882a232a6b" containerName="pull" May 28 17:23:22.496592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496346 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="99691725-7a31-49d2-9961-5e882a232a6b" containerName="pull" May 28 17:23:22.496592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496367 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99691725-7a31-49d2-9961-5e882a232a6b" containerName="extract" May 28 17:23:22.496592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496376 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="99691725-7a31-49d2-9961-5e882a232a6b" containerName="extract" May 28 17:23:22.496592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496400 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99691725-7a31-49d2-9961-5e882a232a6b" containerName="util" May 28 17:23:22.496592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496408 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="99691725-7a31-49d2-9961-5e882a232a6b" containerName="util" May 28 17:23:22.496592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.496491 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="99691725-7a31-49d2-9961-5e882a232a6b" containerName="extract" May 28 17:23:22.498372 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.498356 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:22.500689 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.500670 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vnhhd\"" May 28 17:23:22.500791 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.500670 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 28 17:23:22.509267 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.509248 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-5xv9h"] May 28 17:23:22.560962 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.560931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:22.561105 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.560994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gw4k\" (UniqueName: \"kubernetes.io/projected/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-kube-api-access-8gw4k\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:22.661848 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.661814 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gw4k\" (UniqueName: \"kubernetes.io/projected/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-kube-api-access-8gw4k\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:22.661982 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.661868 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:22.661982 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:23:22.661971 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 28 17:23:22.662052 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:23:22.662040 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert podName:c715a88c-9fb4-45fa-b923-5ee8dcc5c132 nodeName:}" failed. No retries permitted until 2026-05-28 17:23:23.16202167 +0000 UTC m=+326.075914478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert") pod "odh-model-controller-858dbf95b8-5xv9h" (UID: "c715a88c-9fb4-45fa-b923-5ee8dcc5c132") : secret "odh-model-controller-webhook-cert" not found May 28 17:23:22.671526 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:22.671503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gw4k\" (UniqueName: \"kubernetes.io/projected/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-kube-api-access-8gw4k\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:23.166150 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.166112 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:23.166325 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:23:23.166256 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 28 17:23:23.166325 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:23:23.166322 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert podName:c715a88c-9fb4-45fa-b923-5ee8dcc5c132 nodeName:}" failed. No retries permitted until 2026-05-28 17:23:24.166306156 +0000 UTC m=+327.080198964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert") pod "odh-model-controller-858dbf95b8-5xv9h" (UID: "c715a88c-9fb4-45fa-b923-5ee8dcc5c132") : secret "odh-model-controller-webhook-cert" not found May 28 17:23:23.549685 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.549642 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb"] May 28 17:23:23.551993 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.551969 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.557774 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.557752 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hrwrn\"" May 28 17:23:23.557906 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.557848 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 28 17:23:23.557996 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.557982 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 28 17:23:23.558771 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.558438 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 28 17:23:23.558771 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.558442 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 28 17:23:23.558771 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.558602 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 28 17:23:23.568274 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.568242 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb"] May 28 17:23:23.569755 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.569736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltd57\" (UniqueName: \"kubernetes.io/projected/07f5dffc-9d26-4c40-81b1-932c95c500cb-kube-api-access-ltd57\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.569843 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.569769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07f5dffc-9d26-4c40-81b1-932c95c500cb-cert\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.569843 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.569831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07f5dffc-9d26-4c40-81b1-932c95c500cb-manager-config\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.569934 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.569896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07f5dffc-9d26-4c40-81b1-932c95c500cb-metrics-cert\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.671084 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.671042 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltd57\" (UniqueName: \"kubernetes.io/projected/07f5dffc-9d26-4c40-81b1-932c95c500cb-kube-api-access-ltd57\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.671084 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.671082 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07f5dffc-9d26-4c40-81b1-932c95c500cb-cert\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.671281 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.671207 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07f5dffc-9d26-4c40-81b1-932c95c500cb-manager-config\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.671281 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.671256 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07f5dffc-9d26-4c40-81b1-932c95c500cb-metrics-cert\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.671826 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.671802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07f5dffc-9d26-4c40-81b1-932c95c500cb-manager-config\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.673611 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.673592 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07f5dffc-9d26-4c40-81b1-932c95c500cb-cert\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.673696 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.673628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07f5dffc-9d26-4c40-81b1-932c95c500cb-metrics-cert\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.689164 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.689136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltd57\" (UniqueName: \"kubernetes.io/projected/07f5dffc-9d26-4c40-81b1-932c95c500cb-kube-api-access-ltd57\") pod \"lws-controller-manager-588b6f69fd-c5lvb\" (UID: \"07f5dffc-9d26-4c40-81b1-932c95c500cb\") " pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:23.861633 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:23.861558 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:24.012152 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.012117 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb"] May 28 17:23:24.016609 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:23:24.016580 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f5dffc_9d26_4c40_81b1_932c95c500cb.slice/crio-26c7066faae240d94a5e38f5f74acd00a5d718070daae94adc2c5e553d5faabe WatchSource:0}: Error finding container 26c7066faae240d94a5e38f5f74acd00a5d718070daae94adc2c5e553d5faabe: Status 404 returned error can't find the container with id 26c7066faae240d94a5e38f5f74acd00a5d718070daae94adc2c5e553d5faabe May 28 17:23:24.175717 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.175636 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:24.178230 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.178199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c715a88c-9fb4-45fa-b923-5ee8dcc5c132-cert\") pod \"odh-model-controller-858dbf95b8-5xv9h\" (UID: \"c715a88c-9fb4-45fa-b923-5ee8dcc5c132\") " pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:24.308365 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.308324 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:24.438722 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.438698 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-5xv9h"] May 28 17:23:24.440085 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:23:24.440057 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc715a88c_9fb4_45fa_b923_5ee8dcc5c132.slice/crio-414bcd0ed48095c86ea0a9d6c5b9959bc0133ddddb65cf425e74e1c7cabedbd2 WatchSource:0}: Error finding container 414bcd0ed48095c86ea0a9d6c5b9959bc0133ddddb65cf425e74e1c7cabedbd2: Status 404 returned error can't find the container with id 414bcd0ed48095c86ea0a9d6c5b9959bc0133ddddb65cf425e74e1c7cabedbd2 May 28 17:23:24.573701 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.573666 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk"] May 28 17:23:24.576852 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.576828 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.579841 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.579625 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:23:24.579841 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.579625 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:23:24.580293 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.580266 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nvwt6\"" May 28 17:23:24.586727 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.586701 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk"] May 28 17:23:24.680962 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.680933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.681117 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.680996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chnwl\" (UniqueName: \"kubernetes.io/projected/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-kube-api-access-chnwl\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.681117 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.681054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.781561 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.781524 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.782196 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.781829 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chnwl\" (UniqueName: \"kubernetes.io/projected/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-kube-api-access-chnwl\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.782196 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.781877 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.782196 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.781918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.782196 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.782146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.792396 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.792373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chnwl\" (UniqueName: \"kubernetes.io/projected/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-kube-api-access-chnwl\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:24.803066 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.803028 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" event={"ID":"c715a88c-9fb4-45fa-b923-5ee8dcc5c132","Type":"ContainerStarted","Data":"414bcd0ed48095c86ea0a9d6c5b9959bc0133ddddb65cf425e74e1c7cabedbd2"} May 28 17:23:24.804607 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.804574 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" event={"ID":"07f5dffc-9d26-4c40-81b1-932c95c500cb","Type":"ContainerStarted","Data":"26c7066faae240d94a5e38f5f74acd00a5d718070daae94adc2c5e553d5faabe"} May 28 17:23:24.890121 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:24.890090 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:25.077571 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:25.077541 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk"] May 28 17:23:25.079995 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:23:25.079963 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8196c4d7_acdb_4ad8_81ac_aa88edc30bce.slice/crio-68c093355abc1c19c222e9aa4be2d46c85cff5561d8ad73d91e756353e9cdf1b WatchSource:0}: Error finding container 68c093355abc1c19c222e9aa4be2d46c85cff5561d8ad73d91e756353e9cdf1b: Status 404 returned error can't find the container with id 68c093355abc1c19c222e9aa4be2d46c85cff5561d8ad73d91e756353e9cdf1b May 28 17:23:25.810253 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:25.810215 2577 generic.go:358] "Generic (PLEG): container finished" podID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerID="766dd9031bea0501b40ad3f70a1c4a60f4b0517e80936de1d0b02564c56d4346" exitCode=0 May 28 17:23:25.810253 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:25.810262 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" event={"ID":"8196c4d7-acdb-4ad8-81ac-aa88edc30bce","Type":"ContainerDied","Data":"766dd9031bea0501b40ad3f70a1c4a60f4b0517e80936de1d0b02564c56d4346"} May 28 17:23:25.810755 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:25.810293 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" event={"ID":"8196c4d7-acdb-4ad8-81ac-aa88edc30bce","Type":"ContainerStarted","Data":"68c093355abc1c19c222e9aa4be2d46c85cff5561d8ad73d91e756353e9cdf1b"} May 28 17:23:27.819424 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.819391 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" event={"ID":"07f5dffc-9d26-4c40-81b1-932c95c500cb","Type":"ContainerStarted","Data":"4607e98b2618d28396217af22343a8ee450c61d2d1676ca05bc97d7d093f817c"} May 28 17:23:27.819938 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.819480 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:27.820895 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.820871 2577 generic.go:358] "Generic (PLEG): container finished" podID="c715a88c-9fb4-45fa-b923-5ee8dcc5c132" containerID="84cfab6edd9c079fb2e75160e378106272db2ab89d26accfd31ee7a3872b0ec7" exitCode=1 May 28 17:23:27.821029 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.820959 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" event={"ID":"c715a88c-9fb4-45fa-b923-5ee8dcc5c132","Type":"ContainerDied","Data":"84cfab6edd9c079fb2e75160e378106272db2ab89d26accfd31ee7a3872b0ec7"} May 28 17:23:27.821144 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.821130 2577 scope.go:117] "RemoveContainer" containerID="84cfab6edd9c079fb2e75160e378106272db2ab89d26accfd31ee7a3872b0ec7" May 28 17:23:27.822733 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.822686 2577 generic.go:358] "Generic (PLEG): container finished" podID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerID="e4cd186f1fad33007743063c2ade93fcefe229c077cf1e536b87bc9c984321bf" exitCode=0 May 28 17:23:27.822866 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.822768 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" event={"ID":"8196c4d7-acdb-4ad8-81ac-aa88edc30bce","Type":"ContainerDied","Data":"e4cd186f1fad33007743063c2ade93fcefe229c077cf1e536b87bc9c984321bf"} May 28 17:23:27.841317 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:27.841278 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" podStartSLOduration=1.7939846 podStartE2EDuration="4.841267035s" podCreationTimestamp="2026-05-28 17:23:23 +0000 UTC" firstStartedPulling="2026-05-28 17:23:24.018900619 +0000 UTC m=+326.932793430" lastFinishedPulling="2026-05-28 17:23:27.066183057 +0000 UTC m=+329.980075865" observedRunningTime="2026-05-28 17:23:27.839649343 +0000 UTC m=+330.753542174" watchObservedRunningTime="2026-05-28 17:23:27.841267035 +0000 UTC m=+330.755159923" May 28 17:23:28.830170 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:28.830132 2577 generic.go:358] "Generic (PLEG): container finished" podID="c715a88c-9fb4-45fa-b923-5ee8dcc5c132" containerID="2daff488f735ccb41db9d2ecee3b9421bf5bc4a3db4865b502ed93e21b40ad2c" exitCode=1 May 28 17:23:28.830652 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:28.830224 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" event={"ID":"c715a88c-9fb4-45fa-b923-5ee8dcc5c132","Type":"ContainerDied","Data":"2daff488f735ccb41db9d2ecee3b9421bf5bc4a3db4865b502ed93e21b40ad2c"} May 28 17:23:28.830652 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:28.830264 2577 scope.go:117] "RemoveContainer" containerID="84cfab6edd9c079fb2e75160e378106272db2ab89d26accfd31ee7a3872b0ec7" May 28 17:23:28.830652 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:28.830404 2577 scope.go:117] "RemoveContainer" containerID="2daff488f735ccb41db9d2ecee3b9421bf5bc4a3db4865b502ed93e21b40ad2c" May 28 17:23:28.830822 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:23:28.830703 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-5xv9h_opendatahub(c715a88c-9fb4-45fa-b923-5ee8dcc5c132)\"" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" podUID="c715a88c-9fb4-45fa-b923-5ee8dcc5c132" May 28 17:23:28.832187 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:28.832165 2577 generic.go:358] "Generic (PLEG): container finished" podID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerID="5a5a80240050ce623ba28866cdcdb6c2255c25d87ecbca07e03fdd705ca891cb" exitCode=0 May 28 17:23:28.832284 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:28.832252 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" event={"ID":"8196c4d7-acdb-4ad8-81ac-aa88edc30bce","Type":"ContainerDied","Data":"5a5a80240050ce623ba28866cdcdb6c2255c25d87ecbca07e03fdd705ca891cb"} May 28 17:23:29.837743 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:29.837184 2577 scope.go:117] "RemoveContainer" containerID="2daff488f735ccb41db9d2ecee3b9421bf5bc4a3db4865b502ed93e21b40ad2c" May 28 17:23:29.837743 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:23:29.837348 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-5xv9h_opendatahub(c715a88c-9fb4-45fa-b923-5ee8dcc5c132)\"" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" podUID="c715a88c-9fb4-45fa-b923-5ee8dcc5c132" May 28 17:23:29.978374 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:29.978346 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:30.036115 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.036084 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-bundle\") pod \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " May 28 17:23:30.036248 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.036159 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-util\") pod \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " May 28 17:23:30.036248 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.036192 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chnwl\" (UniqueName: \"kubernetes.io/projected/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-kube-api-access-chnwl\") pod \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\" (UID: \"8196c4d7-acdb-4ad8-81ac-aa88edc30bce\") " May 28 17:23:30.037218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.037185 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-bundle" (OuterVolumeSpecName: "bundle") pod "8196c4d7-acdb-4ad8-81ac-aa88edc30bce" (UID: "8196c4d7-acdb-4ad8-81ac-aa88edc30bce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:30.038492 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.038441 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-kube-api-access-chnwl" (OuterVolumeSpecName: "kube-api-access-chnwl") pod "8196c4d7-acdb-4ad8-81ac-aa88edc30bce" (UID: "8196c4d7-acdb-4ad8-81ac-aa88edc30bce"). InnerVolumeSpecName "kube-api-access-chnwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:23:30.042102 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.042076 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-util" (OuterVolumeSpecName: "util") pod "8196c4d7-acdb-4ad8-81ac-aa88edc30bce" (UID: "8196c4d7-acdb-4ad8-81ac-aa88edc30bce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:30.142987 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.142892 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:30.142987 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.142934 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chnwl\" (UniqueName: \"kubernetes.io/projected/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-kube-api-access-chnwl\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:30.142987 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.142951 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8196c4d7-acdb-4ad8-81ac-aa88edc30bce-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:30.842073 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.842043 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" May 28 17:23:30.842479 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.842039 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835cbhfk" event={"ID":"8196c4d7-acdb-4ad8-81ac-aa88edc30bce","Type":"ContainerDied","Data":"68c093355abc1c19c222e9aa4be2d46c85cff5561d8ad73d91e756353e9cdf1b"} May 28 17:23:30.842479 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:30.842146 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68c093355abc1c19c222e9aa4be2d46c85cff5561d8ad73d91e756353e9cdf1b" May 28 17:23:34.308856 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:34.308817 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:34.309329 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:34.309201 2577 scope.go:117] "RemoveContainer" containerID="2daff488f735ccb41db9d2ecee3b9421bf5bc4a3db4865b502ed93e21b40ad2c" May 28 17:23:34.309395 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:23:34.309378 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-5xv9h_opendatahub(c715a88c-9fb4-45fa-b923-5ee8dcc5c132)\"" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" podUID="c715a88c-9fb4-45fa-b923-5ee8dcc5c132" May 28 17:23:38.268141 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268110 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx"] May 28 17:23:38.268641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268449 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerName="util" May 28 17:23:38.268641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268481 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerName="util" May 28 17:23:38.268641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268490 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerName="extract" May 28 17:23:38.268641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268495 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerName="extract" May 28 17:23:38.268641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268511 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerName="pull" May 28 17:23:38.268641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268517 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerName="pull" May 28 17:23:38.268641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.268577 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8196c4d7-acdb-4ad8-81ac-aa88edc30bce" containerName="extract" May 28 17:23:38.278592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.278568 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.281322 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.281295 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx"] May 28 17:23:38.281478 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.281378 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nvwt6\"" May 28 17:23:38.281633 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.281603 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 17:23:38.282302 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.282282 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 17:23:38.413762 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.413727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.413762 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.413761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.413991 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.413799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9pp5\" (UniqueName: \"kubernetes.io/projected/01d0f99d-702f-468e-9f70-6556e9df8b34-kube-api-access-m9pp5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.514732 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.514697 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.514732 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.514730 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.514917 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.514766 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9pp5\" (UniqueName: \"kubernetes.io/projected/01d0f99d-702f-468e-9f70-6556e9df8b34-kube-api-access-m9pp5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.515061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.515042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.515101 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.515067 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.524872 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.524811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9pp5\" (UniqueName: \"kubernetes.io/projected/01d0f99d-702f-468e-9f70-6556e9df8b34-kube-api-access-m9pp5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.591318 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.591284 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:38.739409 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.739387 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx"] May 28 17:23:38.741812 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:23:38.741784 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d0f99d_702f_468e_9f70_6556e9df8b34.slice/crio-90bd94268b363937db235a6a9bc3f75457d15b004c30f7f0b201b193bce81185 WatchSource:0}: Error finding container 90bd94268b363937db235a6a9bc3f75457d15b004c30f7f0b201b193bce81185: Status 404 returned error can't find the container with id 90bd94268b363937db235a6a9bc3f75457d15b004c30f7f0b201b193bce81185 May 28 17:23:38.834500 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.834475 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-588b6f69fd-c5lvb" May 28 17:23:38.870241 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.870209 2577 generic.go:358] "Generic (PLEG): container finished" podID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerID="e7e93a72aa12a8f69855837328a4d689a927410276a76e415c61b52d26f99fc7" exitCode=0 May 28 17:23:38.870372 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.870277 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" event={"ID":"01d0f99d-702f-468e-9f70-6556e9df8b34","Type":"ContainerDied","Data":"e7e93a72aa12a8f69855837328a4d689a927410276a76e415c61b52d26f99fc7"} May 28 17:23:38.870372 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:38.870305 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" event={"ID":"01d0f99d-702f-468e-9f70-6556e9df8b34","Type":"ContainerStarted","Data":"90bd94268b363937db235a6a9bc3f75457d15b004c30f7f0b201b193bce81185"} May 28 17:23:39.875217 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:39.875130 2577 generic.go:358] "Generic (PLEG): container finished" podID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerID="391188d6da92d53d47f4d350c2f5fea18086c9c1072aa1aab345681291685690" exitCode=0 May 28 17:23:39.875580 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:39.875213 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" event={"ID":"01d0f99d-702f-468e-9f70-6556e9df8b34","Type":"ContainerDied","Data":"391188d6da92d53d47f4d350c2f5fea18086c9c1072aa1aab345681291685690"} May 28 17:23:40.880623 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:40.880586 2577 generic.go:358] "Generic (PLEG): container finished" podID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerID="8182d06fcccbd001ed1d645161dccc53c921f8dbcd8fd1e99974949fe3e066a1" exitCode=0 May 28 17:23:40.880995 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:40.880632 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" event={"ID":"01d0f99d-702f-468e-9f70-6556e9df8b34","Type":"ContainerDied","Data":"8182d06fcccbd001ed1d645161dccc53c921f8dbcd8fd1e99974949fe3e066a1"} May 28 17:23:42.024783 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.024761 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:42.145784 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.145692 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9pp5\" (UniqueName: \"kubernetes.io/projected/01d0f99d-702f-468e-9f70-6556e9df8b34-kube-api-access-m9pp5\") pod \"01d0f99d-702f-468e-9f70-6556e9df8b34\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " May 28 17:23:42.145784 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.145756 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-bundle\") pod \"01d0f99d-702f-468e-9f70-6556e9df8b34\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " May 28 17:23:42.146009 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.145823 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-util\") pod \"01d0f99d-702f-468e-9f70-6556e9df8b34\" (UID: \"01d0f99d-702f-468e-9f70-6556e9df8b34\") " May 28 17:23:42.146780 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.146747 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-bundle" (OuterVolumeSpecName: "bundle") pod "01d0f99d-702f-468e-9f70-6556e9df8b34" (UID: "01d0f99d-702f-468e-9f70-6556e9df8b34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:42.148199 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.148175 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d0f99d-702f-468e-9f70-6556e9df8b34-kube-api-access-m9pp5" (OuterVolumeSpecName: "kube-api-access-m9pp5") pod "01d0f99d-702f-468e-9f70-6556e9df8b34" (UID: "01d0f99d-702f-468e-9f70-6556e9df8b34"). InnerVolumeSpecName "kube-api-access-m9pp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:23:42.154860 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.154837 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-util" (OuterVolumeSpecName: "util") pod "01d0f99d-702f-468e-9f70-6556e9df8b34" (UID: "01d0f99d-702f-468e-9f70-6556e9df8b34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:23:42.247177 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.247152 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:42.247177 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.247176 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9pp5\" (UniqueName: \"kubernetes.io/projected/01d0f99d-702f-468e-9f70-6556e9df8b34-kube-api-access-m9pp5\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:42.247300 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.247186 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d0f99d-702f-468e-9f70-6556e9df8b34-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:23:42.887946 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.887914 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" event={"ID":"01d0f99d-702f-468e-9f70-6556e9df8b34","Type":"ContainerDied","Data":"90bd94268b363937db235a6a9bc3f75457d15b004c30f7f0b201b193bce81185"} May 28 17:23:42.887946 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.887944 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90bd94268b363937db235a6a9bc3f75457d15b004c30f7f0b201b193bce81185" May 28 17:23:42.887946 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:42.887932 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762af9xrx" May 28 17:23:44.309484 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:44.309433 2577 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:44.309863 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:44.309817 2577 scope.go:117] "RemoveContainer" containerID="2daff488f735ccb41db9d2ecee3b9421bf5bc4a3db4865b502ed93e21b40ad2c" May 28 17:23:44.896774 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:44.896741 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" event={"ID":"c715a88c-9fb4-45fa-b923-5ee8dcc5c132","Type":"ContainerStarted","Data":"664824f6c8365561fe7a2ce6cd1e4d78669a0f334b7fcc46492814b699d03504"} May 28 17:23:44.896968 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:44.896949 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:44.916578 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:44.916536 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" podStartSLOduration=2.625296861 podStartE2EDuration="22.916522036s" podCreationTimestamp="2026-05-28 17:23:22 +0000 UTC" firstStartedPulling="2026-05-28 17:23:24.441410052 +0000 UTC m=+327.355302861" lastFinishedPulling="2026-05-28 17:23:44.732635229 +0000 UTC m=+347.646528036" observedRunningTime="2026-05-28 17:23:44.91455821 +0000 UTC m=+347.828451042" watchObservedRunningTime="2026-05-28 17:23:44.916522036 +0000 UTC m=+347.830414865" May 28 17:23:55.903171 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:55.903138 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-5xv9h" May 28 17:23:58.755722 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.755684 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4"] May 28 17:23:58.756108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.755969 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerName="extract" May 28 17:23:58.756108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.755980 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerName="extract" May 28 17:23:58.756108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.755990 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerName="pull" May 28 17:23:58.756108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.755996 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerName="pull" May 28 17:23:58.756108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.756007 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerName="util" May 28 17:23:58.756108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.756012 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerName="util" May 28 17:23:58.756108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.756067 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="01d0f99d-702f-468e-9f70-6556e9df8b34" containerName="extract" May 28 17:23:58.759212 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.759196 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.761567 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.761527 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 28 17:23:58.761567 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.761539 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 17:23:58.761722 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.761568 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d8sqc\"" May 28 17:23:58.761722 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.761642 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 17:23:58.771295 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.771268 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4"] May 28 17:23:58.890061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890301 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890301 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a113ee-5bd0-4908-8c88-c44458edd4aa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890301 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc7vt\" (UniqueName: \"kubernetes.io/projected/41a113ee-5bd0-4908-8c88-c44458edd4aa-kube-api-access-xc7vt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890301 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890301 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890573 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.890573 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.890357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991476 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991509 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991525 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991551 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a113ee-5bd0-4908-8c88-c44458edd4aa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991567 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xc7vt\" (UniqueName: \"kubernetes.io/projected/41a113ee-5bd0-4908-8c88-c44458edd4aa-kube-api-access-xc7vt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991594 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991642 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991677 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.991737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991711 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.992091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991957 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.992091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.991966 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.992210 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.992092 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.992210 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.992139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.992351 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.992322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41a113ee-5bd0-4908-8c88-c44458edd4aa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.993910 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.993894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:58.994217 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:58.994195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:59.001954 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:59.001933 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41a113ee-5bd0-4908-8c88-c44458edd4aa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:59.002381 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:59.002362 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc7vt\" (UniqueName: \"kubernetes.io/projected/41a113ee-5bd0-4908-8c88-c44458edd4aa-kube-api-access-xc7vt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bkxld4\" (UID: \"41a113ee-5bd0-4908-8c88-c44458edd4aa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:59.070938 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:59.070907 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:23:59.203141 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:59.203112 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4"] May 28 17:23:59.204958 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:23:59.204928 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a113ee_5bd0_4908_8c88_c44458edd4aa.slice/crio-7afd1c963171770ff938cec5314e8615bc212c03be5efb6141fcf7ae7e6866e0 WatchSource:0}: Error finding container 7afd1c963171770ff938cec5314e8615bc212c03be5efb6141fcf7ae7e6866e0: Status 404 returned error can't find the container with id 7afd1c963171770ff938cec5314e8615bc212c03be5efb6141fcf7ae7e6866e0 May 28 17:23:59.948707 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:23:59.948669 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" event={"ID":"41a113ee-5bd0-4908-8c88-c44458edd4aa","Type":"ContainerStarted","Data":"7afd1c963171770ff938cec5314e8615bc212c03be5efb6141fcf7ae7e6866e0"} May 28 17:24:01.774223 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:01.774184 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 28 17:24:01.774560 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:01.774257 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 28 17:24:01.774560 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:01.774284 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 28 17:24:01.958026 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:01.957989 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" event={"ID":"41a113ee-5bd0-4908-8c88-c44458edd4aa","Type":"ContainerStarted","Data":"9c16ca9e548d779fe252dc2ab54c39e14cf425d5d1281c581d3d54451d40bac6"} May 28 17:24:01.983289 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:01.983223 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" podStartSLOduration=1.416239467 podStartE2EDuration="3.983204499s" podCreationTimestamp="2026-05-28 17:23:58 +0000 UTC" firstStartedPulling="2026-05-28 17:23:59.206956652 +0000 UTC m=+362.120849460" lastFinishedPulling="2026-05-28 17:24:01.773921678 +0000 UTC m=+364.687814492" observedRunningTime="2026-05-28 17:24:01.981005954 +0000 UTC m=+364.894898787" watchObservedRunningTime="2026-05-28 17:24:01.983204499 +0000 UTC m=+364.897097332" May 28 17:24:02.072108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:02.072022 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:24:02.076426 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:02.076401 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:24:02.960937 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:02.960902 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:24:02.961985 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:02.961968 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bkxld4" May 28 17:24:19.466342 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.466305 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dlw5k"] May 28 17:24:19.469424 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.469408 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" May 28 17:24:19.472804 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.472775 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 17:24:19.473747 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.473728 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 17:24:19.473868 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.473763 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2v5z7\"" May 28 17:24:19.478943 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.478918 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dlw5k"] May 28 17:24:19.559215 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.559182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95mqt\" (UniqueName: \"kubernetes.io/projected/6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3-kube-api-access-95mqt\") pod \"kuadrant-operator-catalog-dlw5k\" (UID: \"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3\") " pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" May 28 17:24:19.660531 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.660495 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95mqt\" (UniqueName: \"kubernetes.io/projected/6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3-kube-api-access-95mqt\") pod \"kuadrant-operator-catalog-dlw5k\" (UID: \"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3\") " pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" May 28 17:24:19.670419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.670381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95mqt\" (UniqueName: \"kubernetes.io/projected/6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3-kube-api-access-95mqt\") pod \"kuadrant-operator-catalog-dlw5k\" (UID: \"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3\") " pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" May 28 17:24:19.780076 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.780036 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" May 28 17:24:19.818731 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.818696 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dlw5k"] May 28 17:24:19.912919 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:19.912847 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dlw5k"] May 28 17:24:19.915526 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:19.915497 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4c5aa4_dc09_49c0_b9b7_3eafe64cead3.slice/crio-10c71101460846a54e9d5c04db622eba1aac839bf18d8daf97d828874248be41 WatchSource:0}: Error finding container 10c71101460846a54e9d5c04db622eba1aac839bf18d8daf97d828874248be41: Status 404 returned error can't find the container with id 10c71101460846a54e9d5c04db622eba1aac839bf18d8daf97d828874248be41 May 28 17:24:20.017937 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.017903 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" event={"ID":"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3","Type":"ContainerStarted","Data":"10c71101460846a54e9d5c04db622eba1aac839bf18d8daf97d828874248be41"} May 28 17:24:20.028739 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.028710 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dq2hg"] May 28 17:24:20.032921 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.032880 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:20.041693 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.041668 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dq2hg"] May 28 17:24:20.063096 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.063070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fdfs\" (UniqueName: \"kubernetes.io/projected/9422bc41-88a1-43f4-8f9d-403ea0f9c64d-kube-api-access-5fdfs\") pod \"kuadrant-operator-catalog-dq2hg\" (UID: \"9422bc41-88a1-43f4-8f9d-403ea0f9c64d\") " pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:20.163595 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.163565 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fdfs\" (UniqueName: \"kubernetes.io/projected/9422bc41-88a1-43f4-8f9d-403ea0f9c64d-kube-api-access-5fdfs\") pod \"kuadrant-operator-catalog-dq2hg\" (UID: \"9422bc41-88a1-43f4-8f9d-403ea0f9c64d\") " pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:20.173252 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.173232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fdfs\" (UniqueName: \"kubernetes.io/projected/9422bc41-88a1-43f4-8f9d-403ea0f9c64d-kube-api-access-5fdfs\") pod \"kuadrant-operator-catalog-dq2hg\" (UID: \"9422bc41-88a1-43f4-8f9d-403ea0f9c64d\") " pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:20.342402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.342328 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:20.519337 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:20.519310 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dq2hg"] May 28 17:24:20.548841 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:20.548805 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9422bc41_88a1_43f4_8f9d_403ea0f9c64d.slice/crio-0be5f9b2fe164a68eb9fd10b75bd4af83ac25b58ab1ec9817943da3bb1b3d8ee WatchSource:0}: Error finding container 0be5f9b2fe164a68eb9fd10b75bd4af83ac25b58ab1ec9817943da3bb1b3d8ee: Status 404 returned error can't find the container with id 0be5f9b2fe164a68eb9fd10b75bd4af83ac25b58ab1ec9817943da3bb1b3d8ee May 28 17:24:21.024149 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:21.024111 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" event={"ID":"9422bc41-88a1-43f4-8f9d-403ea0f9c64d","Type":"ContainerStarted","Data":"0be5f9b2fe164a68eb9fd10b75bd4af83ac25b58ab1ec9817943da3bb1b3d8ee"} May 28 17:24:22.028919 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.028884 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" event={"ID":"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3","Type":"ContainerStarted","Data":"93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c"} May 28 17:24:22.029420 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.028938 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" podUID="6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3" containerName="registry-server" containerID="cri-o://93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c" gracePeriod=2 May 28 17:24:22.030360 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.030335 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" event={"ID":"9422bc41-88a1-43f4-8f9d-403ea0f9c64d","Type":"ContainerStarted","Data":"96d0b3c2766046845884bc47b46c2982ecc27ef37e397697aa21796125ddfe7f"} May 28 17:24:22.049246 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.049069 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" podStartSLOduration=1.207612763 podStartE2EDuration="3.049053334s" podCreationTimestamp="2026-05-28 17:24:19 +0000 UTC" firstStartedPulling="2026-05-28 17:24:19.916913783 +0000 UTC m=+382.830806591" lastFinishedPulling="2026-05-28 17:24:21.758354355 +0000 UTC m=+384.672247162" observedRunningTime="2026-05-28 17:24:22.04797331 +0000 UTC m=+384.961866139" watchObservedRunningTime="2026-05-28 17:24:22.049053334 +0000 UTC m=+384.962946164" May 28 17:24:22.065752 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.065711 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" podStartSLOduration=0.856958607 podStartE2EDuration="2.065698418s" podCreationTimestamp="2026-05-28 17:24:20 +0000 UTC" firstStartedPulling="2026-05-28 17:24:20.550191181 +0000 UTC m=+383.464083990" lastFinishedPulling="2026-05-28 17:24:21.75893099 +0000 UTC m=+384.672823801" observedRunningTime="2026-05-28 17:24:22.064207406 +0000 UTC m=+384.978100235" watchObservedRunningTime="2026-05-28 17:24:22.065698418 +0000 UTC m=+384.979591249" May 28 17:24:22.269612 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.269588 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" May 28 17:24:22.384668 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.384580 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95mqt\" (UniqueName: \"kubernetes.io/projected/6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3-kube-api-access-95mqt\") pod \"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3\" (UID: \"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3\") " May 28 17:24:22.386902 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.386880 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3-kube-api-access-95mqt" (OuterVolumeSpecName: "kube-api-access-95mqt") pod "6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3" (UID: "6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3"). InnerVolumeSpecName "kube-api-access-95mqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:22.486031 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:22.485993 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95mqt\" (UniqueName: \"kubernetes.io/projected/6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3-kube-api-access-95mqt\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:23.035204 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.035113 2577 generic.go:358] "Generic (PLEG): container finished" podID="6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3" containerID="93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c" exitCode=0 May 28 17:24:23.035204 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.035171 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" May 28 17:24:23.035677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.035202 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" event={"ID":"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3","Type":"ContainerDied","Data":"93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c"} May 28 17:24:23.035677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.035238 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dlw5k" event={"ID":"6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3","Type":"ContainerDied","Data":"10c71101460846a54e9d5c04db622eba1aac839bf18d8daf97d828874248be41"} May 28 17:24:23.035677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.035253 2577 scope.go:117] "RemoveContainer" containerID="93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c" May 28 17:24:23.043941 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.043924 2577 scope.go:117] "RemoveContainer" containerID="93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c" May 28 17:24:23.044184 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:24:23.044167 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c\": container with ID starting with 93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c not found: ID does not exist" containerID="93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c" May 28 17:24:23.044237 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.044192 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c"} err="failed to get container status \"93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c\": rpc error: code = NotFound desc = could not find container \"93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c\": container with ID starting with 93e6bd7e1fe3c1ba8ee1b20ef0e4404b271d3d8e1d7dbb03985fd228e2698e1c not found: ID does not exist" May 28 17:24:23.060091 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.060066 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dlw5k"] May 28 17:24:23.062136 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.062116 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dlw5k"] May 28 17:24:23.728038 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:23.728006 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3" path="/var/lib/kubelet/pods/6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3/volumes" May 28 17:24:30.343087 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:30.343052 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:30.343087 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:30.343092 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:30.364582 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:30.364559 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:31.084647 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:31.084618 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dq2hg" May 28 17:24:35.276930 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.276896 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl"] May 28 17:24:35.277353 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.277227 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3" containerName="registry-server" May 28 17:24:35.277353 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.277240 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3" containerName="registry-server" May 28 17:24:35.277353 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.277305 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d4c5aa4-dc09-49c0-b9b7-3eafe64cead3" containerName="registry-server" May 28 17:24:35.285593 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.285570 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.288584 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.288560 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2tszw\"" May 28 17:24:35.290491 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.290449 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl"] May 28 17:24:35.393513 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.393474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.393692 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.393521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmwt\" (UniqueName: \"kubernetes.io/projected/c315ecee-a586-40d4-997c-a65e31bb2260-kube-api-access-mmmwt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.393692 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.393571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.494111 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.494081 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.494111 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.494112 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmwt\" (UniqueName: \"kubernetes.io/projected/c315ecee-a586-40d4-997c-a65e31bb2260-kube-api-access-mmmwt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.494334 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.494153 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.494510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.494489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.494615 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.494493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.506214 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.506189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmwt\" (UniqueName: \"kubernetes.io/projected/c315ecee-a586-40d4-997c-a65e31bb2260-kube-api-access-mmmwt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.595271 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.595188 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:35.681577 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.681544 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq"] May 28 17:24:35.686668 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.686647 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.694281 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.694254 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq"] May 28 17:24:35.728598 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.728577 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl"] May 28 17:24:35.730693 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:35.730662 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc315ecee_a586_40d4_997c_a65e31bb2260.slice/crio-1a47ceff9f03d9e10822c1a9aeaef552861d73986bb884cfd1da2098cbb13b14 WatchSource:0}: Error finding container 1a47ceff9f03d9e10822c1a9aeaef552861d73986bb884cfd1da2098cbb13b14: Status 404 returned error can't find the container with id 1a47ceff9f03d9e10822c1a9aeaef552861d73986bb884cfd1da2098cbb13b14 May 28 17:24:35.796200 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.796174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmzjx\" (UniqueName: \"kubernetes.io/projected/77c89060-b4de-457c-a816-770af9e10c40-kube-api-access-vmzjx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.796298 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.796282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.796358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.796314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.897151 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.897088 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.897151 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.897131 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.897344 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.897227 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmzjx\" (UniqueName: \"kubernetes.io/projected/77c89060-b4de-457c-a816-770af9e10c40-kube-api-access-vmzjx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.897475 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.897427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.897585 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.897481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.906966 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.906943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmzjx\" (UniqueName: \"kubernetes.io/projected/77c89060-b4de-457c-a816-770af9e10c40-kube-api-access-vmzjx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:35.999502 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:35.999478 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:36.082219 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.082170 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5"] May 28 17:24:36.085380 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.085317 2577 generic.go:358] "Generic (PLEG): container finished" podID="c315ecee-a586-40d4-997c-a65e31bb2260" containerID="613f0f4c7c2c1642c6d739d572c87441b55a71c4e6e58d67bb76a4f9cbee0d30" exitCode=0 May 28 17:24:36.087263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.087237 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" event={"ID":"c315ecee-a586-40d4-997c-a65e31bb2260","Type":"ContainerDied","Data":"613f0f4c7c2c1642c6d739d572c87441b55a71c4e6e58d67bb76a4f9cbee0d30"} May 28 17:24:36.087365 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.087272 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" event={"ID":"c315ecee-a586-40d4-997c-a65e31bb2260","Type":"ContainerStarted","Data":"1a47ceff9f03d9e10822c1a9aeaef552861d73986bb884cfd1da2098cbb13b14"} May 28 17:24:36.087407 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.087373 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.098764 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.098721 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5"] May 28 17:24:36.130032 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.130007 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq"] May 28 17:24:36.132369 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:36.132340 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c89060_b4de_457c_a816_770af9e10c40.slice/crio-e71691dd7facbac455dff64b2d4bffe1ab19ed385e45461b00520e52a359b9ac WatchSource:0}: Error finding container e71691dd7facbac455dff64b2d4bffe1ab19ed385e45461b00520e52a359b9ac: Status 404 returned error can't find the container with id e71691dd7facbac455dff64b2d4bffe1ab19ed385e45461b00520e52a359b9ac May 28 17:24:36.200050 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.200009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfpt2\" (UniqueName: \"kubernetes.io/projected/be722477-e156-4626-abcf-2603a552b9d5-kube-api-access-xfpt2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.200161 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.200112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.200161 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.200144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.300678 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.300644 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfpt2\" (UniqueName: \"kubernetes.io/projected/be722477-e156-4626-abcf-2603a552b9d5-kube-api-access-xfpt2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.301006 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.300704 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.301006 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.300734 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.301082 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.301044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.301120 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.301082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.311028 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.311001 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfpt2\" (UniqueName: \"kubernetes.io/projected/be722477-e156-4626-abcf-2603a552b9d5-kube-api-access-xfpt2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.401114 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.401033 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:36.492216 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.492179 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6"] May 28 17:24:36.497851 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.497810 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.511601 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.511576 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6"] May 28 17:24:36.532699 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.532639 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5"] May 28 17:24:36.535331 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:36.535305 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe722477_e156_4626_abcf_2603a552b9d5.slice/crio-af2962bd304f44cfc0ab898c07b82d95fe9e701c3720c1cf0db0f137e54f5d08 WatchSource:0}: Error finding container af2962bd304f44cfc0ab898c07b82d95fe9e701c3720c1cf0db0f137e54f5d08: Status 404 returned error can't find the container with id af2962bd304f44cfc0ab898c07b82d95fe9e701c3720c1cf0db0f137e54f5d08 May 28 17:24:36.603537 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.603513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4qrg\" (UniqueName: \"kubernetes.io/projected/35c9df4b-5138-4846-84a2-ccced63776a2-kube-api-access-h4qrg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.603648 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.603555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.603648 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.603586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.704809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.704780 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4qrg\" (UniqueName: \"kubernetes.io/projected/35c9df4b-5138-4846-84a2-ccced63776a2-kube-api-access-h4qrg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.704946 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.704822 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.704946 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.704854 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.705133 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.705117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.705218 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.705196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.719518 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.719488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4qrg\" (UniqueName: \"kubernetes.io/projected/35c9df4b-5138-4846-84a2-ccced63776a2-kube-api-access-h4qrg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.822872 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.822852 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:36.961128 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:36.961101 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6"] May 28 17:24:36.968337 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:36.968301 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c9df4b_5138_4846_84a2_ccced63776a2.slice/crio-869fe800bb58b9cb745315f9ba67c5de1186a2d1a4692c4516e7113fd8b3f388 WatchSource:0}: Error finding container 869fe800bb58b9cb745315f9ba67c5de1186a2d1a4692c4516e7113fd8b3f388: Status 404 returned error can't find the container with id 869fe800bb58b9cb745315f9ba67c5de1186a2d1a4692c4516e7113fd8b3f388 May 28 17:24:37.089724 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.089692 2577 generic.go:358] "Generic (PLEG): container finished" podID="be722477-e156-4626-abcf-2603a552b9d5" containerID="6e5a9b94b8badc3d5bc3a15a028d41aad593343729c7365fc333ded17519f25b" exitCode=0 May 28 17:24:37.089851 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.089771 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" event={"ID":"be722477-e156-4626-abcf-2603a552b9d5","Type":"ContainerDied","Data":"6e5a9b94b8badc3d5bc3a15a028d41aad593343729c7365fc333ded17519f25b"} May 28 17:24:37.089851 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.089809 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" event={"ID":"be722477-e156-4626-abcf-2603a552b9d5","Type":"ContainerStarted","Data":"af2962bd304f44cfc0ab898c07b82d95fe9e701c3720c1cf0db0f137e54f5d08"} May 28 17:24:37.091097 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.091074 2577 generic.go:358] "Generic (PLEG): container finished" podID="35c9df4b-5138-4846-84a2-ccced63776a2" containerID="7bd58e77e1889eef7bd2bbaa8bd9846711a4593bd25ec406f882e3036facd9e7" exitCode=0 May 28 17:24:37.091204 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.091167 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" event={"ID":"35c9df4b-5138-4846-84a2-ccced63776a2","Type":"ContainerDied","Data":"7bd58e77e1889eef7bd2bbaa8bd9846711a4593bd25ec406f882e3036facd9e7"} May 28 17:24:37.091204 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.091191 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" event={"ID":"35c9df4b-5138-4846-84a2-ccced63776a2","Type":"ContainerStarted","Data":"869fe800bb58b9cb745315f9ba67c5de1186a2d1a4692c4516e7113fd8b3f388"} May 28 17:24:37.092668 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.092645 2577 generic.go:358] "Generic (PLEG): container finished" podID="77c89060-b4de-457c-a816-770af9e10c40" containerID="78b568f49db0d7d6c999129805ae0355dcb9e850922b9d0a364e7754088eb8e0" exitCode=0 May 28 17:24:37.092776 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.092724 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" event={"ID":"77c89060-b4de-457c-a816-770af9e10c40","Type":"ContainerDied","Data":"78b568f49db0d7d6c999129805ae0355dcb9e850922b9d0a364e7754088eb8e0"} May 28 17:24:37.092776 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.092755 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" event={"ID":"77c89060-b4de-457c-a816-770af9e10c40","Type":"ContainerStarted","Data":"e71691dd7facbac455dff64b2d4bffe1ab19ed385e45461b00520e52a359b9ac"} May 28 17:24:37.094807 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.094784 2577 generic.go:358] "Generic (PLEG): container finished" podID="c315ecee-a586-40d4-997c-a65e31bb2260" containerID="da728be5f85b70653f076041c26d51632a686244d1e32c5b16ef9b1426bea455" exitCode=0 May 28 17:24:37.094913 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:37.094822 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" event={"ID":"c315ecee-a586-40d4-997c-a65e31bb2260","Type":"ContainerDied","Data":"da728be5f85b70653f076041c26d51632a686244d1e32c5b16ef9b1426bea455"} May 28 17:24:38.099812 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.099781 2577 generic.go:358] "Generic (PLEG): container finished" podID="c315ecee-a586-40d4-997c-a65e31bb2260" containerID="9a6f8e28fa22113d3fda01ed457e6135efd824bbb62632ebe959c62076631cf5" exitCode=0 May 28 17:24:38.100187 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.099917 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" event={"ID":"c315ecee-a586-40d4-997c-a65e31bb2260","Type":"ContainerDied","Data":"9a6f8e28fa22113d3fda01ed457e6135efd824bbb62632ebe959c62076631cf5"} May 28 17:24:38.101447 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.101423 2577 generic.go:358] "Generic (PLEG): container finished" podID="be722477-e156-4626-abcf-2603a552b9d5" containerID="34f25ee9fc40602813c1336807ecc6ac0f836d2a3aeebb5f8d370d03c330b800" exitCode=0 May 28 17:24:38.101603 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.101512 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" event={"ID":"be722477-e156-4626-abcf-2603a552b9d5","Type":"ContainerDied","Data":"34f25ee9fc40602813c1336807ecc6ac0f836d2a3aeebb5f8d370d03c330b800"} May 28 17:24:38.103107 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.103087 2577 generic.go:358] "Generic (PLEG): container finished" podID="35c9df4b-5138-4846-84a2-ccced63776a2" containerID="89c6ad1299c42156a905800d5612950d998482e21c56cd0a50a68901fa406cb1" exitCode=0 May 28 17:24:38.103167 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.103126 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" event={"ID":"35c9df4b-5138-4846-84a2-ccced63776a2","Type":"ContainerDied","Data":"89c6ad1299c42156a905800d5612950d998482e21c56cd0a50a68901fa406cb1"} May 28 17:24:38.105005 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.104954 2577 generic.go:358] "Generic (PLEG): container finished" podID="77c89060-b4de-457c-a816-770af9e10c40" containerID="eef829e434b41a699662cc7bf394cfd4f8a24f1f7078ae6035fca15a48a33eac" exitCode=0 May 28 17:24:38.105123 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:38.105032 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" event={"ID":"77c89060-b4de-457c-a816-770af9e10c40","Type":"ContainerDied","Data":"eef829e434b41a699662cc7bf394cfd4f8a24f1f7078ae6035fca15a48a33eac"} May 28 17:24:39.111054 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.111021 2577 generic.go:358] "Generic (PLEG): container finished" podID="be722477-e156-4626-abcf-2603a552b9d5" containerID="8d9c6640d125e98edc273fe95c1407b87ca1c949598f85da48ed37725ed5f447" exitCode=0 May 28 17:24:39.111493 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.111113 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" event={"ID":"be722477-e156-4626-abcf-2603a552b9d5","Type":"ContainerDied","Data":"8d9c6640d125e98edc273fe95c1407b87ca1c949598f85da48ed37725ed5f447"} May 28 17:24:39.112920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.112893 2577 generic.go:358] "Generic (PLEG): container finished" podID="35c9df4b-5138-4846-84a2-ccced63776a2" containerID="b806a0818a73088750b7903dd13940d9cb40423d5e90a38a49ed78797d6ca150" exitCode=0 May 28 17:24:39.113042 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.112966 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" event={"ID":"35c9df4b-5138-4846-84a2-ccced63776a2","Type":"ContainerDied","Data":"b806a0818a73088750b7903dd13940d9cb40423d5e90a38a49ed78797d6ca150"} May 28 17:24:39.114702 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.114679 2577 generic.go:358] "Generic (PLEG): container finished" podID="77c89060-b4de-457c-a816-770af9e10c40" containerID="019af968ec965138b26fd78781a9d008b925ed4e6071a3f359b5175ff31c0000" exitCode=0 May 28 17:24:39.114814 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.114752 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" event={"ID":"77c89060-b4de-457c-a816-770af9e10c40","Type":"ContainerDied","Data":"019af968ec965138b26fd78781a9d008b925ed4e6071a3f359b5175ff31c0000"} May 28 17:24:39.243948 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.243923 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:39.327475 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.327420 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmmwt\" (UniqueName: \"kubernetes.io/projected/c315ecee-a586-40d4-997c-a65e31bb2260-kube-api-access-mmmwt\") pod \"c315ecee-a586-40d4-997c-a65e31bb2260\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " May 28 17:24:39.327618 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.327519 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-util\") pod \"c315ecee-a586-40d4-997c-a65e31bb2260\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " May 28 17:24:39.327618 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.327580 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-bundle\") pod \"c315ecee-a586-40d4-997c-a65e31bb2260\" (UID: \"c315ecee-a586-40d4-997c-a65e31bb2260\") " May 28 17:24:39.328088 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.328018 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-bundle" (OuterVolumeSpecName: "bundle") pod "c315ecee-a586-40d4-997c-a65e31bb2260" (UID: "c315ecee-a586-40d4-997c-a65e31bb2260"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:39.329654 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.329626 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c315ecee-a586-40d4-997c-a65e31bb2260-kube-api-access-mmmwt" (OuterVolumeSpecName: "kube-api-access-mmmwt") pod "c315ecee-a586-40d4-997c-a65e31bb2260" (UID: "c315ecee-a586-40d4-997c-a65e31bb2260"). InnerVolumeSpecName "kube-api-access-mmmwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:39.332498 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.332479 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-util" (OuterVolumeSpecName: "util") pod "c315ecee-a586-40d4-997c-a65e31bb2260" (UID: "c315ecee-a586-40d4-997c-a65e31bb2260"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:39.428502 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.428409 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:39.428502 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.428437 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmmwt\" (UniqueName: \"kubernetes.io/projected/c315ecee-a586-40d4-997c-a65e31bb2260-kube-api-access-mmmwt\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:39.428502 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:39.428447 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c315ecee-a586-40d4-997c-a65e31bb2260-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.119727 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.119701 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" May 28 17:24:40.120134 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.119737 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl" event={"ID":"c315ecee-a586-40d4-997c-a65e31bb2260","Type":"ContainerDied","Data":"1a47ceff9f03d9e10822c1a9aeaef552861d73986bb884cfd1da2098cbb13b14"} May 28 17:24:40.120134 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.119770 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a47ceff9f03d9e10822c1a9aeaef552861d73986bb884cfd1da2098cbb13b14" May 28 17:24:40.320567 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.320548 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:40.323759 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.323739 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:40.327172 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.327154 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:40.436252 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436169 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4qrg\" (UniqueName: \"kubernetes.io/projected/35c9df4b-5138-4846-84a2-ccced63776a2-kube-api-access-h4qrg\") pod \"35c9df4b-5138-4846-84a2-ccced63776a2\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " May 28 17:24:40.436419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436266 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-bundle\") pod \"77c89060-b4de-457c-a816-770af9e10c40\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " May 28 17:24:40.436419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436293 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfpt2\" (UniqueName: \"kubernetes.io/projected/be722477-e156-4626-abcf-2603a552b9d5-kube-api-access-xfpt2\") pod \"be722477-e156-4626-abcf-2603a552b9d5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " May 28 17:24:40.436419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436328 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-bundle\") pod \"35c9df4b-5138-4846-84a2-ccced63776a2\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " May 28 17:24:40.436419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436362 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-util\") pod \"be722477-e156-4626-abcf-2603a552b9d5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " May 28 17:24:40.436419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436391 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-util\") pod \"77c89060-b4de-457c-a816-770af9e10c40\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " May 28 17:24:40.436419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436417 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-bundle\") pod \"be722477-e156-4626-abcf-2603a552b9d5\" (UID: \"be722477-e156-4626-abcf-2603a552b9d5\") " May 28 17:24:40.436776 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436445 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmzjx\" (UniqueName: \"kubernetes.io/projected/77c89060-b4de-457c-a816-770af9e10c40-kube-api-access-vmzjx\") pod \"77c89060-b4de-457c-a816-770af9e10c40\" (UID: \"77c89060-b4de-457c-a816-770af9e10c40\") " May 28 17:24:40.436776 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.436513 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-util\") pod \"35c9df4b-5138-4846-84a2-ccced63776a2\" (UID: \"35c9df4b-5138-4846-84a2-ccced63776a2\") " May 28 17:24:40.437502 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.437217 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-bundle" (OuterVolumeSpecName: "bundle") pod "35c9df4b-5138-4846-84a2-ccced63776a2" (UID: "35c9df4b-5138-4846-84a2-ccced63776a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:40.437502 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.437229 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-bundle" (OuterVolumeSpecName: "bundle") pod "be722477-e156-4626-abcf-2603a552b9d5" (UID: "be722477-e156-4626-abcf-2603a552b9d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:40.437502 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.437298 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-bundle" (OuterVolumeSpecName: "bundle") pod "77c89060-b4de-457c-a816-770af9e10c40" (UID: "77c89060-b4de-457c-a816-770af9e10c40"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:40.438942 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.438910 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c9df4b-5138-4846-84a2-ccced63776a2-kube-api-access-h4qrg" (OuterVolumeSpecName: "kube-api-access-h4qrg") pod "35c9df4b-5138-4846-84a2-ccced63776a2" (UID: "35c9df4b-5138-4846-84a2-ccced63776a2"). InnerVolumeSpecName "kube-api-access-h4qrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:40.439035 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.438971 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be722477-e156-4626-abcf-2603a552b9d5-kube-api-access-xfpt2" (OuterVolumeSpecName: "kube-api-access-xfpt2") pod "be722477-e156-4626-abcf-2603a552b9d5" (UID: "be722477-e156-4626-abcf-2603a552b9d5"). InnerVolumeSpecName "kube-api-access-xfpt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:40.439198 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.439179 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c89060-b4de-457c-a816-770af9e10c40-kube-api-access-vmzjx" (OuterVolumeSpecName: "kube-api-access-vmzjx") pod "77c89060-b4de-457c-a816-770af9e10c40" (UID: "77c89060-b4de-457c-a816-770af9e10c40"). InnerVolumeSpecName "kube-api-access-vmzjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:24:40.442676 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.442652 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-util" (OuterVolumeSpecName: "util") pod "be722477-e156-4626-abcf-2603a552b9d5" (UID: "be722477-e156-4626-abcf-2603a552b9d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:40.443105 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.443087 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-util" (OuterVolumeSpecName: "util") pod "35c9df4b-5138-4846-84a2-ccced63776a2" (UID: "35c9df4b-5138-4846-84a2-ccced63776a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:40.443402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.443378 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-util" (OuterVolumeSpecName: "util") pod "77c89060-b4de-457c-a816-770af9e10c40" (UID: "77c89060-b4de-457c-a816-770af9e10c40"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:24:40.537966 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.537936 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.537966 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.537961 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfpt2\" (UniqueName: \"kubernetes.io/projected/be722477-e156-4626-abcf-2603a552b9d5-kube-api-access-xfpt2\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.537966 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.537970 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.538176 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.537979 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.538176 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.537987 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c89060-b4de-457c-a816-770af9e10c40-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.538176 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.537995 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be722477-e156-4626-abcf-2603a552b9d5-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.538176 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.538003 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmzjx\" (UniqueName: \"kubernetes.io/projected/77c89060-b4de-457c-a816-770af9e10c40-kube-api-access-vmzjx\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.538176 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.538011 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35c9df4b-5138-4846-84a2-ccced63776a2-util\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:40.538176 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:40.538020 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4qrg\" (UniqueName: \"kubernetes.io/projected/35c9df4b-5138-4846-84a2-ccced63776a2-kube-api-access-h4qrg\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:24:41.124988 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.124953 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" event={"ID":"be722477-e156-4626-abcf-2603a552b9d5","Type":"ContainerDied","Data":"af2962bd304f44cfc0ab898c07b82d95fe9e701c3720c1cf0db0f137e54f5d08"} May 28 17:24:41.124988 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.124994 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af2962bd304f44cfc0ab898c07b82d95fe9e701c3720c1cf0db0f137e54f5d08" May 28 17:24:41.125440 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.124964 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5" May 28 17:24:41.126670 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.126643 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" May 28 17:24:41.126859 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.126641 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6" event={"ID":"35c9df4b-5138-4846-84a2-ccced63776a2","Type":"ContainerDied","Data":"869fe800bb58b9cb745315f9ba67c5de1186a2d1a4692c4516e7113fd8b3f388"} May 28 17:24:41.126859 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.126742 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="869fe800bb58b9cb745315f9ba67c5de1186a2d1a4692c4516e7113fd8b3f388" May 28 17:24:41.128530 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.128508 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" May 28 17:24:41.128530 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.128518 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq" event={"ID":"77c89060-b4de-457c-a816-770af9e10c40","Type":"ContainerDied","Data":"e71691dd7facbac455dff64b2d4bffe1ab19ed385e45461b00520e52a359b9ac"} May 28 17:24:41.128691 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:41.128543 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e71691dd7facbac455dff64b2d4bffe1ab19ed385e45461b00520e52a359b9ac" May 28 17:24:45.394202 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394167 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj"] May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394466 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c89060-b4de-457c-a816-770af9e10c40" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394478 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c89060-b4de-457c-a816-770af9e10c40" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394488 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c315ecee-a586-40d4-997c-a65e31bb2260" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394494 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c315ecee-a586-40d4-997c-a65e31bb2260" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394500 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c315ecee-a586-40d4-997c-a65e31bb2260" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394505 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c315ecee-a586-40d4-997c-a65e31bb2260" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394510 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c9df4b-5138-4846-84a2-ccced63776a2" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394515 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c9df4b-5138-4846-84a2-ccced63776a2" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394522 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c315ecee-a586-40d4-997c-a65e31bb2260" containerName="pull" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394527 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c315ecee-a586-40d4-997c-a65e31bb2260" containerName="pull" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394532 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be722477-e156-4626-abcf-2603a552b9d5" containerName="pull" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394537 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be722477-e156-4626-abcf-2603a552b9d5" containerName="pull" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394545 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c89060-b4de-457c-a816-770af9e10c40" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394550 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c89060-b4de-457c-a816-770af9e10c40" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394557 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be722477-e156-4626-abcf-2603a552b9d5" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394561 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be722477-e156-4626-abcf-2603a552b9d5" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394566 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be722477-e156-4626-abcf-2603a552b9d5" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394571 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be722477-e156-4626-abcf-2603a552b9d5" containerName="extract" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394578 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c9df4b-5138-4846-84a2-ccced63776a2" containerName="pull" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394583 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c9df4b-5138-4846-84a2-ccced63776a2" containerName="pull" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394587 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c9df4b-5138-4846-84a2-ccced63776a2" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394592 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c9df4b-5138-4846-84a2-ccced63776a2" containerName="util" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394600 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c89060-b4de-457c-a816-770af9e10c40" containerName="pull" May 28 17:24:45.394597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394605 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c89060-b4de-457c-a816-770af9e10c40" containerName="pull" May 28 17:24:45.395402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394659 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="35c9df4b-5138-4846-84a2-ccced63776a2" containerName="extract" May 28 17:24:45.395402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394667 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="be722477-e156-4626-abcf-2603a552b9d5" containerName="extract" May 28 17:24:45.395402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394673 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="c315ecee-a586-40d4-997c-a65e31bb2260" containerName="extract" May 28 17:24:45.395402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.394679 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="77c89060-b4de-457c-a816-770af9e10c40" containerName="extract" May 28 17:24:45.397592 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.397576 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:24:45.400131 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.400113 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w5vnz\"" May 28 17:24:45.407428 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.407406 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj"] May 28 17:24:45.478173 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.478139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvt55\" (UniqueName: \"kubernetes.io/projected/45b2fb9a-0350-4b7d-997b-22215d2849c1-kube-api-access-dvt55\") pod \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" (UID: \"45b2fb9a-0350-4b7d-997b-22215d2849c1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:24:45.579328 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.579296 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvt55\" (UniqueName: \"kubernetes.io/projected/45b2fb9a-0350-4b7d-997b-22215d2849c1-kube-api-access-dvt55\") pod \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" (UID: \"45b2fb9a-0350-4b7d-997b-22215d2849c1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:24:45.589951 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.589922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvt55\" (UniqueName: \"kubernetes.io/projected/45b2fb9a-0350-4b7d-997b-22215d2849c1-kube-api-access-dvt55\") pod \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" (UID: \"45b2fb9a-0350-4b7d-997b-22215d2849c1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:24:45.708439 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.708357 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:24:45.844076 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:45.844022 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj"] May 28 17:24:45.846439 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:45.846412 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b2fb9a_0350_4b7d_997b_22215d2849c1.slice/crio-d7619513fe2117bd9a2449a841129a37087df7cc0a2d8221762b8bac5345e4dd WatchSource:0}: Error finding container d7619513fe2117bd9a2449a841129a37087df7cc0a2d8221762b8bac5345e4dd: Status 404 returned error can't find the container with id d7619513fe2117bd9a2449a841129a37087df7cc0a2d8221762b8bac5345e4dd May 28 17:24:46.147431 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:46.147394 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" event={"ID":"45b2fb9a-0350-4b7d-997b-22215d2849c1","Type":"ContainerStarted","Data":"d7619513fe2117bd9a2449a841129a37087df7cc0a2d8221762b8bac5345e4dd"} May 28 17:24:47.153056 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:47.153029 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" event={"ID":"45b2fb9a-0350-4b7d-997b-22215d2849c1","Type":"ContainerStarted","Data":"00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c"} May 28 17:24:47.153359 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:47.153118 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:24:47.178691 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:47.178643 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" podStartSLOduration=0.962823818 podStartE2EDuration="2.178628779s" podCreationTimestamp="2026-05-28 17:24:45 +0000 UTC" firstStartedPulling="2026-05-28 17:24:45.848735812 +0000 UTC m=+408.762628621" lastFinishedPulling="2026-05-28 17:24:47.064540773 +0000 UTC m=+409.978433582" observedRunningTime="2026-05-28 17:24:47.176961117 +0000 UTC m=+410.090853946" watchObservedRunningTime="2026-05-28 17:24:47.178628779 +0000 UTC m=+410.092521609" May 28 17:24:51.012416 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.012377 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw"] May 28 17:24:51.015775 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.015756 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.018144 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.018123 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cxzmg\"" May 28 17:24:51.029100 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.029074 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw"] May 28 17:24:51.133678 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.133645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffffx\" (UniqueName: \"kubernetes.io/projected/4cac5e12-533c-4022-a182-c0c8b86e69f6-kube-api-access-ffffx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.133847 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.133726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cac5e12-533c-4022-a182-c0c8b86e69f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.234693 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.234649 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cac5e12-533c-4022-a182-c0c8b86e69f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.234882 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.234737 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffffx\" (UniqueName: \"kubernetes.io/projected/4cac5e12-533c-4022-a182-c0c8b86e69f6-kube-api-access-ffffx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.235104 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.235081 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cac5e12-533c-4022-a182-c0c8b86e69f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.246723 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.246693 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffffx\" (UniqueName: \"kubernetes.io/projected/4cac5e12-533c-4022-a182-c0c8b86e69f6-kube-api-access-ffffx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.325212 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.325132 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:51.459681 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:51.459652 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw"] May 28 17:24:51.461367 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:51.461340 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cac5e12_533c_4022_a182_c0c8b86e69f6.slice/crio-c493fe46ee1be190e03165bf15d5e0aba0401601f655a3fb9d9ea32a741c2b7d WatchSource:0}: Error finding container c493fe46ee1be190e03165bf15d5e0aba0401601f655a3fb9d9ea32a741c2b7d: Status 404 returned error can't find the container with id c493fe46ee1be190e03165bf15d5e0aba0401601f655a3fb9d9ea32a741c2b7d May 28 17:24:52.173555 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:52.173514 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" event={"ID":"4cac5e12-533c-4022-a182-c0c8b86e69f6","Type":"ContainerStarted","Data":"c493fe46ee1be190e03165bf15d5e0aba0401601f655a3fb9d9ea32a741c2b7d"} May 28 17:24:55.186569 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:55.186469 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" event={"ID":"4cac5e12-533c-4022-a182-c0c8b86e69f6","Type":"ContainerStarted","Data":"c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422"} May 28 17:24:55.186953 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:55.186570 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:24:55.218966 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:55.218910 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" podStartSLOduration=1.775085282 podStartE2EDuration="5.218894438s" podCreationTimestamp="2026-05-28 17:24:50 +0000 UTC" firstStartedPulling="2026-05-28 17:24:51.463738696 +0000 UTC m=+414.377631504" lastFinishedPulling="2026-05-28 17:24:54.907547852 +0000 UTC m=+417.821440660" observedRunningTime="2026-05-28 17:24:55.215757703 +0000 UTC m=+418.129650537" watchObservedRunningTime="2026-05-28 17:24:55.218894438 +0000 UTC m=+418.132787267" May 28 17:24:57.877262 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.877180 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj"] May 28 17:24:57.881799 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.881783 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:57.884275 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.884254 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 28 17:24:57.884363 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.884261 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2tszw\"" May 28 17:24:57.884363 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.884302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cea7d5c4-a2ba-4494-abe3-fee104e24f51-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:57.884363 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.884328 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 28 17:24:57.884540 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.884378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cea7d5c4-a2ba-4494-abe3-fee104e24f51-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:57.884540 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.884420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dn9b\" (UniqueName: \"kubernetes.io/projected/cea7d5c4-a2ba-4494-abe3-fee104e24f51-kube-api-access-8dn9b\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:57.891114 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.891088 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj"] May 28 17:24:57.985304 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.985269 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cea7d5c4-a2ba-4494-abe3-fee104e24f51-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:57.985526 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.985321 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dn9b\" (UniqueName: \"kubernetes.io/projected/cea7d5c4-a2ba-4494-abe3-fee104e24f51-kube-api-access-8dn9b\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:57.985526 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.985391 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cea7d5c4-a2ba-4494-abe3-fee104e24f51-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:57.985526 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:24:57.985514 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 28 17:24:57.985700 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:24:57.985581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea7d5c4-a2ba-4494-abe3-fee104e24f51-plugin-serving-cert podName:cea7d5c4-a2ba-4494-abe3-fee104e24f51 nodeName:}" failed. No retries permitted until 2026-05-28 17:24:58.485560453 +0000 UTC m=+421.399453268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/cea7d5c4-a2ba-4494-abe3-fee104e24f51-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-mmllj" (UID: "cea7d5c4-a2ba-4494-abe3-fee104e24f51") : secret "plugin-serving-cert" not found May 28 17:24:57.985895 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:57.985874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cea7d5c4-a2ba-4494-abe3-fee104e24f51-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:58.001076 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:58.001047 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dn9b\" (UniqueName: \"kubernetes.io/projected/cea7d5c4-a2ba-4494-abe3-fee104e24f51-kube-api-access-8dn9b\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:58.160406 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:58.160310 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:24:58.489154 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:58.489070 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cea7d5c4-a2ba-4494-abe3-fee104e24f51-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:58.491641 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:58.491609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cea7d5c4-a2ba-4494-abe3-fee104e24f51-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mmllj\" (UID: \"cea7d5c4-a2ba-4494-abe3-fee104e24f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:58.790791 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:58.790754 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" May 28 17:24:58.926637 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:58.926608 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj"] May 28 17:24:58.928827 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:24:58.928802 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcea7d5c4_a2ba_4494_abe3_fee104e24f51.slice/crio-3e7cfd610eb9e9449353cd3049687a2506a54f15f1b0b38ec101e1138e2c3fda WatchSource:0}: Error finding container 3e7cfd610eb9e9449353cd3049687a2506a54f15f1b0b38ec101e1138e2c3fda: Status 404 returned error can't find the container with id 3e7cfd610eb9e9449353cd3049687a2506a54f15f1b0b38ec101e1138e2c3fda May 28 17:24:59.203088 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:24:59.203001 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" event={"ID":"cea7d5c4-a2ba-4494-abe3-fee104e24f51","Type":"ContainerStarted","Data":"3e7cfd610eb9e9449353cd3049687a2506a54f15f1b0b38ec101e1138e2c3fda"} May 28 17:25:06.193575 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:06.193530 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:25:07.416049 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.416009 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5"] May 28 17:25:07.426402 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.426363 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.434222 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.434182 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5"] May 28 17:25:07.472253 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.472179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69f5r\" (UniqueName: \"kubernetes.io/projected/57f20d17-2a72-4c56-8500-799fb5b19dfd-kube-api-access-69f5r\") pod \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.472492 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.472291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f20d17-2a72-4c56-8500-799fb5b19dfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.573507 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.573442 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69f5r\" (UniqueName: \"kubernetes.io/projected/57f20d17-2a72-4c56-8500-799fb5b19dfd-kube-api-access-69f5r\") pod \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.573704 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.573555 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f20d17-2a72-4c56-8500-799fb5b19dfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.573971 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.573946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f20d17-2a72-4c56-8500-799fb5b19dfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.584347 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.584309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69f5r\" (UniqueName: \"kubernetes.io/projected/57f20d17-2a72-4c56-8500-799fb5b19dfd-kube-api-access-69f5r\") pod \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.747535 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.747414 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:07.878096 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.877886 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw"] May 28 17:25:07.878310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.878181 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" containerName="manager" containerID="cri-o://c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422" gracePeriod=2 May 28 17:25:07.880887 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.880840 2577 status_manager.go:895] "Failed to get status for pod" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:07.882363 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.882310 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw"] May 28 17:25:07.894949 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.894893 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5"] May 28 17:25:07.902590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.901785 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8"] May 28 17:25:07.902590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.902170 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" containerName="manager" May 28 17:25:07.902590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.902185 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" containerName="manager" May 28 17:25:07.902590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.902246 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" containerName="manager" May 28 17:25:07.906438 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.906411 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5"] May 28 17:25:07.906787 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.906655 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:07.921364 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.921167 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8"] May 28 17:25:07.925660 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.924597 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7"] May 28 17:25:07.932061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.932032 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj"] May 28 17:25:07.932239 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.932076 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj"] May 28 17:25:07.932239 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.932197 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:07.932367 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.932336 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" containerName="manager" containerID="cri-o://00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c" gracePeriod=2 May 28 17:25:07.947674 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.946666 2577 status_manager.go:895] "Failed to get status for pod" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:07.947901 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.947875 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7"] May 28 17:25:07.978847 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.978770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fsq5\" (UniqueName: \"kubernetes.io/projected/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-kube-api-access-5fsq5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhgx8\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:07.978847 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.978822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqwz\" (UniqueName: \"kubernetes.io/projected/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-kube-api-access-6tqwz\") pod \"kuadrant-operator-controller-manager-84b657d985-ht2j7\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:07.979077 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.978881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhgx8\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:07.979077 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.979024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-ht2j7\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:07.983549 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.983502 2577 status_manager.go:895] "Failed to get status for pod" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:07.985920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:07.985885 2577 status_manager.go:895] "Failed to get status for pod" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:08.079929 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.079886 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhgx8\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:08.080122 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.079986 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-ht2j7\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:08.080122 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.080029 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fsq5\" (UniqueName: \"kubernetes.io/projected/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-kube-api-access-5fsq5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhgx8\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:08.080122 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.080058 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqwz\" (UniqueName: \"kubernetes.io/projected/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-kube-api-access-6tqwz\") pod \"kuadrant-operator-controller-manager-84b657d985-ht2j7\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:08.080309 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.080286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhgx8\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:08.080671 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.080636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-ht2j7\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:08.092634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.092595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqwz\" (UniqueName: \"kubernetes.io/projected/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-kube-api-access-6tqwz\") pod \"kuadrant-operator-controller-manager-84b657d985-ht2j7\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:08.093407 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.093383 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fsq5\" (UniqueName: \"kubernetes.io/projected/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-kube-api-access-5fsq5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhgx8\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:08.299537 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.299503 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:08.307244 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:08.307216 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:09.159509 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:09.159432 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.38:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" May 28 17:25:20.895098 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.894802 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:25:20.897367 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.897337 2577 status_manager.go:895] "Failed to get status for pod" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:20.901037 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.901010 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:25:20.903823 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.903712 2577 status_manager.go:895] "Failed to get status for pod" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:20.905933 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.905902 2577 status_manager.go:895] "Failed to get status for pod" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:20.940398 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.940368 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7"] May 28 17:25:20.941254 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:25:20.941225 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc52bec_b6cd_4d57_8f72_e6102546bd6a.slice/crio-586a702de957da8818c38d6eec5af641b21d2911336ed3d1c1e6c64a3bf762a3 WatchSource:0}: Error finding container 586a702de957da8818c38d6eec5af641b21d2911336ed3d1c1e6c64a3bf762a3: Status 404 returned error can't find the container with id 586a702de957da8818c38d6eec5af641b21d2911336ed3d1c1e6c64a3bf762a3 May 28 17:25:20.962061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.962034 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8"] May 28 17:25:20.963997 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:25:20.963955 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e74f76a_baf6_4db3_9d73_d5e14930a9b0.slice/crio-bc52c04d53a5a0ee87d49dbb76d55159ad6827d8c2488b346b99733408695eb9 WatchSource:0}: Error finding container bc52c04d53a5a0ee87d49dbb76d55159ad6827d8c2488b346b99733408695eb9: Status 404 returned error can't find the container with id bc52c04d53a5a0ee87d49dbb76d55159ad6827d8c2488b346b99733408695eb9 May 28 17:25:20.998325 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.998299 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvt55\" (UniqueName: \"kubernetes.io/projected/45b2fb9a-0350-4b7d-997b-22215d2849c1-kube-api-access-dvt55\") pod \"45b2fb9a-0350-4b7d-997b-22215d2849c1\" (UID: \"45b2fb9a-0350-4b7d-997b-22215d2849c1\") " May 28 17:25:20.998449 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.998342 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cac5e12-533c-4022-a182-c0c8b86e69f6-extensions-socket-volume\") pod \"4cac5e12-533c-4022-a182-c0c8b86e69f6\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " May 28 17:25:20.998543 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.998522 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffffx\" (UniqueName: \"kubernetes.io/projected/4cac5e12-533c-4022-a182-c0c8b86e69f6-kube-api-access-ffffx\") pod \"4cac5e12-533c-4022-a182-c0c8b86e69f6\" (UID: \"4cac5e12-533c-4022-a182-c0c8b86e69f6\") " May 28 17:25:20.998748 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.998722 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cac5e12-533c-4022-a182-c0c8b86e69f6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4cac5e12-533c-4022-a182-c0c8b86e69f6" (UID: "4cac5e12-533c-4022-a182-c0c8b86e69f6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:20.998868 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:20.998852 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cac5e12-533c-4022-a182-c0c8b86e69f6-extensions-socket-volume\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:21.000835 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.000798 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b2fb9a-0350-4b7d-997b-22215d2849c1-kube-api-access-dvt55" (OuterVolumeSpecName: "kube-api-access-dvt55") pod "45b2fb9a-0350-4b7d-997b-22215d2849c1" (UID: "45b2fb9a-0350-4b7d-997b-22215d2849c1"). InnerVolumeSpecName "kube-api-access-dvt55". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:21.000946 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.000907 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cac5e12-533c-4022-a182-c0c8b86e69f6-kube-api-access-ffffx" (OuterVolumeSpecName: "kube-api-access-ffffx") pod "4cac5e12-533c-4022-a182-c0c8b86e69f6" (UID: "4cac5e12-533c-4022-a182-c0c8b86e69f6"). InnerVolumeSpecName "kube-api-access-ffffx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:21.099654 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.099623 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvt55\" (UniqueName: \"kubernetes.io/projected/45b2fb9a-0350-4b7d-997b-22215d2849c1-kube-api-access-dvt55\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:21.099654 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.099655 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffffx\" (UniqueName: \"kubernetes.io/projected/4cac5e12-533c-4022-a182-c0c8b86e69f6-kube-api-access-ffffx\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:21.304825 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.304781 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" event={"ID":"cea7d5c4-a2ba-4494-abe3-fee104e24f51","Type":"ContainerStarted","Data":"0730045f677a98158dca10636d2db4af25253782a9bd8101d9b6754dce428ced"} May 28 17:25:21.306020 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.305994 2577 generic.go:358] "Generic (PLEG): container finished" podID="45b2fb9a-0350-4b7d-997b-22215d2849c1" containerID="00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c" exitCode=0 May 28 17:25:21.306109 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.306033 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" May 28 17:25:21.306109 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.306067 2577 scope.go:117] "RemoveContainer" containerID="00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c" May 28 17:25:21.307846 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.307822 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" event={"ID":"4e74f76a-baf6-4db3-9d73-d5e14930a9b0","Type":"ContainerStarted","Data":"64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0"} May 28 17:25:21.307962 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.307855 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" event={"ID":"4e74f76a-baf6-4db3-9d73-d5e14930a9b0","Type":"ContainerStarted","Data":"bc52c04d53a5a0ee87d49dbb76d55159ad6827d8c2488b346b99733408695eb9"} May 28 17:25:21.307962 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.307890 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:21.309204 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.309175 2577 generic.go:358] "Generic (PLEG): container finished" podID="4cac5e12-533c-4022-a182-c0c8b86e69f6" containerID="c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422" exitCode=0 May 28 17:25:21.309311 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.309216 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" May 28 17:25:21.311537 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.311506 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" event={"ID":"2fc52bec-b6cd-4d57-8f72-e6102546bd6a","Type":"ContainerStarted","Data":"c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a"} May 28 17:25:21.311648 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.311563 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" event={"ID":"2fc52bec-b6cd-4d57-8f72-e6102546bd6a","Type":"ContainerStarted","Data":"586a702de957da8818c38d6eec5af641b21d2911336ed3d1c1e6c64a3bf762a3"} May 28 17:25:21.312166 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.312146 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:21.322920 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.322900 2577 scope.go:117] "RemoveContainer" containerID="00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c" May 28 17:25:21.323184 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:25:21.323166 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c\": container with ID starting with 00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c not found: ID does not exist" containerID="00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c" May 28 17:25:21.323251 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.323193 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c"} err="failed to get container status \"00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c\": rpc error: code = NotFound desc = could not find container \"00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c\": container with ID starting with 00539097cee09c3d13687bac57a330e099a674a60ad5b22d2c34e959f616727c not found: ID does not exist" May 28 17:25:21.323251 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.323212 2577 scope.go:117] "RemoveContainer" containerID="c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422" May 28 17:25:21.323251 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.323209 2577 status_manager.go:895] "Failed to get status for pod" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:21.324322 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.324286 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mmllj" podStartSLOduration=2.434537861 podStartE2EDuration="24.324276267s" podCreationTimestamp="2026-05-28 17:24:57 +0000 UTC" firstStartedPulling="2026-05-28 17:24:58.930818327 +0000 UTC m=+421.844711137" lastFinishedPulling="2026-05-28 17:25:20.820556727 +0000 UTC m=+443.734449543" observedRunningTime="2026-05-28 17:25:21.32118644 +0000 UTC m=+444.235079274" watchObservedRunningTime="2026-05-28 17:25:21.324276267 +0000 UTC m=+444.238169097" May 28 17:25:21.325118 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.325099 2577 status_manager.go:895] "Failed to get status for pod" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:21.326971 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.326945 2577 status_manager.go:895] "Failed to get status for pod" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-r7wtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-r7wtj\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:21.328811 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.328787 2577 status_manager.go:895] "Failed to get status for pod" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c96xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c96xw\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:21.332232 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.332208 2577 scope.go:117] "RemoveContainer" containerID="c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422" May 28 17:25:21.332577 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:25:21.332559 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422\": container with ID starting with c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422 not found: ID does not exist" containerID="c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422" May 28 17:25:21.332653 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.332590 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422"} err="failed to get container status \"c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422\": rpc error: code = NotFound desc = could not find container \"c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422\": container with ID starting with c3a108966e36eeea8fa0c77214aaeed1777531ecb58965734e2a23ecde938422 not found: ID does not exist" May 28 17:25:21.350057 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.349984 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" podStartSLOduration=14.349969395 podStartE2EDuration="14.349969395s" podCreationTimestamp="2026-05-28 17:25:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:25:21.346794388 +0000 UTC m=+444.260687219" watchObservedRunningTime="2026-05-28 17:25:21.349969395 +0000 UTC m=+444.263862255" May 28 17:25:21.368581 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.368525 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" podStartSLOduration=14.368505015 podStartE2EDuration="14.368505015s" podCreationTimestamp="2026-05-28 17:25:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:25:21.366757158 +0000 UTC m=+444.280649987" watchObservedRunningTime="2026-05-28 17:25:21.368505015 +0000 UTC m=+444.282397897" May 28 17:25:21.729103 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.728677 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" path="/var/lib/kubelet/pods/45b2fb9a-0350-4b7d-997b-22215d2849c1/volumes" May 28 17:25:21.729103 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:21.729008 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cac5e12-533c-4022-a182-c0c8b86e69f6" path="/var/lib/kubelet/pods/4cac5e12-533c-4022-a182-c0c8b86e69f6/volumes" May 28 17:25:23.303106 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:25:23.303072 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f20d17_2a72_4c56_8500_799fb5b19dfd.slice/crio-9f5ea6181b5c86bc7a86f892272c9c56782ff3d19d02194c7ce428c1962c39d4 WatchSource:0}: Error finding container 9f5ea6181b5c86bc7a86f892272c9c56782ff3d19d02194c7ce428c1962c39d4: Status 404 returned error can't find the container with id 9f5ea6181b5c86bc7a86f892272c9c56782ff3d19d02194c7ce428c1962c39d4 May 28 17:25:24.332796 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.332756 2577 generic.go:358] "Generic (PLEG): container finished" podID="57f20d17-2a72-4c56-8500-799fb5b19dfd" containerID="56b71fa8afd8da5e4588a520fb03622c757edc8ac3d17bfb282781ce4b2d9ecb" exitCode=1 May 28 17:25:24.335036 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.335009 2577 status_manager.go:895] "Failed to get status for pod" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" err="pods \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:24.364922 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.364896 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:24.367371 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.367338 2577 status_manager.go:895] "Failed to get status for pod" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" err="pods \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:24.428360 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.428319 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f20d17-2a72-4c56-8500-799fb5b19dfd-extensions-socket-volume\") pod \"57f20d17-2a72-4c56-8500-799fb5b19dfd\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " May 28 17:25:24.428532 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.428429 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69f5r\" (UniqueName: \"kubernetes.io/projected/57f20d17-2a72-4c56-8500-799fb5b19dfd-kube-api-access-69f5r\") pod \"57f20d17-2a72-4c56-8500-799fb5b19dfd\" (UID: \"57f20d17-2a72-4c56-8500-799fb5b19dfd\") " May 28 17:25:24.428667 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.428639 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57f20d17-2a72-4c56-8500-799fb5b19dfd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "57f20d17-2a72-4c56-8500-799fb5b19dfd" (UID: "57f20d17-2a72-4c56-8500-799fb5b19dfd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:24.430687 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.430658 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f20d17-2a72-4c56-8500-799fb5b19dfd-kube-api-access-69f5r" (OuterVolumeSpecName: "kube-api-access-69f5r") pod "57f20d17-2a72-4c56-8500-799fb5b19dfd" (UID: "57f20d17-2a72-4c56-8500-799fb5b19dfd"). InnerVolumeSpecName "kube-api-access-69f5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:24.529874 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.529837 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57f20d17-2a72-4c56-8500-799fb5b19dfd-extensions-socket-volume\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:24.529874 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:24.529869 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69f5r\" (UniqueName: \"kubernetes.io/projected/57f20d17-2a72-4c56-8500-799fb5b19dfd-kube-api-access-69f5r\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:25.338622 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:25.338590 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" May 28 17:25:25.339090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:25.338631 2577 scope.go:117] "RemoveContainer" containerID="56b71fa8afd8da5e4588a520fb03622c757edc8ac3d17bfb282781ce4b2d9ecb" May 28 17:25:25.341637 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:25.341607 2577 status_manager.go:895] "Failed to get status for pod" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" err="pods \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:25.349514 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:25.349483 2577 status_manager.go:895] "Failed to get status for pod" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-mzdb5" err="pods \"kuadrant-operator-controller-manager-84b657d985-mzdb5\" is forbidden: User \"system:node:ip-10-0-141-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-59.ec2.internal' and this object" May 28 17:25:25.733793 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:25.733708 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" path="/var/lib/kubelet/pods/57f20d17-2a72-4c56-8500-799fb5b19dfd/volumes" May 28 17:25:32.319823 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:32.319788 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:33.328926 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.328894 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:33.382810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.382769 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8"] May 28 17:25:33.383055 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.383030 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" podUID="4e74f76a-baf6-4db3-9d73-d5e14930a9b0" containerName="manager" containerID="cri-o://64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0" gracePeriod=10 May 28 17:25:33.627259 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.627225 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx"] May 28 17:25:33.627679 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.627654 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" containerName="manager" May 28 17:25:33.627679 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.627674 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" containerName="manager" May 28 17:25:33.627859 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.627704 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" containerName="manager" May 28 17:25:33.627859 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.627710 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" containerName="manager" May 28 17:25:33.627859 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.627791 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="57f20d17-2a72-4c56-8500-799fb5b19dfd" containerName="manager" May 28 17:25:33.627859 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.627799 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="45b2fb9a-0350-4b7d-997b-22215d2849c1" containerName="manager" May 28 17:25:33.630165 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.630145 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:33.636256 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.636227 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:33.643121 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.643096 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx"] May 28 17:25:33.715420 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.715386 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fsq5\" (UniqueName: \"kubernetes.io/projected/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-kube-api-access-5fsq5\") pod \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " May 28 17:25:33.715609 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.715494 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-extensions-socket-volume\") pod \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\" (UID: \"4e74f76a-baf6-4db3-9d73-d5e14930a9b0\") " May 28 17:25:33.715745 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.715725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcb5c\" (UniqueName: \"kubernetes.io/projected/079792fa-c022-4413-8162-deef006d208d-kube-api-access-xcb5c\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dpqbx\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:33.715784 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.715766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/079792fa-c022-4413-8162-deef006d208d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dpqbx\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:33.715935 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.715905 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e74f76a-baf6-4db3-9d73-d5e14930a9b0" (UID: "4e74f76a-baf6-4db3-9d73-d5e14930a9b0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:33.717809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.717782 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-kube-api-access-5fsq5" (OuterVolumeSpecName: "kube-api-access-5fsq5") pod "4e74f76a-baf6-4db3-9d73-d5e14930a9b0" (UID: "4e74f76a-baf6-4db3-9d73-d5e14930a9b0"). InnerVolumeSpecName "kube-api-access-5fsq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:33.816344 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.816299 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcb5c\" (UniqueName: \"kubernetes.io/projected/079792fa-c022-4413-8162-deef006d208d-kube-api-access-xcb5c\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dpqbx\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:33.816344 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.816347 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/079792fa-c022-4413-8162-deef006d208d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dpqbx\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:33.816597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.816394 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-extensions-socket-volume\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:33.816597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.816405 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fsq5\" (UniqueName: \"kubernetes.io/projected/4e74f76a-baf6-4db3-9d73-d5e14930a9b0-kube-api-access-5fsq5\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:33.816728 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.816713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/079792fa-c022-4413-8162-deef006d208d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dpqbx\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:33.826404 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.826376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcb5c\" (UniqueName: \"kubernetes.io/projected/079792fa-c022-4413-8162-deef006d208d-kube-api-access-xcb5c\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dpqbx\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:33.945961 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:33.945876 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:34.088596 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.088568 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx"] May 28 17:25:34.091417 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:25:34.091370 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079792fa_c022_4413_8162_deef006d208d.slice/crio-d88622654eb4b843cef8ab6aa042a8372886a28fd976d2197b2fac1b81a7e258 WatchSource:0}: Error finding container d88622654eb4b843cef8ab6aa042a8372886a28fd976d2197b2fac1b81a7e258: Status 404 returned error can't find the container with id d88622654eb4b843cef8ab6aa042a8372886a28fd976d2197b2fac1b81a7e258 May 28 17:25:34.376258 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.376218 2577 generic.go:358] "Generic (PLEG): container finished" podID="4e74f76a-baf6-4db3-9d73-d5e14930a9b0" containerID="64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0" exitCode=0 May 28 17:25:34.376759 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.376262 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" event={"ID":"4e74f76a-baf6-4db3-9d73-d5e14930a9b0","Type":"ContainerDied","Data":"64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0"} May 28 17:25:34.376759 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.376305 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" event={"ID":"4e74f76a-baf6-4db3-9d73-d5e14930a9b0","Type":"ContainerDied","Data":"bc52c04d53a5a0ee87d49dbb76d55159ad6827d8c2488b346b99733408695eb9"} May 28 17:25:34.376759 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.376315 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8" May 28 17:25:34.376759 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.376355 2577 scope.go:117] "RemoveContainer" containerID="64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0" May 28 17:25:34.378245 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.378215 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" event={"ID":"079792fa-c022-4413-8162-deef006d208d","Type":"ContainerStarted","Data":"c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a"} May 28 17:25:34.378391 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.378254 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" event={"ID":"079792fa-c022-4413-8162-deef006d208d","Type":"ContainerStarted","Data":"d88622654eb4b843cef8ab6aa042a8372886a28fd976d2197b2fac1b81a7e258"} May 28 17:25:34.378391 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.378311 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:34.385512 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.385370 2577 scope.go:117] "RemoveContainer" containerID="64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0" May 28 17:25:34.385706 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:25:34.385688 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0\": container with ID starting with 64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0 not found: ID does not exist" containerID="64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0" May 28 17:25:34.385760 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.385716 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0"} err="failed to get container status \"64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0\": rpc error: code = NotFound desc = could not find container \"64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0\": container with ID starting with 64e970022e73e9a794216c11a6886783ab1cbee3e8cf43ae85e47ffee5a316a0 not found: ID does not exist" May 28 17:25:34.397713 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.397674 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8"] May 28 17:25:34.403202 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.403158 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhgx8"] May 28 17:25:34.422336 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:34.422280 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" podStartSLOduration=1.422266149 podStartE2EDuration="1.422266149s" podCreationTimestamp="2026-05-28 17:25:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:25:34.420134879 +0000 UTC m=+457.334027709" watchObservedRunningTime="2026-05-28 17:25:34.422266149 +0000 UTC m=+457.336158979" May 28 17:25:35.728274 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:35.728236 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e74f76a-baf6-4db3-9d73-d5e14930a9b0" path="/var/lib/kubelet/pods/4e74f76a-baf6-4db3-9d73-d5e14930a9b0/volumes" May 28 17:25:45.385884 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:45.385844 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:25:45.440224 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:45.440183 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7"] May 28 17:25:45.440613 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:45.440582 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" podUID="2fc52bec-b6cd-4d57-8f72-e6102546bd6a" containerName="manager" containerID="cri-o://c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a" gracePeriod=10 May 28 17:25:46.191118 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.191088 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:46.224720 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.224689 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tqwz\" (UniqueName: \"kubernetes.io/projected/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-kube-api-access-6tqwz\") pod \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " May 28 17:25:46.224887 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.224763 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-extensions-socket-volume\") pod \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\" (UID: \"2fc52bec-b6cd-4d57-8f72-e6102546bd6a\") " May 28 17:25:46.225123 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.225103 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2fc52bec-b6cd-4d57-8f72-e6102546bd6a" (UID: "2fc52bec-b6cd-4d57-8f72-e6102546bd6a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:25:46.227008 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.226987 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-kube-api-access-6tqwz" (OuterVolumeSpecName: "kube-api-access-6tqwz") pod "2fc52bec-b6cd-4d57-8f72-e6102546bd6a" (UID: "2fc52bec-b6cd-4d57-8f72-e6102546bd6a"). InnerVolumeSpecName "kube-api-access-6tqwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:25:46.325515 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.325390 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-extensions-socket-volume\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:46.325515 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.325425 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tqwz\" (UniqueName: \"kubernetes.io/projected/2fc52bec-b6cd-4d57-8f72-e6102546bd6a-kube-api-access-6tqwz\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:25:46.428756 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.428715 2577 generic.go:358] "Generic (PLEG): container finished" podID="2fc52bec-b6cd-4d57-8f72-e6102546bd6a" containerID="c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a" exitCode=0 May 28 17:25:46.429158 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.428776 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" May 28 17:25:46.429158 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.428804 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" event={"ID":"2fc52bec-b6cd-4d57-8f72-e6102546bd6a","Type":"ContainerDied","Data":"c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a"} May 28 17:25:46.429158 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.428844 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7" event={"ID":"2fc52bec-b6cd-4d57-8f72-e6102546bd6a","Type":"ContainerDied","Data":"586a702de957da8818c38d6eec5af641b21d2911336ed3d1c1e6c64a3bf762a3"} May 28 17:25:46.429158 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.428862 2577 scope.go:117] "RemoveContainer" containerID="c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a" May 28 17:25:46.437753 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.437736 2577 scope.go:117] "RemoveContainer" containerID="c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a" May 28 17:25:46.438039 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:25:46.438020 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a\": container with ID starting with c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a not found: ID does not exist" containerID="c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a" May 28 17:25:46.438093 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.438050 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a"} err="failed to get container status \"c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a\": rpc error: code = NotFound desc = could not find container \"c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a\": container with ID starting with c78880744c3129564d1a4d71d07e38331717d6637a3ecfb6cd2c4781354b1a7a not found: ID does not exist" May 28 17:25:46.451925 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.451889 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7"] May 28 17:25:46.457996 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:46.457962 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-ht2j7"] May 28 17:25:47.728199 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:47.728165 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fc52bec-b6cd-4d57-8f72-e6102546bd6a" path="/var/lib/kubelet/pods/2fc52bec-b6cd-4d57-8f72-e6102546bd6a/volumes" May 28 17:25:49.659927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.659887 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9"] May 28 17:25:49.660295 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.660278 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc52bec-b6cd-4d57-8f72-e6102546bd6a" containerName="manager" May 28 17:25:49.660295 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.660291 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc52bec-b6cd-4d57-8f72-e6102546bd6a" containerName="manager" May 28 17:25:49.660387 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.660304 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e74f76a-baf6-4db3-9d73-d5e14930a9b0" containerName="manager" May 28 17:25:49.660387 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.660312 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e74f76a-baf6-4db3-9d73-d5e14930a9b0" containerName="manager" May 28 17:25:49.660449 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.660389 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fc52bec-b6cd-4d57-8f72-e6102546bd6a" containerName="manager" May 28 17:25:49.660449 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.660397 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e74f76a-baf6-4db3-9d73-d5e14930a9b0" containerName="manager" May 28 17:25:49.664858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.664824 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.668732 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.668704 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-slrn8\"" May 28 17:25:49.683508 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.683470 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9"] May 28 17:25:49.754022 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.753982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754022 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754262 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f7218df-deb4-48f1-8a83-33bc72a4b836-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754262 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdjc\" (UniqueName: \"kubernetes.io/projected/6f7218df-deb4-48f1-8a83-33bc72a4b836-kube-api-access-hzdjc\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754262 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754262 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754262 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754262 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.754552 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.754319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.855551 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.855515 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.855551 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.855564 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.855832 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.855596 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.855832 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.855642 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.855832 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.855676 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856047 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856019 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856114 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856114 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856068 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856227 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856110 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856227 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856127 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f7218df-deb4-48f1-8a83-33bc72a4b836-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856227 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856144 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdjc\" (UniqueName: \"kubernetes.io/projected/6f7218df-deb4-48f1-8a83-33bc72a4b836-kube-api-access-hzdjc\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856389 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856428 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856369 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.856809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.856789 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f7218df-deb4-48f1-8a83-33bc72a4b836-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.858192 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.858175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.858240 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.858226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.865171 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.865142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f7218df-deb4-48f1-8a83-33bc72a4b836-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.865329 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.865188 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdjc\" (UniqueName: \"kubernetes.io/projected/6f7218df-deb4-48f1-8a83-33bc72a4b836-kube-api-access-hzdjc\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-kb7j9\" (UID: \"6f7218df-deb4-48f1-8a83-33bc72a4b836\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:49.976681 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:49.976583 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:50.121522 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.121498 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9"] May 28 17:25:50.126684 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:25:50.126644 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7218df_deb4_48f1_8a83_33bc72a4b836.slice/crio-7ca6cec6b63e075d2dd1877f597deac0bbd855f49e55aba88c46e4ccae45e13a WatchSource:0}: Error finding container 7ca6cec6b63e075d2dd1877f597deac0bbd855f49e55aba88c46e4ccae45e13a: Status 404 returned error can't find the container with id 7ca6cec6b63e075d2dd1877f597deac0bbd855f49e55aba88c46e4ccae45e13a May 28 17:25:50.129636 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.129597 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 28 17:25:50.129745 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.129680 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 28 17:25:50.129745 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.129725 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 28 17:25:50.446054 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.446018 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" event={"ID":"6f7218df-deb4-48f1-8a83-33bc72a4b836","Type":"ContainerStarted","Data":"1989c8c61165dab33eeea62982a984c5d0dc313cee791721af5971f0c876e2d2"} May 28 17:25:50.446256 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.446061 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" event={"ID":"6f7218df-deb4-48f1-8a83-33bc72a4b836","Type":"ContainerStarted","Data":"7ca6cec6b63e075d2dd1877f597deac0bbd855f49e55aba88c46e4ccae45e13a"} May 28 17:25:50.468523 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.468449 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" podStartSLOduration=1.468433937 podStartE2EDuration="1.468433937s" podCreationTimestamp="2026-05-28 17:25:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:25:50.466973324 +0000 UTC m=+473.380866154" watchObservedRunningTime="2026-05-28 17:25:50.468433937 +0000 UTC m=+473.382326770" May 28 17:25:50.976977 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:50.976930 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:51.981853 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:51.981822 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:52.455561 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:52.455534 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:52.456426 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:52.456408 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-kb7j9" May 28 17:25:55.323169 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.323133 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-86476d8f8d-4txwx"] May 28 17:25:55.358834 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.358796 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86476d8f8d-4txwx"] May 28 17:25:55.359003 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.358924 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.411766 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.411722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-oauth-serving-cert\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.411980 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.411787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f349896-efc5-41dc-996b-558182315f3b-console-serving-cert\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.411980 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.411820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-service-ca\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.411980 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.411843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72mgc\" (UniqueName: \"kubernetes.io/projected/5f349896-efc5-41dc-996b-558182315f3b-kube-api-access-72mgc\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.411980 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.411906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-trusted-ca-bundle\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.411980 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.411952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f349896-efc5-41dc-996b-558182315f3b-console-oauth-config\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.411980 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.411975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-console-config\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.512953 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.512908 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-oauth-serving-cert\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.512967 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f349896-efc5-41dc-996b-558182315f3b-console-serving-cert\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.512992 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-service-ca\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.513009 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72mgc\" (UniqueName: \"kubernetes.io/projected/5f349896-efc5-41dc-996b-558182315f3b-kube-api-access-72mgc\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.513035 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-trusted-ca-bundle\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.513079 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f349896-efc5-41dc-996b-558182315f3b-console-oauth-config\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513147 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.513104 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-console-config\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513801 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.513757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-service-ca\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.513801 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.513757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-oauth-serving-cert\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.514100 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.514078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-console-config\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.514198 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.514174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f349896-efc5-41dc-996b-558182315f3b-trusted-ca-bundle\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.515737 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.515710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f349896-efc5-41dc-996b-558182315f3b-console-oauth-config\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.515970 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.515948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f349896-efc5-41dc-996b-558182315f3b-console-serving-cert\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.523423 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.523398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72mgc\" (UniqueName: \"kubernetes.io/projected/5f349896-efc5-41dc-996b-558182315f3b-kube-api-access-72mgc\") pod \"console-86476d8f8d-4txwx\" (UID: \"5f349896-efc5-41dc-996b-558182315f3b\") " pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.667978 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.667879 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:25:55.842975 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:55.842949 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86476d8f8d-4txwx"] May 28 17:25:55.844397 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:25:55.844371 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f349896_efc5_41dc_996b_558182315f3b.slice/crio-6fd247064ad027a02e6e9f8067450b638bd699ae6b97c37b1a0168718dad310e WatchSource:0}: Error finding container 6fd247064ad027a02e6e9f8067450b638bd699ae6b97c37b1a0168718dad310e: Status 404 returned error can't find the container with id 6fd247064ad027a02e6e9f8067450b638bd699ae6b97c37b1a0168718dad310e May 28 17:25:56.472231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:56.472196 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86476d8f8d-4txwx" event={"ID":"5f349896-efc5-41dc-996b-558182315f3b","Type":"ContainerStarted","Data":"2ac9d2592c92c9e4d7b00293d73c0adfb097bcc82b3fbc160b5f05f09da1c443"} May 28 17:25:56.472231 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:56.472232 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86476d8f8d-4txwx" event={"ID":"5f349896-efc5-41dc-996b-558182315f3b","Type":"ContainerStarted","Data":"6fd247064ad027a02e6e9f8067450b638bd699ae6b97c37b1a0168718dad310e"} May 28 17:25:56.494260 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:25:56.494209 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-86476d8f8d-4txwx" podStartSLOduration=1.4941934 podStartE2EDuration="1.4941934s" podCreationTimestamp="2026-05-28 17:25:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:25:56.492490082 +0000 UTC m=+479.406382906" watchObservedRunningTime="2026-05-28 17:25:56.4941934 +0000 UTC m=+479.408086230" May 28 17:26:05.668520 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:05.668477 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:26:05.668520 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:05.668524 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:26:05.673365 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:05.673342 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:26:06.517423 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.517394 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86476d8f8d-4txwx" May 28 17:26:06.572382 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.572343 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd9bb848-cf2qd"] May 28 17:26:06.785236 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.785135 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:26:06.790376 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.790348 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:06.792851 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.792819 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 28 17:26:06.797574 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.797544 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:26:06.825155 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.825126 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:26:06.916358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.916311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5081778-986a-44fc-bad9-9959ef93bef0-config-file\") pod \"limitador-limitador-78c99df468-q7bpn\" (UID: \"b5081778-986a-44fc-bad9-9959ef93bef0\") " pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:06.916358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:06.916360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f54kc\" (UniqueName: \"kubernetes.io/projected/b5081778-986a-44fc-bad9-9959ef93bef0-kube-api-access-f54kc\") pod \"limitador-limitador-78c99df468-q7bpn\" (UID: \"b5081778-986a-44fc-bad9-9959ef93bef0\") " pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:07.017775 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.017729 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5081778-986a-44fc-bad9-9959ef93bef0-config-file\") pod \"limitador-limitador-78c99df468-q7bpn\" (UID: \"b5081778-986a-44fc-bad9-9959ef93bef0\") " pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:07.017775 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.017774 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f54kc\" (UniqueName: \"kubernetes.io/projected/b5081778-986a-44fc-bad9-9959ef93bef0-kube-api-access-f54kc\") pod \"limitador-limitador-78c99df468-q7bpn\" (UID: \"b5081778-986a-44fc-bad9-9959ef93bef0\") " pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:07.018418 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.018389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5081778-986a-44fc-bad9-9959ef93bef0-config-file\") pod \"limitador-limitador-78c99df468-q7bpn\" (UID: \"b5081778-986a-44fc-bad9-9959ef93bef0\") " pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:07.027708 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.027679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f54kc\" (UniqueName: \"kubernetes.io/projected/b5081778-986a-44fc-bad9-9959ef93bef0-kube-api-access-f54kc\") pod \"limitador-limitador-78c99df468-q7bpn\" (UID: \"b5081778-986a-44fc-bad9-9959ef93bef0\") " pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:07.101863 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.101762 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:07.242900 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.242871 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:26:07.245096 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:26:07.245066 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5081778_986a_44fc_bad9_9959ef93bef0.slice/crio-9ed27a15d0f0cc772fbcd3df46da883c92d8204555337771986e16e9a79b4efd WatchSource:0}: Error finding container 9ed27a15d0f0cc772fbcd3df46da883c92d8204555337771986e16e9a79b4efd: Status 404 returned error can't find the container with id 9ed27a15d0f0cc772fbcd3df46da883c92d8204555337771986e16e9a79b4efd May 28 17:26:07.491580 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.491493 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jr674"] May 28 17:26:07.496264 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.496243 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jr674" May 28 17:26:07.498732 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.498707 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-782nz\"" May 28 17:26:07.503080 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.503051 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jr674"] May 28 17:26:07.518235 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.518200 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" event={"ID":"b5081778-986a-44fc-bad9-9959ef93bef0","Type":"ContainerStarted","Data":"9ed27a15d0f0cc772fbcd3df46da883c92d8204555337771986e16e9a79b4efd"} May 28 17:26:07.623376 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.623332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snnz5\" (UniqueName: \"kubernetes.io/projected/e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf-kube-api-access-snnz5\") pod \"authorino-f99f4b5cd-jr674\" (UID: \"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf\") " pod="kuadrant-system/authorino-f99f4b5cd-jr674" May 28 17:26:07.724730 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.724685 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snnz5\" (UniqueName: \"kubernetes.io/projected/e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf-kube-api-access-snnz5\") pod \"authorino-f99f4b5cd-jr674\" (UID: \"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf\") " pod="kuadrant-system/authorino-f99f4b5cd-jr674" May 28 17:26:07.734793 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.734759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snnz5\" (UniqueName: \"kubernetes.io/projected/e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf-kube-api-access-snnz5\") pod \"authorino-f99f4b5cd-jr674\" (UID: \"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf\") " pod="kuadrant-system/authorino-f99f4b5cd-jr674" May 28 17:26:07.807378 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:07.807343 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jr674" May 28 17:26:08.003701 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:08.003662 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jr674"] May 28 17:26:08.006793 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:26:08.006754 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7efee9e_9b42_4ea7_a2ef_5a91599ad8cf.slice/crio-3ca9bb1dc499abf18feae66b9c3256f4320df93c5298eb9ff588306b2b00d60e WatchSource:0}: Error finding container 3ca9bb1dc499abf18feae66b9c3256f4320df93c5298eb9ff588306b2b00d60e: Status 404 returned error can't find the container with id 3ca9bb1dc499abf18feae66b9c3256f4320df93c5298eb9ff588306b2b00d60e May 28 17:26:08.525708 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:08.525653 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jr674" event={"ID":"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf","Type":"ContainerStarted","Data":"3ca9bb1dc499abf18feae66b9c3256f4320df93c5298eb9ff588306b2b00d60e"} May 28 17:26:12.224921 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:12.224878 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jr674"] May 28 17:26:12.547554 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:12.547514 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" event={"ID":"b5081778-986a-44fc-bad9-9959ef93bef0","Type":"ContainerStarted","Data":"950959613fb5579a99f77f012a2db88e66c0faf34af82aca226c6f8109db5356"} May 28 17:26:12.547806 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:12.547784 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:12.549067 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:12.549042 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jr674" event={"ID":"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf","Type":"ContainerStarted","Data":"4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb"} May 28 17:26:12.568660 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:12.568608 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" podStartSLOduration=2.023565545 podStartE2EDuration="6.568593285s" podCreationTimestamp="2026-05-28 17:26:06 +0000 UTC" firstStartedPulling="2026-05-28 17:26:07.246977706 +0000 UTC m=+490.160870518" lastFinishedPulling="2026-05-28 17:26:11.792005448 +0000 UTC m=+494.705898258" observedRunningTime="2026-05-28 17:26:12.565908461 +0000 UTC m=+495.479801292" watchObservedRunningTime="2026-05-28 17:26:12.568593285 +0000 UTC m=+495.482486115" May 28 17:26:12.581659 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:12.581597 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-jr674" podStartSLOduration=1.843748604 podStartE2EDuration="5.58158045s" podCreationTimestamp="2026-05-28 17:26:07 +0000 UTC" firstStartedPulling="2026-05-28 17:26:08.009225509 +0000 UTC m=+490.923118320" lastFinishedPulling="2026-05-28 17:26:11.747057357 +0000 UTC m=+494.660950166" observedRunningTime="2026-05-28 17:26:12.580419401 +0000 UTC m=+495.494312233" watchObservedRunningTime="2026-05-28 17:26:12.58158045 +0000 UTC m=+495.495473282" May 28 17:26:13.559330 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:13.559267 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-jr674" podUID="e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf" containerName="authorino" containerID="cri-o://4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb" gracePeriod=30 May 28 17:26:13.811840 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:13.811775 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jr674" May 28 17:26:13.888632 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:13.888601 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snnz5\" (UniqueName: \"kubernetes.io/projected/e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf-kube-api-access-snnz5\") pod \"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf\" (UID: \"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf\") " May 28 17:26:13.890810 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:13.890783 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf-kube-api-access-snnz5" (OuterVolumeSpecName: "kube-api-access-snnz5") pod "e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf" (UID: "e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf"). InnerVolumeSpecName "kube-api-access-snnz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:26:13.989544 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:13.989505 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snnz5\" (UniqueName: \"kubernetes.io/projected/e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf-kube-api-access-snnz5\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:14.565134 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.565097 2577 generic.go:358] "Generic (PLEG): container finished" podID="e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf" containerID="4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb" exitCode=0 May 28 17:26:14.565547 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.565151 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jr674" May 28 17:26:14.565547 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.565190 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jr674" event={"ID":"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf","Type":"ContainerDied","Data":"4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb"} May 28 17:26:14.565547 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.565232 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jr674" event={"ID":"e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf","Type":"ContainerDied","Data":"3ca9bb1dc499abf18feae66b9c3256f4320df93c5298eb9ff588306b2b00d60e"} May 28 17:26:14.565547 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.565247 2577 scope.go:117] "RemoveContainer" containerID="4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb" May 28 17:26:14.574310 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.574292 2577 scope.go:117] "RemoveContainer" containerID="4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb" May 28 17:26:14.574571 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:26:14.574552 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb\": container with ID starting with 4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb not found: ID does not exist" containerID="4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb" May 28 17:26:14.574629 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.574593 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb"} err="failed to get container status \"4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb\": rpc error: code = NotFound desc = could not find container \"4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb\": container with ID starting with 4b3f93c7ec3554fd6e7aa74628405231e905b7e80722a8aecafa7e3e183190cb not found: ID does not exist" May 28 17:26:14.587552 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.587516 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jr674"] May 28 17:26:14.592378 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:14.592332 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jr674"] May 28 17:26:15.728277 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:15.728242 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf" path="/var/lib/kubelet/pods/e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf/volumes" May 28 17:26:23.560800 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:23.560769 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-q7bpn" May 28 17:26:31.593780 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.593728 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5bd9bb848-cf2qd" podUID="f64ff2b0-2eae-4452-ac96-e002a66ec9f4" containerName="console" containerID="cri-o://ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693" gracePeriod=15 May 28 17:26:31.847588 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.847523 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bd9bb848-cf2qd_f64ff2b0-2eae-4452-ac96-e002a66ec9f4/console/0.log" May 28 17:26:31.847720 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.847599 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:26:31.951350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951316 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-service-ca\") pod \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " May 28 17:26:31.951350 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951369 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-oauth-serving-cert\") pod \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " May 28 17:26:31.951634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951394 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-serving-cert\") pod \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " May 28 17:26:31.951634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951441 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-oauth-config\") pod \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " May 28 17:26:31.951634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951494 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-trusted-ca-bundle\") pod \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " May 28 17:26:31.951634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951532 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq4nc\" (UniqueName: \"kubernetes.io/projected/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-kube-api-access-vq4nc\") pod \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " May 28 17:26:31.951634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951594 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-config\") pod \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\" (UID: \"f64ff2b0-2eae-4452-ac96-e002a66ec9f4\") " May 28 17:26:31.951866 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951846 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f64ff2b0-2eae-4452-ac96-e002a66ec9f4" (UID: "f64ff2b0-2eae-4452-ac96-e002a66ec9f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:31.951917 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951856 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "f64ff2b0-2eae-4452-ac96-e002a66ec9f4" (UID: "f64ff2b0-2eae-4452-ac96-e002a66ec9f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:31.951957 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.951924 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f64ff2b0-2eae-4452-ac96-e002a66ec9f4" (UID: "f64ff2b0-2eae-4452-ac96-e002a66ec9f4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:31.952171 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.952141 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-config" (OuterVolumeSpecName: "console-config") pod "f64ff2b0-2eae-4452-ac96-e002a66ec9f4" (UID: "f64ff2b0-2eae-4452-ac96-e002a66ec9f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:26:31.953843 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.953814 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-kube-api-access-vq4nc" (OuterVolumeSpecName: "kube-api-access-vq4nc") pod "f64ff2b0-2eae-4452-ac96-e002a66ec9f4" (UID: "f64ff2b0-2eae-4452-ac96-e002a66ec9f4"). InnerVolumeSpecName "kube-api-access-vq4nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:26:31.954298 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.954276 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f64ff2b0-2eae-4452-ac96-e002a66ec9f4" (UID: "f64ff2b0-2eae-4452-ac96-e002a66ec9f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:26:31.954357 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:31.954298 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f64ff2b0-2eae-4452-ac96-e002a66ec9f4" (UID: "f64ff2b0-2eae-4452-ac96-e002a66ec9f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:26:32.052413 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.052378 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq4nc\" (UniqueName: \"kubernetes.io/projected/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-kube-api-access-vq4nc\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:32.052413 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.052408 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:32.052413 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.052418 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-service-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:32.052656 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.052426 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-oauth-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:32.052656 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.052435 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:32.052656 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.052445 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-console-oauth-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:32.052656 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.052468 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64ff2b0-2eae-4452-ac96-e002a66ec9f4-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:32.647974 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.647946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bd9bb848-cf2qd_f64ff2b0-2eae-4452-ac96-e002a66ec9f4/console/0.log" May 28 17:26:32.648358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.647986 2577 generic.go:358] "Generic (PLEG): container finished" podID="f64ff2b0-2eae-4452-ac96-e002a66ec9f4" containerID="ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693" exitCode=2 May 28 17:26:32.648358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.648039 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd9bb848-cf2qd" event={"ID":"f64ff2b0-2eae-4452-ac96-e002a66ec9f4","Type":"ContainerDied","Data":"ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693"} May 28 17:26:32.648358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.648055 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd9bb848-cf2qd" May 28 17:26:32.648358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.648069 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd9bb848-cf2qd" event={"ID":"f64ff2b0-2eae-4452-ac96-e002a66ec9f4","Type":"ContainerDied","Data":"231ae29d9bc3ef49a49c3b3ef721c8474792ab4422aba1168a21e55d1b5416f4"} May 28 17:26:32.648358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.648087 2577 scope.go:117] "RemoveContainer" containerID="ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693" May 28 17:26:32.657742 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.657724 2577 scope.go:117] "RemoveContainer" containerID="ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693" May 28 17:26:32.658024 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:26:32.658005 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693\": container with ID starting with ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693 not found: ID does not exist" containerID="ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693" May 28 17:26:32.658085 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.658039 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693"} err="failed to get container status \"ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693\": rpc error: code = NotFound desc = could not find container \"ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693\": container with ID starting with ad7ae903bc095a82a328544c6cb5456bba30cb1b61c04d7b1bd914f4b5066693 not found: ID does not exist" May 28 17:26:32.672085 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.672057 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd9bb848-cf2qd"] May 28 17:26:32.676273 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:32.676250 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bd9bb848-cf2qd"] May 28 17:26:33.728748 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:33.728712 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f64ff2b0-2eae-4452-ac96-e002a66ec9f4" path="/var/lib/kubelet/pods/f64ff2b0-2eae-4452-ac96-e002a66ec9f4/volumes" May 28 17:26:38.197597 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.197558 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-584c457bf8-4bl2j"] May 28 17:26:38.198063 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.197910 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64ff2b0-2eae-4452-ac96-e002a66ec9f4" containerName="console" May 28 17:26:38.198063 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.197923 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64ff2b0-2eae-4452-ac96-e002a66ec9f4" containerName="console" May 28 17:26:38.198063 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.197935 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf" containerName="authorino" May 28 17:26:38.198063 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.197941 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf" containerName="authorino" May 28 17:26:38.198063 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.198001 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7efee9e-9b42-4ea7-a2ef-5a91599ad8cf" containerName="authorino" May 28 17:26:38.198063 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.198009 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="f64ff2b0-2eae-4452-ac96-e002a66ec9f4" containerName="console" May 28 17:26:38.204019 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.203993 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-584c457bf8-4bl2j" May 28 17:26:38.206309 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.206285 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-584c457bf8-4bl2j"] May 28 17:26:38.206559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.206541 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-782nz\"" May 28 17:26:38.313136 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.313102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz5ps\" (UniqueName: \"kubernetes.io/projected/38d0111c-e8c6-4b9f-a571-5b6593ebdc3b-kube-api-access-rz5ps\") pod \"authorino-584c457bf8-4bl2j\" (UID: \"38d0111c-e8c6-4b9f-a571-5b6593ebdc3b\") " pod="kuadrant-system/authorino-584c457bf8-4bl2j" May 28 17:26:38.385302 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.385265 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-584c457bf8-4bl2j"] May 28 17:26:38.385648 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:26:38.385622 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rz5ps], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-584c457bf8-4bl2j" podUID="38d0111c-e8c6-4b9f-a571-5b6593ebdc3b" May 28 17:26:38.414146 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.414106 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rz5ps\" (UniqueName: \"kubernetes.io/projected/38d0111c-e8c6-4b9f-a571-5b6593ebdc3b-kube-api-access-rz5ps\") pod \"authorino-584c457bf8-4bl2j\" (UID: \"38d0111c-e8c6-4b9f-a571-5b6593ebdc3b\") " pod="kuadrant-system/authorino-584c457bf8-4bl2j" May 28 17:26:38.416286 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.416264 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8456b57774-kxbr7"] May 28 17:26:38.419029 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.419009 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.421324 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.421305 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 28 17:26:38.432575 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.432544 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8456b57774-kxbr7"] May 28 17:26:38.436064 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.436042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz5ps\" (UniqueName: \"kubernetes.io/projected/38d0111c-e8c6-4b9f-a571-5b6593ebdc3b-kube-api-access-rz5ps\") pod \"authorino-584c457bf8-4bl2j\" (UID: \"38d0111c-e8c6-4b9f-a571-5b6593ebdc3b\") " pod="kuadrant-system/authorino-584c457bf8-4bl2j" May 28 17:26:38.515536 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.515502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/028efb02-bd00-4b50-81e3-2b529b290086-tls-cert\") pod \"authorino-8456b57774-kxbr7\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.515714 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.515564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ldpt\" (UniqueName: \"kubernetes.io/projected/028efb02-bd00-4b50-81e3-2b529b290086-kube-api-access-4ldpt\") pod \"authorino-8456b57774-kxbr7\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.617025 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.616982 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/028efb02-bd00-4b50-81e3-2b529b290086-tls-cert\") pod \"authorino-8456b57774-kxbr7\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.617216 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.617061 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ldpt\" (UniqueName: \"kubernetes.io/projected/028efb02-bd00-4b50-81e3-2b529b290086-kube-api-access-4ldpt\") pod \"authorino-8456b57774-kxbr7\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.619770 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.619746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/028efb02-bd00-4b50-81e3-2b529b290086-tls-cert\") pod \"authorino-8456b57774-kxbr7\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.625960 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.625938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ldpt\" (UniqueName: \"kubernetes.io/projected/028efb02-bd00-4b50-81e3-2b529b290086-kube-api-access-4ldpt\") pod \"authorino-8456b57774-kxbr7\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.672211 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.672181 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-584c457bf8-4bl2j" May 28 17:26:38.677248 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.677227 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-584c457bf8-4bl2j" May 28 17:26:38.717975 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.717937 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz5ps\" (UniqueName: \"kubernetes.io/projected/38d0111c-e8c6-4b9f-a571-5b6593ebdc3b-kube-api-access-rz5ps\") pod \"38d0111c-e8c6-4b9f-a571-5b6593ebdc3b\" (UID: \"38d0111c-e8c6-4b9f-a571-5b6593ebdc3b\") " May 28 17:26:38.720229 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.720194 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d0111c-e8c6-4b9f-a571-5b6593ebdc3b-kube-api-access-rz5ps" (OuterVolumeSpecName: "kube-api-access-rz5ps") pod "38d0111c-e8c6-4b9f-a571-5b6593ebdc3b" (UID: "38d0111c-e8c6-4b9f-a571-5b6593ebdc3b"). InnerVolumeSpecName "kube-api-access-rz5ps". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:26:38.727646 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.727629 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:26:38.819184 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.819148 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz5ps\" (UniqueName: \"kubernetes.io/projected/38d0111c-e8c6-4b9f-a571-5b6593ebdc3b-kube-api-access-rz5ps\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:26:38.867358 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:38.867333 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8456b57774-kxbr7"] May 28 17:26:38.868649 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:26:38.868624 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod028efb02_bd00_4b50_81e3_2b529b290086.slice/crio-8ce277980dc206360d4b0b8f1bfa3880c2ec87915868a997279a2e4a2fbd9951 WatchSource:0}: Error finding container 8ce277980dc206360d4b0b8f1bfa3880c2ec87915868a997279a2e4a2fbd9951: Status 404 returned error can't find the container with id 8ce277980dc206360d4b0b8f1bfa3880c2ec87915868a997279a2e4a2fbd9951 May 28 17:26:39.676884 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:39.676843 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8456b57774-kxbr7" event={"ID":"028efb02-bd00-4b50-81e3-2b529b290086","Type":"ContainerStarted","Data":"92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a"} May 28 17:26:39.676884 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:39.676889 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8456b57774-kxbr7" event={"ID":"028efb02-bd00-4b50-81e3-2b529b290086","Type":"ContainerStarted","Data":"8ce277980dc206360d4b0b8f1bfa3880c2ec87915868a997279a2e4a2fbd9951"} May 28 17:26:39.677311 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:39.676914 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-584c457bf8-4bl2j" May 28 17:26:39.693364 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:39.693307 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8456b57774-kxbr7" podStartSLOduration=1.331357849 podStartE2EDuration="1.693288124s" podCreationTimestamp="2026-05-28 17:26:38 +0000 UTC" firstStartedPulling="2026-05-28 17:26:38.869842336 +0000 UTC m=+521.783735144" lastFinishedPulling="2026-05-28 17:26:39.231772612 +0000 UTC m=+522.145665419" observedRunningTime="2026-05-28 17:26:39.69315291 +0000 UTC m=+522.607045742" watchObservedRunningTime="2026-05-28 17:26:39.693288124 +0000 UTC m=+522.607180952" May 28 17:26:39.721632 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:39.721595 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-584c457bf8-4bl2j"] May 28 17:26:39.731659 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:39.731620 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-584c457bf8-4bl2j"] May 28 17:26:41.727706 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:26:41.727629 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d0111c-e8c6-4b9f-a571-5b6593ebdc3b" path="/var/lib/kubelet/pods/38d0111c-e8c6-4b9f-a571-5b6593ebdc3b/volumes" May 28 17:27:16.045601 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:16.045560 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:27:37.158251 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:37.158213 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:27:37.951111 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:37.951065 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:27:40.552867 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:40.552818 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:27:42.952858 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:42.952829 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:27:46.459853 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:46.459812 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:27:50.777963 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.777915 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr"] May 28 17:27:50.781829 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.781807 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:50.785367 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.785347 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 28 17:27:50.785493 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.785374 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zdzh\"" May 28 17:27:50.785493 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.785384 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 28 17:27:50.785493 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.785470 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 28 17:27:50.794998 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.794979 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr"] May 28 17:27:50.965702 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.965657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/670727ee-caa1-409b-90a1-9fe2a38e8bd3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:50.965902 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.965722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:50.965902 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.965741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xdv6\" (UniqueName: \"kubernetes.io/projected/670727ee-caa1-409b-90a1-9fe2a38e8bd3-kube-api-access-4xdv6\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:50.965902 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.965775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:50.965902 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.965797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:50.965902 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:50.965873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.067368 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.066951 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.067368 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.067001 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xdv6\" (UniqueName: \"kubernetes.io/projected/670727ee-caa1-409b-90a1-9fe2a38e8bd3-kube-api-access-4xdv6\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.067368 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.067054 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.067368 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.067080 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.067368 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.067123 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.067368 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.067172 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/670727ee-caa1-409b-90a1-9fe2a38e8bd3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.067809 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.067389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.068559 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.068531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.068694 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.068607 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.069828 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.069805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/670727ee-caa1-409b-90a1-9fe2a38e8bd3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.070253 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.070236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/670727ee-caa1-409b-90a1-9fe2a38e8bd3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.077137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.077114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xdv6\" (UniqueName: \"kubernetes.io/projected/670727ee-caa1-409b-90a1-9fe2a38e8bd3-kube-api-access-4xdv6\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr\" (UID: \"670727ee-caa1-409b-90a1-9fe2a38e8bd3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.091935 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.091917 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:27:51.223633 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.223598 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr"] May 28 17:27:51.224358 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:27:51.224329 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670727ee_caa1_409b_90a1_9fe2a38e8bd3.slice/crio-c4ea397ff8948fff3580bc1ec078b8c2e72dd408a14a0e209358ed20244db631 WatchSource:0}: Error finding container c4ea397ff8948fff3580bc1ec078b8c2e72dd408a14a0e209358ed20244db631: Status 404 returned error can't find the container with id c4ea397ff8948fff3580bc1ec078b8c2e72dd408a14a0e209358ed20244db631 May 28 17:27:51.950155 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:51.950122 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" event={"ID":"670727ee-caa1-409b-90a1-9fe2a38e8bd3","Type":"ContainerStarted","Data":"c4ea397ff8948fff3580bc1ec078b8c2e72dd408a14a0e209358ed20244db631"} May 28 17:27:52.689433 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:52.689396 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:27:56.973503 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:56.973440 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" event={"ID":"670727ee-caa1-409b-90a1-9fe2a38e8bd3","Type":"ContainerStarted","Data":"1f91700b39ce8a7216b54ca4832aff29b8b5dca58843eaa564a60a66663dad1b"} May 28 17:27:57.630578 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:57.630547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:27:57.631574 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:27:57.631551 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:28:02.001095 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:02.001003 2577 generic.go:358] "Generic (PLEG): container finished" podID="670727ee-caa1-409b-90a1-9fe2a38e8bd3" containerID="1f91700b39ce8a7216b54ca4832aff29b8b5dca58843eaa564a60a66663dad1b" exitCode=0 May 28 17:28:02.001095 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:02.001073 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" event={"ID":"670727ee-caa1-409b-90a1-9fe2a38e8bd3","Type":"ContainerDied","Data":"1f91700b39ce8a7216b54ca4832aff29b8b5dca58843eaa564a60a66663dad1b"} May 28 17:28:02.001721 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:02.001704 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:28:04.011180 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:04.011145 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" event={"ID":"670727ee-caa1-409b-90a1-9fe2a38e8bd3","Type":"ContainerStarted","Data":"63f393dfe3765062f1d3a816825acb523c54ec2a8cfe388d398178f0a94e2324"} May 28 17:28:04.011599 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:04.011366 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:28:04.031073 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:04.031008 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" podStartSLOduration=2.1405896970000002 podStartE2EDuration="14.030989931s" podCreationTimestamp="2026-05-28 17:27:50 +0000 UTC" firstStartedPulling="2026-05-28 17:27:51.226353129 +0000 UTC m=+594.140245936" lastFinishedPulling="2026-05-28 17:28:03.116753363 +0000 UTC m=+606.030646170" observedRunningTime="2026-05-28 17:28:04.029941633 +0000 UTC m=+606.943834464" watchObservedRunningTime="2026-05-28 17:28:04.030989931 +0000 UTC m=+606.944882778" May 28 17:28:15.028991 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:15.028902 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr" May 28 17:28:35.741955 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:35.741925 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8456b57774-kxbr7"] May 28 17:28:35.742398 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:35.742115 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8456b57774-kxbr7" podUID="028efb02-bd00-4b50-81e3-2b529b290086" containerName="authorino" containerID="cri-o://92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a" gracePeriod=30 May 28 17:28:35.995450 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:35.995394 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:28:36.139347 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.139305 2577 generic.go:358] "Generic (PLEG): container finished" podID="028efb02-bd00-4b50-81e3-2b529b290086" containerID="92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a" exitCode=0 May 28 17:28:36.139535 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.139363 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8456b57774-kxbr7" May 28 17:28:36.139535 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.139389 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8456b57774-kxbr7" event={"ID":"028efb02-bd00-4b50-81e3-2b529b290086","Type":"ContainerDied","Data":"92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a"} May 28 17:28:36.139535 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.139436 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8456b57774-kxbr7" event={"ID":"028efb02-bd00-4b50-81e3-2b529b290086","Type":"ContainerDied","Data":"8ce277980dc206360d4b0b8f1bfa3880c2ec87915868a997279a2e4a2fbd9951"} May 28 17:28:36.139535 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.139471 2577 scope.go:117] "RemoveContainer" containerID="92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a" May 28 17:28:36.147861 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.147836 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ldpt\" (UniqueName: \"kubernetes.io/projected/028efb02-bd00-4b50-81e3-2b529b290086-kube-api-access-4ldpt\") pod \"028efb02-bd00-4b50-81e3-2b529b290086\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " May 28 17:28:36.148341 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.148316 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/028efb02-bd00-4b50-81e3-2b529b290086-tls-cert\") pod \"028efb02-bd00-4b50-81e3-2b529b290086\" (UID: \"028efb02-bd00-4b50-81e3-2b529b290086\") " May 28 17:28:36.150419 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.150360 2577 scope.go:117] "RemoveContainer" containerID="92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a" May 28 17:28:36.150544 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.150500 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028efb02-bd00-4b50-81e3-2b529b290086-kube-api-access-4ldpt" (OuterVolumeSpecName: "kube-api-access-4ldpt") pod "028efb02-bd00-4b50-81e3-2b529b290086" (UID: "028efb02-bd00-4b50-81e3-2b529b290086"). InnerVolumeSpecName "kube-api-access-4ldpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:28:36.150848 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:28:36.150818 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a\": container with ID starting with 92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a not found: ID does not exist" containerID="92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a" May 28 17:28:36.150933 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.150860 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a"} err="failed to get container status \"92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a\": rpc error: code = NotFound desc = could not find container \"92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a\": container with ID starting with 92f896cb5a3539f50e5f1d4b1ec479a64e015a5887e5c48a3e7b1a546882d05a not found: ID does not exist" May 28 17:28:36.160590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.160564 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/028efb02-bd00-4b50-81e3-2b529b290086-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "028efb02-bd00-4b50-81e3-2b529b290086" (UID: "028efb02-bd00-4b50-81e3-2b529b290086"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:28:36.249316 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.249236 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ldpt\" (UniqueName: \"kubernetes.io/projected/028efb02-bd00-4b50-81e3-2b529b290086-kube-api-access-4ldpt\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:28:36.249316 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.249265 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/028efb02-bd00-4b50-81e3-2b529b290086-tls-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:28:36.462128 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.462095 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8456b57774-kxbr7"] May 28 17:28:36.466948 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:36.466928 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8456b57774-kxbr7"] May 28 17:28:37.727941 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:28:37.727912 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="028efb02-bd00-4b50-81e3-2b529b290086" path="/var/lib/kubelet/pods/028efb02-bd00-4b50-81e3-2b529b290086/volumes" May 28 17:29:01.453013 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:29:01.452980 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:29:11.559870 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:29:11.559841 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:29:20.664108 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:29:20.664072 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:29:31.259107 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:29:31.259077 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:29:40.051383 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:29:40.051349 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:29:49.956753 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:29:49.956673 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:30:00.149949 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.149915 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-dnqt8"] May 28 17:30:00.150302 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.150226 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028efb02-bd00-4b50-81e3-2b529b290086" containerName="authorino" May 28 17:30:00.150302 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.150237 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="028efb02-bd00-4b50-81e3-2b529b290086" containerName="authorino" May 28 17:30:00.150377 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.150324 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="028efb02-bd00-4b50-81e3-2b529b290086" containerName="authorino" May 28 17:30:00.153387 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.153371 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" May 28 17:30:00.156144 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.156119 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fzhcz\"" May 28 17:30:00.161894 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.161868 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-dnqt8"] May 28 17:30:00.241288 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.241244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmp9h\" (UniqueName: \"kubernetes.io/projected/10ada545-3015-4c88-b8a6-74c4238e96d4-kube-api-access-nmp9h\") pod \"maas-api-key-cleanup-29666490-dnqt8\" (UID: \"10ada545-3015-4c88-b8a6-74c4238e96d4\") " pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" May 28 17:30:00.342595 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.342560 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmp9h\" (UniqueName: \"kubernetes.io/projected/10ada545-3015-4c88-b8a6-74c4238e96d4-kube-api-access-nmp9h\") pod \"maas-api-key-cleanup-29666490-dnqt8\" (UID: \"10ada545-3015-4c88-b8a6-74c4238e96d4\") " pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" May 28 17:30:00.351657 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.351624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmp9h\" (UniqueName: \"kubernetes.io/projected/10ada545-3015-4c88-b8a6-74c4238e96d4-kube-api-access-nmp9h\") pod \"maas-api-key-cleanup-29666490-dnqt8\" (UID: \"10ada545-3015-4c88-b8a6-74c4238e96d4\") " pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" May 28 17:30:00.463066 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.462976 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" May 28 17:30:00.601120 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:00.601084 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-dnqt8"] May 28 17:30:00.602174 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:30:00.602144 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ada545_3015_4c88_b8a6_74c4238e96d4.slice/crio-38052766abc90ffba7b0e3cae8120000fe7566f41cbe0f3e4ba22dc915c89ff8 WatchSource:0}: Error finding container 38052766abc90ffba7b0e3cae8120000fe7566f41cbe0f3e4ba22dc915c89ff8: Status 404 returned error can't find the container with id 38052766abc90ffba7b0e3cae8120000fe7566f41cbe0f3e4ba22dc915c89ff8 May 28 17:30:01.468674 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:01.468640 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" event={"ID":"10ada545-3015-4c88-b8a6-74c4238e96d4","Type":"ContainerStarted","Data":"38052766abc90ffba7b0e3cae8120000fe7566f41cbe0f3e4ba22dc915c89ff8"} May 28 17:30:03.481489 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:03.481365 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" event={"ID":"10ada545-3015-4c88-b8a6-74c4238e96d4","Type":"ContainerStarted","Data":"1adffc2255259de7b38a1e9a706afc874e00ed3b1551c8451f779364f47d6496"} May 28 17:30:03.500396 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:03.500340 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" podStartSLOduration=1.155458155 podStartE2EDuration="3.500327829s" podCreationTimestamp="2026-05-28 17:30:00 +0000 UTC" firstStartedPulling="2026-05-28 17:30:00.604112302 +0000 UTC m=+723.518005110" lastFinishedPulling="2026-05-28 17:30:02.948981978 +0000 UTC m=+725.862874784" observedRunningTime="2026-05-28 17:30:03.498120939 +0000 UTC m=+726.412013762" watchObservedRunningTime="2026-05-28 17:30:03.500327829 +0000 UTC m=+726.414220657" May 28 17:30:04.486556 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:04.486509 2577 generic.go:358] "Generic (PLEG): container finished" podID="10ada545-3015-4c88-b8a6-74c4238e96d4" containerID="1adffc2255259de7b38a1e9a706afc874e00ed3b1551c8451f779364f47d6496" exitCode=0 May 28 17:30:04.486988 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:04.486596 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" event={"ID":"10ada545-3015-4c88-b8a6-74c4238e96d4","Type":"ContainerDied","Data":"1adffc2255259de7b38a1e9a706afc874e00ed3b1551c8451f779364f47d6496"} May 28 17:30:05.617028 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:05.617008 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" May 28 17:30:05.686642 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:05.686618 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmp9h\" (UniqueName: \"kubernetes.io/projected/10ada545-3015-4c88-b8a6-74c4238e96d4-kube-api-access-nmp9h\") pod \"10ada545-3015-4c88-b8a6-74c4238e96d4\" (UID: \"10ada545-3015-4c88-b8a6-74c4238e96d4\") " May 28 17:30:05.689220 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:05.689197 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ada545-3015-4c88-b8a6-74c4238e96d4-kube-api-access-nmp9h" (OuterVolumeSpecName: "kube-api-access-nmp9h") pod "10ada545-3015-4c88-b8a6-74c4238e96d4" (UID: "10ada545-3015-4c88-b8a6-74c4238e96d4"). InnerVolumeSpecName "kube-api-access-nmp9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:30:05.787947 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:05.787927 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmp9h\" (UniqueName: \"kubernetes.io/projected/10ada545-3015-4c88-b8a6-74c4238e96d4-kube-api-access-nmp9h\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:30:06.496090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:06.496056 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" event={"ID":"10ada545-3015-4c88-b8a6-74c4238e96d4","Type":"ContainerDied","Data":"38052766abc90ffba7b0e3cae8120000fe7566f41cbe0f3e4ba22dc915c89ff8"} May 28 17:30:06.496090 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:06.496091 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38052766abc90ffba7b0e3cae8120000fe7566f41cbe0f3e4ba22dc915c89ff8" May 28 17:30:06.496291 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:06.496105 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-dnqt8" May 28 17:30:21.356765 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:21.356731 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:30:26.959788 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:30:26.959755 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:31:04.852771 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:31:04.852735 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:31:21.359137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:31:21.359055 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:32:00.769275 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:32:00.769230 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:32:19.259008 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:32:19.258972 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:32:33.470270 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:32:33.470233 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:32:48.652682 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:32:48.652605 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:32:57.664427 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:32:57.664394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:32:57.665004 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:32:57.664846 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:33:19.248956 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:33:19.248909 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:33:24.848126 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:33:24.848089 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:33:44.853134 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:33:44.853096 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:33:54.048947 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:33:54.048912 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:34:11.466526 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:34:11.466495 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:34:19.356076 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:34:19.356042 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:34:36.256065 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:34:36.256034 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:34:43.858298 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:34:43.858265 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:35:17.849137 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:35:17.849098 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:35:25.450929 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:35:25.450894 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:35:33.745328 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:35:33.745293 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:35:42.249185 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:35:42.249096 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:35:50.454193 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:35:50.454156 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:36:08.267859 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:36:08.267822 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:36:21.254818 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:36:21.254781 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:06.951249 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:06.951215 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:12.761088 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:12.761004 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:19.347686 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:19.347640 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:27.446276 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:27.446228 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:36.541943 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:36.541906 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:44.951650 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:44.951601 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:53.944912 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:53.944875 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:37:57.700204 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:57.700178 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:37:57.703282 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:37:57.703263 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:38:02.649590 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:38:02.649556 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:38:11.554786 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:38:11.554750 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:38:19.751500 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:38:19.751464 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:38:28.345315 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:38:28.345277 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:38:37.338188 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:38:37.338153 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:38:46.047999 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:38:46.047910 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:38:54.847066 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:38:54.847029 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:39:03.859774 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:39:03.859743 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:39:11.661362 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:39:11.661328 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:39:21.289583 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:39:21.289550 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:39:29.161628 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:39:29.161589 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:40:20.965503 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:20.965412 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx"] May 28 17:40:20.965953 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:20.965674 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" podUID="079792fa-c022-4413-8162-deef006d208d" containerName="manager" containerID="cri-o://c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a" gracePeriod=10 May 28 17:40:21.807026 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.807000 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:40:21.850101 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.850062 2577 generic.go:358] "Generic (PLEG): container finished" podID="079792fa-c022-4413-8162-deef006d208d" containerID="c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a" exitCode=0 May 28 17:40:21.850255 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.850139 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" May 28 17:40:21.850255 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.850144 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" event={"ID":"079792fa-c022-4413-8162-deef006d208d","Type":"ContainerDied","Data":"c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a"} May 28 17:40:21.850255 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.850187 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx" event={"ID":"079792fa-c022-4413-8162-deef006d208d","Type":"ContainerDied","Data":"d88622654eb4b843cef8ab6aa042a8372886a28fd976d2197b2fac1b81a7e258"} May 28 17:40:21.850255 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.850206 2577 scope.go:117] "RemoveContainer" containerID="c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a" May 28 17:40:21.860307 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.860287 2577 scope.go:117] "RemoveContainer" containerID="c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a" May 28 17:40:21.860591 ip-10-0-141-59 kubenswrapper[2577]: E0528 17:40:21.860564 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a\": container with ID starting with c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a not found: ID does not exist" containerID="c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a" May 28 17:40:21.860694 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.860603 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a"} err="failed to get container status \"c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a\": rpc error: code = NotFound desc = could not find container \"c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a\": container with ID starting with c89f61f3da4135e00b92e9f7774573f441aa7e58105ab14e7f9d65e72b17db4a not found: ID does not exist" May 28 17:40:21.922072 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.922043 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcb5c\" (UniqueName: \"kubernetes.io/projected/079792fa-c022-4413-8162-deef006d208d-kube-api-access-xcb5c\") pod \"079792fa-c022-4413-8162-deef006d208d\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " May 28 17:40:21.922225 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.922086 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/079792fa-c022-4413-8162-deef006d208d-extensions-socket-volume\") pod \"079792fa-c022-4413-8162-deef006d208d\" (UID: \"079792fa-c022-4413-8162-deef006d208d\") " May 28 17:40:21.922526 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.922505 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/079792fa-c022-4413-8162-deef006d208d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "079792fa-c022-4413-8162-deef006d208d" (UID: "079792fa-c022-4413-8162-deef006d208d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:40:21.924179 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:21.924159 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079792fa-c022-4413-8162-deef006d208d-kube-api-access-xcb5c" (OuterVolumeSpecName: "kube-api-access-xcb5c") pod "079792fa-c022-4413-8162-deef006d208d" (UID: "079792fa-c022-4413-8162-deef006d208d"). InnerVolumeSpecName "kube-api-access-xcb5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:40:22.022667 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:22.022635 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcb5c\" (UniqueName: \"kubernetes.io/projected/079792fa-c022-4413-8162-deef006d208d-kube-api-access-xcb5c\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:40:22.022667 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:22.022663 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/079792fa-c022-4413-8162-deef006d208d-extensions-socket-volume\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:40:22.177157 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:22.177121 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx"] May 28 17:40:22.182949 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:22.182871 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dpqbx"] May 28 17:40:23.727010 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:40:23.726976 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="079792fa-c022-4413-8162-deef006d208d" path="/var/lib/kubelet/pods/079792fa-c022-4413-8162-deef006d208d/volumes" May 28 17:41:27.024026 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.023988 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4"] May 28 17:41:27.024510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.024365 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ada545-3015-4c88-b8a6-74c4238e96d4" containerName="cleanup" May 28 17:41:27.024510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.024378 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ada545-3015-4c88-b8a6-74c4238e96d4" containerName="cleanup" May 28 17:41:27.024510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.024403 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="079792fa-c022-4413-8162-deef006d208d" containerName="manager" May 28 17:41:27.024510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.024408 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="079792fa-c022-4413-8162-deef006d208d" containerName="manager" May 28 17:41:27.024510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.024474 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="079792fa-c022-4413-8162-deef006d208d" containerName="manager" May 28 17:41:27.024510 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.024483 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="10ada545-3015-4c88-b8a6-74c4238e96d4" containerName="cleanup" May 28 17:41:27.027489 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.027472 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.029800 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.029781 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cxzmg\"" May 28 17:41:27.036801 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.036778 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4"] May 28 17:41:27.124221 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.124191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzj75\" (UniqueName: \"kubernetes.io/projected/681b2de6-5bfe-4460-8731-eab6e073cf80-kube-api-access-kzj75\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6pck4\" (UID: \"681b2de6-5bfe-4460-8731-eab6e073cf80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.124343 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.124251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/681b2de6-5bfe-4460-8731-eab6e073cf80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6pck4\" (UID: \"681b2de6-5bfe-4460-8731-eab6e073cf80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.225043 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.225018 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzj75\" (UniqueName: \"kubernetes.io/projected/681b2de6-5bfe-4460-8731-eab6e073cf80-kube-api-access-kzj75\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6pck4\" (UID: \"681b2de6-5bfe-4460-8731-eab6e073cf80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.225139 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.225060 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/681b2de6-5bfe-4460-8731-eab6e073cf80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6pck4\" (UID: \"681b2de6-5bfe-4460-8731-eab6e073cf80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.225329 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.225315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/681b2de6-5bfe-4460-8731-eab6e073cf80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6pck4\" (UID: \"681b2de6-5bfe-4460-8731-eab6e073cf80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.233253 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.233235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzj75\" (UniqueName: \"kubernetes.io/projected/681b2de6-5bfe-4460-8731-eab6e073cf80-kube-api-access-kzj75\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6pck4\" (UID: \"681b2de6-5bfe-4460-8731-eab6e073cf80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.338325 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.338266 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:27.468632 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.468605 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4"] May 28 17:41:27.470500 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:41:27.470471 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681b2de6_5bfe_4460_8731_eab6e073cf80.slice/crio-89ce9914f8914eff78e00493659f467a9e19a609f76858fcb32875351007556c WatchSource:0}: Error finding container 89ce9914f8914eff78e00493659f467a9e19a609f76858fcb32875351007556c: Status 404 returned error can't find the container with id 89ce9914f8914eff78e00493659f467a9e19a609f76858fcb32875351007556c May 28 17:41:27.472869 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:27.472850 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:41:28.090630 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:28.090588 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" event={"ID":"681b2de6-5bfe-4460-8731-eab6e073cf80","Type":"ContainerStarted","Data":"e028fca11abb65870fd5960bf2e07e887d3d39aac5afa0ce2e45bdedc7d6e5f9"} May 28 17:41:28.090630 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:28.090635 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" event={"ID":"681b2de6-5bfe-4460-8731-eab6e073cf80","Type":"ContainerStarted","Data":"89ce9914f8914eff78e00493659f467a9e19a609f76858fcb32875351007556c"} May 28 17:41:28.091151 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:28.090668 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:28.112878 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:28.112824 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" podStartSLOduration=1.112807738 podStartE2EDuration="1.112807738s" podCreationTimestamp="2026-05-28 17:41:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:41:28.10953396 +0000 UTC m=+1411.023426789" watchObservedRunningTime="2026-05-28 17:41:28.112807738 +0000 UTC m=+1411.026700569" May 28 17:41:39.096404 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:39.096374 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6pck4" May 28 17:41:47.355622 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:47.355537 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:41:51.947695 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:41:51.947660 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:42:17.948935 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:42:17.948904 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:42:24.448980 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:42:24.448951 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:42:34.742143 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:42:34.742109 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:42:44.540823 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:42:44.540788 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:42:53.348632 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:42:53.348595 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:42:57.735239 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:42:57.735208 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:42:57.737209 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:42:57.737191 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:43:03.543889 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:43:03.543847 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:43:12.542987 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:43:12.542947 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:43:22.944960 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:43:22.944924 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:43:31.645252 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:43:31.645220 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:43:42.053156 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:43:42.053115 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:43:51.187829 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:43:51.187792 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:44:24.145468 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:44:24.145411 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:45:00.139194 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.139118 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-gz5s4"] May 28 17:45:00.142497 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.142479 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" May 28 17:45:00.144507 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.144488 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fzhcz\"" May 28 17:45:00.157885 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.157862 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-gz5s4"] May 28 17:45:00.296573 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.296543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvbk\" (UniqueName: \"kubernetes.io/projected/2ac8ae17-8a51-40f2-b564-1e136e6008a1-kube-api-access-rnvbk\") pod \"maas-api-key-cleanup-29666505-gz5s4\" (UID: \"2ac8ae17-8a51-40f2-b564-1e136e6008a1\") " pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" May 28 17:45:00.397525 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.397429 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvbk\" (UniqueName: \"kubernetes.io/projected/2ac8ae17-8a51-40f2-b564-1e136e6008a1-kube-api-access-rnvbk\") pod \"maas-api-key-cleanup-29666505-gz5s4\" (UID: \"2ac8ae17-8a51-40f2-b564-1e136e6008a1\") " pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" May 28 17:45:00.405234 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.405211 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvbk\" (UniqueName: \"kubernetes.io/projected/2ac8ae17-8a51-40f2-b564-1e136e6008a1-kube-api-access-rnvbk\") pod \"maas-api-key-cleanup-29666505-gz5s4\" (UID: \"2ac8ae17-8a51-40f2-b564-1e136e6008a1\") " pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" May 28 17:45:00.452127 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.452103 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" May 28 17:45:00.578661 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.578638 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-gz5s4"] May 28 17:45:00.580313 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:45:00.580272 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac8ae17_8a51_40f2_b564_1e136e6008a1.slice/crio-1d2e5f704e00ac7dc660fd18d4feca7872d552545d60fd4b6b9273412bf2eb03 WatchSource:0}: Error finding container 1d2e5f704e00ac7dc660fd18d4feca7872d552545d60fd4b6b9273412bf2eb03: Status 404 returned error can't find the container with id 1d2e5f704e00ac7dc660fd18d4feca7872d552545d60fd4b6b9273412bf2eb03 May 28 17:45:00.886930 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:00.886899 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" event={"ID":"2ac8ae17-8a51-40f2-b564-1e136e6008a1","Type":"ContainerStarted","Data":"1d2e5f704e00ac7dc660fd18d4feca7872d552545d60fd4b6b9273412bf2eb03"} May 28 17:45:01.891878 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:01.891845 2577 generic.go:358] "Generic (PLEG): container finished" podID="2ac8ae17-8a51-40f2-b564-1e136e6008a1" containerID="0d46f63dcb38cc9ddb7bc9d40b590a654968f35a770db0f0667a89248c12f562" exitCode=0 May 28 17:45:01.892235 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:01.891914 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" event={"ID":"2ac8ae17-8a51-40f2-b564-1e136e6008a1","Type":"ContainerDied","Data":"0d46f63dcb38cc9ddb7bc9d40b590a654968f35a770db0f0667a89248c12f562"} May 28 17:45:03.018646 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:03.018619 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" May 28 17:45:03.118659 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:03.118636 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnvbk\" (UniqueName: \"kubernetes.io/projected/2ac8ae17-8a51-40f2-b564-1e136e6008a1-kube-api-access-rnvbk\") pod \"2ac8ae17-8a51-40f2-b564-1e136e6008a1\" (UID: \"2ac8ae17-8a51-40f2-b564-1e136e6008a1\") " May 28 17:45:03.120725 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:03.120696 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac8ae17-8a51-40f2-b564-1e136e6008a1-kube-api-access-rnvbk" (OuterVolumeSpecName: "kube-api-access-rnvbk") pod "2ac8ae17-8a51-40f2-b564-1e136e6008a1" (UID: "2ac8ae17-8a51-40f2-b564-1e136e6008a1"). InnerVolumeSpecName "kube-api-access-rnvbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:45:03.220036 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:03.219977 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnvbk\" (UniqueName: \"kubernetes.io/projected/2ac8ae17-8a51-40f2-b564-1e136e6008a1-kube-api-access-rnvbk\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 28 17:45:03.901223 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:03.901197 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" May 28 17:45:03.901223 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:03.901211 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-gz5s4" event={"ID":"2ac8ae17-8a51-40f2-b564-1e136e6008a1","Type":"ContainerDied","Data":"1d2e5f704e00ac7dc660fd18d4feca7872d552545d60fd4b6b9273412bf2eb03"} May 28 17:45:03.901409 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:03.901244 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d2e5f704e00ac7dc660fd18d4feca7872d552545d60fd4b6b9273412bf2eb03" May 28 17:45:06.445878 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:06.445836 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:45:15.346972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:15.346931 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:45:24.052512 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:24.052477 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:45:32.850026 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:32.849991 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:45:41.745875 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:41.745843 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:45:52.147634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:45:52.147601 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:46:02.342640 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:46:02.342604 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:46:07.750051 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:46:07.750015 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:46:17.547197 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:46:17.547122 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:46:25.642021 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:46:25.641988 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:46:33.947428 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:46:33.947397 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:46:44.646046 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:46:44.646011 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:47:02.051039 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:02.051006 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:47:09.747308 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:09.747276 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:47:19.158311 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:19.158280 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:47:27.544411 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:27.544378 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:47:44.445371 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:44.445280 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:47:53.152741 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:53.152709 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:47:57.767677 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:57.767638 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:47:57.771509 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:47:57.771487 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sd6sz_a555954e-e046-4a2c-86be-e413388972e8/ovn-acl-logging/0.log" May 28 17:48:01.554579 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:48:01.554546 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:48:09.438751 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:48:09.438709 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:48:18.546495 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:48:18.546443 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:48:26.643823 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:48:26.643784 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:48:37.445634 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:48:37.445597 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:48:47.845400 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:48:47.845370 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:48:56.249148 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:48:56.249117 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:49:09.342650 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:49:09.342610 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:49:19.347012 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:49:19.346931 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:49:26.650280 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:49:26.650237 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:49:35.446768 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:49:35.446733 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:49:43.242191 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:49:43.242148 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:49:59.444972 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:49:59.444935 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:50:07.352766 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:50:07.352736 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:50:16.747045 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:50:16.747010 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:50:24.846016 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:50:24.845981 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:50:48.242291 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:50:48.242206 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:51:01.840543 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:01.840509 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-q7bpn"] May 28 17:51:08.979048 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:08.979021 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666490-dnqt8_10ada545-3015-4c88-b8a6-74c4238e96d4/cleanup/0.log" May 28 17:51:09.083327 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:09.083299 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666505-gz5s4_2ac8ae17-8a51-40f2-b564-1e136e6008a1/cleanup/0.log" May 28 17:51:09.305309 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:09.305272 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-5xv9h_c715a88c-9fb4-45fa-b923-5ee8dcc5c132/manager/2.log" May 28 17:51:09.629506 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:09.629417 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6_83eeb1f3-bd93-49c4-8633-eed90304321c/manager/0.log" May 28 17:51:10.464241 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.464214 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl_c315ecee-a586-40d4-997c-a65e31bb2260/util/0.log" May 28 17:51:10.470818 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.470790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl_c315ecee-a586-40d4-997c-a65e31bb2260/pull/0.log" May 28 17:51:10.477936 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.477916 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl_c315ecee-a586-40d4-997c-a65e31bb2260/extract/0.log" May 28 17:51:10.584110 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.584088 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6_35c9df4b-5138-4846-84a2-ccced63776a2/util/0.log" May 28 17:51:10.591035 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.591011 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6_35c9df4b-5138-4846-84a2-ccced63776a2/pull/0.log" May 28 17:51:10.597343 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.597313 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6_35c9df4b-5138-4846-84a2-ccced63776a2/extract/0.log" May 28 17:51:10.705150 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.705128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq_77c89060-b4de-457c-a816-770af9e10c40/util/0.log" May 28 17:51:10.711605 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.711586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq_77c89060-b4de-457c-a816-770af9e10c40/pull/0.log" May 28 17:51:10.717881 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.717828 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq_77c89060-b4de-457c-a816-770af9e10c40/extract/0.log" May 28 17:51:10.824490 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.824471 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5_be722477-e156-4626-abcf-2603a552b9d5/extract/0.log" May 28 17:51:10.831014 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.830991 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5_be722477-e156-4626-abcf-2603a552b9d5/util/0.log" May 28 17:51:10.837784 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:10.837752 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5_be722477-e156-4626-abcf-2603a552b9d5/pull/0.log" May 28 17:51:11.279625 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:11.279596 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-mmllj_cea7d5c4-a2ba-4494-abe3-fee104e24f51/kuadrant-console-plugin/0.log" May 28 17:51:11.397096 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:11.397065 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dq2hg_9422bc41-88a1-43f4-8f9d-403ea0f9c64d/registry-server/0.log" May 28 17:51:11.527729 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:11.527698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6pck4_681b2de6-5bfe-4460-8731-eab6e073cf80/manager/0.log" May 28 17:51:11.658263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:11.658202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-q7bpn_b5081778-986a-44fc-bad9-9959ef93bef0/limitador/0.log" May 28 17:51:12.137060 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:12.137036 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bkxld4_41a113ee-5bd0-4908-8c88-c44458edd4aa/istio-proxy/0.log" May 28 17:51:12.580761 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:12.580732 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-kb7j9_6f7218df-deb4-48f1-8a83-33bc72a4b836/istio-proxy/0.log" May 28 17:51:13.264616 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:13.264586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr_670727ee-caa1-409b-90a1-9fe2a38e8bd3/storage-initializer/0.log" May 28 17:51:13.273472 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:13.273418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-st2dr_670727ee-caa1-409b-90a1-9fe2a38e8bd3/main/0.log" May 28 17:51:17.912497 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.912448 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bhdkc/must-gather-dfmdr"] May 28 17:51:17.912844 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.912804 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac8ae17-8a51-40f2-b564-1e136e6008a1" containerName="cleanup" May 28 17:51:17.912844 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.912815 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac8ae17-8a51-40f2-b564-1e136e6008a1" containerName="cleanup" May 28 17:51:17.912916 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.912876 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ac8ae17-8a51-40f2-b564-1e136e6008a1" containerName="cleanup" May 28 17:51:17.915040 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.915023 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:17.917613 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.917589 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bhdkc\"/\"default-dockercfg-pcpxk\"" May 28 17:51:17.917731 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.917612 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bhdkc\"/\"kube-root-ca.crt\"" May 28 17:51:17.918287 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.918028 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bhdkc\"/\"openshift-service-ca.crt\"" May 28 17:51:17.936407 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.936384 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bhdkc/must-gather-dfmdr"] May 28 17:51:17.989796 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.989765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2ljc\" (UniqueName: \"kubernetes.io/projected/08c3f08e-30ed-46f2-bc64-165c978e1502-kube-api-access-b2ljc\") pod \"must-gather-dfmdr\" (UID: \"08c3f08e-30ed-46f2-bc64-165c978e1502\") " pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:17.989908 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:17.989891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/08c3f08e-30ed-46f2-bc64-165c978e1502-must-gather-output\") pod \"must-gather-dfmdr\" (UID: \"08c3f08e-30ed-46f2-bc64-165c978e1502\") " pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:18.090376 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:18.090352 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2ljc\" (UniqueName: \"kubernetes.io/projected/08c3f08e-30ed-46f2-bc64-165c978e1502-kube-api-access-b2ljc\") pod \"must-gather-dfmdr\" (UID: \"08c3f08e-30ed-46f2-bc64-165c978e1502\") " pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:18.090540 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:18.090425 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/08c3f08e-30ed-46f2-bc64-165c978e1502-must-gather-output\") pod \"must-gather-dfmdr\" (UID: \"08c3f08e-30ed-46f2-bc64-165c978e1502\") " pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:18.090728 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:18.090710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/08c3f08e-30ed-46f2-bc64-165c978e1502-must-gather-output\") pod \"must-gather-dfmdr\" (UID: \"08c3f08e-30ed-46f2-bc64-165c978e1502\") " pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:18.103031 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:18.103004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2ljc\" (UniqueName: \"kubernetes.io/projected/08c3f08e-30ed-46f2-bc64-165c978e1502-kube-api-access-b2ljc\") pod \"must-gather-dfmdr\" (UID: \"08c3f08e-30ed-46f2-bc64-165c978e1502\") " pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:18.224408 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:18.224319 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bhdkc/must-gather-dfmdr" May 28 17:51:18.353894 ip-10-0-141-59 kubenswrapper[2577]: W0528 17:51:18.353861 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08c3f08e_30ed_46f2_bc64_165c978e1502.slice/crio-029e1ae349bf5904f06e400fcd9ae8c9321b86cf586305145f967aa45c75d5ce WatchSource:0}: Error finding container 029e1ae349bf5904f06e400fcd9ae8c9321b86cf586305145f967aa45c75d5ce: Status 404 returned error can't find the container with id 029e1ae349bf5904f06e400fcd9ae8c9321b86cf586305145f967aa45c75d5ce May 28 17:51:18.355717 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:18.355700 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:51:18.356013 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:18.355988 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bhdkc/must-gather-dfmdr"] May 28 17:51:19.292787 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:19.292688 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bhdkc/must-gather-dfmdr" event={"ID":"08c3f08e-30ed-46f2-bc64-165c978e1502","Type":"ContainerStarted","Data":"257b4ca03a1dab737a0b7fd0dbffe9a22bca0bfb634aa3465b03213475900dac"} May 28 17:51:19.292787 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:19.292739 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bhdkc/must-gather-dfmdr" event={"ID":"08c3f08e-30ed-46f2-bc64-165c978e1502","Type":"ContainerStarted","Data":"66f670866fddba2b899ba2fadcaf02ed8dc1e3931c64cbbf617590b29adf8c80"} May 28 17:51:19.292787 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:19.292754 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bhdkc/must-gather-dfmdr" event={"ID":"08c3f08e-30ed-46f2-bc64-165c978e1502","Type":"ContainerStarted","Data":"029e1ae349bf5904f06e400fcd9ae8c9321b86cf586305145f967aa45c75d5ce"} May 28 17:51:20.549751 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:20.549722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k2prg_87ee72a8-f2b8-4a38-8618-f8d6f6898a28/global-pull-secret-syncer/0.log" May 28 17:51:20.721958 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:20.721926 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tcv7p_2bb609db-c2dd-413c-aae2-c6c2b1fae027/konnectivity-agent/0.log" May 28 17:51:20.800508 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:20.800371 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-59.ec2.internal_865c2e3735c54eea4d9ac88d1c24d330/haproxy/0.log" May 28 17:51:24.774775 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.774745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl_c315ecee-a586-40d4-997c-a65e31bb2260/extract/0.log" May 28 17:51:24.809213 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.809163 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl_c315ecee-a586-40d4-997c-a65e31bb2260/util/0.log" May 28 17:51:24.844681 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.844628 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599c4jl_c315ecee-a586-40d4-997c-a65e31bb2260/pull/0.log" May 28 17:51:24.886253 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.886168 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6_35c9df4b-5138-4846-84a2-ccced63776a2/extract/0.log" May 28 17:51:24.913861 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.913830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6_35c9df4b-5138-4846-84a2-ccced63776a2/util/0.log" May 28 17:51:24.941926 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.941848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxpr6_35c9df4b-5138-4846-84a2-ccced63776a2/pull/0.log" May 28 17:51:24.968986 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.968920 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq_77c89060-b4de-457c-a816-770af9e10c40/extract/0.log" May 28 17:51:24.998103 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:24.998007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq_77c89060-b4de-457c-a816-770af9e10c40/util/0.log" May 28 17:51:25.033525 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.033431 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2tmq_77c89060-b4de-457c-a816-770af9e10c40/pull/0.log" May 28 17:51:25.066324 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.066290 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5_be722477-e156-4626-abcf-2603a552b9d5/extract/0.log" May 28 17:51:25.094707 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.094674 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5_be722477-e156-4626-abcf-2603a552b9d5/util/0.log" May 28 17:51:25.135227 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.135196 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn9n5_be722477-e156-4626-abcf-2603a552b9d5/pull/0.log" May 28 17:51:25.419482 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.419375 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-mmllj_cea7d5c4-a2ba-4494-abe3-fee104e24f51/kuadrant-console-plugin/0.log" May 28 17:51:25.480370 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.480341 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dq2hg_9422bc41-88a1-43f4-8f9d-403ea0f9c64d/registry-server/0.log" May 28 17:51:25.555075 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.555046 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6pck4_681b2de6-5bfe-4460-8731-eab6e073cf80/manager/0.log" May 28 17:51:25.579036 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:25.579007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-q7bpn_b5081778-986a-44fc-bad9-9959ef93bef0/limitador/0.log" May 28 17:51:27.221830 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.221750 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pqhg5_c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9/kube-state-metrics/0.log" May 28 17:51:27.242997 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.242969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pqhg5_c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9/kube-rbac-proxy-main/0.log" May 28 17:51:27.268839 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.268803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pqhg5_c6b3e42d-da48-41a4-8ac5-a5425bcbd8f9/kube-rbac-proxy-self/0.log" May 28 17:51:27.399889 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.399861 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vmw4_5ee06866-a35b-4f01-ac3e-4340adc202f0/node-exporter/0.log" May 28 17:51:27.448007 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.447981 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vmw4_5ee06866-a35b-4f01-ac3e-4340adc202f0/kube-rbac-proxy/0.log" May 28 17:51:27.473132 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.473043 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vmw4_5ee06866-a35b-4f01-ac3e-4340adc202f0/init-textfile/0.log" May 28 17:51:27.675272 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.675239 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8db98_da1e854b-0ab8-4711-af22-a836b7033493/kube-rbac-proxy-main/0.log" May 28 17:51:27.707812 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.707771 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8db98_da1e854b-0ab8-4711-af22-a836b7033493/kube-rbac-proxy-self/0.log" May 28 17:51:27.731678 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:27.731559 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8db98_da1e854b-0ab8-4711-af22-a836b7033493/openshift-state-metrics/0.log" May 28 17:51:28.027901 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:28.027875 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb54c69c5-7cp8s_7de4920e-5dee-4768-9ef1-c02e4bc0c20f/telemeter-client/0.log" May 28 17:51:28.060425 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:28.060388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb54c69c5-7cp8s_7de4920e-5dee-4768-9ef1-c02e4bc0c20f/reload/0.log" May 28 17:51:28.086308 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:28.086281 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb54c69c5-7cp8s_7de4920e-5dee-4768-9ef1-c02e4bc0c20f/kube-rbac-proxy/0.log" May 28 17:51:29.128308 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.128220 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bhdkc/must-gather-dfmdr" podStartSLOduration=11.589475019 podStartE2EDuration="12.128199772s" podCreationTimestamp="2026-05-28 17:51:17 +0000 UTC" firstStartedPulling="2026-05-28 17:51:18.355820969 +0000 UTC m=+2001.269713776" lastFinishedPulling="2026-05-28 17:51:18.894545722 +0000 UTC m=+2001.808438529" observedRunningTime="2026-05-28 17:51:19.31363049 +0000 UTC m=+2002.227523320" watchObservedRunningTime="2026-05-28 17:51:29.128199772 +0000 UTC m=+2012.042092614" May 28 17:51:29.129525 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.129498 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv"] May 28 17:51:29.134811 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.134786 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.138999 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.138976 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv"] May 28 17:51:29.303684 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.303647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-lib-modules\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.303960 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.303940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-proc\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.304154 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.304140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-sys\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.304290 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.304271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-podres\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.304418 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.304403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x75vd\" (UniqueName: \"kubernetes.io/projected/498db428-41c4-436b-82a4-e33b5dc791d8-kube-api-access-x75vd\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406016 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.405912 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-podres\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406016 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.405961 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x75vd\" (UniqueName: \"kubernetes.io/projected/498db428-41c4-436b-82a4-e33b5dc791d8-kube-api-access-x75vd\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.406093 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-lib-modules\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.406106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-podres\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.406163 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-proc\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.406205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-lib-modules\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406263 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.406248 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-proc\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406548 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.406274 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-sys\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.406548 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.406349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/498db428-41c4-436b-82a4-e33b5dc791d8-sys\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.415976 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.415949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x75vd\" (UniqueName: \"kubernetes.io/projected/498db428-41c4-436b-82a4-e33b5dc791d8-kube-api-access-x75vd\") pod \"perf-node-gather-daemonset-h4rrv\" (UID: \"498db428-41c4-436b-82a4-e33b5dc791d8\") " pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.449892 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.449866 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:29.613869 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:29.613823 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv"] May 28 17:51:30.370986 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:30.370943 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" event={"ID":"498db428-41c4-436b-82a4-e33b5dc791d8","Type":"ContainerStarted","Data":"3470ac0c085e96dae9170a95410eb7eaaf5ed9f2b4369084db758b58d5d52a07"} May 28 17:51:30.370986 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:30.370992 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" event={"ID":"498db428-41c4-436b-82a4-e33b5dc791d8","Type":"ContainerStarted","Data":"137f1635fcf264457c74450a7d71813cb1150e2b2d5481daf92d4554ac752f37"} May 28 17:51:30.371816 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:30.371791 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:30.389501 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:30.389419 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" podStartSLOduration=1.389398427 podStartE2EDuration="1.389398427s" podCreationTimestamp="2026-05-28 17:51:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:51:30.387974061 +0000 UTC m=+2013.301866891" watchObservedRunningTime="2026-05-28 17:51:30.389398427 +0000 UTC m=+2013.303291257" May 28 17:51:30.410359 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:30.410335 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86476d8f8d-4txwx_5f349896-efc5-41dc-996b-558182315f3b/console/0.log" May 28 17:51:32.181738 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:32.181695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xmcq_eed58bbd-c24e-46b9-a979-37acb52be93a/dns/0.log" May 28 17:51:32.215996 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:32.215964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xmcq_eed58bbd-c24e-46b9-a979-37acb52be93a/kube-rbac-proxy/0.log" May 28 17:51:32.449391 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:32.449321 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stbzw_4b4c20a1-5e3d-45bd-b93f-8bf72ef52a58/dns-node-resolver/0.log" May 28 17:51:33.010164 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:33.010136 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d7548c674-smbgk_c3f92e06-10a1-4413-88b3-916a96f7ed3a/registry/0.log" May 28 17:51:33.038624 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:33.038601 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5x8jt_dc3e38ef-5c1d-41b1-bde6-df40dc097d5a/node-ca/0.log" May 28 17:51:33.939450 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:33.939423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bkxld4_41a113ee-5bd0-4908-8c88-c44458edd4aa/istio-proxy/0.log" May 28 17:51:34.172261 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:34.172224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-kb7j9_6f7218df-deb4-48f1-8a83-33bc72a4b836/istio-proxy/0.log" May 28 17:51:34.758942 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:34.758911 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4r267_24372b91-a4cb-41d7-b327-c05797292962/serve-healthcheck-canary/0.log" May 28 17:51:35.285492 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:35.285445 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4279m_e451b982-f085-4e36-8572-fbdca5cce77a/kube-rbac-proxy/0.log" May 28 17:51:35.307570 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:35.307546 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4279m_e451b982-f085-4e36-8572-fbdca5cce77a/exporter/0.log" May 28 17:51:35.330649 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:35.330617 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4279m_e451b982-f085-4e36-8572-fbdca5cce77a/extractor/0.log" May 28 17:51:37.344225 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:37.344201 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666490-dnqt8_10ada545-3015-4c88-b8a6-74c4238e96d4/cleanup/0.log" May 28 17:51:37.370906 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:37.370872 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666505-gz5s4_2ac8ae17-8a51-40f2-b564-1e136e6008a1/cleanup/0.log" May 28 17:51:37.388947 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:37.388925 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bhdkc/perf-node-gather-daemonset-h4rrv" May 28 17:51:37.466744 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:37.466704 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-5xv9h_c715a88c-9fb4-45fa-b923-5ee8dcc5c132/manager/1.log" May 28 17:51:37.489406 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:37.489376 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-5xv9h_c715a88c-9fb4-45fa-b923-5ee8dcc5c132/manager/2.log" May 28 17:51:37.585135 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:37.585106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bbd9c6cf-7wbn6_83eeb1f3-bd93-49c4-8633-eed90304321c/manager/0.log" May 28 17:51:38.758236 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:38.758210 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-588b6f69fd-c5lvb_07f5dffc-9d26-4c40-81b1-932c95c500cb/manager/0.log" May 28 17:51:45.384071 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.384039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk7tl_a4f8262f-8675-4bff-8ef1-d55b8b36e8c2/kube-multus-additional-cni-plugins/0.log" May 28 17:51:45.420591 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.420553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk7tl_a4f8262f-8675-4bff-8ef1-d55b8b36e8c2/egress-router-binary-copy/0.log" May 28 17:51:45.478018 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.477990 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk7tl_a4f8262f-8675-4bff-8ef1-d55b8b36e8c2/cni-plugins/0.log" May 28 17:51:45.518613 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.518577 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk7tl_a4f8262f-8675-4bff-8ef1-d55b8b36e8c2/bond-cni-plugin/0.log" May 28 17:51:45.564927 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.564889 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk7tl_a4f8262f-8675-4bff-8ef1-d55b8b36e8c2/routeoverride-cni/0.log" May 28 17:51:45.637598 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.637519 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk7tl_a4f8262f-8675-4bff-8ef1-d55b8b36e8c2/whereabouts-cni-bincopy/0.log" May 28 17:51:45.682718 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.682697 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk7tl_a4f8262f-8675-4bff-8ef1-d55b8b36e8c2/whereabouts-cni/0.log" May 28 17:51:45.734637 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.734610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vvgs4_a1bd670c-b6b7-4905-95d7-a54b9fd20e8a/kube-multus/0.log" May 28 17:51:45.893726 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.893639 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hwp99_7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a/network-metrics-daemon/0.log" May 28 17:51:45.957061 ip-10-0-141-59 kubenswrapper[2577]: I0528 17:51:45.957026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hwp99_7bbb10d2-af0b-43c4-a96a-a0fe18b6a16a/kube-rbac-proxy/0.log"