May 20 21:26:30.986280 ip-10-0-141-6 systemd[1]: Starting Kubernetes Kubelet...
May 20 21:26:31.431825 ip-10-0-141-6 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 21:26:31.431825 ip-10-0-141-6 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 21:26:31.431825 ip-10-0-141-6 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 21:26:31.431825 ip-10-0-141-6 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 21:26:31.431825 ip-10-0-141-6 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 21:26:31.434779 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.434690    2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 21:26:31.443364 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443343    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:26:31.443364 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443361    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:26:31.443364 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443366    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443370    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443374    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443377    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443380    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443383    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443385    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443388    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443390    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443393    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443395    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443398    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443401    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443404    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443407    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443409    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443412    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443415    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443418    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443421    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:26:31.443459 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443423    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443426    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443428    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443431    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443433    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443436    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443438    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443441    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443444    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443446    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443450    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443452    2560 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443455    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443458    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443461    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443464    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443467    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443470    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443473    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443475    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:26:31.443939 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443478    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443481    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443483    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443486    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443489    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443491    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443494    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443496    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443499    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443501    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443504    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443508    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443512    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443515    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443518    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443520    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443522    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443525    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443528    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:26:31.444432 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443530    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443533    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443535    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443538    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443540    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443549    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443551    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443554    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443557    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443560    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443564    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443566    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443569    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443572    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443574    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443577    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443579    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443582    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443584    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443587    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:26:31.444885 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443589    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:26:31.445383 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443592    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:26:31.445383 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443598    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:26:31.445383 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443600    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:26:31.445383 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.443603    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:26:31.446360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446349    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:26:31.446360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446359    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446362    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446365    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446369    2560 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446372    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446375    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446378    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446381    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446384    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446387    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446389    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446398    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446401    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446404    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446409    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446412    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446415    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446418    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446421    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446424    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:26:31.446420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446428    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446431    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446434    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446437    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446440    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446442    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446445    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446448    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446450    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446453    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446456    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446458    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446461    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446463    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446465    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446468    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446471    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446473    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446476    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446478    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:26:31.446927 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446481    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446483    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446486    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446488    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446496    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446499    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446501    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446504    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446506    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446510    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446512    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446515    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446517    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446520    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446524    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446527    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446529    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446532    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446534    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:26:31.447470 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446537    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446539    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446542    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446545    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446547    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446550    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446552    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446555    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446557    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446559    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446562    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446564    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446567    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446571    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446574    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446576    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446579    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446581    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446589    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446593    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:26:31.447932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446595    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446598    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446600    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446603    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446606    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.446608    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446679    2560 flags.go:64] FLAG: --address="0.0.0.0"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446691    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446702    2560 flags.go:64] FLAG: --anonymous-auth="true"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446707    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446712    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446715    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446720    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446724    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446728    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446731    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446734    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446738    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446741    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446744    2560 flags.go:64] FLAG: --cgroup-root=""
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446747    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446750    2560 flags.go:64] FLAG: --client-ca-file=""
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446753    2560 flags.go:64] FLAG: --cloud-config=""
May 20 21:26:31.448434 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446756    2560 flags.go:64] FLAG: --cloud-provider="external"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446759    2560 flags.go:64] FLAG: --cluster-dns="[]"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446766    2560 flags.go:64] FLAG: --cluster-domain=""
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446769    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446772    2560 flags.go:64] FLAG: --config-dir=""
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446775    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446779    2560 flags.go:64] FLAG: --container-log-max-files="5"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446783    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446793    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446797    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446801    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446804    2560 flags.go:64] FLAG: --contention-profiling="false"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446807    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446810    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446814    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446817    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446821    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446824    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446827    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446830    2560 flags.go:64] FLAG: --enable-load-reader="false"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446833    2560 flags.go:64] FLAG: --enable-server="true"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446836    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446842    2560 flags.go:64] FLAG: --event-burst="100"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446845    2560 flags.go:64] FLAG: --event-qps="50"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446848    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 21:26:31.449004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446851    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446854    2560 flags.go:64] FLAG: --eviction-hard=""
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446858    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446861    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446864    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446867    2560 flags.go:64] FLAG: --eviction-soft=""
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446870    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446873    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446876    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446879    2560 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446882    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446884    2560 flags.go:64] FLAG: --fail-swap-on="true"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446887    2560 flags.go:64] FLAG: --feature-gates=""
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446891    2560 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446894    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446898    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446906    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446910    2560 flags.go:64] FLAG: --healthz-port="10248"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446913    2560 flags.go:64] FLAG: --help="false"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446916    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-141-6.ec2.internal"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446920    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446923    2560 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446926    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446930    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 21:26:31.449618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446934    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446937    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446940    2560 flags.go:64] FLAG: --image-service-endpoint=""
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446943    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446945    2560 flags.go:64] FLAG: --kube-api-burst="100"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446948    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446951    2560 flags.go:64] FLAG: --kube-api-qps="50"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446954    2560 flags.go:64] FLAG: --kube-reserved=""
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446957    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446960    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446963    2560 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446966    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446969    2560 flags.go:64] FLAG: --lock-file=""
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446971    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446974    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446977    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446995    2560 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.446998    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447001    2560 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447004    2560 flags.go:64] FLAG: --logging-format="text"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447007    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447010    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447013    2560 flags.go:64] FLAG: --manifest-url=""
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447018    2560 flags.go:64] FLAG: --manifest-url-header=""
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447023    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 21:26:31.450304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447032    2560 flags.go:64] FLAG: --max-open-files="1000000"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447036    2560 flags.go:64] FLAG: --max-pods="110"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447039    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447042    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447046    2560 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447049    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447052    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447055    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447058    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447072    2560 flags.go:64] FLAG: --node-status-max-images="50"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447075    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447078    2560 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447087    2560 flags.go:64] FLAG: --pod-cidr=""
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447090    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447096    2560 flags.go:64] FLAG: --pod-manifest-path=""
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447099    2560 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447102    2560 flags.go:64] FLAG: --pods-per-core="0"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447104    2560 flags.go:64] FLAG: --port="10250"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447107    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447110    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cf2cb00ba7c0cde0"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447114    2560 flags.go:64] FLAG: --qos-reserved=""
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447117    2560 flags.go:64] FLAG: --read-only-port="10255"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447120    2560 flags.go:64] FLAG: --register-node="true"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447122    2560 flags.go:64] FLAG: --register-schedulable="true"
May 20 21:26:31.450901 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447125    2560 flags.go:64] FLAG: --register-with-taints=""
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447134    2560 flags.go:64] FLAG: --registry-burst="10"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447137    2560 flags.go:64] FLAG: --registry-qps="5"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447140    2560 flags.go:64] FLAG: --reserved-cpus=""
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447143    2560 flags.go:64] FLAG: --reserved-memory=""
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447147    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447162    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447166    2560 flags.go:64] FLAG: --rotate-certificates="false"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447169    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447177    2560 flags.go:64] FLAG: --runonce="false"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447180    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447183    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447187    2560 flags.go:64] FLAG: --seccomp-default="false"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447190    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447193    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447196    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447199    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447202    2560 flags.go:64] FLAG: --storage-driver-password="root"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447205    2560 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447208    2560 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447211    2560 flags.go:64] FLAG: --storage-driver-user="root"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447214    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447217    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447220    2560 flags.go:64] FLAG: --system-cgroups=""
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447223    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 21:26:31.451480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447228    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447231    2560 flags.go:64] FLAG: --tls-cert-file=""
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447234    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447241    2560 flags.go:64] FLAG: --tls-min-version=""
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447244    2560 flags.go:64] FLAG: --tls-private-key-file=""
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447247    2560 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447249    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447252    2560 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447255    2560 flags.go:64] FLAG: --v="2"
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447259    2560 flags.go:64] FLAG: --version="false"
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447264    2560 flags.go:64] FLAG: --vmodule=""
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447268    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.447271    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447396    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447401    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447404    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447407    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447431    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447436    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447439    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447444    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447447    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:26:31.452125 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447449    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447452    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447454    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447457    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447460    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447462    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447465    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447468    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447470    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447473    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447475    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447478    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447481    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447483    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447486    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447489    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447491    2560 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447494    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447497    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447499    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:26:31.452660 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447502    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447504    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447507    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447510    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447512    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447515    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447517    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447520    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447529    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447532    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447536    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447539    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447541    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447544    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447546    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447549    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447552    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447554    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447557    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447560    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:26:31.453294 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447562    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447565    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447567    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447570    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447572    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447575    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447577    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447580    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447582    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447585    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447588    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447592    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447595    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447598    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447601    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447604    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447606    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447609    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447612    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:26:31.453818 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447615    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447617    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447622    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447626    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447628    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447631    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447634    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447636    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447639    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447642    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447644    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447647    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447649    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447652    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447655    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447657    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447660    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:26:31.454360 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.447662    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:26:31.454756 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.448474    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 21:26:31.457801 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.457688    2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 21:26:31.457801 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.457802    2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 21:26:31.457877 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457857    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:26:31.457877 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457862    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:26:31.457877 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457865    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:26:31.457877 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457868    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:26:31.457877 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457871    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:26:31.457877 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457876    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:26:31.457877 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457881    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457884    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457887    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457890    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457893    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457896    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457899    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457901    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457903    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457906    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457909    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457912    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457914    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457917    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457919    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457922    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457924    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457927    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457929    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457932    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:26:31.458068 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457934    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457937    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457939    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457942    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457944    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457948    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457950    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457953    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457955    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457957    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457960    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457963    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457965    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457968    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457971    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457974    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457976    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457990    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457993    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457996    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:26:31.458598 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.457998    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458001    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458004    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458006    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458009    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458011    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458014    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458017    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458019    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458022    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458024    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458027    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458029    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458032    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458035    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458038    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458041    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458044    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458047    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458050    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:26:31.459226 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458052    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458055    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458057    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458060    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458063    2560 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458065    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458069    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458071    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458074    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458077    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458081    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458084    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458087    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458090    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458093    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458095    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458098    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458100    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458103    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:26:31.459724 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458105    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.458110    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458211    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458218    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458221    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458224    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458227    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458230    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458233    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458236    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458238    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458242    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458245    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458248    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458250    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458253    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:26:31.460206 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458255    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458258    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458260    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458264    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458267    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458269    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458272    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458275    2560 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458277    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458280    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458282    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458285    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458287    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458292    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458295    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458298    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458301    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458304    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458306    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:26:31.460609 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458309    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458312    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458314    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458317    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458320    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458322    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458325    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458327    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458330    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458333    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458335    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458338    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458341    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458343    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458345    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458348    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458351    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458354    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458357    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458360    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:26:31.461087 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458362    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458365    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458367    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458371    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458374    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458376    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458379    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458382    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458384    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458387    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458389    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458392    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458395    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458397    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458400    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458403    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458405    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458407    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458410    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458412    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:26:31.461577 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458415    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458417    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458420    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458423    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458425    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458428    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458431    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458433    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458436    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458439    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458441    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458444    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:31.458447    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.458451    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.459379    2560 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 21:26:31.462118 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.461456    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 21:26:31.462489 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.462458    2560 server.go:1019] "Starting client certificate rotation"
May 20 21:26:31.462579 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.462560    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 21:26:31.462615 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.462606    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 21:26:31.491562 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.491541    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 21:26:31.498588 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.498558    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 21:26:31.511795 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.511776    2560 log.go:25] "Validated CRI v1 runtime API"
May 20 21:26:31.516864 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.516849    2560 log.go:25] "Validated CRI v1 image API"
May 20 21:26:31.518935 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.518915    2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 21:26:31.524121 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.524101    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 21:26:31.525140 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.525120    2560 fs.go:135] Filesystem UUIDs: map[753f007b-44eb-4945-a885-d57052c7475f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90ffca02-195e-4d95-850a-a5ee906e817d:/dev/nvme0n1p4]
May 20 21:26:31.525206 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.525139    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 21:26:31.529432 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.529323    2560 manager.go:217] Machine: {Timestamp:2026-05-20 21:26:31.528833857 +0000 UTC m=+0.425431507 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100093 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27ca9421dd84844c0cbd4907ec9ef2 SystemUUID:ec27ca94-21dd-8484-4c0c-bd4907ec9ef2 BootID:b68d7ab7-5d35-472d-84a7-6eb3d0dbe3c9 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:57:b7:47:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:57:b7:47:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:e4:5f:f3:58:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 21:26:31.530319 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.530310    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 21:26:31.530401 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.530389    2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 21:26:31.531681 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.531660    2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 21:26:31.531819 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.531682    2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 21:26:31.531862 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.531829    2560 topology_manager.go:138] "Creating topology manager with none policy"
May 20 21:26:31.531862 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.531837    2560 container_manager_linux.go:306] "Creating device plugin manager"
May 20 21:26:31.531862 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.531848    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 21:26:31.531943 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.531862    2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 21:26:31.533555 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.533543    2560 state_mem.go:36] "Initialized new in-memory state store"
May 20 21:26:31.533669 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.533660    2560 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 21:26:31.537135 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.537126    2560 kubelet.go:491] "Attempting to sync node with API server"
May 20 21:26:31.537170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.537144    2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 21:26:31.537170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.537155    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 21:26:31.537170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.537165    2560 kubelet.go:397] "Adding apiserver pod source"
May 20 21:26:31.537301 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.537175    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 21:26:31.538427 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.538411    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 21:26:31.538427 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.538430    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 21:26:31.542035 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.542017    2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 21:26:31.544294 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.544279    2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 21:26:31.546881 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546867    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 21:26:31.546947 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546890    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 21:26:31.546947 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546917    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 21:26:31.546947 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546926    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 21:26:31.546947 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546939    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 21:26:31.546947 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546948    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 21:26:31.547136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546958    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 21:26:31.547136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546966    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 21:26:31.547136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546976    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 21:26:31.547136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.546999    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 21:26:31.547136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.547020    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 21:26:31.547136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.547029    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 21:26:31.548774 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.548752    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 21:26:31.549624 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.549608    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 21:26:31.549677 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.549632    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 21:26:31.549820 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.549796    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 21:26:31.553796 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.553779    2560 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 21:26:31.553861 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.553820    2560 server.go:1295] "Started kubelet"
May 20 21:26:31.553915 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.553869    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 21:26:31.553992 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.553935    2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 21:26:31.554030 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.554016    2560 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 21:26:31.554689 ip-10-0-141-6 systemd[1]: Started Kubernetes Kubelet.
May 20 21:26:31.555341 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.555325    2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 21:26:31.557247 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.557232    2560 server.go:317] "Adding debug handlers to kubelet server"
May 20 21:26:31.561923 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.561906    2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 21:26:31.562498 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.562481    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 21:26:31.562995 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.561921    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-6.ec2.internal.18b163316303c385  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-6.ec2.internal,UID:ip-10-0-141-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-6.ec2.internal,},FirstTimestamp:2026-05-20 21:26:31.553794949 +0000 UTC m=+0.450392594,LastTimestamp:2026-05-20 21:26:31.553794949 +0000 UTC m=+0.450392594,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-6.ec2.internal,}"
May 20 21:26:31.563208 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.563183    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 21:26:31.563531 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.563515    2560 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 21:26:31.563531 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.563530    2560 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 21:26:31.563669 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.563657    2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 21:26:31.563731 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.563722    2560 reconstruct.go:97] "Volume reconstruction finished"
May 20 21:26:31.563798 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.563733    2560 reconciler.go:26] "Reconciler: start to sync state"
May 20 21:26:31.564098 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.564080    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:31.564659 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.564637    2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 21:26:31.565064 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565050    2560 factory.go:153] Registering CRI-O factory
May 20 21:26:31.565064 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565067    2560 factory.go:223] Registration of the crio container factory successfully
May 20 21:26:31.565204 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565114    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 21:26:31.565204 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565125    2560 factory.go:55] Registering systemd factory
May 20 21:26:31.565204 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565132    2560 factory.go:223] Registration of the systemd container factory successfully
May 20 21:26:31.565204 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565148    2560 factory.go:103] Registering Raw factory
May 20 21:26:31.565204 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565160    2560 manager.go:1196] Started watching for new ooms in manager
May 20 21:26:31.565651 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.565538    2560 manager.go:319] Starting recovery of all containers
May 20 21:26:31.567288 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.567262    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j5s9g"
May 20 21:26:31.568908 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.568877    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 20 21:26:31.569009 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.568915    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 20 21:26:31.574523 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.574505    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j5s9g"
May 20 21:26:31.576213 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.576198    2560 manager.go:324] Recovery completed
May 20 21:26:31.581126 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.581111    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:26:31.583037 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.583019    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:26:31.583111 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.583056    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:26:31.583111 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.583073    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientPID"
May 20 21:26:31.583631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.583616    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 21:26:31.583631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.583628    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 21:26:31.583725 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.583644    2560 state_mem.go:36] "Initialized new in-memory state store"
May 20 21:26:31.584925 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.584864    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-6.ec2.internal.18b1633164c1fa06  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-6.ec2.internal,UID:ip-10-0-141-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-6.ec2.internal,},FirstTimestamp:2026-05-20 21:26:31.583037958 +0000 UTC m=+0.479635604,LastTimestamp:2026-05-20 21:26:31.583037958 +0000 UTC m=+0.479635604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-6.ec2.internal,}"
May 20 21:26:31.587242 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.587228    2560 policy_none.go:49] "None policy: Start"
May 20 21:26:31.587242 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.587244    2560 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 21:26:31.587336 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.587254    2560 state_mem.go:35] "Initializing new in-memory state store"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.626530    2560 manager.go:341] "Starting Device Plugin manager"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.626575    2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.626585    2560 server.go:85] "Starting device plugin registration server"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.626787    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.626798    2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.626885    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.627004    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.627015    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.627457    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 21:26:31.642043 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.627491    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:31.691939 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.691865    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 21:26:31.693048 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.693030    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 21:26:31.693141 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.693056    2560 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 21:26:31.693141 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.693073    2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 21:26:31.693141 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.693080    2560 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 21:26:31.693289 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.693171    2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 21:26:31.699494 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.699473    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:26:31.727598 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.727578    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:26:31.728437 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.728419    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:26:31.728520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.728457    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:26:31.728520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.728474    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientPID"
May 20 21:26:31.728520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.728508    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-6.ec2.internal"
May 20 21:26:31.736147 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.736131    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-6.ec2.internal"
May 20 21:26:31.736240 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.736156    2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-6.ec2.internal\": node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:31.761048 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.761028    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:31.794264 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.794240    2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"]
May 20 21:26:31.794376 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.794312    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:26:31.795892 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.795877    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:26:31.795950 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.795906    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:26:31.795950 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.795922    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientPID"
May 20 21:26:31.798184 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798170    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:26:31.798324 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798309    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.798372 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798345    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:26:31.798839 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798816    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:26:31.798941 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798852    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:26:31.798941 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798865    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientPID"
May 20 21:26:31.798941 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798818    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:26:31.798941 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798928    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:26:31.798941 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.798939    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientPID"
May 20 21:26:31.801728 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.801715    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.801797 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.801739    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:26:31.802393 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.802369    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:26:31.802479 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.802397    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:26:31.802479 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.802406    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeHasSufficientPID"
May 20 21:26:31.820487 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.820466    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-6.ec2.internal\" not found" node="ip-10-0-141-6.ec2.internal"
May 20 21:26:31.824645 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.824630    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-6.ec2.internal\" not found" node="ip-10-0-141-6.ec2.internal"
May 20 21:26:31.861682 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.861661    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:31.864908 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.864891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/13d041cd8df9263941ab1da1d846fce6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal\" (UID: \"13d041cd8df9263941ab1da1d846fce6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.865001 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.864916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d041cd8df9263941ab1da1d846fce6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal\" (UID: \"13d041cd8df9263941ab1da1d846fce6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.865001 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.864936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/422de367e208d52bacb83c72eacec5e9-config\") pod \"kube-apiserver-proxy-ip-10-0-141-6.ec2.internal\" (UID: \"422de367e208d52bacb83c72eacec5e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.962136 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:31.962067    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:31.965367 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.965348    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d041cd8df9263941ab1da1d846fce6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal\" (UID: \"13d041cd8df9263941ab1da1d846fce6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.965455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.965305    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d041cd8df9263941ab1da1d846fce6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal\" (UID: \"13d041cd8df9263941ab1da1d846fce6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.965455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.965401    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/422de367e208d52bacb83c72eacec5e9-config\") pod \"kube-apiserver-proxy-ip-10-0-141-6.ec2.internal\" (UID: \"422de367e208d52bacb83c72eacec5e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.965455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.965418    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/13d041cd8df9263941ab1da1d846fce6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal\" (UID: \"13d041cd8df9263941ab1da1d846fce6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.965455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.965455    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/13d041cd8df9263941ab1da1d846fce6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal\" (UID: \"13d041cd8df9263941ab1da1d846fce6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:31.965600 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:31.965497    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/422de367e208d52bacb83c72eacec5e9-config\") pod \"kube-apiserver-proxy-ip-10-0-141-6.ec2.internal\" (UID: \"422de367e208d52bacb83c72eacec5e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal"
May 20 21:26:32.062742 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.062697    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:32.123167 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.123124    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal"
May 20 21:26:32.127720 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.127701    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:32.163437 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.163384    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:32.263867 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.263799    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:32.364203 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.364167    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:32.462589 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.462559    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 21:26:32.463245 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.462729    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 21:26:32.464713 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.464694    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-6.ec2.internal\" not found"
May 20 21:26:32.528655 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.528568    2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:26:32.538397 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.538375    2560 apiserver.go:52] "Watching apiserver"
May 20 21:26:32.549116 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.549093    2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 21:26:32.551523 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.551503    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-5xsm5","openshift-multus/multus-additional-cni-plugins-bx647","openshift-multus/network-metrics-daemon-mkbw8","openshift-network-operator/iptables-alerter-cd6fq","openshift-cluster-node-tuning-operator/tuned-2nhvn","openshift-network-diagnostics/network-check-target-gzsq5","openshift-ovn-kubernetes/ovnkube-node-x69c5","kube-system/konnectivity-agent-l9667","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h","openshift-dns/node-resolver-cfrlt","openshift-image-registry/node-ca-bxd5f"]
May 20 21:26:32.556145 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.556127    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.556340 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.556320    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.558366 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.558347    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.558846 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.558827    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 21:26:32.559279 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559253    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 21:26:32.559378 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559280    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 21:26:32.559378 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559362    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 21:26:32.559480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559251    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bcvk7\""
May 20 21:26:32.559480 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559285    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 21:26:32.560083 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559596    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 21:26:32.560083 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559653    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7cr5v\""
May 20 21:26:32.560083 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.559886    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 21:26:32.560450 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.560431    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 21:26:32.560514 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.560468    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 21:26:32.560754 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.560733    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-88swr\""
May 20 21:26:32.561215 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.561198    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 21:26:32.562745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.562727    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 21:26:32.563413 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.563397    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"
May 20 21:26:32.563476 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.563430    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:32.563524 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.563491    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:32.563610 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.563595    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.565508 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.565489    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 21:26:32.565597 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.565505    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s7cl9\""
May 20 21:26:32.565597 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.565495    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 21:26:32.565690 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.565670    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.565849 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.565831    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 21:26:32.566043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.566029    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 21:26:32.566095 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.566050    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 21:26:32.566095 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.566079    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 21:26:32.567500 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.567483    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gfcjl\""
May 20 21:26:32.567836 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.567822    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 21:26:32.567964 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.567946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovn-node-metrics-cert\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.567964 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.567962    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.568127 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.567977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/447195d9-44e1-46c0-b2a3-c578ac208d8c-agent-certs\") pod \"konnectivity-agent-l9667\" (UID: \"447195d9-44e1-46c0-b2a3-c578ac208d8c\") " pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.568127 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-cnibin\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.568127 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysctl-conf\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568127 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-system-cni-dir\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.568127 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-lib-modules\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568127 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-run-netns\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qtv\" (UniqueName: \"kubernetes.io/projected/962d02e9-d578-437f-b258-9f0625dab236-kube-api-access-k6qtv\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-var-lib-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-systemd\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-host\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568315    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-systemd\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-cni-netd\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-os-release\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysctl-d\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-var-lib-kubelet\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrh4\" (UniqueName: \"kubernetes.io/projected/6c9c8f61-6aab-4f53-b05b-70458d165f0e-kube-api-access-hkrh4\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-systemd-units\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/447195d9-44e1-46c0-b2a3-c578ac208d8c-konnectivity-ca\") pod \"konnectivity-agent-l9667\" (UID: \"447195d9-44e1-46c0-b2a3-c578ac208d8c\") " pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-kubernetes\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-kubelet\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-slash\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-log-socket\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-run-ovn-kubernetes\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovnkube-config\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.568733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-modprobe-d\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-run\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-env-overrides\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovnkube-script-lib\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4gl\" (UniqueName: \"kubernetes.io/projected/b95fa26a-7729-473d-9cd4-04cb53848ad1-kube-api-access-rk4gl\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-cni-binary-copy\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-etc-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-iptables-alerter-script\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-host-slash\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-sys\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-tuned\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.568976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-cni-bin\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.569016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.569032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r7rx\" (UniqueName: \"kubernetes.io/projected/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-kube-api-access-9r7rx\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.569214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.569046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysconfig\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.569646 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.569064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c9c8f61-6aab-4f53-b05b-70458d165f0e-tmp\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.569646 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.569085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-ovn\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569646 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.569106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-node-log\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.569867 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.569854    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b6lvs\""
May 20 21:26:32.570124 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.570112    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 21:26:32.570439 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.570428    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:32.570498 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.570484    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:32.572260 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.572243    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 21:26:32.572564 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.572550    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.574632 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.574616    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 21:26:32.574741 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.574722    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 21:26:32.574803 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.574757    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kqcmm\""
May 20 21:26:32.574803 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.574774    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 21:26:32.574946 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.574868    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.576713 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.576678    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 21:21:31 +0000 UTC" deadline="2028-02-04 13:43:54.694206276 +0000 UTC"
May 20 21:26:32.576792 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.576712    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14992h17m22.117497393s"
May 20 21:26:32.576792 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.576718    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 21:26:32.576792 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.576755    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 21:26:32.576792 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.576696    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xwf7g\""
May 20 21:26:32.576973 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.576960    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.577331 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.577312    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal"]
May 20 21:26:32.577929 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.577916    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 21:26:32.578009 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.578002    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal"
May 20 21:26:32.580090 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.580074    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 21:26:32.580170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.580091    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 21:26:32.580284 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.580270    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 21:26:32.580392 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.580379    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:26:32.580452 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.580435    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cvbvh\""
May 20 21:26:32.584495 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.584461    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal"]
May 20 21:26:32.584598 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.584583    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 21:26:32.600677 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.600652    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8q48v"
May 20 21:26:32.608754 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.608736    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8q48v"
May 20 21:26:32.630096 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.630074    2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:26:32.665705 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.665491    2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 21:26:32.669452 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-cni-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.669588 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669465    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9r7rx\" (UniqueName: \"kubernetes.io/projected/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-kube-api-access-9r7rx\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.669588 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669485    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c9c8f61-6aab-4f53-b05b-70458d165f0e-tmp\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.669588 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669509    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-ovn\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.669588 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669533    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-node-log\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.669800 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669630    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-node-log\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.669800 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669639    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-ovn\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.669906 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.669838    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 21:26:32.670084 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ace839a-4af0-41ea-88c0-1d31c514c7be-cni-binary-copy\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.670148 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-registration-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.670148 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670115    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-lib-modules\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.670148 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670133    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-run-netns\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670289 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670157    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.670289 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670191    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-systemd\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.670289 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670199    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-run-netns\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670289 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670258    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-systemd\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.670289 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670275    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-lib-modules\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670317    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-socket-dir-parent\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-cni-multus\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670412    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysctl-d\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670447    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrh4\" (UniqueName: \"kubernetes.io/projected/6c9c8f61-6aab-4f53-b05b-70458d165f0e-kube-api-access-hkrh4\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670473    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-systemd-units\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670505    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/447195d9-44e1-46c0-b2a3-c578ac208d8c-konnectivity-ca\") pod \"konnectivity-agent-l9667\" (UID: \"447195d9-44e1-46c0-b2a3-c578ac208d8c\") " pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-os-release\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670543    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670593    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-kubelet\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670597    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-systemd-units\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670604    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysctl-d\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670549    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-kubelet\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670640    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-slash\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670664    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670687    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovnkube-config\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670709    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovnkube-script-lib\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670734    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670737    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76q8\" (UniqueName: \"kubernetes.io/projected/0ace839a-4af0-41ea-88c0-1d31c514c7be-kube-api-access-j76q8\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-device-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.670883 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-sys-fs\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b5f4076-063c-483b-8d10-fa73b3a40cc7-tmp-dir\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn9pj\" (UniqueName: \"kubernetes.io/projected/1b5f4076-063c-483b-8d10-fa73b3a40cc7-kube-api-access-vn9pj\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60fc5dde-26ac-4bf7-b15c-3715e6012387-host\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.670965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgz6p\" (UniqueName: \"kubernetes.io/projected/60fc5dde-26ac-4bf7-b15c-3715e6012387-kube-api-access-kgz6p\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671037    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-tuned\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671060    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-cni-bin\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671089    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-daemon-config\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60fc5dde-26ac-4bf7-b15c-3715e6012387-serviceca\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671187    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysconfig\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671210    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovn-node-metrics-cert\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671222    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-slash\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671234    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/447195d9-44e1-46c0-b2a3-c578ac208d8c-agent-certs\") pod \"konnectivity-agent-l9667\" (UID: \"447195d9-44e1-46c0-b2a3-c578ac208d8c\") " pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671273    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671309    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-cnibin\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671307    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovnkube-config\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.671896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-cnibin\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671362    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-cnibin\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-socket-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671478    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-cni-bin\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671489    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysctl-conf\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671520    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-system-cni-dir\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671548    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qtv\" (UniqueName: \"kubernetes.io/projected/962d02e9-d578-437f-b258-9f0625dab236-kube-api-access-k6qtv\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-netns\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxckq\" (UniqueName: \"kubernetes.io/projected/111d8b7e-7500-480c-99d1-05d2a3b2397f-kube-api-access-lxckq\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671652    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-var-lib-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671677    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-host\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671687    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/447195d9-44e1-46c0-b2a3-c578ac208d8c-konnectivity-ca\") pod \"konnectivity-agent-l9667\" (UID: \"447195d9-44e1-46c0-b2a3-c578ac208d8c\") " pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671701    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-systemd\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671727    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-cni-netd\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671751    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-os-release\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671767    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysconfig\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-k8s-cni-cncf-io\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.672685 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671820    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671851    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovnkube-script-lib\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-265ff\" (UniqueName: \"kubernetes.io/projected/8cf199af-5799-401f-8b45-bf8fdab58f06-kube-api-access-265ff\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671902    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.671939    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-os-release\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.672018    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/962d02e9-d578-437f-b258-9f0625dab236-system-cni-dir\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.672056    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-sysctl-conf\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.672159    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-run-systemd\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.672200    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-var-lib-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.672239    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-host\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.672407    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-cni-netd\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.672627    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c9c8f61-6aab-4f53-b05b-70458d165f0e-tmp\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673003    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-var-lib-kubelet\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-kubelet\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-conf-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-multus-certs\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673119    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-kubernetes\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.673461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673145    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-log-socket\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673168    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-run-ovn-kubernetes\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673191    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-env-overrides\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673216    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4gl\" (UniqueName: \"kubernetes.io/projected/b95fa26a-7729-473d-9cd4-04cb53848ad1-kube-api-access-rk4gl\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-cni-bin\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b5f4076-063c-483b-8d10-fa73b3a40cc7-hosts-file\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-system-cni-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673317    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-modprobe-d\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673341    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-run\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673365    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-cni-binary-copy\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-hostroot\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-etc-kubernetes\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673437    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-etc-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673491    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-etc-openvswitch\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673618    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-modprobe-d\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673686    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-run\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673772    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-kubernetes\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674225 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673818    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-log-socket\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.673862    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95fa26a-7729-473d-9cd4-04cb53848ad1-host-run-ovn-kubernetes\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674135    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/962d02e9-d578-437f-b258-9f0625dab236-cni-binary-copy\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674193    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-var-lib-kubelet\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674243    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-iptables-alerter-script\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674259    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b95fa26a-7729-473d-9cd4-04cb53848ad1-env-overrides\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674271    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-host-slash\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674292    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-sys\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674315    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674514    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b95fa26a-7729-473d-9cd4-04cb53848ad1-ovn-node-metrics-cert\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674559    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-host-slash\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674562    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/447195d9-44e1-46c0-b2a3-c578ac208d8c-agent-certs\") pod \"konnectivity-agent-l9667\" (UID: \"447195d9-44e1-46c0-b2a3-c578ac208d8c\") " pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674596    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c9c8f61-6aab-4f53-b05b-70458d165f0e-sys\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674687    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-iptables-alerter-script\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.674951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.674856    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c9c8f61-6aab-4f53-b05b-70458d165f0e-etc-tuned\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.680444 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.677998    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r7rx\" (UniqueName: \"kubernetes.io/projected/3c2d6f7c-8a36-4d42-bbb4-2571e563ea31-kube-api-access-9r7rx\") pod \"iptables-alerter-cd6fq\" (UID: \"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31\") " pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.681439 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.681246    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:26:32.681439 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.681269    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:26:32.681439 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.681282    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2sch for pod openshift-network-diagnostics/network-check-target-gzsq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:32.681439 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.681385    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qtv\" (UniqueName: \"kubernetes.io/projected/962d02e9-d578-437f-b258-9f0625dab236-kube-api-access-k6qtv\") pod \"multus-additional-cni-plugins-bx647\" (UID: \"962d02e9-d578-437f-b258-9f0625dab236\") " pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.681439 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.681396    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch podName:ef393f8b-c48e-463e-9b8b-f1fb6514b8c5 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:33.181335764 +0000 UTC m=+2.077933399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g2sch" (UniqueName: "kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch") pod "network-check-target-gzsq5" (UID: "ef393f8b-c48e-463e-9b8b-f1fb6514b8c5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:32.681757 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.681436    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrh4\" (UniqueName: \"kubernetes.io/projected/6c9c8f61-6aab-4f53-b05b-70458d165f0e-kube-api-access-hkrh4\") pod \"tuned-2nhvn\" (UID: \"6c9c8f61-6aab-4f53-b05b-70458d165f0e\") " pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.683334 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.683316    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4gl\" (UniqueName: \"kubernetes.io/projected/b95fa26a-7729-473d-9cd4-04cb53848ad1-kube-api-access-rk4gl\") pod \"ovnkube-node-x69c5\" (UID: \"b95fa26a-7729-473d-9cd4-04cb53848ad1\") " pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.774968 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.774943    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-hostroot\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.774968 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.774970    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-etc-kubernetes\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775022    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-etc-kubernetes\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775034    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-cni-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775053    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-hostroot\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775060    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ace839a-4af0-41ea-88c0-1d31c514c7be-cni-binary-copy\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775082    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-registration-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775100    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-socket-dir-parent\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775115    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-cni-multus\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775114    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-cni-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775130    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775182    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775190    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-registration-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775182    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-os-release\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775200    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-cni-multus\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775226    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775233    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-socket-dir-parent\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775240    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-os-release\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775262    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775301    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.775313    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775333    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j76q8\" (UniqueName: \"kubernetes.io/projected/0ace839a-4af0-41ea-88c0-1d31c514c7be-kube-api-access-j76q8\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775358    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-device-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:32.775365    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:26:33.275351454 +0000 UTC m=+2.171949098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775390    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-sys-fs\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775397    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-device-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775410    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b5f4076-063c-483b-8d10-fa73b3a40cc7-tmp-dir\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.775431 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775435    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vn9pj\" (UniqueName: \"kubernetes.io/projected/1b5f4076-063c-483b-8d10-fa73b3a40cc7-kube-api-access-vn9pj\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775458    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60fc5dde-26ac-4bf7-b15c-3715e6012387-host\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775468    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-sys-fs\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775484    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz6p\" (UniqueName: \"kubernetes.io/projected/60fc5dde-26ac-4bf7-b15c-3715e6012387-kube-api-access-kgz6p\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775513    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-daemon-config\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775517    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60fc5dde-26ac-4bf7-b15c-3715e6012387-host\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775537    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60fc5dde-26ac-4bf7-b15c-3715e6012387-serviceca\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775562    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-cnibin\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775561    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ace839a-4af0-41ea-88c0-1d31c514c7be-cni-binary-copy\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775601    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-socket-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775633    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-netns\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775659    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxckq\" (UniqueName: \"kubernetes.io/projected/111d8b7e-7500-480c-99d1-05d2a3b2397f-kube-api-access-lxckq\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775689    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-k8s-cni-cncf-io\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775713    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-265ff\" (UniqueName: \"kubernetes.io/projected/8cf199af-5799-401f-8b45-bf8fdab58f06-kube-api-access-265ff\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775753    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-cnibin\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775763    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-kubelet\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775793    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-conf-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775798    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b5f4076-063c-483b-8d10-fa73b3a40cc7-tmp-dir\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.776161 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775833    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-multus-certs\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775864    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-cni-bin\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775887    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b5f4076-063c-483b-8d10-fa73b3a40cc7-hosts-file\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775887    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cf199af-5799-401f-8b45-bf8fdab58f06-socket-dir\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775911    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-system-cni-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775944    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-netns\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.775945    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-k8s-cni-cncf-io\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776001    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-run-multus-certs\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776001    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-system-cni-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776011    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60fc5dde-26ac-4bf7-b15c-3715e6012387-serviceca\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776014    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-cni-bin\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776006    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-daemon-config\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776037    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b5f4076-063c-483b-8d10-fa73b3a40cc7-hosts-file\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776065    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-multus-conf-dir\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.776639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.776061    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ace839a-4af0-41ea-88c0-1d31c514c7be-host-var-lib-kubelet\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.785767 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.785739    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgz6p\" (UniqueName: \"kubernetes.io/projected/60fc5dde-26ac-4bf7-b15c-3715e6012387-kube-api-access-kgz6p\") pod \"node-ca-bxd5f\" (UID: \"60fc5dde-26ac-4bf7-b15c-3715e6012387\") " pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:32.785881 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.785784    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn9pj\" (UniqueName: \"kubernetes.io/projected/1b5f4076-063c-483b-8d10-fa73b3a40cc7-kube-api-access-vn9pj\") pod \"node-resolver-cfrlt\" (UID: \"1b5f4076-063c-483b-8d10-fa73b3a40cc7\") " pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:32.785881 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.785794    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76q8\" (UniqueName: \"kubernetes.io/projected/0ace839a-4af0-41ea-88c0-1d31c514c7be-kube-api-access-j76q8\") pod \"multus-5xsm5\" (UID: \"0ace839a-4af0-41ea-88c0-1d31c514c7be\") " pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.785881 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.785806    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-265ff\" (UniqueName: \"kubernetes.io/projected/8cf199af-5799-401f-8b45-bf8fdab58f06-kube-api-access-265ff\") pod \"aws-ebs-csi-driver-node-2fh8h\" (UID: \"8cf199af-5799-401f-8b45-bf8fdab58f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:32.786456 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.786431    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxckq\" (UniqueName: \"kubernetes.io/projected/111d8b7e-7500-480c-99d1-05d2a3b2397f-kube-api-access-lxckq\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:32.790145 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:32.790112    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d041cd8df9263941ab1da1d846fce6.slice/crio-af6b39cf04c92626d8ffecde0f61ff9406451d1b698109b787e1242584a93b1a WatchSource:0}: Error finding container af6b39cf04c92626d8ffecde0f61ff9406451d1b698109b787e1242584a93b1a: Status 404 returned error can't find the container with id af6b39cf04c92626d8ffecde0f61ff9406451d1b698109b787e1242584a93b1a
May 20 21:26:32.790392 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:32.790370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422de367e208d52bacb83c72eacec5e9.slice/crio-ffb8513311d992b353ec4f46e5dc985705ddae82fff8921587b8bda46f0c3dab WatchSource:0}: Error finding container ffb8513311d992b353ec4f46e5dc985705ddae82fff8921587b8bda46f0c3dab: Status 404 returned error can't find the container with id ffb8513311d992b353ec4f46e5dc985705ddae82fff8921587b8bda46f0c3dab
May 20 21:26:32.795587 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.795573    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:26:32.880806 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.880784    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bx647"
May 20 21:26:32.886677 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:32.886654    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962d02e9_d578_437f_b258_9f0625dab236.slice/crio-ad2b73267c69e7acddec570338adce028f77241e44160d19fc4e5f58c983bead WatchSource:0}: Error finding container ad2b73267c69e7acddec570338adce028f77241e44160d19fc4e5f58c983bead: Status 404 returned error can't find the container with id ad2b73267c69e7acddec570338adce028f77241e44160d19fc4e5f58c983bead
May 20 21:26:32.918819 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.918799    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd6fq"
May 20 21:26:32.924147 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:32.924127    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2d6f7c_8a36_4d42_bbb4_2571e563ea31.slice/crio-73b4d730a57c9b32ce1fe7c890d1b433c52e15c8b9d51b0c973b24442137e86d WatchSource:0}: Error finding container 73b4d730a57c9b32ce1fe7c890d1b433c52e15c8b9d51b0c973b24442137e86d: Status 404 returned error can't find the container with id 73b4d730a57c9b32ce1fe7c890d1b433c52e15c8b9d51b0c973b24442137e86d
May 20 21:26:32.936659 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.936641    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2nhvn"
May 20 21:26:32.942081 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:32.942044    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9c8f61_6aab_4f53_b05b_70458d165f0e.slice/crio-ff2fc4a1d239815c38562b880c7efbbb99d0ce01fdde6f457322e554e48ea670 WatchSource:0}: Error finding container ff2fc4a1d239815c38562b880c7efbbb99d0ce01fdde6f457322e554e48ea670: Status 404 returned error can't find the container with id ff2fc4a1d239815c38562b880c7efbbb99d0ce01fdde6f457322e554e48ea670
May 20 21:26:32.946953 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.946936    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:32.949331 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.949316    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:32.953781 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:32.953762    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5xsm5"
May 20 21:26:32.956968 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:32.956950    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447195d9_44e1_46c0_b2a3_c578ac208d8c.slice/crio-710a79ee01a49f6c4dae81d79a2a721492fc90c69b0d3ed0b1b4980311c8b234 WatchSource:0}: Error finding container 710a79ee01a49f6c4dae81d79a2a721492fc90c69b0d3ed0b1b4980311c8b234: Status 404 returned error can't find the container with id 710a79ee01a49f6c4dae81d79a2a721492fc90c69b0d3ed0b1b4980311c8b234
May 20 21:26:32.961616 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:32.961594    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ace839a_4af0_41ea_88c0_1d31c514c7be.slice/crio-6ffc926a756db206b075398a9c75f3b1ca86dc22f4c20f7dc05ff3e59fd981fb WatchSource:0}: Error finding container 6ffc926a756db206b075398a9c75f3b1ca86dc22f4c20f7dc05ff3e59fd981fb: Status 404 returned error can't find the container with id 6ffc926a756db206b075398a9c75f3b1ca86dc22f4c20f7dc05ff3e59fd981fb
May 20 21:26:33.003122 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.003092    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h"
May 20 21:26:33.009450 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:33.009428    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf199af_5799_401f_8b45_bf8fdab58f06.slice/crio-bd81e40d9cba31aaf1b186e04e26eeab8b34fceb91f7f62f8e3df74206cab814 WatchSource:0}: Error finding container bd81e40d9cba31aaf1b186e04e26eeab8b34fceb91f7f62f8e3df74206cab814: Status 404 returned error can't find the container with id bd81e40d9cba31aaf1b186e04e26eeab8b34fceb91f7f62f8e3df74206cab814
May 20 21:26:33.017799 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.017781    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cfrlt"
May 20 21:26:33.022674 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.022656    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxd5f"
May 20 21:26:33.026336 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:33.026314    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5f4076_063c_483b_8d10_fa73b3a40cc7.slice/crio-ab026bb44f176da2ff338ed130a2e0ce498cf55612fa6e488e904c05c48fcb3d WatchSource:0}: Error finding container ab026bb44f176da2ff338ed130a2e0ce498cf55612fa6e488e904c05c48fcb3d: Status 404 returned error can't find the container with id ab026bb44f176da2ff338ed130a2e0ce498cf55612fa6e488e904c05c48fcb3d
May 20 21:26:33.029100 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:26:33.029075    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fc5dde_26ac_4bf7_b15c_3715e6012387.slice/crio-b8037bcc426fca18f2bbe476505214f5081e943c69d1a6070501a1d0e6b373ad WatchSource:0}: Error finding container b8037bcc426fca18f2bbe476505214f5081e943c69d1a6070501a1d0e6b373ad: Status 404 returned error can't find the container with id b8037bcc426fca18f2bbe476505214f5081e943c69d1a6070501a1d0e6b373ad
May 20 21:26:33.279049 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.278975    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:33.279212 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.279071    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:33.279212 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.279118    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:33.279212 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.279194    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:26:34.279176483 +0000 UTC m=+3.175774114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:33.279212 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.279196    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:26:33.279437 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.279224    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:26:33.279437 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.279238    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2sch for pod openshift-network-diagnostics/network-check-target-gzsq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:33.279437 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.279332    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch podName:ef393f8b-c48e-463e-9b8b-f1fb6514b8c5 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:34.27930405 +0000 UTC m=+3.175901689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2sch" (UniqueName: "kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch") pod "network-check-target-gzsq5" (UID: "ef393f8b-c48e-463e-9b8b-f1fb6514b8c5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:33.610188 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.610142    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:21:32 +0000 UTC" deadline="2028-01-27 12:20:43.11872521 +0000 UTC"
May 20 21:26:33.610188 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.610179    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14798h54m9.508549619s"
May 20 21:26:33.722138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.721963    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2nhvn" event={"ID":"6c9c8f61-6aab-4f53-b05b-70458d165f0e","Type":"ContainerStarted","Data":"ff2fc4a1d239815c38562b880c7efbbb99d0ce01fdde6f457322e554e48ea670"}
May 20 21:26:33.728887 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.728851    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd6fq" event={"ID":"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31","Type":"ContainerStarted","Data":"73b4d730a57c9b32ce1fe7c890d1b433c52e15c8b9d51b0c973b24442137e86d"}
May 20 21:26:33.731315 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.731288    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal" event={"ID":"422de367e208d52bacb83c72eacec5e9","Type":"ContainerStarted","Data":"ffb8513311d992b353ec4f46e5dc985705ddae82fff8921587b8bda46f0c3dab"}
May 20 21:26:33.733447 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.733421    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxd5f" event={"ID":"60fc5dde-26ac-4bf7-b15c-3715e6012387","Type":"ContainerStarted","Data":"b8037bcc426fca18f2bbe476505214f5081e943c69d1a6070501a1d0e6b373ad"}
May 20 21:26:33.740334 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.740139    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cfrlt" event={"ID":"1b5f4076-063c-483b-8d10-fa73b3a40cc7","Type":"ContainerStarted","Data":"ab026bb44f176da2ff338ed130a2e0ce498cf55612fa6e488e904c05c48fcb3d"}
May 20 21:26:33.750376 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.750330    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h" event={"ID":"8cf199af-5799-401f-8b45-bf8fdab58f06","Type":"ContainerStarted","Data":"bd81e40d9cba31aaf1b186e04e26eeab8b34fceb91f7f62f8e3df74206cab814"}
May 20 21:26:33.760748 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.760716    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5xsm5" event={"ID":"0ace839a-4af0-41ea-88c0-1d31c514c7be","Type":"ContainerStarted","Data":"6ffc926a756db206b075398a9c75f3b1ca86dc22f4c20f7dc05ff3e59fd981fb"}
May 20 21:26:33.766205 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.766169    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerStarted","Data":"ad2b73267c69e7acddec570338adce028f77241e44160d19fc4e5f58c983bead"}
May 20 21:26:33.772011 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.771971    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal" event={"ID":"13d041cd8df9263941ab1da1d846fce6","Type":"ContainerStarted","Data":"af6b39cf04c92626d8ffecde0f61ff9406451d1b698109b787e1242584a93b1a"}
May 20 21:26:33.774233 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.773643    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l9667" event={"ID":"447195d9-44e1-46c0-b2a3-c578ac208d8c","Type":"ContainerStarted","Data":"710a79ee01a49f6c4dae81d79a2a721492fc90c69b0d3ed0b1b4980311c8b234"}
May 20 21:26:33.783142 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.782765    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"485e823d7d2ce5a14422868ad06b2816db50fd6ba4797187fe6557ac67f7c415"}
May 20 21:26:33.839895 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.839814    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hw4d9"]
May 20 21:26:33.842964 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.842939    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.843094 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.843039    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:33.883319 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.883281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.883488 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.883352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3e786c4-b898-4c16-a572-c99e9c285870-dbus\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.883488 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.883394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3e786c4-b898-4c16-a572-c99e9c285870-kubelet-config\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.895636 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.895608    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:26:33.984362 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.984323    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.984542 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.984395    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3e786c4-b898-4c16-a572-c99e9c285870-dbus\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.984542 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.984434    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3e786c4-b898-4c16-a572-c99e9c285870-kubelet-config\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.984542 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.984536    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3e786c4-b898-4c16-a572-c99e9c285870-kubelet-config\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:33.984702 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.984640    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:26:33.984748 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:33.984703    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret podName:f3e786c4-b898-4c16-a572-c99e9c285870 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:34.484687399 +0000 UTC m=+3.381285034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret") pod "global-pull-secret-syncer-hw4d9" (UID: "f3e786c4-b898-4c16-a572-c99e9c285870") : object "kube-system"/"original-pull-secret" not registered
May 20 21:26:33.985552 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:33.984957    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3e786c4-b898-4c16-a572-c99e9c285870-dbus\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:34.287746 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:34.287586    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:34.287746 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:34.287676    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:34.287958 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.287795    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:34.287958 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.287856    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:26:36.287839464 +0000 UTC m=+5.184437107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:34.288256 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.288120    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:26:34.288256 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.288140    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:26:34.288256 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.288152    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2sch for pod openshift-network-diagnostics/network-check-target-gzsq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:34.288256 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.288196    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch podName:ef393f8b-c48e-463e-9b8b-f1fb6514b8c5 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:36.288182484 +0000 UTC m=+5.184780119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2sch" (UniqueName: "kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch") pod "network-check-target-gzsq5" (UID: "ef393f8b-c48e-463e-9b8b-f1fb6514b8c5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:34.489368 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:34.489330    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:34.489559 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.489518    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:26:34.489615 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.489594    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret podName:f3e786c4-b898-4c16-a572-c99e9c285870 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:35.489574883 +0000 UTC m=+4.386172539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret") pod "global-pull-secret-syncer-hw4d9" (UID: "f3e786c4-b898-4c16-a572-c99e9c285870") : object "kube-system"/"original-pull-secret" not registered
May 20 21:26:34.611408 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:34.611317    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:21:32 +0000 UTC" deadline="2028-02-28 04:39:53.96618176 +0000 UTC"
May 20 21:26:34.611408 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:34.611362    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15559h13m19.354823999s"
May 20 21:26:34.694618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:34.694129    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:34.694618 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.694253    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:34.694618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:34.694434    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:34.694618 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:34.694563    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:35.497392 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:35.497344    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:35.497579 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:35.497531    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:26:35.497651 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:35.497592    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret podName:f3e786c4-b898-4c16-a572-c99e9c285870 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:37.497574244 +0000 UTC m=+6.394171877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret") pod "global-pull-secret-syncer-hw4d9" (UID: "f3e786c4-b898-4c16-a572-c99e9c285870") : object "kube-system"/"original-pull-secret" not registered
May 20 21:26:35.696606 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:35.696576    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:35.697068 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:35.696713    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:36.306236 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:36.306196    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:36.306422 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:36.306286    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:36.306492 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.306460    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:26:36.306492 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.306480    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:26:36.306492 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.306493    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2sch for pod openshift-network-diagnostics/network-check-target-gzsq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:36.306642 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.306524    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:36.306642 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.306554    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch podName:ef393f8b-c48e-463e-9b8b-f1fb6514b8c5 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:40.306532269 +0000 UTC m=+9.203129906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2sch" (UniqueName: "kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch") pod "network-check-target-gzsq5" (UID: "ef393f8b-c48e-463e-9b8b-f1fb6514b8c5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:36.306642 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.306594    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:26:40.306574428 +0000 UTC m=+9.203172074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:36.693351 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:36.693276    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:36.693504 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:36.693276    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:36.693504 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.693387    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:36.693504 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:36.693479    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:37.516284 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:37.516194    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:37.516711 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:37.516346    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:26:37.516711 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:37.516405    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret podName:f3e786c4-b898-4c16-a572-c99e9c285870 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:41.516388247 +0000 UTC m=+10.412985883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret") pod "global-pull-secret-syncer-hw4d9" (UID: "f3e786c4-b898-4c16-a572-c99e9c285870") : object "kube-system"/"original-pull-secret" not registered
May 20 21:26:37.694156 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:37.694125    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:37.694335 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:37.694265    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:38.694037 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:38.693997    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:38.694485 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:38.694125    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:38.694545 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:38.694509    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:38.694641 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:38.694619    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:39.694462 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:39.693934    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:39.694462 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:39.694085    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:40.338023 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:40.337961    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:40.338187 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:40.338067    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:40.338187 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.338151    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:40.338315 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.338193    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:26:40.338315 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.338205    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:26:40.338315 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.338215    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2sch for pod openshift-network-diagnostics/network-check-target-gzsq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:40.338315 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.338248    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:26:48.338225637 +0000 UTC m=+17.234823281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:40.338315 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.338268    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch podName:ef393f8b-c48e-463e-9b8b-f1fb6514b8c5 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:48.338257047 +0000 UTC m=+17.234854677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2sch" (UniqueName: "kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch") pod "network-check-target-gzsq5" (UID: "ef393f8b-c48e-463e-9b8b-f1fb6514b8c5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:40.693813 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:40.693706    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:40.693959 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.693835    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:40.694223 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:40.694055    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:40.694223 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:40.694179    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:41.546528 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:41.546495    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:41.546919 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:41.546671    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:26:41.546919 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:41.546731    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret podName:f3e786c4-b898-4c16-a572-c99e9c285870 nodeName:}" failed. No retries permitted until 2026-05-20 21:26:49.546712797 +0000 UTC m=+18.443310434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret") pod "global-pull-secret-syncer-hw4d9" (UID: "f3e786c4-b898-4c16-a572-c99e9c285870") : object "kube-system"/"original-pull-secret" not registered
May 20 21:26:41.694918 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:41.694885    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:41.695115 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:41.695021    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:42.693576 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:42.693543    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:42.693975 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:42.693662    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:42.693975 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:42.693729    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:42.693975 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:42.693856    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:43.694118 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:43.694088    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:43.694519 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:43.694225    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:44.693451 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:44.693413    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:44.693626 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:44.693414    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:44.693626 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:44.693548    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:44.693741 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:44.693643    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:45.694286 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:45.694256    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:45.694709 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:45.694375    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:46.693612 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:46.693572    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:46.693789 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:46.693572    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:46.693789 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:46.693714    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:46.693895 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:46.693794    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:47.693569 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:47.693531    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:47.693971 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:47.693665    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:48.397721 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:48.397685    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:48.397923 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:48.397746    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:48.397923 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.397855    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:48.397923 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.397918    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:27:04.397902221 +0000 UTC m=+33.294499851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:26:48.398082 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.397943    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:26:48.398082 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.397959    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:26:48.398082 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.397968    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2sch for pod openshift-network-diagnostics/network-check-target-gzsq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:48.398082 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.398030    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch podName:ef393f8b-c48e-463e-9b8b-f1fb6514b8c5 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:04.398013848 +0000 UTC m=+33.294611491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2sch" (UniqueName: "kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch") pod "network-check-target-gzsq5" (UID: "ef393f8b-c48e-463e-9b8b-f1fb6514b8c5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:26:48.693631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:48.693555    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:48.693631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:48.693573    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:48.694074 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.693675    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:48.694074 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:48.693815    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:49.604733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:49.604703    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:49.604907 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:49.604824    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:26:49.604907 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:49.604876    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret podName:f3e786c4-b898-4c16-a572-c99e9c285870 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:05.604863406 +0000 UTC m=+34.501461037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret") pod "global-pull-secret-syncer-hw4d9" (UID: "f3e786c4-b898-4c16-a572-c99e9c285870") : object "kube-system"/"original-pull-secret" not registered
May 20 21:26:49.694147 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:49.694115    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:49.694572 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:49.694233    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:50.693505 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:50.693465    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:50.693694 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:50.693465    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:50.693694 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:50.693605    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:50.693694 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:50.693641    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:51.694055 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:51.694023    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:51.694429 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:51.694118    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:52.693672 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.693368    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:52.693793 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.693368    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:52.693793 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:52.693762    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:52.693898 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:52.693826    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:52.839322 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.839293    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerStarted","Data":"b28309126b128fc7db71bf97a41b0b0804cb90097995a21c5d2ffea46d76a5b6"}
May 20 21:26:52.840960 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.840934    2560 generic.go:358] "Generic (PLEG): container finished" podID="13d041cd8df9263941ab1da1d846fce6" containerID="c31e6db2de8e48b8e6d0402b309bb55c6690eaca53905a0f82cdd49910b0af89" exitCode=0
May 20 21:26:52.841103 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.841036    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal" event={"ID":"13d041cd8df9263941ab1da1d846fce6","Type":"ContainerDied","Data":"c31e6db2de8e48b8e6d0402b309bb55c6690eaca53905a0f82cdd49910b0af89"}
May 20 21:26:52.842475 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.842452    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l9667" event={"ID":"447195d9-44e1-46c0-b2a3-c578ac208d8c","Type":"ContainerStarted","Data":"f4989eaa62e7cb22e79b68025b521f095cc85aeb0e53aaa71e498c7775953afd"}
May 20 21:26:52.845215 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.845191    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"55d5e8fcdc868ecfe29a7348087d8fa31885961c79fa22c0f68cdeeef4378b0a"}
May 20 21:26:52.845310 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.845223    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"273104ee2006d4db5a5d0e6d1bbe70c31a5471fd0d58121e5773fd04f6efa2f1"}
May 20 21:26:52.845310 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.845236    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"6920345c6bdf44d2d3b9cbcf11352fb77962037af19808b29aea8c7f0e3dbcb9"}
May 20 21:26:52.845310 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.845251    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"99ba8de16020600d55219b705ed05a31c74f467b6944b8829227e60ce3c38b75"}
May 20 21:26:52.845310 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.845264    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"8691ffa0e45a2e65ad6940e82bd1e0616814e095a098135c295677f23477dfbf"}
May 20 21:26:52.845310 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.845275    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"5d8f59a3b357916c6d5389118bd34dc3f238c0835dee42f48394b61408bf838d"}
May 20 21:26:52.846653 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.846622    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2nhvn" event={"ID":"6c9c8f61-6aab-4f53-b05b-70458d165f0e","Type":"ContainerStarted","Data":"2c88b97dbf0b16fd993c4d3f3c93a3b3c8bf43df2816ad00f560ac1b7e73e04a"}
May 20 21:26:52.847882 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.847864    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal" event={"ID":"422de367e208d52bacb83c72eacec5e9","Type":"ContainerStarted","Data":"c01ddfa1066e160dc9d50ed57a9ac9afcedd34a25f44a4d92e9cdb1465e60a13"}
May 20 21:26:52.849157 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.849135    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxd5f" event={"ID":"60fc5dde-26ac-4bf7-b15c-3715e6012387","Type":"ContainerStarted","Data":"1d3393b2695db0fcf0138f909ca40fba39c60671da7dfae54faeb9f505a21b50"}
May 20 21:26:52.850625 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.850607    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cfrlt" event={"ID":"1b5f4076-063c-483b-8d10-fa73b3a40cc7","Type":"ContainerStarted","Data":"03051f808c8afe40b81e32df23f9c4e47f67f4499dfa537c855bcf9bcc4c94ba"}
May 20 21:26:52.851999 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.851959    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h" event={"ID":"8cf199af-5799-401f-8b45-bf8fdab58f06","Type":"ContainerStarted","Data":"b162222ad37c1fd1684d543f5059d5b939dd42f2bc8197135536ceca76bfa1e7"}
May 20 21:26:52.853282 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.853263    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5xsm5" event={"ID":"0ace839a-4af0-41ea-88c0-1d31c514c7be","Type":"ContainerStarted","Data":"f7d00b536278fc359accb862afa3dc3cc3e84d53f66f74fd180c855efb0fd861"}
May 20 21:26:52.874555 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.874517    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-6.ec2.internal" podStartSLOduration=20.874504121 podStartE2EDuration="20.874504121s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:26:52.874127696 +0000 UTC m=+21.770725349" watchObservedRunningTime="2026-05-20 21:26:52.874504121 +0000 UTC m=+21.771101774"
May 20 21:26:52.891859 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.891736    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2nhvn" podStartSLOduration=2.991655098 podStartE2EDuration="21.891717374s" podCreationTimestamp="2026-05-20 21:26:31 +0000 UTC" firstStartedPulling="2026-05-20 21:26:32.943469523 +0000 UTC m=+1.840067159" lastFinishedPulling="2026-05-20 21:26:51.84353179 +0000 UTC m=+20.740129435" observedRunningTime="2026-05-20 21:26:52.891127393 +0000 UTC m=+21.787725049" watchObservedRunningTime="2026-05-20 21:26:52.891717374 +0000 UTC m=+21.788315038"
May 20 21:26:52.928147 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.928082    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l9667" podStartSLOduration=11.231404554 podStartE2EDuration="21.928069026s" podCreationTimestamp="2026-05-20 21:26:31 +0000 UTC" firstStartedPulling="2026-05-20 21:26:32.959410837 +0000 UTC m=+1.856008471" lastFinishedPulling="2026-05-20 21:26:43.656075309 +0000 UTC m=+12.552672943" observedRunningTime="2026-05-20 21:26:52.928044761 +0000 UTC m=+21.824642413" watchObservedRunningTime="2026-05-20 21:26:52.928069026 +0000 UTC m=+21.824666679"
May 20 21:26:52.950383 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.950233    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5xsm5" podStartSLOduration=2.058873175 podStartE2EDuration="20.950221555s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:26:32.96357641 +0000 UTC m=+1.860174046" lastFinishedPulling="2026-05-20 21:26:51.85492478 +0000 UTC m=+20.751522426" observedRunningTime="2026-05-20 21:26:52.950022591 +0000 UTC m=+21.846620245" watchObservedRunningTime="2026-05-20 21:26:52.950221555 +0000 UTC m=+21.846819208"
May 20 21:26:52.966348 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.966313    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-cfrlt" podStartSLOduration=2.169847163 podStartE2EDuration="20.966298712s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:26:33.028308934 +0000 UTC m=+1.924906568" lastFinishedPulling="2026-05-20 21:26:51.824760482 +0000 UTC m=+20.721358117" observedRunningTime="2026-05-20 21:26:52.966127592 +0000 UTC m=+21.862725245" watchObservedRunningTime="2026-05-20 21:26:52.966298712 +0000 UTC m=+21.862896365"
May 20 21:26:52.979485 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:52.979445    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxd5f" podStartSLOduration=2.168168931 podStartE2EDuration="20.979433077s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:26:33.031636972 +0000 UTC m=+1.928234602" lastFinishedPulling="2026-05-20 21:26:51.842901103 +0000 UTC m=+20.739498748" observedRunningTime="2026-05-20 21:26:52.979100129 +0000 UTC m=+21.875697782" watchObservedRunningTime="2026-05-20 21:26:52.979433077 +0000 UTC m=+21.876030730"
May 20 21:26:53.130014 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.129963    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:53.130598 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.130579    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:53.694146 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.694057    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:53.694431 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:53.694191    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:53.856501 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.856458    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd6fq" event={"ID":"3c2d6f7c-8a36-4d42-bbb4-2571e563ea31","Type":"ContainerStarted","Data":"5b099e6bfdf6cd8273fa8336cf23ea612622e5a0dc8baf608532db70c19d1c5a"}
May 20 21:26:53.857649 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.857628    2560 generic.go:358] "Generic (PLEG): container finished" podID="962d02e9-d578-437f-b258-9f0625dab236" containerID="b28309126b128fc7db71bf97a41b0b0804cb90097995a21c5d2ffea46d76a5b6" exitCode=0
May 20 21:26:53.857756 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.857690    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerDied","Data":"b28309126b128fc7db71bf97a41b0b0804cb90097995a21c5d2ffea46d76a5b6"}
May 20 21:26:53.859246 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.859228    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal" event={"ID":"13d041cd8df9263941ab1da1d846fce6","Type":"ContainerStarted","Data":"bf4d4b4ad6641cd80a59c5ff05b3fab700b5125d7d5774b1188caeb71c4e9302"}
May 20 21:26:53.860192 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.860163    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:53.860447 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.860429    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l9667"
May 20 21:26:53.870201 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.870165    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cd6fq" podStartSLOduration=3.971928625 podStartE2EDuration="22.870155452s" podCreationTimestamp="2026-05-20 21:26:31 +0000 UTC" firstStartedPulling="2026-05-20 21:26:32.925650619 +0000 UTC m=+1.822248253" lastFinishedPulling="2026-05-20 21:26:51.823877446 +0000 UTC m=+20.720475080" observedRunningTime="2026-05-20 21:26:53.869649691 +0000 UTC m=+22.766247344" watchObservedRunningTime="2026-05-20 21:26:53.870155452 +0000 UTC m=+22.766753153"
May 20 21:26:53.917126 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:53.917082    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-6.ec2.internal" podStartSLOduration=21.917070151 podStartE2EDuration="21.917070151s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:26:53.916707293 +0000 UTC m=+22.813304946" watchObservedRunningTime="2026-05-20 21:26:53.917070151 +0000 UTC m=+22.813667804"
May 20 21:26:54.091555 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:54.091534    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 21:26:54.636960 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:54.636784    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T21:26:54.091552596Z","UUID":"ad9fea17-eff9-42a5-972b-0d362d98485a","Handler":null,"Name":"","Endpoint":""}
May 20 21:26:54.638577 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:54.638553    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 21:26:54.638710 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:54.638594    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 21:26:54.693305 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:54.693276    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:54.693479 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:54.693276    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:54.693479 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:54.693387    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:54.693479 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:54.693459    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:54.864643 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:54.864582    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h" event={"ID":"8cf199af-5799-401f-8b45-bf8fdab58f06","Type":"ContainerStarted","Data":"c87006cb1057399f72d2bab809549aa9a20fd5858970712f0d4d50bb26e504b3"}
May 20 21:26:55.694383 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:55.694285    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:55.694597 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:55.694405    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:55.868122 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:55.868077    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h" event={"ID":"8cf199af-5799-401f-8b45-bf8fdab58f06","Type":"ContainerStarted","Data":"ad3597bb415d70a8c3f2aa51005cb7a9230f80df5e21dbf46f8ad9d0b4e03402"}
May 20 21:26:55.871378 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:55.871345    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"36175cfdf65272a1a0873554f2de3326b477a3d512fcad602ad7807d129837d6"}
May 20 21:26:55.885638 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:55.885589    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh8h" podStartSLOduration=1.456173738 podStartE2EDuration="23.885574701s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:26:33.010971532 +0000 UTC m=+1.907569163" lastFinishedPulling="2026-05-20 21:26:55.440372494 +0000 UTC m=+24.336970126" observedRunningTime="2026-05-20 21:26:55.885328673 +0000 UTC m=+24.781926328" watchObservedRunningTime="2026-05-20 21:26:55.885574701 +0000 UTC m=+24.782172353"
May 20 21:26:56.693297 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:56.693261    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:56.693473 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:56.693269    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:56.693473 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:56.693395    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:56.693595 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:56.693480    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:57.693536 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:57.693347    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:57.694063 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:57.693636    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:57.877143 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:57.877097    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" event={"ID":"b95fa26a-7729-473d-9cd4-04cb53848ad1","Type":"ContainerStarted","Data":"0c2d0321b8d71bce42eb5f35803c9d53d650cea256cbf301ccf699742ca8e3eb"}
May 20 21:26:57.877525 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:57.877500    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:57.877525 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:57.877533    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:57.896080 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:57.896052    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:57.931949 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:57.931890    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5" podStartSLOduration=7.721464865 podStartE2EDuration="26.931875382s" podCreationTimestamp="2026-05-20 21:26:31 +0000 UTC" firstStartedPulling="2026-05-20 21:26:32.953914166 +0000 UTC m=+1.850511799" lastFinishedPulling="2026-05-20 21:26:52.164324683 +0000 UTC m=+21.060922316" observedRunningTime="2026-05-20 21:26:57.906871962 +0000 UTC m=+26.803469619" watchObservedRunningTime="2026-05-20 21:26:57.931875382 +0000 UTC m=+26.828473035"
May 20 21:26:58.693723 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.693693    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:58.694147 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.693693    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:58.694147 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:58.693823    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:58.694147 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:58.693904    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:26:58.879786 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.879741    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:58.897560 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.897379    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:26:58.974836 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.974572    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw4d9"]
May 20 21:26:58.974836 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.974718    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:26:58.975074 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:58.974838    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:26:58.978165 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.977889    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkbw8"]
May 20 21:26:58.978165 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.978027    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:26:58.978165 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:58.978125    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:26:58.978751 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.978701    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gzsq5"]
May 20 21:26:58.978886 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:26:58.978780    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:26:58.978886 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:26:58.978865    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:27:00.693346 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:00.693313    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:27:00.693713 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:00.693310    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:00.693713 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:00.693416    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:27:00.693713 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:00.693326    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:00.693713 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:00.693459    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:27:00.693713 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:00.693568    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:27:00.883449 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:00.883418    2560 generic.go:358] "Generic (PLEG): container finished" podID="962d02e9-d578-437f-b258-9f0625dab236" containerID="8b8b519f014d8092110ec81d4611826084b1cd33e43b8fe74e1c6d8dda21ee36" exitCode=0
May 20 21:27:00.883595 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:00.883452    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerDied","Data":"8b8b519f014d8092110ec81d4611826084b1cd33e43b8fe74e1c6d8dda21ee36"}
May 20 21:27:02.693295 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:02.693260    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:27:02.693850 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:02.693260    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:02.693850 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:02.693370    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:27:02.693850 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:02.693260    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:02.693850 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:02.693461    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:27:02.693850 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:02.693543    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:27:02.888532 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:02.888501    2560 generic.go:358] "Generic (PLEG): container finished" podID="962d02e9-d578-437f-b258-9f0625dab236" containerID="83953d7385b14d3bad89833c65e38d7d49493da37d30a69853b5873001a5e924" exitCode=0
May 20 21:27:02.888693 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:02.888543    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerDied","Data":"83953d7385b14d3bad89833c65e38d7d49493da37d30a69853b5873001a5e924"}
May 20 21:27:04.422867 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:04.422629    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:04.422867 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:04.422843    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:27:04.423329 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.422779    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:27:04.423329 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.422893    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:27:04.423329 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.422902    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2sch for pod openshift-network-diagnostics/network-check-target-gzsq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:27:04.423329 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.422934    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:27:04.423329 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.422951    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch podName:ef393f8b-c48e-463e-9b8b-f1fb6514b8c5 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:36.422936779 +0000 UTC m=+65.319534410 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2sch" (UniqueName: "kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch") pod "network-check-target-gzsq5" (UID: "ef393f8b-c48e-463e-9b8b-f1fb6514b8c5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:27:04.423329 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.422973    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:27:36.422961595 +0000 UTC m=+65.319559225 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:27:04.693925 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:04.693847    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:04.694189 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.693943    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gzsq5" podUID="ef393f8b-c48e-463e-9b8b-f1fb6514b8c5"
May 20 21:27:04.694189 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:04.693964    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:04.694189 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:04.694003    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:27:04.694189 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.694079    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw4d9" podUID="f3e786c4-b898-4c16-a572-c99e9c285870"
May 20 21:27:04.694189 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:04.694151    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkbw8" podUID="111d8b7e-7500-480c-99d1-05d2a3b2397f"
May 20 21:27:04.893928 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:04.893897    2560 generic.go:358] "Generic (PLEG): container finished" podID="962d02e9-d578-437f-b258-9f0625dab236" containerID="7b623e66d6e9c9a3c4e36d0b6d8163bd39dce1d9635a0f45a3e5d2ce4126ea5a" exitCode=0
May 20 21:27:04.894105 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:04.893949    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerDied","Data":"7b623e66d6e9c9a3c4e36d0b6d8163bd39dce1d9635a0f45a3e5d2ce4126ea5a"}
May 20 21:27:05.631708 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.631672    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:05.632114 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:05.631816    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:27:05.632114 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:05.631884    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret podName:f3e786c4-b898-4c16-a572-c99e9c285870 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:37.631865302 +0000 UTC m=+66.528462952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret") pod "global-pull-secret-syncer-hw4d9" (UID: "f3e786c4-b898-4c16-a572-c99e9c285870") : object "kube-system"/"original-pull-secret" not registered
May 20 21:27:05.940540 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.940462    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-6.ec2.internal" event="NodeReady"
May 20 21:27:05.940700 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.940612    2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 21:27:05.972639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.972603    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"]
May 20 21:27:05.992549 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.992505    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"]
May 20 21:27:05.993384 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.992868    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"
May 20 21:27:05.995536 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.995506    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 20 21:27:05.995536 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.995532    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 20 21:27:05.995698 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:05.995582    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kh24p\""
May 20 21:27:06.018099 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.018075    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"]
May 20 21:27:06.018237 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.018107    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"]
May 20 21:27:06.018237 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.018229    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.024142 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.023542    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 21:27:06.024142 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.022712    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 21:27:06.024142 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.023808    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 21:27:06.024142 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.024021    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hzgt9\""
May 20 21:27:06.032219 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.032196    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 21:27:06.034103 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.034084    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"]
May 20 21:27:06.034394 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.034373    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:06.036604 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.036581    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 20 21:27:06.036937 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.036903    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 20 21:27:06.037183 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.037136    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vbd9z\""
May 20 21:27:06.037949 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.037739    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 20 21:27:06.054232 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.054203    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dv64q"]
May 20 21:27:06.054389 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.054322    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.056695 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.056650    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 20 21:27:06.056695 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.056670    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 20 21:27:06.056695 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.056685    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 20 21:27:06.057047 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.056670    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 20 21:27:06.057047 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.056791    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rcmzf\""
May 20 21:27:06.078312 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.078287    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69fbb9b8bb-588mz"]
May 20 21:27:06.078491 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.078467    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.081342 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.081215    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 20 21:27:06.081342 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.081321    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pl258\""
May 20 21:27:06.081507 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.081475    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 20 21:27:06.081694 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.081675    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 20 21:27:06.082003 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.081773    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 20 21:27:06.093961 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.093942    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"]
May 20 21:27:06.094118 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.094101    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.096586 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.096558    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 20 21:27:06.096586 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.096580    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 20 21:27:06.096913 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.096819    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 20 21:27:06.097014 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.096923    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 20 21:27:06.097014 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.096937    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 20 21:27:06.097132 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.097020    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hxwn\""
May 20 21:27:06.097132 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.097064    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 20 21:27:06.108678 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.108657    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 20 21:27:06.112720 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.112700    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"]
May 20 21:27:06.112808 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.112725    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"]
May 20 21:27:06.112808 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.112734    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"]
May 20 21:27:06.112808 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.112743    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"]
May 20 21:27:06.112808 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.112757    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dv64q"]
May 20 21:27:06.112808 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.112772    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-87qw4"]
May 20 21:27:06.113086 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.112871    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.115348 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.115318    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qmstr\""
May 20 21:27:06.115455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.115374    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 20 21:27:06.115691 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.115673    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 20 21:27:06.115843 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.115747    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 20 21:27:06.115919 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.115892    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 20 21:27:06.126786 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.126766    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"]
May 20 21:27:06.126949 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.126934    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.129277 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.129260    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 21:27:06.129374 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.129266    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 20 21:27:06.129616 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.129595    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 21:27:06.129694 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.129650    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q9zzr\""
May 20 21:27:06.129756 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.129598    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 20 21:27:06.135568 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.135542    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 20 21:27:06.135807 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.135780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-bound-sa-token\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.135878 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.135834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:06.135939 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.135883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9ft\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-kube-api-access-pg9ft\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.135939 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.135910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8bb9\" (UniqueName: \"kubernetes.io/projected/7b4b4c92-21eb-4075-aa74-d395b4daab41-kube-api-access-v8bb9\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:06.136069 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.135940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d8gz\" (UniqueName: \"kubernetes.io/projected/d663c583-abf3-420f-9e5a-3a19ed266eff-kube-api-access-4d8gz\") pod \"volume-data-source-validator-5cf8c89d64-ml6l8\" (UID: \"d663c583-abf3-420f-9e5a-3a19ed266eff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"
May 20 21:27:06.136069 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.135971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-image-registry-private-configuration\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.136171 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.136171 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkgp\" (UniqueName: \"kubernetes.io/projected/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-kube-api-access-tfkgp\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.136171 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.136171 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-config\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.136373 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6094fb48-c154-4bad-8ad8-48df6b851cfa-ca-trust-extracted\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.136373 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-certificates\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.136373 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-installation-pull-secrets\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.136373 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.136324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-trusted-ca\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.145096 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.145073    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"]
May 20 21:27:06.145185 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.145110    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:06.147230 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.147205    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 20 21:27:06.147230 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.147214    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8v2l8\""
May 20 21:27:06.147395 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.147240    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 20 21:27:06.167077 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.167048    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"]
May 20 21:27:06.167219 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.167207    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.169848 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.169826    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7q29x\""
May 20 21:27:06.169944 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.169922    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 21:27:06.169944 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.169936    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 21:27:06.170139 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.169954    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 20 21:27:06.170139 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.170108    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 20 21:27:06.179276 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.179258    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"]
May 20 21:27:06.179537 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.179403    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"
May 20 21:27:06.182395 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.182038    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 21:27:06.182395 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.182050    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 21:27:06.182395 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.182050    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xvm2p\""
May 20 21:27:06.194033 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.193224    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ncrvx"]
May 20 21:27:06.194033 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.193435    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.196367 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.196346    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 20 21:27:06.196473 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.196375    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 20 21:27:06.196619 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.196600    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 20 21:27:06.196703 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.196620    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cvwbg\""
May 20 21:27:06.196703 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.196684    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 20 21:27:06.209374 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.209354    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"]
May 20 21:27:06.209523 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.209507    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:06.211949 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.211931    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 21:27:06.212061 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.211962    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 21:27:06.212061 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.212009    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dv5z7\""
May 20 21:27:06.212168 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.212066    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 21:27:06.219541 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.219518    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"]
May 20 21:27:06.219683 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.219663    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.221801 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.221775    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 20 21:27:06.233646 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233628    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69fbb9b8bb-588mz"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233654    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233666    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ncrvx"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233677    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-87qw4"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233694    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233705    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233717    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233729    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"]
May 20 21:27:06.233745 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233743    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"]
May 20 21:27:06.234172 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233765    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-78nj7"]
May 20 21:27:06.234172 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.233781    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.235997 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.235967    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 20 21:27:06.236081 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.236059    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 20 21:27:06.236174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.236010    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 20 21:27:06.236174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.236005    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 20 21:27:06.237053 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237032    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4d8gz\" (UniqueName: \"kubernetes.io/projected/d663c583-abf3-420f-9e5a-3a19ed266eff-kube-api-access-4d8gz\") pod \"volume-data-source-validator-5cf8c89d64-ml6l8\" (UID: \"d663c583-abf3-420f-9e5a-3a19ed266eff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"
May 20 21:27:06.237136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237072    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-image-registry-private-configuration\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.237136 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmvc\" (UniqueName: \"kubernetes.io/projected/ee1dd742-0bc4-4e11-a40c-4576f60fd557-kube-api-access-8qmvc\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.237206 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.237206 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4qcc\" (UniqueName: \"kubernetes.io/projected/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-kube-api-access-z4qcc\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.237206 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-serving-cert\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.237206 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237187    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkgp\" (UniqueName: \"kubernetes.io/projected/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-kube-api-access-tfkgp\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.237206 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhql8\" (UniqueName: \"kubernetes.io/projected/868feb22-77cc-49fe-bd67-1f44bd10fc9b-kube-api-access-hhql8\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.237461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237223    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.237461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee1dd742-0bc4-4e11-a40c-4576f60fd557-serving-cert\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.237461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237259    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6094fb48-c154-4bad-8ad8-48df6b851cfa-ca-trust-extracted\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.237461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237275    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-installation-pull-secrets\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.237461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237293    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-certificates\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.237461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237320    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-bound-sa-token\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.237461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-config\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.237775 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee1dd742-0bc4-4e11-a40c-4576f60fd557-service-ca-bundle\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.237775 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237637    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:06.237889 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p964j\" (UniqueName: \"kubernetes.io/projected/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-kube-api-access-p964j\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.237889 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-stats-auth\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.237999 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237899    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.237999 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ee1dd742-0bc4-4e11-a40c-4576f60fd557-snapshots\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.237999 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-serving-cert\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.237999 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.237973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee1dd742-0bc4-4e11-a40c-4576f60fd557-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.238195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-config\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.238195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238036    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-config\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.238195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13ceb671-36ca-4c71-a282-ca5a513affbf-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:06.238195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee1dd742-0bc4-4e11-a40c-4576f60fd557-tmp\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.238195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238119    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-trusted-ca\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.238195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-trusted-ca\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.238195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:06.238448 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.238448 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-default-certificate\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.238448 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.238304    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:27:06.238448 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.238319    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4bc4c77f-5kqrp: secret "image-registry-tls" not found
May 20 21:27:06.238448 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.238398    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls podName:6094fb48-c154-4bad-8ad8-48df6b851cfa nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.738379927 +0000 UTC m=+35.634977577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls") pod "image-registry-7b4bc4c77f-5kqrp" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa") : secret "image-registry-tls" not found
May 20 21:27:06.238448 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238409    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6094fb48-c154-4bad-8ad8-48df6b851cfa-ca-trust-extracted\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.239426 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.238767    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 21:27:06.239426 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.238880    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls podName:7b4b4c92-21eb-4075-aa74-d395b4daab41 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.738862152 +0000 UTC m=+35.635459786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls") pod "cluster-samples-operator-697587599-67f2r" (UID: "7b4b4c92-21eb-4075-aa74-d395b4daab41") : secret "samples-operator-tls" not found
May 20 21:27:06.239426 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.239315    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-trusted-ca\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.239426 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.238767    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9ft\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-kube-api-access-pg9ft\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.239426 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.239379    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8bb9\" (UniqueName: \"kubernetes.io/projected/7b4b4c92-21eb-4075-aa74-d395b4daab41-kube-api-access-v8bb9\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:06.239426 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.239392    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-certificates\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.239777 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.239641    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-config\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.242436 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.242399    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.242696 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.242671    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-image-registry-private-configuration\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.242696 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.242688    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-installation-pull-secrets\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.245020 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.244965    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkgp\" (UniqueName: \"kubernetes.io/projected/e13267c2-b86f-44b8-817a-8f7dd6ef7c0b-kube-api-access-tfkgp\") pod \"kube-storage-version-migrator-operator-565644f49-c6zxs\" (UID: \"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.245677 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.245658    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d8gz\" (UniqueName: \"kubernetes.io/projected/d663c583-abf3-420f-9e5a-3a19ed266eff-kube-api-access-4d8gz\") pod \"volume-data-source-validator-5cf8c89d64-ml6l8\" (UID: \"d663c583-abf3-420f-9e5a-3a19ed266eff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"
May 20 21:27:06.247395 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.247370    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9ft\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-kube-api-access-pg9ft\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.247953 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.247937    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8bb9\" (UniqueName: \"kubernetes.io/projected/7b4b4c92-21eb-4075-aa74-d395b4daab41-kube-api-access-v8bb9\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:06.248038 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.247938    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-bound-sa-token\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.252089 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.252071    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-78nj7"]
May 20 21:27:06.252200 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.252188    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.254303 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.254281    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 21:27:06.254419 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.254300    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 21:27:06.254482 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.254427    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dvjst\""
May 20 21:27:06.304794 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.304743    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"
May 20 21:27:06.339924 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.339892    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ee1dd742-0bc4-4e11-a40c-4576f60fd557-snapshots\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.340100 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.339944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8pn9\" (UniqueName: \"kubernetes.io/projected/01867303-a11e-47a1-ad88-e23d2bd76cf6-kube-api-access-j8pn9\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:06.340100 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.339968    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-serving-cert\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.340100 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.339999    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee1dd742-0bc4-4e11-a40c-4576f60fd557-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.340100 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340020    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-config\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.340495 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.340589 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.340647 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340609    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13ceb671-36ca-4c71-a282-ca5a513affbf-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:06.340701 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340652    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ee1dd742-0bc4-4e11-a40c-4576f60fd557-snapshots\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.340753 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0666f875-ea9e-4adb-8480-f91b2a69e576-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7679c94b74-bcgwd\" (UID: \"0666f875-ea9e-4adb-8480-f91b2a69e576\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.340753 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340730    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-config\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.340753 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937d007b-b153-41f0-aa59-bbe3f891c651-tmp-dir\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.340898 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:06.340898 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340836    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee1dd742-0bc4-4e11-a40c-4576f60fd557-tmp\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.341019 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.340945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-ca\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.341019 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341000    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-trusted-ca\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.341129 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341030    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:06.341129 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/937d007b-b153-41f0-aa59-bbe3f891c651-config-volume\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.341129 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341091    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.341129 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341108    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee1dd742-0bc4-4e11-a40c-4576f60fd557-tmp\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnmtg\" (UniqueName: \"kubernetes.io/projected/14dd7ec1-01b3-49d4-9272-ae762142621a-kube-api-access-nnmtg\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341170    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-default-certificate\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.341215    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341221    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee1dd742-0bc4-4e11-a40c-4576f60fd557-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9223b24e-bf0d-446a-981a-e317cbdb6edc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341259    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13ceb671-36ca-4c71-a282-ca5a513affbf-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.341295    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert podName:13ceb671-36ca-4c71-a282-ca5a513affbf nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.841270425 +0000 UTC m=+35.737868055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g5nhr" (UID: "13ceb671-36ca-4c71-a282-ca5a513affbf") : secret "networking-console-plugin-cert" not found
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.341327    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.841310821 +0000 UTC m=+35.737908466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : configmap references non-existent config key: service-ca.crt
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qqwn\" (UniqueName: \"kubernetes.io/projected/937d007b-b153-41f0-aa59-bbe3f891c651-kube-api-access-8qqwn\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341443    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmvc\" (UniqueName: \"kubernetes.io/projected/ee1dd742-0bc4-4e11-a40c-4576f60fd557-kube-api-access-8qmvc\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341471    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341488    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4qcc\" (UniqueName: \"kubernetes.io/projected/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-kube-api-access-z4qcc\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341505    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-serving-cert\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.342166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341546    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhql8\" (UniqueName: \"kubernetes.io/projected/868feb22-77cc-49fe-bd67-1f44bd10fc9b-kube-api-access-hhql8\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/14dd7ec1-01b3-49d4-9272-ae762142621a-klusterlet-config\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341619    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee1dd742-0bc4-4e11-a40c-4576f60fd557-serving-cert\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.341651    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2e705b79-0930-4f62-ba03-93438908d54a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341692    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-config\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.341705    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.84169239 +0000 UTC m=+35.738290041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : secret "router-metrics-certs-default" not found
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5ml\" (UniqueName: \"kubernetes.io/projected/0666f875-ea9e-4adb-8480-f91b2a69e576-kube-api-access-6j5ml\") pod \"managed-serviceaccount-addon-agent-7679c94b74-bcgwd\" (UID: \"0666f875-ea9e-4adb-8480-f91b2a69e576\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccgm8\" (UniqueName: \"kubernetes.io/projected/ba1154ec-16ba-4261-ae6d-938cb804fcc1-kube-api-access-ccgm8\") pod \"network-check-source-7f44b6dd87-vcphj\" (UID: \"ba1154ec-16ba-4261-ae6d-938cb804fcc1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341805    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee1dd742-0bc4-4e11-a40c-4576f60fd557-service-ca-bundle\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14dd7ec1-01b3-49d4-9272-ae762142621a-tmp\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlndq\" (UniqueName: \"kubernetes.io/projected/2e705b79-0930-4f62-ba03-93438908d54a-kube-api-access-tlndq\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-hub\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxlct\" (UniqueName: \"kubernetes.io/projected/9223b24e-bf0d-446a-981a-e317cbdb6edc-kube-api-access-pxlct\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.342719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341941    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-trusted-ca\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.343455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.341971    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p964j\" (UniqueName: \"kubernetes.io/projected/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-kube-api-access-p964j\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.343455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.342045    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-stats-auth\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.343455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.342856    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee1dd742-0bc4-4e11-a40c-4576f60fd557-service-ca-bundle\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.345268 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.345246    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-stats-auth\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.345357 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.345314    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-serving-cert\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.345830 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.345800    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-default-certificate\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.346382 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.346358    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee1dd742-0bc4-4e11-a40c-4576f60fd557-serving-cert\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.356455 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.356400    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-serving-cert\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.356585 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.356497    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-config\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.358783 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.358763    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmvc\" (UniqueName: \"kubernetes.io/projected/ee1dd742-0bc4-4e11-a40c-4576f60fd557-kube-api-access-8qmvc\") pod \"insights-operator-78bdfb888c-87qw4\" (UID: \"ee1dd742-0bc4-4e11-a40c-4576f60fd557\") " pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.361412 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.361370    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4qcc\" (UniqueName: \"kubernetes.io/projected/d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c-kube-api-access-z4qcc\") pod \"service-ca-operator-57b5b68b8-nq4vv\" (UID: \"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.361500 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.361469    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p964j\" (UniqueName: \"kubernetes.io/projected/9a08ad1e-eaf8-46df-bda3-8305d384cd3c-kube-api-access-p964j\") pod \"console-operator-76dff48d59-dv64q\" (UID: \"9a08ad1e-eaf8-46df-bda3-8305d384cd3c\") " pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.361666 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.361646    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhql8\" (UniqueName: \"kubernetes.io/projected/868feb22-77cc-49fe-bd67-1f44bd10fc9b-kube-api-access-hhql8\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.364210 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.364194    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"
May 20 21:27:06.390107 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.390073    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:06.423677 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.422806    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"
May 20 21:27:06.443490 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.439373    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-87qw4"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445539    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14dd7ec1-01b3-49d4-9272-ae762142621a-tmp\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445572    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlndq\" (UniqueName: \"kubernetes.io/projected/2e705b79-0930-4f62-ba03-93438908d54a-kube-api-access-tlndq\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445610    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-hub\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445647    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxlct\" (UniqueName: \"kubernetes.io/projected/9223b24e-bf0d-446a-981a-e317cbdb6edc-kube-api-access-pxlct\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445682    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8pn9\" (UniqueName: \"kubernetes.io/projected/01867303-a11e-47a1-ad88-e23d2bd76cf6-kube-api-access-j8pn9\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445709    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445732    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445757    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0666f875-ea9e-4adb-8480-f91b2a69e576-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7679c94b74-bcgwd\" (UID: \"0666f875-ea9e-4adb-8480-f91b2a69e576\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445783    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937d007b-b153-41f0-aa59-bbe3f891c651-tmp-dir\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445805    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445837    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-ca\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445870    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/937d007b-b153-41f0-aa59-bbe3f891c651-config-volume\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445907    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnmtg\" (UniqueName: \"kubernetes.io/projected/14dd7ec1-01b3-49d4-9272-ae762142621a-kube-api-access-nnmtg\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445934    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9223b24e-bf0d-446a-981a-e317cbdb6edc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.445962    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.448337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.446019    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qqwn\" (UniqueName: \"kubernetes.io/projected/937d007b-b153-41f0-aa59-bbe3f891c651-kube-api-access-8qqwn\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.446082    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.446117    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/14dd7ec1-01b3-49d4-9272-ae762142621a-klusterlet-config\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.446161    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2e705b79-0930-4f62-ba03-93438908d54a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.446195    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5ml\" (UniqueName: \"kubernetes.io/projected/0666f875-ea9e-4adb-8480-f91b2a69e576-kube-api-access-6j5ml\") pod \"managed-serviceaccount-addon-agent-7679c94b74-bcgwd\" (UID: \"0666f875-ea9e-4adb-8480-f91b2a69e576\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.446221    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgm8\" (UniqueName: \"kubernetes.io/projected/ba1154ec-16ba-4261-ae6d-938cb804fcc1-kube-api-access-ccgm8\") pod \"network-check-source-7f44b6dd87-vcphj\" (UID: \"ba1154ec-16ba-4261-ae6d-938cb804fcc1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.447114    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14dd7ec1-01b3-49d4-9272-ae762142621a-tmp\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.448141    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/937d007b-b153-41f0-aa59-bbe3f891c651-config-volume\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.448546    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 21:27:06.449174 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.448601    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls podName:9223b24e-bf0d-446a-981a-e317cbdb6edc nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.948583281 +0000 UTC m=+35.845180916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tcx5w" (UID: "9223b24e-bf0d-446a-981a-e317cbdb6edc") : secret "cluster-monitoring-operator-tls" not found
May 20 21:27:06.449630 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.449611    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9223b24e-bf0d-446a-981a-e317cbdb6edc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.455755 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.449869    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:27:06.455755 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.449919    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls podName:937d007b-b153-41f0-aa59-bbe3f891c651 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.949902893 +0000 UTC m=+35.846500539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls") pod "dns-default-78nj7" (UID: "937d007b-b153-41f0-aa59-bbe3f891c651") : secret "dns-default-metrics-tls" not found
May 20 21:27:06.455755 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.450284    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:27:06.455755 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.450325    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert podName:01867303-a11e-47a1-ad88-e23d2bd76cf6 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:06.950312077 +0000 UTC m=+35.846909713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert") pod "ingress-canary-ncrvx" (UID: "01867303-a11e-47a1-ad88-e23d2bd76cf6") : secret "canary-serving-cert" not found
May 20 21:27:06.455755 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.451040    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937d007b-b153-41f0-aa59-bbe3f891c651-tmp-dir\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.455755 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.451598    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2e705b79-0930-4f62-ba03-93438908d54a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.455755 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.452775    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-hub\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.458758 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.456677    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.466499 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.464975    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgm8\" (UniqueName: \"kubernetes.io/projected/ba1154ec-16ba-4261-ae6d-938cb804fcc1-kube-api-access-ccgm8\") pod \"network-check-source-7f44b6dd87-vcphj\" (UID: \"ba1154ec-16ba-4261-ae6d-938cb804fcc1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"
May 20 21:27:06.467401 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.467201    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qqwn\" (UniqueName: \"kubernetes.io/projected/937d007b-b153-41f0-aa59-bbe3f891c651-kube-api-access-8qqwn\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.467401 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.467341    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlndq\" (UniqueName: \"kubernetes.io/projected/2e705b79-0930-4f62-ba03-93438908d54a-kube-api-access-tlndq\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.467706 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.467680    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-ca\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.468488 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.468448    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e705b79-0930-4f62-ba03-93438908d54a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f6d7544fc-p88tq\" (UID: \"2e705b79-0930-4f62-ba03-93438908d54a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.469818 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.469792    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5ml\" (UniqueName: \"kubernetes.io/projected/0666f875-ea9e-4adb-8480-f91b2a69e576-kube-api-access-6j5ml\") pod \"managed-serviceaccount-addon-agent-7679c94b74-bcgwd\" (UID: \"0666f875-ea9e-4adb-8480-f91b2a69e576\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.471898 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.471304    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0666f875-ea9e-4adb-8480-f91b2a69e576-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7679c94b74-bcgwd\" (UID: \"0666f875-ea9e-4adb-8480-f91b2a69e576\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.471898 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.471784    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnmtg\" (UniqueName: \"kubernetes.io/projected/14dd7ec1-01b3-49d4-9272-ae762142621a-kube-api-access-nnmtg\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.471898 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.471810    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxlct\" (UniqueName: \"kubernetes.io/projected/9223b24e-bf0d-446a-981a-e317cbdb6edc-kube-api-access-pxlct\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.474483 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.472352    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/14dd7ec1-01b3-49d4-9272-ae762142621a-klusterlet-config\") pod \"klusterlet-addon-workmgr-64677f8756-lm45g\" (UID: \"14dd7ec1-01b3-49d4-9272-ae762142621a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.475655 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.475404    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8pn9\" (UniqueName: \"kubernetes.io/projected/01867303-a11e-47a1-ad88-e23d2bd76cf6-kube-api-access-j8pn9\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:06.489369 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.489113    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"
May 20 21:27:06.517095 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.516701    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"
May 20 21:27:06.534788 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.532519    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:06.541875 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.541846    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8"]
May 20 21:27:06.565758 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.563293    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:27:06.574400 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.573911    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs"]
May 20 21:27:06.591060 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:06.591023    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13267c2_b86f_44b8_817a_8f7dd6ef7c0b.slice/crio-143f8a1bdd27edf8cba893e770986deb501e878a5a4388f79606a43216c27ec8 WatchSource:0}: Error finding container 143f8a1bdd27edf8cba893e770986deb501e878a5a4388f79606a43216c27ec8: Status 404 returned error can't find the container with id 143f8a1bdd27edf8cba893e770986deb501e878a5a4388f79606a43216c27ec8
May 20 21:27:06.605581 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.605476    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dv64q"]
May 20 21:27:06.624599 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:06.623742    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a08ad1e_eaf8_46df_bda3_8305d384cd3c.slice/crio-3118ea16187f4f0fd23114ea0de251c3c3dd430bf91055d71e66146b8fa58e87 WatchSource:0}: Error finding container 3118ea16187f4f0fd23114ea0de251c3c3dd430bf91055d71e66146b8fa58e87: Status 404 returned error can't find the container with id 3118ea16187f4f0fd23114ea0de251c3c3dd430bf91055d71e66146b8fa58e87
May 20 21:27:06.698345 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.696949    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:06.698345 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.696977    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-87qw4"]
May 20 21:27:06.698345 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.696949    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:27:06.698345 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.697749    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:06.701636 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.701613    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-54hkt\""
May 20 21:27:06.701913 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.701896    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r759\""
May 20 21:27:06.702152 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:06.702120    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1dd742_0bc4_4e11_a40c_4576f60fd557.slice/crio-f486f640dd5058dc77fea1c9581211667b81eb5bd775e17c531ba92e627dc4df WatchSource:0}: Error finding container f486f640dd5058dc77fea1c9581211667b81eb5bd775e17c531ba92e627dc4df: Status 404 returned error can't find the container with id f486f640dd5058dc77fea1c9581211667b81eb5bd775e17c531ba92e627dc4df
May 20 21:27:06.702274 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.702259    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 21:27:06.702563 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.702463    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 21:27:06.702563 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.702495    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv"]
May 20 21:27:06.716056 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:06.714761    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d8d1a1_2dd0_40c1_ac23_8c1aaa171d2c.slice/crio-e6478bd682769032e1e7f1fda1ac528bb3671fdfcfa3d59c9265c50bab4654e1 WatchSource:0}: Error finding container e6478bd682769032e1e7f1fda1ac528bb3671fdfcfa3d59c9265c50bab4654e1: Status 404 returned error can't find the container with id e6478bd682769032e1e7f1fda1ac528bb3671fdfcfa3d59c9265c50bab4654e1
May 20 21:27:06.752755 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.752720    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd"]
May 20 21:27:06.755503 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.755460    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj"]
May 20 21:27:06.755975 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.755886    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:06.755975 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.755952    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:06.756166 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.756135    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 21:27:06.756273 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.756208    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls podName:7b4b4c92-21eb-4075-aa74-d395b4daab41 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.756188874 +0000 UTC m=+36.652786508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls") pod "cluster-samples-operator-697587599-67f2r" (UID: "7b4b4c92-21eb-4075-aa74-d395b4daab41") : secret "samples-operator-tls" not found
May 20 21:27:06.756273 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.756212    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:27:06.756273 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.756257    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4bc4c77f-5kqrp: secret "image-registry-tls" not found
May 20 21:27:06.756471 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.756297    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls podName:6094fb48-c154-4bad-8ad8-48df6b851cfa nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.756284226 +0000 UTC m=+36.652881868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls") pod "image-registry-7b4bc4c77f-5kqrp" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa") : secret "image-registry-tls" not found
May 20 21:27:06.758167 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.758128    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"]
May 20 21:27:06.760098 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:06.760065    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1154ec_16ba_4261_ae6d_938cb804fcc1.slice/crio-86903ebc19aa4bb50a11cf08449b35270251681ef5968a61c75ff7f05e133621 WatchSource:0}: Error finding container 86903ebc19aa4bb50a11cf08449b35270251681ef5968a61c75ff7f05e133621: Status 404 returned error can't find the container with id 86903ebc19aa4bb50a11cf08449b35270251681ef5968a61c75ff7f05e133621
May 20 21:27:06.762882 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:06.762856    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dd7ec1_01b3_49d4_9272_ae762142621a.slice/crio-d772d11f0c267f0ae8a42f16f3b816310aaad14b56fb34c544109535ca0a2054 WatchSource:0}: Error finding container d772d11f0c267f0ae8a42f16f3b816310aaad14b56fb34c544109535ca0a2054: Status 404 returned error can't find the container with id d772d11f0c267f0ae8a42f16f3b816310aaad14b56fb34c544109535ca0a2054
May 20 21:27:06.789388 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.789360    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"]
May 20 21:27:06.792746 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:06.792713    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e705b79_0930_4f62_ba03_93438908d54a.slice/crio-e25bdf865bbd628ee30a8285cd7a40814774582b138f6820822a0c6012737cc8 WatchSource:0}: Error finding container e25bdf865bbd628ee30a8285cd7a40814774582b138f6820822a0c6012737cc8: Status 404 returned error can't find the container with id e25bdf865bbd628ee30a8285cd7a40814774582b138f6820822a0c6012737cc8
May 20 21:27:06.857388 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.857356    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.857544 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.857517    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 21:27:06.857603 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.857576    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:27:06.857603 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.857584    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.857564533 +0000 UTC m=+36.754162173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : secret "router-metrics-certs-default" not found
May 20 21:27:06.857700 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.857626    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert podName:13ceb671-36ca-4c71-a282-ca5a513affbf nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.857610869 +0000 UTC m=+36.754208515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g5nhr" (UID: "13ceb671-36ca-4c71-a282-ca5a513affbf") : secret "networking-console-plugin-cert" not found
May 20 21:27:06.857700 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.857517    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:06.857700 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.857664    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:06.857887 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.857791    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.857779186 +0000 UTC m=+36.754376829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : configmap references non-existent config key: service-ca.crt
May 20 21:27:06.898575 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.898541    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj" event={"ID":"ba1154ec-16ba-4261-ae6d-938cb804fcc1","Type":"ContainerStarted","Data":"86903ebc19aa4bb50a11cf08449b35270251681ef5968a61c75ff7f05e133621"}
May 20 21:27:06.899804 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.899772    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv" event={"ID":"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c","Type":"ContainerStarted","Data":"e6478bd682769032e1e7f1fda1ac528bb3671fdfcfa3d59c9265c50bab4654e1"}
May 20 21:27:06.900866 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.900828    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g" event={"ID":"14dd7ec1-01b3-49d4-9272-ae762142621a","Type":"ContainerStarted","Data":"d772d11f0c267f0ae8a42f16f3b816310aaad14b56fb34c544109535ca0a2054"}
May 20 21:27:06.902027 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.901995    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd" event={"ID":"0666f875-ea9e-4adb-8480-f91b2a69e576","Type":"ContainerStarted","Data":"df2b56a0871963c82214068e4c87eb9bf4881b86ca2de742f6d053b72bf00033"}
May 20 21:27:06.903085 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.903051    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-87qw4" event={"ID":"ee1dd742-0bc4-4e11-a40c-4576f60fd557","Type":"ContainerStarted","Data":"f486f640dd5058dc77fea1c9581211667b81eb5bd775e17c531ba92e627dc4df"}
May 20 21:27:06.904182 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.904148    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs" event={"ID":"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b","Type":"ContainerStarted","Data":"143f8a1bdd27edf8cba893e770986deb501e878a5a4388f79606a43216c27ec8"}
May 20 21:27:06.905134 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.905107    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" event={"ID":"9a08ad1e-eaf8-46df-bda3-8305d384cd3c","Type":"ContainerStarted","Data":"3118ea16187f4f0fd23114ea0de251c3c3dd430bf91055d71e66146b8fa58e87"}
May 20 21:27:06.906170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.906143    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8" event={"ID":"d663c583-abf3-420f-9e5a-3a19ed266eff","Type":"ContainerStarted","Data":"6cc77727d0bdb8a2601bf59f768cf4e9c15e454bc9e8cbf0b000b1765db6eab2"}
May 20 21:27:06.907172 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.907149    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" event={"ID":"2e705b79-0930-4f62-ba03-93438908d54a","Type":"ContainerStarted","Data":"e25bdf865bbd628ee30a8285cd7a40814774582b138f6820822a0c6012737cc8"}
May 20 21:27:06.959036 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.958947    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:06.959036 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.959020    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:06.959221 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:06.959095    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:06.959221 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.959096    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 21:27:06.959315 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.959246    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls podName:9223b24e-bf0d-446a-981a-e317cbdb6edc nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.959233262 +0000 UTC m=+36.855830893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tcx5w" (UID: "9223b24e-bf0d-446a-981a-e317cbdb6edc") : secret "cluster-monitoring-operator-tls" not found
May 20 21:27:06.959315 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.959152    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:27:06.959392 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.959344    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls podName:937d007b-b153-41f0-aa59-bbe3f891c651 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.95933119 +0000 UTC m=+36.855928825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls") pod "dns-default-78nj7" (UID: "937d007b-b153-41f0-aa59-bbe3f891c651") : secret "dns-default-metrics-tls" not found
May 20 21:27:06.959392 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.959191    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:27:06.959392 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:06.959382    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert podName:01867303-a11e-47a1-ad88-e23d2bd76cf6 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:07.95937257 +0000 UTC m=+36.855970204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert") pod "ingress-canary-ncrvx" (UID: "01867303-a11e-47a1-ad88-e23d2bd76cf6") : secret "canary-serving-cert" not found
May 20 21:27:07.771932 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.771893    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:07.772603 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.771969    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:07.772603 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.772184    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 21:27:07.772603 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.772243    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls podName:7b4b4c92-21eb-4075-aa74-d395b4daab41 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.772224838 +0000 UTC m=+38.668822483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls") pod "cluster-samples-operator-697587599-67f2r" (UID: "7b4b4c92-21eb-4075-aa74-d395b4daab41") : secret "samples-operator-tls" not found
May 20 21:27:07.772788 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.772662    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:27:07.772788 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.772680    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4bc4c77f-5kqrp: secret "image-registry-tls" not found
May 20 21:27:07.772788 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.772732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls podName:6094fb48-c154-4bad-8ad8-48df6b851cfa nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.7727137 +0000 UTC m=+38.669311345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls") pod "image-registry-7b4bc4c77f-5kqrp" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa") : secret "image-registry-tls" not found
May 20 21:27:07.873287 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.873249    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:07.873445 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.873298    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:07.873521 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.873491    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:07.873669 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.873638    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 21:27:07.873738 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.873703    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.873684947 +0000 UTC m=+38.770282603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : secret "router-metrics-certs-default" not found
May 20 21:27:07.874143 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.874123    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:27:07.874246 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.874179    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert podName:13ceb671-36ca-4c71-a282-ca5a513affbf nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.874164375 +0000 UTC m=+38.770762020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g5nhr" (UID: "13ceb671-36ca-4c71-a282-ca5a513affbf") : secret "networking-console-plugin-cert" not found
May 20 21:27:07.874308 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.874248    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.874237479 +0000 UTC m=+38.770835113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : configmap references non-existent config key: service-ca.crt
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.974949    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.975020    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:07.975089    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.975339    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.975407    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls podName:937d007b-b153-41f0-aa59-bbe3f891c651 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.975387058 +0000 UTC m=+38.871984711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls") pod "dns-default-78nj7" (UID: "937d007b-b153-41f0-aa59-bbe3f891c651") : secret "dns-default-metrics-tls" not found
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.975473    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.975507    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls podName:9223b24e-bf0d-446a-981a-e317cbdb6edc nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.975496283 +0000 UTC m=+38.872093915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tcx5w" (UID: "9223b24e-bf0d-446a-981a-e317cbdb6edc") : secret "cluster-monitoring-operator-tls" not found
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.975558    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:27:07.975942 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:07.975584    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert podName:01867303-a11e-47a1-ad88-e23d2bd76cf6 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:09.975575114 +0000 UTC m=+38.872172745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert") pod "ingress-canary-ncrvx" (UID: "01867303-a11e-47a1-ad88-e23d2bd76cf6") : secret "canary-serving-cert" not found
May 20 21:27:09.804151 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:09.804107    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:09.804754 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:09.804331    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:09.804754 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.804495    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:27:09.804754 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.804513    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4bc4c77f-5kqrp: secret "image-registry-tls" not found
May 20 21:27:09.804754 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.804575    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls podName:6094fb48-c154-4bad-8ad8-48df6b851cfa nodeName:}" failed. No retries permitted until 2026-05-20 21:27:13.804552561 +0000 UTC m=+42.701150208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls") pod "image-registry-7b4bc4c77f-5kqrp" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa") : secret "image-registry-tls" not found
May 20 21:27:09.805159 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.805032    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 21:27:09.805159 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.805093    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls podName:7b4b4c92-21eb-4075-aa74-d395b4daab41 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:13.805076284 +0000 UTC m=+42.701673921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls") pod "cluster-samples-operator-697587599-67f2r" (UID: "7b4b4c92-21eb-4075-aa74-d395b4daab41") : secret "samples-operator-tls" not found
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:09.905362    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:09.905410    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:09.905485    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.905665    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.905727    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:13.905708993 +0000 UTC m=+42.802306624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : secret "router-metrics-certs-default" not found
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.906138    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.906189    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert podName:13ceb671-36ca-4c71-a282-ca5a513affbf nodeName:}" failed. No retries permitted until 2026-05-20 21:27:13.906173823 +0000 UTC m=+42.802771458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g5nhr" (UID: "13ceb671-36ca-4c71-a282-ca5a513affbf") : secret "networking-console-plugin-cert" not found
May 20 21:27:09.906412 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:09.906254    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:13.906241307 +0000 UTC m=+42.802838941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : configmap references non-existent config key: service-ca.crt
May 20 21:27:10.006563 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:10.006524    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:10.006721 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:10.006582    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:10.006721 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:10.006657    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:10.006947 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:10.006925    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:27:10.007050 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:10.007033    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls podName:937d007b-b153-41f0-aa59-bbe3f891c651 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:14.007012367 +0000 UTC m=+42.903610004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls") pod "dns-default-78nj7" (UID: "937d007b-b153-41f0-aa59-bbe3f891c651") : secret "dns-default-metrics-tls" not found
May 20 21:27:10.007454 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:10.007437    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 21:27:10.007523 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:10.007493    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls podName:9223b24e-bf0d-446a-981a-e317cbdb6edc nodeName:}" failed. No retries permitted until 2026-05-20 21:27:14.007476775 +0000 UTC m=+42.904074409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tcx5w" (UID: "9223b24e-bf0d-446a-981a-e317cbdb6edc") : secret "cluster-monitoring-operator-tls" not found
May 20 21:27:10.007593 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:10.007546    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:27:10.007593 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:10.007579    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert podName:01867303-a11e-47a1-ad88-e23d2bd76cf6 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:14.007568449 +0000 UTC m=+42.904166085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert") pod "ingress-canary-ncrvx" (UID: "01867303-a11e-47a1-ad88-e23d2bd76cf6") : secret "canary-serving-cert" not found
May 20 21:27:13.847016 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:13.846958    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:13.847435 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:13.847062    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:13.847435 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.847129    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:27:13.847435 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.847162    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4bc4c77f-5kqrp: secret "image-registry-tls" not found
May 20 21:27:13.847435 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.847243    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 21:27:13.847435 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.847256    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls podName:6094fb48-c154-4bad-8ad8-48df6b851cfa nodeName:}" failed. No retries permitted until 2026-05-20 21:27:21.847232916 +0000 UTC m=+50.743830550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls") pod "image-registry-7b4bc4c77f-5kqrp" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa") : secret "image-registry-tls" not found
May 20 21:27:13.847435 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.847312    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls podName:7b4b4c92-21eb-4075-aa74-d395b4daab41 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:21.847295003 +0000 UTC m=+50.743892673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls") pod "cluster-samples-operator-697587599-67f2r" (UID: "7b4b4c92-21eb-4075-aa74-d395b4daab41") : secret "samples-operator-tls" not found
May 20 21:27:13.947860 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:13.947813    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:13.948060 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:13.947883    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:13.948060 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:13.948000    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:13.948060 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.948040    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:27:13.948212 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.948119    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert podName:13ceb671-36ca-4c71-a282-ca5a513affbf nodeName:}" failed. No retries permitted until 2026-05-20 21:27:21.948099023 +0000 UTC m=+50.844696717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g5nhr" (UID: "13ceb671-36ca-4c71-a282-ca5a513affbf") : secret "networking-console-plugin-cert" not found
May 20 21:27:13.948212 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.948161    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 21:27:13.948284 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.948221    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:21.948197293 +0000 UTC m=+50.844794923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : secret "router-metrics-certs-default" not found
May 20 21:27:13.948327 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:13.948286    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:21.948268725 +0000 UTC m=+50.844866381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : configmap references non-existent config key: service-ca.crt
May 20 21:27:14.048604 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:14.048568    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:14.048604 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:14.048607    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:14.048845 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:14.048654    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:14.048845 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:14.048741    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 21:27:14.048845 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:14.048779    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:27:14.048845 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:14.048779    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:27:14.049031 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:14.048830    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls podName:937d007b-b153-41f0-aa59-bbe3f891c651 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:22.048817333 +0000 UTC m=+50.945414963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls") pod "dns-default-78nj7" (UID: "937d007b-b153-41f0-aa59-bbe3f891c651") : secret "dns-default-metrics-tls" not found
May 20 21:27:14.049031 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:14.048879    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls podName:9223b24e-bf0d-446a-981a-e317cbdb6edc nodeName:}" failed. No retries permitted until 2026-05-20 21:27:22.048858173 +0000 UTC m=+50.945455807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tcx5w" (UID: "9223b24e-bf0d-446a-981a-e317cbdb6edc") : secret "cluster-monitoring-operator-tls" not found
May 20 21:27:14.049031 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:14.048904    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert podName:01867303-a11e-47a1-ad88-e23d2bd76cf6 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:22.048893738 +0000 UTC m=+50.945491374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert") pod "ingress-canary-ncrvx" (UID: "01867303-a11e-47a1-ad88-e23d2bd76cf6") : secret "canary-serving-cert" not found
May 20 21:27:21.923173 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:21.923124    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:21.923720 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:21.923237    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:21.923720 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:21.923306    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:27:21.923720 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:21.923330    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4bc4c77f-5kqrp: secret "image-registry-tls" not found
May 20 21:27:21.923720 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:21.923387    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 21:27:21.923720 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:21.923398    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls podName:6094fb48-c154-4bad-8ad8-48df6b851cfa nodeName:}" failed. No retries permitted until 2026-05-20 21:27:37.923377811 +0000 UTC m=+66.819975443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls") pod "image-registry-7b4bc4c77f-5kqrp" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa") : secret "image-registry-tls" not found
May 20 21:27:21.923720 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:21.923432    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls podName:7b4b4c92-21eb-4075-aa74-d395b4daab41 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:37.923419903 +0000 UTC m=+66.820017539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls") pod "cluster-samples-operator-697587599-67f2r" (UID: "7b4b4c92-21eb-4075-aa74-d395b4daab41") : secret "samples-operator-tls" not found
May 20 21:27:22.024589 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:22.024553    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:22.024589 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:22.024590    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:22.024815 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.024716    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:27:22.024815 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.024722    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:38.02470266 +0000 UTC m=+66.921300290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : configmap references non-existent config key: service-ca.crt
May 20 21:27:22.024815 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:22.024792    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:22.024937 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.024866    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert podName:13ceb671-36ca-4c71-a282-ca5a513affbf nodeName:}" failed. No retries permitted until 2026-05-20 21:27:38.024849561 +0000 UTC m=+66.921447193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g5nhr" (UID: "13ceb671-36ca-4c71-a282-ca5a513affbf") : secret "networking-console-plugin-cert" not found
May 20 21:27:22.024937 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.024869    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 21:27:22.024937 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.024926    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs podName:868feb22-77cc-49fe-bd67-1f44bd10fc9b nodeName:}" failed. No retries permitted until 2026-05-20 21:27:38.024910087 +0000 UTC m=+66.921507722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs") pod "router-default-69fbb9b8bb-588mz" (UID: "868feb22-77cc-49fe-bd67-1f44bd10fc9b") : secret "router-metrics-certs-default" not found
May 20 21:27:22.125272 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:22.125238    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:22.125272 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:22.125282    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:22.125511 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:22.125351    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:22.125511 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.125399    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 21:27:22.125511 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.125438    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:27:22.125511 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.125481    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls podName:9223b24e-bf0d-446a-981a-e317cbdb6edc nodeName:}" failed. No retries permitted until 2026-05-20 21:27:38.125460805 +0000 UTC m=+67.022058460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tcx5w" (UID: "9223b24e-bf0d-446a-981a-e317cbdb6edc") : secret "cluster-monitoring-operator-tls" not found
May 20 21:27:22.125511 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.125486    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:27:22.125511 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.125502    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert podName:01867303-a11e-47a1-ad88-e23d2bd76cf6 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:38.12549336 +0000 UTC m=+67.022090991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert") pod "ingress-canary-ncrvx" (UID: "01867303-a11e-47a1-ad88-e23d2bd76cf6") : secret "canary-serving-cert" not found
May 20 21:27:22.125819 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:22.125529    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls podName:937d007b-b153-41f0-aa59-bbe3f891c651 nodeName:}" failed. No retries permitted until 2026-05-20 21:27:38.125513879 +0000 UTC m=+67.022111509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls") pod "dns-default-78nj7" (UID: "937d007b-b153-41f0-aa59-bbe3f891c651") : secret "dns-default-metrics-tls" not found
May 20 21:27:23.985897 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.985867    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/0.log"
May 20 21:27:23.986354 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.985917    2560 generic.go:358] "Generic (PLEG): container finished" podID="9a08ad1e-eaf8-46df-bda3-8305d384cd3c" containerID="48ff792cc092e86d382dd625b219fdbedc62270883b86dcf9fa6ca03fc7d3e04" exitCode=255
May 20 21:27:23.986354 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.986006    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" event={"ID":"9a08ad1e-eaf8-46df-bda3-8305d384cd3c","Type":"ContainerDied","Data":"48ff792cc092e86d382dd625b219fdbedc62270883b86dcf9fa6ca03fc7d3e04"}
May 20 21:27:23.986354 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.986257    2560 scope.go:117] "RemoveContainer" containerID="48ff792cc092e86d382dd625b219fdbedc62270883b86dcf9fa6ca03fc7d3e04"
May 20 21:27:23.988001 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.987960    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8" event={"ID":"d663c583-abf3-420f-9e5a-3a19ed266eff","Type":"ContainerStarted","Data":"d0ea653a17b62349e4192fb82e2eb575a519a14cbd5044d3e7c76b0a1e8eb226"}
May 20 21:27:23.991763 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.991114    2560 generic.go:358] "Generic (PLEG): container finished" podID="962d02e9-d578-437f-b258-9f0625dab236" containerID="3857aa9673481b5e49bbaa18acb4c0c4417bca1516fa7e768d90574cf1760c45" exitCode=0
May 20 21:27:23.991763 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.991201    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerDied","Data":"3857aa9673481b5e49bbaa18acb4c0c4417bca1516fa7e768d90574cf1760c45"}
May 20 21:27:23.993186 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.993151    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" event={"ID":"2e705b79-0930-4f62-ba03-93438908d54a","Type":"ContainerStarted","Data":"f89eafbd0ad734d68823697074b7daa4bd33f5bd197eac44692459bb60a678ca"}
May 20 21:27:23.994482 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.994452    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj" event={"ID":"ba1154ec-16ba-4261-ae6d-938cb804fcc1","Type":"ContainerStarted","Data":"41a6a58ce0446777bb4c6dadf8d64a1899ea27b4d0e56c9972e66b1a4b71a16c"}
May 20 21:27:23.995934 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.995911    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv" event={"ID":"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c","Type":"ContainerStarted","Data":"5120e80d7521fda296a15cbceae46e1769a8b3169540c88a6aa4ef2afda87bfc"}
May 20 21:27:23.997679 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.997660    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g" event={"ID":"14dd7ec1-01b3-49d4-9272-ae762142621a","Type":"ContainerStarted","Data":"1be92364c7ced883ba7cec11f50205aeb606b3fb9ba52e7517adc3abf8c5ca25"}
May 20 21:27:23.998402 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:23.998385    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:24.000319 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.000274    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g"
May 20 21:27:24.000424 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.000403    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd" event={"ID":"0666f875-ea9e-4adb-8480-f91b2a69e576","Type":"ContainerStarted","Data":"5f609eeeaffbe7803696752734a3099df5425f3e9c8e5e69282523b778730221"}
May 20 21:27:24.001833 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.001812    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-87qw4" event={"ID":"ee1dd742-0bc4-4e11-a40c-4576f60fd557","Type":"ContainerStarted","Data":"8fd9cedd6187a7fe262c50981f88ec4c1c5dd929535f9cbad4db03cc8049b9dd"}
May 20 21:27:24.004459 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.004005    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs" event={"ID":"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b","Type":"ContainerStarted","Data":"01688eddd23f44bc920805338c28e0a1efcbd09a46280146640eba3215a1919d"}
May 20 21:27:24.018921 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.018879    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64677f8756-lm45g" podStartSLOduration=35.875525525 podStartE2EDuration="52.018866791s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.765027653 +0000 UTC m=+35.661625291" lastFinishedPulling="2026-05-20 21:27:22.908368909 +0000 UTC m=+51.804966557" observedRunningTime="2026-05-20 21:27:24.018630933 +0000 UTC m=+52.915228588" watchObservedRunningTime="2026-05-20 21:27:24.018866791 +0000 UTC m=+52.915464441"
May 20 21:27:24.032904 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.032789    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vcphj" podStartSLOduration=10.901994325 podStartE2EDuration="27.032774213s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.762259825 +0000 UTC m=+35.658857460" lastFinishedPulling="2026-05-20 21:27:22.893039717 +0000 UTC m=+51.789637348" observedRunningTime="2026-05-20 21:27:24.032459174 +0000 UTC m=+52.929056827" watchObservedRunningTime="2026-05-20 21:27:24.032774213 +0000 UTC m=+52.929371866"
May 20 21:27:24.071257 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.071204    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ml6l8" podStartSLOduration=11.378563819 podStartE2EDuration="27.071170955s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.556585986 +0000 UTC m=+35.453183624" lastFinishedPulling="2026-05-20 21:27:22.249193124 +0000 UTC m=+51.145790760" observedRunningTime="2026-05-20 21:27:24.070301288 +0000 UTC m=+52.966898941" watchObservedRunningTime="2026-05-20 21:27:24.071170955 +0000 UTC m=+52.967768611"
May 20 21:27:24.130897 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.130290    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv" podStartSLOduration=10.955593198999999 podStartE2EDuration="27.130272439s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.717353107 +0000 UTC m=+35.613950743" lastFinishedPulling="2026-05-20 21:27:22.892032338 +0000 UTC m=+51.788629983" observedRunningTime="2026-05-20 21:27:24.094881663 +0000 UTC m=+52.991479316" watchObservedRunningTime="2026-05-20 21:27:24.130272439 +0000 UTC m=+53.026870093"
May 20 21:27:24.131036 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.130967    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7679c94b74-bcgwd" podStartSLOduration=35.998905861 podStartE2EDuration="52.13095764s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.760106281 +0000 UTC m=+35.656703915" lastFinishedPulling="2026-05-20 21:27:22.892158051 +0000 UTC m=+51.788755694" observedRunningTime="2026-05-20 21:27:24.129741377 +0000 UTC m=+53.026339027" watchObservedRunningTime="2026-05-20 21:27:24.13095764 +0000 UTC m=+53.027555293"
May 20 21:27:24.195966 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.195837    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs" podStartSLOduration=10.903641944 podStartE2EDuration="27.195819573s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.599213779 +0000 UTC m=+35.495811425" lastFinishedPulling="2026-05-20 21:27:22.891391421 +0000 UTC m=+51.787989054" observedRunningTime="2026-05-20 21:27:24.170306589 +0000 UTC m=+53.066904241" watchObservedRunningTime="2026-05-20 21:27:24.195819573 +0000 UTC m=+53.092417227"
May 20 21:27:24.196517 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:24.196484    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-87qw4" podStartSLOduration=11.097651163 podStartE2EDuration="27.196476007s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.707474987 +0000 UTC m=+35.604072620" lastFinishedPulling="2026-05-20 21:27:22.806299831 +0000 UTC m=+51.702897464" observedRunningTime="2026-05-20 21:27:24.195444325 +0000 UTC m=+53.092041992" watchObservedRunningTime="2026-05-20 21:27:24.196476007 +0000 UTC m=+53.093073662"
May 20 21:27:25.008391 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.008344    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:27:25.008831 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.008810    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/0.log"
May 20 21:27:25.008887 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.008854    2560 generic.go:358] "Generic (PLEG): container finished" podID="9a08ad1e-eaf8-46df-bda3-8305d384cd3c" containerID="081588308d9830d0f5c9859e63210e17eee3cdc3c68b62ae82053f45989979a5" exitCode=255
May 20 21:27:25.008955 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.008937    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" event={"ID":"9a08ad1e-eaf8-46df-bda3-8305d384cd3c","Type":"ContainerDied","Data":"081588308d9830d0f5c9859e63210e17eee3cdc3c68b62ae82053f45989979a5"}
May 20 21:27:25.009027 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.009005    2560 scope.go:117] "RemoveContainer" containerID="48ff792cc092e86d382dd625b219fdbedc62270883b86dcf9fa6ca03fc7d3e04"
May 20 21:27:25.009263 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.009244    2560 scope.go:117] "RemoveContainer" containerID="081588308d9830d0f5c9859e63210e17eee3cdc3c68b62ae82053f45989979a5"
May 20 21:27:25.009486 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:25.009454    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dv64q_openshift-console-operator(9a08ad1e-eaf8-46df-bda3-8305d384cd3c)\"" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" podUID="9a08ad1e-eaf8-46df-bda3-8305d384cd3c"
May 20 21:27:25.012036 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.012013    2560 generic.go:358] "Generic (PLEG): container finished" podID="962d02e9-d578-437f-b258-9f0625dab236" containerID="674e800daad6d977c8ccd30da961e69218cab4fdd6a2bfe9f2936d010278756b" exitCode=0
May 20 21:27:25.012157 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:25.012138    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerDied","Data":"674e800daad6d977c8ccd30da961e69218cab4fdd6a2bfe9f2936d010278756b"}
May 20 21:27:26.017333 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:26.017299    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:27:26.017783 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:26.017705    2560 scope.go:117] "RemoveContainer" containerID="081588308d9830d0f5c9859e63210e17eee3cdc3c68b62ae82053f45989979a5"
May 20 21:27:26.017943 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:26.017921    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dv64q_openshift-console-operator(9a08ad1e-eaf8-46df-bda3-8305d384cd3c)\"" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" podUID="9a08ad1e-eaf8-46df-bda3-8305d384cd3c"
May 20 21:27:26.020954 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:26.020921    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bx647" event={"ID":"962d02e9-d578-437f-b258-9f0625dab236","Type":"ContainerStarted","Data":"ab13e97338c258a4aa79ac03d0c35d4178404cb29bc268c1ed5864054eb52424"}
May 20 21:27:26.071096 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:26.071042    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bx647" podStartSLOduration=5.066571107 podStartE2EDuration="55.071028425s" podCreationTimestamp="2026-05-20 21:26:31 +0000 UTC" firstStartedPulling="2026-05-20 21:26:32.888004235 +0000 UTC m=+1.784601867" lastFinishedPulling="2026-05-20 21:27:22.892461555 +0000 UTC m=+51.789059185" observedRunningTime="2026-05-20 21:27:26.069764782 +0000 UTC m=+54.966362454" watchObservedRunningTime="2026-05-20 21:27:26.071028425 +0000 UTC m=+54.967626079"
May 20 21:27:26.390834 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:26.390806    2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:26.390834 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:26.390838    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:27.025700 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:27.025616    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" event={"ID":"2e705b79-0930-4f62-ba03-93438908d54a","Type":"ContainerStarted","Data":"5f9949c755743829145d4fa6b3f1e20c966eab9929cd288db6ab75272e07b616"}
May 20 21:27:27.025700 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:27.025651    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" event={"ID":"2e705b79-0930-4f62-ba03-93438908d54a","Type":"ContainerStarted","Data":"dc15897b33c214f11022538c955af5c6ef892ad9d7d5db1af6a41cf40a25c041"}
May 20 21:27:27.026234 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:27.026218    2560 scope.go:117] "RemoveContainer" containerID="081588308d9830d0f5c9859e63210e17eee3cdc3c68b62ae82053f45989979a5"
May 20 21:27:27.026377 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:27.026360    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dv64q_openshift-console-operator(9a08ad1e-eaf8-46df-bda3-8305d384cd3c)\"" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" podUID="9a08ad1e-eaf8-46df-bda3-8305d384cd3c"
May 20 21:27:27.045275 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:27.045225    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" podStartSLOduration=35.339155955 podStartE2EDuration="55.04521281s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.7948176 +0000 UTC m=+35.691415232" lastFinishedPulling="2026-05-20 21:27:26.50087444 +0000 UTC m=+55.397472087" observedRunningTime="2026-05-20 21:27:27.043490704 +0000 UTC m=+55.940088356" watchObservedRunningTime="2026-05-20 21:27:27.04521281 +0000 UTC m=+55.941810491"
May 20 21:27:27.797407 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:27.797378    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cfrlt_1b5f4076-063c-483b-8d10-fa73b3a40cc7/dns-node-resolver/0.log"
May 20 21:27:28.997281 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:28.997255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxd5f_60fc5dde-26ac-4bf7-b15c-3715e6012387/node-ca/0.log"
May 20 21:27:30.599367 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:30.599317    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-c6zxs_e13267c2-b86f-44b8-817a-8f7dd6ef7c0b/kube-storage-version-migrator-operator/0.log"
May 20 21:27:30.899360 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:30.899323    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x69c5"
May 20 21:27:36.466594 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:36.466561    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:27:36.467057 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:36.466661    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:36.469067 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:36.469048    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 21:27:36.469505 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:36.469486    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2sch\" (UniqueName: \"kubernetes.io/projected/ef393f8b-c48e-463e-9b8b-f1fb6514b8c5-kube-api-access-g2sch\") pod \"network-check-target-gzsq5\" (UID: \"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5\") " pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:36.476972 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:36.476952    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 21:27:36.477085 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:36.477036    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs podName:111d8b7e-7500-480c-99d1-05d2a3b2397f nodeName:}" failed. No retries permitted until 2026-05-20 21:28:40.477016512 +0000 UTC m=+129.373614150 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs") pod "network-metrics-daemon-mkbw8" (UID: "111d8b7e-7500-480c-99d1-05d2a3b2397f") : secret "metrics-daemon-secret" not found
May 20 21:27:36.739483 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:36.739390    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r759\""
May 20 21:27:36.748228 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:36.748203    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:36.868761 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:36.868732    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gzsq5"]
May 20 21:27:36.871686 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:36.871651    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef393f8b_c48e_463e_9b8b_f1fb6514b8c5.slice/crio-d8f6c70543f1b56a48ed1f36ada78f9bb60c947899ea478f7802ce20483ca8aa WatchSource:0}: Error finding container d8f6c70543f1b56a48ed1f36ada78f9bb60c947899ea478f7802ce20483ca8aa: Status 404 returned error can't find the container with id d8f6c70543f1b56a48ed1f36ada78f9bb60c947899ea478f7802ce20483ca8aa
May 20 21:27:37.051043 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.051015    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gzsq5" event={"ID":"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5","Type":"ContainerStarted","Data":"0e4ae10481aaaeaa5725921e9968d2e77dc66aaf6980665795b759931fe464fe"}
May 20 21:27:37.051148 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.051056    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gzsq5" event={"ID":"ef393f8b-c48e-463e-9b8b-f1fb6514b8c5","Type":"ContainerStarted","Data":"d8f6c70543f1b56a48ed1f36ada78f9bb60c947899ea478f7802ce20483ca8aa"}
May 20 21:27:37.051148 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.051138    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:27:37.066065 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.066023    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gzsq5" podStartSLOduration=66.06601048 podStartE2EDuration="1m6.06601048s" podCreationTimestamp="2026-05-20 21:26:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:27:37.064814478 +0000 UTC m=+65.961412130" watchObservedRunningTime="2026-05-20 21:27:37.06601048 +0000 UTC m=+65.962608155"
May 20 21:27:37.677908 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.677874    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:37.680214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.680192    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 21:27:37.690301 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.690279    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3e786c4-b898-4c16-a572-c99e9c285870-original-pull-secret\") pod \"global-pull-secret-syncer-hw4d9\" (UID: \"f3e786c4-b898-4c16-a572-c99e9c285870\") " pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:37.918718 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.918690    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw4d9"
May 20 21:27:37.981217 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.981186    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:37.981370 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.981229    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:37.983490 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.983462    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4b4c92-21eb-4075-aa74-d395b4daab41-samples-operator-tls\") pod \"cluster-samples-operator-697587599-67f2r\" (UID: \"7b4b4c92-21eb-4075-aa74-d395b4daab41\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:37.983599 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:37.983462    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"image-registry-7b4bc4c77f-5kqrp\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") " pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:38.036781 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.036746    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw4d9"]
May 20 21:27:38.039552 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:38.039523    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e786c4_b898_4c16_a572_c99e9c285870.slice/crio-68740774c9d95e9b3f97a7f2ba6b884529b846562ac33b04ab0dbd4e5a8beea6 WatchSource:0}: Error finding container 68740774c9d95e9b3f97a7f2ba6b884529b846562ac33b04ab0dbd4e5a8beea6: Status 404 returned error can't find the container with id 68740774c9d95e9b3f97a7f2ba6b884529b846562ac33b04ab0dbd4e5a8beea6
May 20 21:27:38.054853 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.054818    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw4d9" event={"ID":"f3e786c4-b898-4c16-a572-c99e9c285870","Type":"ContainerStarted","Data":"68740774c9d95e9b3f97a7f2ba6b884529b846562ac33b04ab0dbd4e5a8beea6"}
May 20 21:27:38.082616 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.082591    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:38.082714 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.082700    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:27:38.082751 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.082730    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:38.082883 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:38.082865    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:27:38.082938 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:38.082929    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert podName:13ceb671-36ca-4c71-a282-ca5a513affbf nodeName:}" failed. No retries permitted until 2026-05-20 21:28:10.082915034 +0000 UTC m=+98.979512664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g5nhr" (UID: "13ceb671-36ca-4c71-a282-ca5a513affbf") : secret "networking-console-plugin-cert" not found
May 20 21:27:38.083447 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.083431    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/868feb22-77cc-49fe-bd67-1f44bd10fc9b-service-ca-bundle\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:38.084911 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.084896    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/868feb22-77cc-49fe-bd67-1f44bd10fc9b-metrics-certs\") pod \"router-default-69fbb9b8bb-588mz\" (UID: \"868feb22-77cc-49fe-bd67-1f44bd10fc9b\") " pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:38.135416 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.135389    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hzgt9\""
May 20 21:27:38.144220 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.144198    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:38.147978 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.147960    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vbd9z\""
May 20 21:27:38.156807 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.156788    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"
May 20 21:27:38.184018 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.183963    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:27:38.184217 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.184045    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:38.184217 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.184128    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:38.184217 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:38.184137    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 21:27:38.184369 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:27:38.184234    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls podName:9223b24e-bf0d-446a-981a-e317cbdb6edc nodeName:}" failed. No retries permitted until 2026-05-20 21:28:10.184197788 +0000 UTC m=+99.080795421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tcx5w" (UID: "9223b24e-bf0d-446a-981a-e317cbdb6edc") : secret "cluster-monitoring-operator-tls" not found
May 20 21:27:38.186550 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.186526    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/937d007b-b153-41f0-aa59-bbe3f891c651-metrics-tls\") pod \"dns-default-78nj7\" (UID: \"937d007b-b153-41f0-aa59-bbe3f891c651\") " pod="openshift-dns/dns-default-78nj7"
May 20 21:27:38.186667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.186528    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01867303-a11e-47a1-ad88-e23d2bd76cf6-cert\") pod \"ingress-canary-ncrvx\" (UID: \"01867303-a11e-47a1-ad88-e23d2bd76cf6\") " pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:38.209016 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.208787    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hxwn\""
May 20 21:27:38.218214 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.216156    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:38.314995 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.314922    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"]
May 20 21:27:38.319091 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:38.319058    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6094fb48_c154_4bad_8ad8_48df6b851cfa.slice/crio-28ba8641b067ac253b44be50a92bcf6c91b621b8a461813497fe0dc8fe107c28 WatchSource:0}: Error finding container 28ba8641b067ac253b44be50a92bcf6c91b621b8a461813497fe0dc8fe107c28: Status 404 returned error can't find the container with id 28ba8641b067ac253b44be50a92bcf6c91b621b8a461813497fe0dc8fe107c28
May 20 21:27:38.331535 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.331495    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dv5z7\""
May 20 21:27:38.334357 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.334331    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r"]
May 20 21:27:38.336191 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.336171    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ncrvx"
May 20 21:27:38.364243 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.364196    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69fbb9b8bb-588mz"]
May 20 21:27:38.367001 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:38.366959    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868feb22_77cc_49fe_bd67_1f44bd10fc9b.slice/crio-1f3cc58191c3ad3314644ea95258d796f16afe29f67e304f5fb47ccb5c88e1a7 WatchSource:0}: Error finding container 1f3cc58191c3ad3314644ea95258d796f16afe29f67e304f5fb47ccb5c88e1a7: Status 404 returned error can't find the container with id 1f3cc58191c3ad3314644ea95258d796f16afe29f67e304f5fb47ccb5c88e1a7
May 20 21:27:38.378377 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.378347    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dvjst\""
May 20 21:27:38.387257 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.387201    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-78nj7"
May 20 21:27:38.476377 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.476304    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ncrvx"]
May 20 21:27:38.479311 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:38.479284    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01867303_a11e_47a1_ad88_e23d2bd76cf6.slice/crio-77e6d69c26eec6047bade019c2b4caa142ece099b4a94b550e1f9a6b5754085e WatchSource:0}: Error finding container 77e6d69c26eec6047bade019c2b4caa142ece099b4a94b550e1f9a6b5754085e: Status 404 returned error can't find the container with id 77e6d69c26eec6047bade019c2b4caa142ece099b4a94b550e1f9a6b5754085e
May 20 21:27:38.537631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:38.537597    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-78nj7"]
May 20 21:27:38.540916 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:38.540883    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937d007b_b153_41f0_aa59_bbe3f891c651.slice/crio-7a4511c784f4d0bd6379b83d7e1aa9b0fe93c1f9150173d4b535edbfb956013b WatchSource:0}: Error finding container 7a4511c784f4d0bd6379b83d7e1aa9b0fe93c1f9150173d4b535edbfb956013b: Status 404 returned error can't find the container with id 7a4511c784f4d0bd6379b83d7e1aa9b0fe93c1f9150173d4b535edbfb956013b
May 20 21:27:39.061667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.060744    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp" event={"ID":"6094fb48-c154-4bad-8ad8-48df6b851cfa","Type":"ContainerStarted","Data":"a751b9ada2d6a573c305236b19a2d8d693968f854efbf0ec2836b5f95efb8931"}
May 20 21:27:39.061667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.060791    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp" event={"ID":"6094fb48-c154-4bad-8ad8-48df6b851cfa","Type":"ContainerStarted","Data":"28ba8641b067ac253b44be50a92bcf6c91b621b8a461813497fe0dc8fe107c28"}
May 20 21:27:39.061667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.061621    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:27:39.064114 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.064077    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-78nj7" event={"ID":"937d007b-b153-41f0-aa59-bbe3f891c651","Type":"ContainerStarted","Data":"7a4511c784f4d0bd6379b83d7e1aa9b0fe93c1f9150173d4b535edbfb956013b"}
May 20 21:27:39.065359 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.065317    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r" event={"ID":"7b4b4c92-21eb-4075-aa74-d395b4daab41","Type":"ContainerStarted","Data":"db68c7957b51de69da68106c85c988aa5e8169b656a75de527e5ae3921a0e964"}
May 20 21:27:39.067090 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.067055    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ncrvx" event={"ID":"01867303-a11e-47a1-ad88-e23d2bd76cf6","Type":"ContainerStarted","Data":"77e6d69c26eec6047bade019c2b4caa142ece099b4a94b550e1f9a6b5754085e"}
May 20 21:27:39.069618 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.069593    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69fbb9b8bb-588mz" event={"ID":"868feb22-77cc-49fe-bd67-1f44bd10fc9b","Type":"ContainerStarted","Data":"2cd26a3832e9831929ea5907f9abe0af3380a2071b383badb533f6815d5be893"}
May 20 21:27:39.069712 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.069626    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69fbb9b8bb-588mz" event={"ID":"868feb22-77cc-49fe-bd67-1f44bd10fc9b","Type":"ContainerStarted","Data":"1f3cc58191c3ad3314644ea95258d796f16afe29f67e304f5fb47ccb5c88e1a7"}
May 20 21:27:39.087602 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.087516    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp" podStartSLOduration=67.087499703 podStartE2EDuration="1m7.087499703s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:27:39.086272047 +0000 UTC m=+67.982869699" watchObservedRunningTime="2026-05-20 21:27:39.087499703 +0000 UTC m=+67.984097358"
May 20 21:27:39.108942 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.108891    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-69fbb9b8bb-588mz" podStartSLOduration=42.108876711 podStartE2EDuration="42.108876711s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:27:39.107877436 +0000 UTC m=+68.004475090" watchObservedRunningTime="2026-05-20 21:27:39.108876711 +0000 UTC m=+68.005474365"
May 20 21:27:39.217070 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.216967    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:39.219951 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.219756    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:39.700138 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:39.699780    2560 scope.go:117] "RemoveContainer" containerID="081588308d9830d0f5c9859e63210e17eee3cdc3c68b62ae82053f45989979a5"
May 20 21:27:40.074639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:40.074562    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:27:40.075109 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:40.074794    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" event={"ID":"9a08ad1e-eaf8-46df-bda3-8305d384cd3c","Type":"ContainerStarted","Data":"00736a3e7b7d3faf38e1ba8cff0478502794fc5da85c88d381ad272b71cbefec"}
May 20 21:27:40.075545 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:40.075340    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:40.075545 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:40.075380    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:40.076485 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:40.076420    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69fbb9b8bb-588mz"
May 20 21:27:40.093457 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:40.093409    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-dv64q" podStartSLOduration=26.825998249 podStartE2EDuration="43.093394029s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:27:06.625655456 +0000 UTC m=+35.522253102" lastFinishedPulling="2026-05-20 21:27:22.893051238 +0000 UTC m=+51.789648882" observedRunningTime="2026-05-20 21:27:40.092145956 +0000 UTC m=+68.988743611" watchObservedRunningTime="2026-05-20 21:27:40.093394029 +0000 UTC m=+68.989991681"
May 20 21:27:40.562012 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:40.561850    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-dv64q"
May 20 21:27:43.084626 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.084591    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ncrvx" event={"ID":"01867303-a11e-47a1-ad88-e23d2bd76cf6","Type":"ContainerStarted","Data":"43d7dcfc1ed20267223408798f152ec20e483c920910e83a768d9e36965bff87"}
May 20 21:27:43.086123 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.086092    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-78nj7" event={"ID":"937d007b-b153-41f0-aa59-bbe3f891c651","Type":"ContainerStarted","Data":"a95933e69c61eead5bcc9e7e2061116147af98a20bdb4d83b3e26af3f99c9505"}
May 20 21:27:43.086269 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.086128    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-78nj7" event={"ID":"937d007b-b153-41f0-aa59-bbe3f891c651","Type":"ContainerStarted","Data":"913cd2356d78258d6a4e0ad1989036d562b9a0be595d14a434ce3459a7d0e34d"}
May 20 21:27:43.086269 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.086237    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-78nj7"
May 20 21:27:43.087652 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.087623    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r" event={"ID":"7b4b4c92-21eb-4075-aa74-d395b4daab41","Type":"ContainerStarted","Data":"d1bc222d923261e7686f026248365ee4373c34e97a5808a986c5eefa3ecc1b38"}
May 20 21:27:43.087652 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.087650    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r" event={"ID":"7b4b4c92-21eb-4075-aa74-d395b4daab41","Type":"ContainerStarted","Data":"277164ea4c6885010401a68a9b765d0089b980f9a8fa6c7a5c55408ecbf03521"}
May 20 21:27:43.088922 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.088902    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw4d9" event={"ID":"f3e786c4-b898-4c16-a572-c99e9c285870","Type":"ContainerStarted","Data":"fc8ec420c2a90cf20243d85098d894af47656ffac665d305335cc10e0196b6d0"}
May 20 21:27:43.100857 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.100822    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ncrvx" podStartSLOduration=33.991397703 podStartE2EDuration="38.100812234s" podCreationTimestamp="2026-05-20 21:27:05 +0000 UTC" firstStartedPulling="2026-05-20 21:27:38.481140527 +0000 UTC m=+67.377738157" lastFinishedPulling="2026-05-20 21:27:42.590555054 +0000 UTC m=+71.487152688" observedRunningTime="2026-05-20 21:27:43.099421378 +0000 UTC m=+71.996019031" watchObservedRunningTime="2026-05-20 21:27:43.100812234 +0000 UTC m=+71.997409886"
May 20 21:27:43.114511 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.114470    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-67f2r" podStartSLOduration=41.925677242 podStartE2EDuration="46.114459277s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:27:38.400438845 +0000 UTC m=+67.297036495" lastFinishedPulling="2026-05-20 21:27:42.589220886 +0000 UTC m=+71.485818530" observedRunningTime="2026-05-20 21:27:43.113586472 +0000 UTC m=+72.010184124" watchObservedRunningTime="2026-05-20 21:27:43.114459277 +0000 UTC m=+72.011056927"
May 20 21:27:43.129801 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:43.129766    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-78nj7" podStartSLOduration=33.080935296 podStartE2EDuration="37.12975925s" podCreationTimestamp="2026-05-20 21:27:06 +0000 UTC" firstStartedPulling="2026-05-20 21:27:38.543298877 +0000 UTC m=+67.439896509" lastFinishedPulling="2026-05-20 21:27:42.592122814 +0000 UTC m=+71.488720463" observedRunningTime="2026-05-20 21:27:43.128447094 +0000 UTC m=+72.025044758" watchObservedRunningTime="2026-05-20 21:27:43.12975925 +0000 UTC m=+72.026356898"
May 20 21:27:46.077491 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.077442    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hw4d9" podStartSLOduration=68.509353311 podStartE2EDuration="1m13.077424614s" podCreationTimestamp="2026-05-20 21:26:33 +0000 UTC" firstStartedPulling="2026-05-20 21:27:38.041276032 +0000 UTC m=+66.937873662" lastFinishedPulling="2026-05-20 21:27:42.609347333 +0000 UTC m=+71.505944965" observedRunningTime="2026-05-20 21:27:43.141533048 +0000 UTC m=+72.038130699" watchObservedRunningTime="2026-05-20 21:27:46.077424614 +0000 UTC m=+74.974022265"
May 20 21:27:46.078020 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.077680    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6bhkb"]
May 20 21:27:46.080764 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.080743    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.083943 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.083921    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 21:27:46.084096 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.084077    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 21:27:46.084195 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.084182    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t2tlz\""
May 20 21:27:46.089177 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.089158    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bhkb"]
May 20 21:27:46.263548 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.263505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.263548 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.263555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-crio-socket\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.263754 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.263586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brdmt\" (UniqueName: \"kubernetes.io/projected/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-kube-api-access-brdmt\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.263754 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.263644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.263754 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.263724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-data-volume\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364290 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364200    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364290 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364240    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-crio-socket\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364290 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364266    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brdmt\" (UniqueName: \"kubernetes.io/projected/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-kube-api-access-brdmt\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364570 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364341    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364570 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364343    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-crio-socket\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364570 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364403    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-data-volume\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364755 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364735    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.364794 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.364765    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-data-volume\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.366624 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.366606    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.371592 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.371565    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brdmt\" (UniqueName: \"kubernetes.io/projected/d2252fc4-0b24-4c71-aeb3-b7b11d9e019c-kube-api-access-brdmt\") pod \"insights-runtime-extractor-6bhkb\" (UID: \"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c\") " pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.391199 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.391163    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bhkb"
May 20 21:27:46.509906 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:46.509874    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bhkb"]
May 20 21:27:46.512851 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:27:46.512823    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2252fc4_0b24_4c71_aeb3_b7b11d9e019c.slice/crio-87b47d07a769ceed9d81f2d91c257b4534554f7d194cf4ab6c379f9dc11801ec WatchSource:0}: Error finding container 87b47d07a769ceed9d81f2d91c257b4534554f7d194cf4ab6c379f9dc11801ec: Status 404 returned error can't find the container with id 87b47d07a769ceed9d81f2d91c257b4534554f7d194cf4ab6c379f9dc11801ec
May 20 21:27:47.101819 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:47.101787    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhkb" event={"ID":"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c","Type":"ContainerStarted","Data":"cf7dcf5df0a91afa2dda781e603e7aac513550c86ba591826b9da85f4c99731f"}
May 20 21:27:47.101819 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:47.101820    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhkb" event={"ID":"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c","Type":"ContainerStarted","Data":"87b47d07a769ceed9d81f2d91c257b4534554f7d194cf4ab6c379f9dc11801ec"}
May 20 21:27:48.106903 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:48.106852    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhkb" event={"ID":"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c","Type":"ContainerStarted","Data":"eb70b62fe631bf24579aa68f548bf7334fe60188fd0b7bb43e19c478750c9240"}
May 20 21:27:49.111706 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:49.111616    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhkb" event={"ID":"d2252fc4-0b24-4c71-aeb3-b7b11d9e019c","Type":"ContainerStarted","Data":"8d8bff01e83f5e20378f43c8553409d6fdac8af4c4073221fe3961c11a4ac595"}
May 20 21:27:49.150968 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:49.150919    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6bhkb" podStartSLOduration=0.894067865 podStartE2EDuration="3.150904878s" podCreationTimestamp="2026-05-20 21:27:46 +0000 UTC" firstStartedPulling="2026-05-20 21:27:46.564836407 +0000 UTC m=+75.461434041" lastFinishedPulling="2026-05-20 21:27:48.821673424 +0000 UTC m=+77.718271054" observedRunningTime="2026-05-20 21:27:49.150094279 +0000 UTC m=+78.046691930" watchObservedRunningTime="2026-05-20 21:27:49.150904878 +0000 UTC m=+78.047502529"
May 20 21:27:53.094657 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:53.094524    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-78nj7"
May 20 21:27:58.149097 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:58.149063    2560 patch_prober.go:28] interesting pod/image-registry-7b4bc4c77f-5kqrp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 21:27:58.149539 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:27:58.149126    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp" podUID="6094fb48-c154-4bad-8ad8-48df6b851cfa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 21:28:01.082543 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:01.082513    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:28:08.057370 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:08.057340    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gzsq5"
May 20 21:28:08.091365 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:08.091332    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"]
May 20 21:28:10.155636 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.155593    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:28:10.158134 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.158112    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ceb671-36ca-4c71-a282-ca5a513affbf-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g5nhr\" (UID: \"13ceb671-36ca-4c71-a282-ca5a513affbf\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:28:10.256233 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.256197    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:28:10.258529 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.258500    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9223b24e-bf0d-446a-981a-e317cbdb6edc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tcx5w\" (UID: \"9223b24e-bf0d-446a-981a-e317cbdb6edc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:28:10.355922 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.355893    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8v2l8\""
May 20 21:28:10.364033 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.364007    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"
May 20 21:28:10.379365 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.379342    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7q29x\""
May 20 21:28:10.387116 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.387093    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"
May 20 21:28:10.500021 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.499954    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr"]
May 20 21:28:10.504799 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:28:10.504773    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ceb671_36ca_4c71_a282_ca5a513affbf.slice/crio-ba86a47acb49cf2d686bab5699bc43872991783635e8229bb6fc99ec6093f149 WatchSource:0}: Error finding container ba86a47acb49cf2d686bab5699bc43872991783635e8229bb6fc99ec6093f149: Status 404 returned error can't find the container with id ba86a47acb49cf2d686bab5699bc43872991783635e8229bb6fc99ec6093f149
May 20 21:28:10.525150 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:10.525126    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w"]
May 20 21:28:10.529910 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:28:10.529881    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9223b24e_bf0d_446a_981a_e317cbdb6edc.slice/crio-3408ceccf348579dd71a522ca4da249d3852364970fa61f37895035574036692 WatchSource:0}: Error finding container 3408ceccf348579dd71a522ca4da249d3852364970fa61f37895035574036692: Status 404 returned error can't find the container with id 3408ceccf348579dd71a522ca4da249d3852364970fa61f37895035574036692
May 20 21:28:11.171641 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:11.171605    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr" event={"ID":"13ceb671-36ca-4c71-a282-ca5a513affbf","Type":"ContainerStarted","Data":"ba86a47acb49cf2d686bab5699bc43872991783635e8229bb6fc99ec6093f149"}
May 20 21:28:11.172784 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:11.172752    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w" event={"ID":"9223b24e-bf0d-446a-981a-e317cbdb6edc","Type":"ContainerStarted","Data":"3408ceccf348579dd71a522ca4da249d3852364970fa61f37895035574036692"}
May 20 21:28:12.177343 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:12.177303    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr" event={"ID":"13ceb671-36ca-4c71-a282-ca5a513affbf","Type":"ContainerStarted","Data":"e81f50be41ff014d011915e4e11304ea801aac1d0d8148411dee158e9c4bea21"}
May 20 21:28:12.192004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:12.191923    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g5nhr" podStartSLOduration=74.00745125 podStartE2EDuration="1m15.191905746s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:28:10.506680451 +0000 UTC m=+99.403278081" lastFinishedPulling="2026-05-20 21:28:11.691134947 +0000 UTC m=+100.587732577" observedRunningTime="2026-05-20 21:28:12.191401198 +0000 UTC m=+101.087998852" watchObservedRunningTime="2026-05-20 21:28:12.191905746 +0000 UTC m=+101.088503401"
May 20 21:28:13.181189 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:13.181145    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w" event={"ID":"9223b24e-bf0d-446a-981a-e317cbdb6edc","Type":"ContainerStarted","Data":"4835eb9fe4159fc47c868e5d45097fba66bd0658a7a5a5af81cac3667bc81e06"}
May 20 21:28:13.200917 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:13.200870    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tcx5w" podStartSLOduration=74.363798396 podStartE2EDuration="1m16.200856116s" podCreationTimestamp="2026-05-20 21:26:57 +0000 UTC" firstStartedPulling="2026-05-20 21:28:10.531678438 +0000 UTC m=+99.428276072" lastFinishedPulling="2026-05-20 21:28:12.36873616 +0000 UTC m=+101.265333792" observedRunningTime="2026-05-20 21:28:13.199529725 +0000 UTC m=+102.096127378" watchObservedRunningTime="2026-05-20 21:28:13.200856116 +0000 UTC m=+102.097453767"
May 20 21:28:20.319715 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.319679    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6v279"]
May 20 21:28:20.322157 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.322140    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.324659 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.324631    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 21:28:20.324886 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.324862    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hhk7m\""
May 20 21:28:20.325270 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.325252    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 21:28:20.325446 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.325428    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 21:28:20.325532 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.325486    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 21:28:20.445304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-wtmp\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445304 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkgzg\" (UniqueName: \"kubernetes.io/projected/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-kube-api-access-nkgzg\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445530 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-metrics-client-ca\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445530 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445530 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-sys\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445530 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-tls\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-textfile\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-root\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.445667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.445606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547075 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547037    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-root\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547075 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547080    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547328 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547109    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-wtmp\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547328 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547139    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkgzg\" (UniqueName: \"kubernetes.io/projected/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-kube-api-access-nkgzg\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547328 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547146    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-root\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547328 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547274    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-metrics-client-ca\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547328 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547326    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547583 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547362    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-sys\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547583 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547326    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-wtmp\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547583 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547391    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-tls\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547583 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547437    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-sys\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547583 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547454    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-textfile\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.547583 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:28:20.547507    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 20 21:28:20.547874 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:28:20.547588    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-tls podName:cbd3d30d-a22a-4b8d-9807-3bfb71d926d4 nodeName:}" failed. No retries permitted until 2026-05-20 21:28:21.047569104 +0000 UTC m=+109.944166736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-tls") pod "node-exporter-6v279" (UID: "cbd3d30d-a22a-4b8d-9807-3bfb71d926d4") : secret "node-exporter-tls" not found
May 20 21:28:20.547874 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547722    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-textfile\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.548007 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547920    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-metrics-client-ca\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.548007 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.547949    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.549512 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.549494    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:20.555013 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:20.554970    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkgzg\" (UniqueName: \"kubernetes.io/projected/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-kube-api-access-nkgzg\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:21.052701 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:21.052661    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-tls\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:21.055332 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:21.055304    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d30d-a22a-4b8d-9807-3bfb71d926d4-node-exporter-tls\") pod \"node-exporter-6v279\" (UID: \"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4\") " pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:21.236104 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:21.236069    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6v279"
May 20 21:28:21.248356 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:28:21.248319    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd3d30d_a22a_4b8d_9807_3bfb71d926d4.slice/crio-44bbdfc2af11387beb8837171c784d003930c74fd7e6e2091731fb46a2588983 WatchSource:0}: Error finding container 44bbdfc2af11387beb8837171c784d003930c74fd7e6e2091731fb46a2588983: Status 404 returned error can't find the container with id 44bbdfc2af11387beb8837171c784d003930c74fd7e6e2091731fb46a2588983
May 20 21:28:22.207379 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:22.207343    2560 generic.go:358] "Generic (PLEG): container finished" podID="cbd3d30d-a22a-4b8d-9807-3bfb71d926d4" containerID="a57ea10894966811d78725ba712f21161468c4bc8f2821bd7a69b5cbf4583d44" exitCode=0
May 20 21:28:22.207743 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:22.207413    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v279" event={"ID":"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4","Type":"ContainerDied","Data":"a57ea10894966811d78725ba712f21161468c4bc8f2821bd7a69b5cbf4583d44"}
May 20 21:28:22.207743 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:22.207450    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v279" event={"ID":"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4","Type":"ContainerStarted","Data":"44bbdfc2af11387beb8837171c784d003930c74fd7e6e2091731fb46a2588983"}
May 20 21:28:23.211679 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:23.211645    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v279" event={"ID":"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4","Type":"ContainerStarted","Data":"56dcb37f011bbb1e5b623b3db68a0f540f4cedff8dbc73cbb0f9aa7d11ebdb38"}
May 20 21:28:23.212075 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:23.211685    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v279" event={"ID":"cbd3d30d-a22a-4b8d-9807-3bfb71d926d4","Type":"ContainerStarted","Data":"9d238b04956f05f72a9c3cb05388a31749b01508031a4b0e5843f69e1234bb01"}
May 20 21:28:23.235842 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:23.235800    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6v279" podStartSLOduration=2.477025366 podStartE2EDuration="3.235785098s" podCreationTimestamp="2026-05-20 21:28:20 +0000 UTC" firstStartedPulling="2026-05-20 21:28:21.249854424 +0000 UTC m=+110.146452056" lastFinishedPulling="2026-05-20 21:28:22.008614157 +0000 UTC m=+110.905211788" observedRunningTime="2026-05-20 21:28:23.235511016 +0000 UTC m=+112.132108669" watchObservedRunningTime="2026-05-20 21:28:23.235785098 +0000 UTC m=+112.132382750"
May 20 21:28:33.110510 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.110447    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp" podUID="6094fb48-c154-4bad-8ad8-48df6b851cfa" containerName="registry" containerID="cri-o://a751b9ada2d6a573c305236b19a2d8d693968f854efbf0ec2836b5f95efb8931" gracePeriod=30
May 20 21:28:33.239731 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.239700    2560 generic.go:358] "Generic (PLEG): container finished" podID="6094fb48-c154-4bad-8ad8-48df6b851cfa" containerID="a751b9ada2d6a573c305236b19a2d8d693968f854efbf0ec2836b5f95efb8931" exitCode=0
May 20 21:28:33.239867 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.239770    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp" event={"ID":"6094fb48-c154-4bad-8ad8-48df6b851cfa","Type":"ContainerDied","Data":"a751b9ada2d6a573c305236b19a2d8d693968f854efbf0ec2836b5f95efb8931"}
May 20 21:28:33.347185 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.347163    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:28:33.463312 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463283    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-bound-sa-token\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.463491 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463321    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.463491 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463350    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg9ft\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-kube-api-access-pg9ft\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.463491 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463373    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-image-registry-private-configuration\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.463631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463496    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-installation-pull-secrets\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.463631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463538    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-certificates\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.463631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463577    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6094fb48-c154-4bad-8ad8-48df6b851cfa-ca-trust-extracted\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.463786 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.463651    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-trusted-ca\") pod \"6094fb48-c154-4bad-8ad8-48df6b851cfa\" (UID: \"6094fb48-c154-4bad-8ad8-48df6b851cfa\") "
May 20 21:28:33.464179 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.464022    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 21:28:33.464287 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.464262    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 21:28:33.465930 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.465901    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:28:33.466052 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.465954    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 21:28:33.466052 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.466002    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-kube-api-access-pg9ft" (OuterVolumeSpecName: "kube-api-access-pg9ft") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "kube-api-access-pg9ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:28:33.466162 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.466085    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:28:33.466197 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.466175    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 21:28:33.472873 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.472846    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6094fb48-c154-4bad-8ad8-48df6b851cfa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6094fb48-c154-4bad-8ad8-48df6b851cfa" (UID: "6094fb48-c154-4bad-8ad8-48df6b851cfa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 21:28:33.565004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.564950    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6094fb48-c154-4bad-8ad8-48df6b851cfa-ca-trust-extracted\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:33.565004 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.565002    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-trusted-ca\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:33.565170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.565026    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-bound-sa-token\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:33.565170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.565034    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-tls\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:33.565170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.565043    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg9ft\" (UniqueName: \"kubernetes.io/projected/6094fb48-c154-4bad-8ad8-48df6b851cfa-kube-api-access-pg9ft\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:33.565170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.565053    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-image-registry-private-configuration\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:33.565170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.565064    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6094fb48-c154-4bad-8ad8-48df6b851cfa-installation-pull-secrets\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:33.565170 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:33.565073    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6094fb48-c154-4bad-8ad8-48df6b851cfa-registry-certificates\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:28:34.243141 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:34.243112    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"
May 20 21:28:34.243602 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:34.243111    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4bc4c77f-5kqrp" event={"ID":"6094fb48-c154-4bad-8ad8-48df6b851cfa","Type":"ContainerDied","Data":"28ba8641b067ac253b44be50a92bcf6c91b621b8a461813497fe0dc8fe107c28"}
May 20 21:28:34.243602 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:34.243233    2560 scope.go:117] "RemoveContainer" containerID="a751b9ada2d6a573c305236b19a2d8d693968f854efbf0ec2836b5f95efb8931"
May 20 21:28:34.258806 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:34.258780    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"]
May 20 21:28:34.265831 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:34.265810    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b4bc4c77f-5kqrp"]
May 20 21:28:35.699836 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:35.699802    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6094fb48-c154-4bad-8ad8-48df6b851cfa" path="/var/lib/kubelet/pods/6094fb48-c154-4bad-8ad8-48df6b851cfa/volumes"
May 20 21:28:36.564341 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:36.564300    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" podUID="2e705b79-0930-4f62-ba03-93438908d54a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 21:28:39.259253 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:39.259216    2560 generic.go:358] "Generic (PLEG): container finished" podID="d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c" containerID="5120e80d7521fda296a15cbceae46e1769a8b3169540c88a6aa4ef2afda87bfc" exitCode=0
May 20 21:28:39.259733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:39.259302    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv" event={"ID":"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c","Type":"ContainerDied","Data":"5120e80d7521fda296a15cbceae46e1769a8b3169540c88a6aa4ef2afda87bfc"}
May 20 21:28:39.259733 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:39.259718    2560 scope.go:117] "RemoveContainer" containerID="5120e80d7521fda296a15cbceae46e1769a8b3169540c88a6aa4ef2afda87bfc"
May 20 21:28:40.263327 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:40.263295    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nq4vv" event={"ID":"d8d8d1a1-2dd0-40c1-ac23-8c1aaa171d2c","Type":"ContainerStarted","Data":"1d42302206b34c9ba6ccbdc00326495718d2df6e9603461e79ee799d3199056a"}
May 20 21:28:40.524315 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:40.524223    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:28:40.526555 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:40.526533    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111d8b7e-7500-480c-99d1-05d2a3b2397f-metrics-certs\") pod \"network-metrics-daemon-mkbw8\" (UID: \"111d8b7e-7500-480c-99d1-05d2a3b2397f\") " pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:28:40.631563 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:40.631529    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-54hkt\""
May 20 21:28:40.639342 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:40.639317    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkbw8"
May 20 21:28:40.765028 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:40.764974    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkbw8"]
May 20 21:28:40.768322 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:28:40.768294    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111d8b7e_7500_480c_99d1_05d2a3b2397f.slice/crio-6c7cf29399c3d622d5d7da2f9c3b90510c282ec17253fef2dbd121f6cfde019d WatchSource:0}: Error finding container 6c7cf29399c3d622d5d7da2f9c3b90510c282ec17253fef2dbd121f6cfde019d: Status 404 returned error can't find the container with id 6c7cf29399c3d622d5d7da2f9c3b90510c282ec17253fef2dbd121f6cfde019d
May 20 21:28:41.267196 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:41.267159    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkbw8" event={"ID":"111d8b7e-7500-480c-99d1-05d2a3b2397f","Type":"ContainerStarted","Data":"6c7cf29399c3d622d5d7da2f9c3b90510c282ec17253fef2dbd121f6cfde019d"}
May 20 21:28:42.270818 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:42.270720    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkbw8" event={"ID":"111d8b7e-7500-480c-99d1-05d2a3b2397f","Type":"ContainerStarted","Data":"27573da7a13a1e8afdd4dd6720cc2fc907e4a026454029ab3de703fddabd9e40"}
May 20 21:28:42.270818 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:42.270764    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkbw8" event={"ID":"111d8b7e-7500-480c-99d1-05d2a3b2397f","Type":"ContainerStarted","Data":"d1e3f49bec4e7fba6e6c6c7d6423dd40a73abb619e0b843ef6447a567bb6a540"}
May 20 21:28:42.289066 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:42.289015    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mkbw8" podStartSLOduration=129.052836791 podStartE2EDuration="2m10.289003016s" podCreationTimestamp="2026-05-20 21:26:32 +0000 UTC" firstStartedPulling="2026-05-20 21:28:40.770140683 +0000 UTC m=+129.666738314" lastFinishedPulling="2026-05-20 21:28:42.006306908 +0000 UTC m=+130.902904539" observedRunningTime="2026-05-20 21:28:42.287114811 +0000 UTC m=+131.183712465" watchObservedRunningTime="2026-05-20 21:28:42.289003016 +0000 UTC m=+131.185600665"
May 20 21:28:44.277708 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:44.277611    2560 generic.go:358] "Generic (PLEG): container finished" podID="e13267c2-b86f-44b8-817a-8f7dd6ef7c0b" containerID="01688eddd23f44bc920805338c28e0a1efcbd09a46280146640eba3215a1919d" exitCode=0
May 20 21:28:44.277708 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:44.277683    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs" event={"ID":"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b","Type":"ContainerDied","Data":"01688eddd23f44bc920805338c28e0a1efcbd09a46280146640eba3215a1919d"}
May 20 21:28:44.278132 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:44.278004    2560 scope.go:117] "RemoveContainer" containerID="01688eddd23f44bc920805338c28e0a1efcbd09a46280146640eba3215a1919d"
May 20 21:28:45.284524 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:45.284493    2560 generic.go:358] "Generic (PLEG): container finished" podID="ee1dd742-0bc4-4e11-a40c-4576f60fd557" containerID="8fd9cedd6187a7fe262c50981f88ec4c1c5dd929535f9cbad4db03cc8049b9dd" exitCode=0
May 20 21:28:45.284923 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:45.284567    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-87qw4" event={"ID":"ee1dd742-0bc4-4e11-a40c-4576f60fd557","Type":"ContainerDied","Data":"8fd9cedd6187a7fe262c50981f88ec4c1c5dd929535f9cbad4db03cc8049b9dd"}
May 20 21:28:45.285036 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:45.285008    2560 scope.go:117] "RemoveContainer" containerID="8fd9cedd6187a7fe262c50981f88ec4c1c5dd929535f9cbad4db03cc8049b9dd"
May 20 21:28:45.286264 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:45.286244    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c6zxs" event={"ID":"e13267c2-b86f-44b8-817a-8f7dd6ef7c0b","Type":"ContainerStarted","Data":"40ca6398aedc1e2e59933f749bbf198d87d8092811980b1711751f01ba40e46d"}
May 20 21:28:46.291261 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:46.291227    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-87qw4" event={"ID":"ee1dd742-0bc4-4e11-a40c-4576f60fd557","Type":"ContainerStarted","Data":"27911b13c48e96bf495096bcaf23d0be71127f7de67a2997de4976e38138a352"}
May 20 21:28:46.564616 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:46.564526    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" podUID="2e705b79-0930-4f62-ba03-93438908d54a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 21:28:56.565135 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:56.565095    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" podUID="2e705b79-0930-4f62-ba03-93438908d54a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 21:28:56.565585 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:56.565175    2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq"
May 20 21:28:56.565700 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:56.565669    2560 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5f9949c755743829145d4fa6b3f1e20c966eab9929cd288db6ab75272e07b616"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 20 21:28:56.565740 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:56.565721    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" podUID="2e705b79-0930-4f62-ba03-93438908d54a" containerName="service-proxy" containerID="cri-o://5f9949c755743829145d4fa6b3f1e20c966eab9929cd288db6ab75272e07b616" gracePeriod=30
May 20 21:28:57.323730 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:57.323696    2560 generic.go:358] "Generic (PLEG): container finished" podID="2e705b79-0930-4f62-ba03-93438908d54a" containerID="5f9949c755743829145d4fa6b3f1e20c966eab9929cd288db6ab75272e07b616" exitCode=2
May 20 21:28:57.323897 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:57.323731    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" event={"ID":"2e705b79-0930-4f62-ba03-93438908d54a","Type":"ContainerDied","Data":"5f9949c755743829145d4fa6b3f1e20c966eab9929cd288db6ab75272e07b616"}
May 20 21:28:57.323897 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:28:57.323778    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6d7544fc-p88tq" event={"ID":"2e705b79-0930-4f62-ba03-93438908d54a","Type":"ContainerStarted","Data":"e3bb64d4f8b05e1bc6ea17b75f85e5bdbe51186e0e841e90e060e468843e91df"}
May 20 21:31:29.629174 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.629139    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"]
May 20 21:31:29.629609 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.629463    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6094fb48-c154-4bad-8ad8-48df6b851cfa" containerName="registry"
May 20 21:31:29.629609 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.629476    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6094fb48-c154-4bad-8ad8-48df6b851cfa" containerName="registry"
May 20 21:31:29.629609 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.629520    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="6094fb48-c154-4bad-8ad8-48df6b851cfa" containerName="registry"
May 20 21:31:29.635164 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.632822    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.635840 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.635814    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 20 21:31:29.636094 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.636077    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 20 21:31:29.637353 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.637337    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 20 21:31:29.637457 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.637425    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 20 21:31:29.648053 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.648036    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lgmw2\""
May 20 21:31:29.648622 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.648604    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"]
May 20 21:31:29.677619 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.677588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10af6108-f845-4f43-8de6-b925606be1de-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.677746 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.677635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnsvj\" (UniqueName: \"kubernetes.io/projected/10af6108-f845-4f43-8de6-b925606be1de-kube-api-access-wnsvj\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.677746 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.677655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10af6108-f845-4f43-8de6-b925606be1de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.779081 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.779049    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10af6108-f845-4f43-8de6-b925606be1de-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.779261 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.779096    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnsvj\" (UniqueName: \"kubernetes.io/projected/10af6108-f845-4f43-8de6-b925606be1de-kube-api-access-wnsvj\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.779261 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.779149    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10af6108-f845-4f43-8de6-b925606be1de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.781586 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.781560    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10af6108-f845-4f43-8de6-b925606be1de-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.781687 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.781598    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10af6108-f845-4f43-8de6-b925606be1de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.793520 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.793489    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnsvj\" (UniqueName: \"kubernetes.io/projected/10af6108-f845-4f43-8de6-b925606be1de-kube-api-access-wnsvj\") pod \"opendatahub-operator-controller-manager-5b9dbd78dd-khqsm\" (UID: \"10af6108-f845-4f43-8de6-b925606be1de\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:29.943657 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:29.943618    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:30.080806 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:30.080617    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"]
May 20 21:31:30.083695 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:31:30.083669    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10af6108_f845_4f43_8de6_b925606be1de.slice/crio-51afd9c355f7c23a40d493b08a421e605990884bb24bda68325af7390d4b7941 WatchSource:0}: Error finding container 51afd9c355f7c23a40d493b08a421e605990884bb24bda68325af7390d4b7941: Status 404 returned error can't find the container with id 51afd9c355f7c23a40d493b08a421e605990884bb24bda68325af7390d4b7941
May 20 21:31:30.756496 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:30.756457    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm" event={"ID":"10af6108-f845-4f43-8de6-b925606be1de","Type":"ContainerStarted","Data":"51afd9c355f7c23a40d493b08a421e605990884bb24bda68325af7390d4b7941"}
May 20 21:31:32.524671 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:32.524647    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:31:32.526341 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:32.524645    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:31:32.533332 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:32.533310    2560 kubelet.go:1628] "Image garbage collection succeeded"
May 20 21:31:32.765282 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:32.765241    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm" event={"ID":"10af6108-f845-4f43-8de6-b925606be1de","Type":"ContainerStarted","Data":"55e5c06e0437f39d1120c9524d4419e04bae3b25d22522610d55c009788f03db"}
May 20 21:31:32.765472 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:32.765356    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:32.806234 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:32.806129    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm" podStartSLOduration=1.3324332700000001 podStartE2EDuration="3.806114956s" podCreationTimestamp="2026-05-20 21:31:29 +0000 UTC" firstStartedPulling="2026-05-20 21:31:30.085340402 +0000 UTC m=+298.981938033" lastFinishedPulling="2026-05-20 21:31:32.559022085 +0000 UTC m=+301.455619719" observedRunningTime="2026-05-20 21:31:32.802973637 +0000 UTC m=+301.699571290" watchObservedRunningTime="2026-05-20 21:31:32.806114956 +0000 UTC m=+301.702712609"
May 20 21:31:43.771132 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:43.771097    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b9dbd78dd-khqsm"
May 20 21:31:48.078232 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.078197    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"]
May 20 21:31:48.081513 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.081491    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.088000 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.084856    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 20 21:31:48.088000 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.084932    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 20 21:31:48.088000 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.084857    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sl6sn\""
May 20 21:31:48.089717 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.089073    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"]
May 20 21:31:48.237540 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.237507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44jrp\" (UniqueName: \"kubernetes.io/projected/a5ea434b-0cde-4456-ba2d-81244755c6e9-kube-api-access-44jrp\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.237710 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.237563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5ea434b-0cde-4456-ba2d-81244755c6e9-tmp\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.237710 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.237581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ea434b-0cde-4456-ba2d-81244755c6e9-tls-certs\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.338737 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.338659    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44jrp\" (UniqueName: \"kubernetes.io/projected/a5ea434b-0cde-4456-ba2d-81244755c6e9-kube-api-access-44jrp\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.338737 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.338725    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5ea434b-0cde-4456-ba2d-81244755c6e9-tmp\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.338907 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.338747    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ea434b-0cde-4456-ba2d-81244755c6e9-tls-certs\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.341049 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.341019    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5ea434b-0cde-4456-ba2d-81244755c6e9-tmp\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.341166 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.341144    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ea434b-0cde-4456-ba2d-81244755c6e9-tls-certs\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.347860 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.347838    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44jrp\" (UniqueName: \"kubernetes.io/projected/a5ea434b-0cde-4456-ba2d-81244755c6e9-kube-api-access-44jrp\") pod \"kube-auth-proxy-5ddb78cf8b-m7wb4\" (UID: \"a5ea434b-0cde-4456-ba2d-81244755c6e9\") " pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.397515 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.397474    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"
May 20 21:31:48.527854 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.527782    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4"]
May 20 21:31:48.530546 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:31:48.530517    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ea434b_0cde_4456_ba2d_81244755c6e9.slice/crio-5c13ff6022a33cc1da2caaf903761f1772e94ac037e25f01842356b329a1aafa WatchSource:0}: Error finding container 5c13ff6022a33cc1da2caaf903761f1772e94ac037e25f01842356b329a1aafa: Status 404 returned error can't find the container with id 5c13ff6022a33cc1da2caaf903761f1772e94ac037e25f01842356b329a1aafa
May 20 21:31:48.532424 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.532408    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:31:48.812777 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:48.812744    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4" event={"ID":"a5ea434b-0cde-4456-ba2d-81244755c6e9","Type":"ContainerStarted","Data":"5c13ff6022a33cc1da2caaf903761f1772e94ac037e25f01842356b329a1aafa"}
May 20 21:31:50.929758 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:50.929723    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-ckttf"]
May 20 21:31:50.933333 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:50.933307    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:50.935452 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:50.935428    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 20 21:31:50.935614 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:50.935430    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5wkl4\""
May 20 21:31:50.941545 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:50.941495    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-ckttf"]
May 20 21:31:51.064460 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.064421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzzd5\" (UniqueName: \"kubernetes.io/projected/177446a5-519d-4985-996f-8aaa3123ef6f-kube-api-access-vzzd5\") pod \"odh-model-controller-858dbf95b8-ckttf\" (UID: \"177446a5-519d-4985-996f-8aaa3123ef6f\") " pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.064632 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.064553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177446a5-519d-4985-996f-8aaa3123ef6f-cert\") pod \"odh-model-controller-858dbf95b8-ckttf\" (UID: \"177446a5-519d-4985-996f-8aaa3123ef6f\") " pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.165801 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.165759    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177446a5-519d-4985-996f-8aaa3123ef6f-cert\") pod \"odh-model-controller-858dbf95b8-ckttf\" (UID: \"177446a5-519d-4985-996f-8aaa3123ef6f\") " pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.166014 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.165860    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzzd5\" (UniqueName: \"kubernetes.io/projected/177446a5-519d-4985-996f-8aaa3123ef6f-kube-api-access-vzzd5\") pod \"odh-model-controller-858dbf95b8-ckttf\" (UID: \"177446a5-519d-4985-996f-8aaa3123ef6f\") " pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.166014 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:31:51.165935    2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 20 21:31:51.166140 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:31:51.166035    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/177446a5-519d-4985-996f-8aaa3123ef6f-cert podName:177446a5-519d-4985-996f-8aaa3123ef6f nodeName:}" failed. No retries permitted until 2026-05-20 21:31:51.666018265 +0000 UTC m=+320.562615896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/177446a5-519d-4985-996f-8aaa3123ef6f-cert") pod "odh-model-controller-858dbf95b8-ckttf" (UID: "177446a5-519d-4985-996f-8aaa3123ef6f") : secret "odh-model-controller-webhook-cert" not found
May 20 21:31:51.174802 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.174771    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzzd5\" (UniqueName: \"kubernetes.io/projected/177446a5-519d-4985-996f-8aaa3123ef6f-kube-api-access-vzzd5\") pod \"odh-model-controller-858dbf95b8-ckttf\" (UID: \"177446a5-519d-4985-996f-8aaa3123ef6f\") " pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.669952 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.669918    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177446a5-519d-4985-996f-8aaa3123ef6f-cert\") pod \"odh-model-controller-858dbf95b8-ckttf\" (UID: \"177446a5-519d-4985-996f-8aaa3123ef6f\") " pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.672208 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.672184    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177446a5-519d-4985-996f-8aaa3123ef6f-cert\") pod \"odh-model-controller-858dbf95b8-ckttf\" (UID: \"177446a5-519d-4985-996f-8aaa3123ef6f\") " pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.827358 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.827310    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4" event={"ID":"a5ea434b-0cde-4456-ba2d-81244755c6e9","Type":"ContainerStarted","Data":"63d8247916ca7b9bc76a17f398b91a482a6b60d4399c1c0bbb221d1902ea5c4d"}
May 20 21:31:51.846441 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.846416    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:31:51.863307 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.863251    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5ddb78cf8b-m7wb4" podStartSLOduration=0.791720216 podStartE2EDuration="3.863231067s" podCreationTimestamp="2026-05-20 21:31:48 +0000 UTC" firstStartedPulling="2026-05-20 21:31:48.532534908 +0000 UTC m=+317.429132550" lastFinishedPulling="2026-05-20 21:31:51.604045758 +0000 UTC m=+320.500643401" observedRunningTime="2026-05-20 21:31:51.861013629 +0000 UTC m=+320.757611272" watchObservedRunningTime="2026-05-20 21:31:51.863231067 +0000 UTC m=+320.759828722"
May 20 21:31:51.974375 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:51.974334    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-ckttf"]
May 20 21:31:51.977420 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:31:51.977395    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177446a5_519d_4985_996f_8aaa3123ef6f.slice/crio-2f40fe4449ea8a4e5eb8d84a282e6daac24a64b66a393245c0e144a0e2b5ca2e WatchSource:0}: Error finding container 2f40fe4449ea8a4e5eb8d84a282e6daac24a64b66a393245c0e144a0e2b5ca2e: Status 404 returned error can't find the container with id 2f40fe4449ea8a4e5eb8d84a282e6daac24a64b66a393245c0e144a0e2b5ca2e
May 20 21:31:52.833709 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:52.833670    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" event={"ID":"177446a5-519d-4985-996f-8aaa3123ef6f","Type":"ContainerStarted","Data":"2f40fe4449ea8a4e5eb8d84a282e6daac24a64b66a393245c0e144a0e2b5ca2e"}
May 20 21:31:55.846829 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:55.846789    2560 generic.go:358] "Generic (PLEG): container finished" podID="177446a5-519d-4985-996f-8aaa3123ef6f" containerID="f2ab0d9640f6f3175fbb42f4bd286bfc4af5e2269df914e72d7218a908595329" exitCode=1
May 20 21:31:55.847305 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:55.846871    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" event={"ID":"177446a5-519d-4985-996f-8aaa3123ef6f","Type":"ContainerDied","Data":"f2ab0d9640f6f3175fbb42f4bd286bfc4af5e2269df914e72d7218a908595329"}
May 20 21:31:55.847305 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:55.847095    2560 scope.go:117] "RemoveContainer" containerID="f2ab0d9640f6f3175fbb42f4bd286bfc4af5e2269df914e72d7218a908595329"
May 20 21:31:56.835543 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.835506    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rcdcp"]
May 20 21:31:56.838594 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.838576    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:56.841724 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.841702    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zdb5t\""
May 20 21:31:56.842065 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.842048    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 20 21:31:56.851591 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.851566    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rcdcp"]
May 20 21:31:56.853232 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.853208    2560 generic.go:358] "Generic (PLEG): container finished" podID="177446a5-519d-4985-996f-8aaa3123ef6f" containerID="06e806bf767ed959f56ac7085223581381d697af31258c754c36a7a6e8905af8" exitCode=1
May 20 21:31:56.853386 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.853297    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" event={"ID":"177446a5-519d-4985-996f-8aaa3123ef6f","Type":"ContainerDied","Data":"06e806bf767ed959f56ac7085223581381d697af31258c754c36a7a6e8905af8"}
May 20 21:31:56.853521 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.853509    2560 scope.go:117] "RemoveContainer" containerID="f2ab0d9640f6f3175fbb42f4bd286bfc4af5e2269df914e72d7218a908595329"
May 20 21:31:56.853681 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:56.853656    2560 scope.go:117] "RemoveContainer" containerID="06e806bf767ed959f56ac7085223581381d697af31258c754c36a7a6e8905af8"
May 20 21:31:56.853925 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:31:56.853906    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-ckttf_opendatahub(177446a5-519d-4985-996f-8aaa3123ef6f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" podUID="177446a5-519d-4985-996f-8aaa3123ef6f"
May 20 21:31:57.021114 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.021077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-cert\") pod \"kserve-controller-manager-856948b99f-rcdcp\" (UID: \"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7\") " pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.021289 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.021126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djrhv\" (UniqueName: \"kubernetes.io/projected/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-kube-api-access-djrhv\") pod \"kserve-controller-manager-856948b99f-rcdcp\" (UID: \"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7\") " pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.122701 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.122613    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-cert\") pod \"kserve-controller-manager-856948b99f-rcdcp\" (UID: \"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7\") " pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.122701 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.122659    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djrhv\" (UniqueName: \"kubernetes.io/projected/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-kube-api-access-djrhv\") pod \"kserve-controller-manager-856948b99f-rcdcp\" (UID: \"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7\") " pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.122881 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:31:57.122767    2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 20 21:31:57.122881 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:31:57.122827    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-cert podName:0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7 nodeName:}" failed. No retries permitted until 2026-05-20 21:31:57.622809996 +0000 UTC m=+326.519407636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-cert") pod "kserve-controller-manager-856948b99f-rcdcp" (UID: "0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7") : secret "kserve-webhook-server-cert" not found
May 20 21:31:57.134938 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.134905    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djrhv\" (UniqueName: \"kubernetes.io/projected/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-kube-api-access-djrhv\") pod \"kserve-controller-manager-856948b99f-rcdcp\" (UID: \"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7\") " pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.627443 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.627410    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-cert\") pod \"kserve-controller-manager-856948b99f-rcdcp\" (UID: \"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7\") " pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.629877 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.629844    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7-cert\") pod \"kserve-controller-manager-856948b99f-rcdcp\" (UID: \"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7\") " pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.748879 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.748834    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:31:57.867486 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.867457    2560 scope.go:117] "RemoveContainer" containerID="06e806bf767ed959f56ac7085223581381d697af31258c754c36a7a6e8905af8"
May 20 21:31:57.867835 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:31:57.867682    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-ckttf_opendatahub(177446a5-519d-4985-996f-8aaa3123ef6f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" podUID="177446a5-519d-4985-996f-8aaa3123ef6f"
May 20 21:31:57.910082 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:57.910053    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rcdcp"]
May 20 21:31:57.912047 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:31:57.912021    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1ffbe5_3b6f_4448_9e98_db46c23f9ba7.slice/crio-ce3079ed5d2d74be8cb950fcf31f3103be1843697d89c51d470fbfac697604cd WatchSource:0}: Error finding container ce3079ed5d2d74be8cb950fcf31f3103be1843697d89c51d470fbfac697604cd: Status 404 returned error can't find the container with id ce3079ed5d2d74be8cb950fcf31f3103be1843697d89c51d470fbfac697604cd
May 20 21:31:58.871837 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:31:58.871797    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp" event={"ID":"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7","Type":"ContainerStarted","Data":"ce3079ed5d2d74be8cb950fcf31f3103be1843697d89c51d470fbfac697604cd"}
May 20 21:32:01.847064 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:01.847024    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:32:01.847461 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:01.847428    2560 scope.go:117] "RemoveContainer" containerID="06e806bf767ed959f56ac7085223581381d697af31258c754c36a7a6e8905af8"
May 20 21:32:01.847631 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:32:01.847610    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-ckttf_opendatahub(177446a5-519d-4985-996f-8aaa3123ef6f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" podUID="177446a5-519d-4985-996f-8aaa3123ef6f"
May 20 21:32:01.883032 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:01.882977    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp" event={"ID":"0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7","Type":"ContainerStarted","Data":"1fee55946f206d6b4059a7aeb20165940e655b6c80c9e1041f40fefcf24ad409"}
May 20 21:32:01.883202 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:01.883071    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:32:01.905868 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:01.905811    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp" podStartSLOduration=2.520392631 podStartE2EDuration="5.90579616s" podCreationTimestamp="2026-05-20 21:31:56 +0000 UTC" firstStartedPulling="2026-05-20 21:31:57.913565584 +0000 UTC m=+326.810163223" lastFinishedPulling="2026-05-20 21:32:01.298969121 +0000 UTC m=+330.195566752" observedRunningTime="2026-05-20 21:32:01.904037807 +0000 UTC m=+330.800635461" watchObservedRunningTime="2026-05-20 21:32:01.90579616 +0000 UTC m=+330.802393812"
May 20 21:32:02.097221 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.097149    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"]
May 20 21:32:02.100372 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.100356    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.103539 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.103515    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 20 21:32:02.103717 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.103698    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-nsgcf\""
May 20 21:32:02.104054 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.104036    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 20 21:32:02.121443 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.121415    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"]
May 20 21:32:02.158254 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.158223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/34f86d0c-f00a-446d-8684-0556cc23d947-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tqtwg\" (UID: \"34f86d0c-f00a-446d-8684-0556cc23d947\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.158254 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.158268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbv2\" (UniqueName: \"kubernetes.io/projected/34f86d0c-f00a-446d-8684-0556cc23d947-kube-api-access-bjbv2\") pod \"servicemesh-operator3-55f49c5f94-tqtwg\" (UID: \"34f86d0c-f00a-446d-8684-0556cc23d947\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.259443 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.259394    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/34f86d0c-f00a-446d-8684-0556cc23d947-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tqtwg\" (UID: \"34f86d0c-f00a-446d-8684-0556cc23d947\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.259635 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.259561    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbv2\" (UniqueName: \"kubernetes.io/projected/34f86d0c-f00a-446d-8684-0556cc23d947-kube-api-access-bjbv2\") pod \"servicemesh-operator3-55f49c5f94-tqtwg\" (UID: \"34f86d0c-f00a-446d-8684-0556cc23d947\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.262033 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.262012    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/34f86d0c-f00a-446d-8684-0556cc23d947-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tqtwg\" (UID: \"34f86d0c-f00a-446d-8684-0556cc23d947\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.269907 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.269881    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbv2\" (UniqueName: \"kubernetes.io/projected/34f86d0c-f00a-446d-8684-0556cc23d947-kube-api-access-bjbv2\") pod \"servicemesh-operator3-55f49c5f94-tqtwg\" (UID: \"34f86d0c-f00a-446d-8684-0556cc23d947\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.410050 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.410013    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:02.571096 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.571065    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"]
May 20 21:32:02.573588 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:32:02.573558    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f86d0c_f00a_446d_8684_0556cc23d947.slice/crio-962976e547e22f45c4ba78fa524a996dcfe9a9fa174eefc8b2e034454b81e4d8 WatchSource:0}: Error finding container 962976e547e22f45c4ba78fa524a996dcfe9a9fa174eefc8b2e034454b81e4d8: Status 404 returned error can't find the container with id 962976e547e22f45c4ba78fa524a996dcfe9a9fa174eefc8b2e034454b81e4d8
May 20 21:32:02.887428 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:02.887342    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg" event={"ID":"34f86d0c-f00a-446d-8684-0556cc23d947","Type":"ContainerStarted","Data":"962976e547e22f45c4ba78fa524a996dcfe9a9fa174eefc8b2e034454b81e4d8"}
May 20 21:32:05.899408 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:05.899366    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg" event={"ID":"34f86d0c-f00a-446d-8684-0556cc23d947","Type":"ContainerStarted","Data":"25a8f71ad3bee75b401bc2590f41e9d388f12a1a0f170496c74133d8b177a31c"}
May 20 21:32:05.899799 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:05.899506    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:05.939379 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:05.939304    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg" podStartSLOduration=1.2029582109999999 podStartE2EDuration="3.939284075s" podCreationTimestamp="2026-05-20 21:32:02 +0000 UTC" firstStartedPulling="2026-05-20 21:32:02.576198567 +0000 UTC m=+331.472796199" lastFinishedPulling="2026-05-20 21:32:05.312524432 +0000 UTC m=+334.209122063" observedRunningTime="2026-05-20 21:32:05.937866848 +0000 UTC m=+334.834464514" watchObservedRunningTime="2026-05-20 21:32:05.939284075 +0000 UTC m=+334.835881725"
May 20 21:32:07.552202 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.552161    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"]
May 20 21:32:07.558322 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.558297    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.560539 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.560515    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 20 21:32:07.560539 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.560517    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 20 21:32:07.560770 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.560755    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vpgg4\""
May 20 21:32:07.560811 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.560767    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 20 21:32:07.560959 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.560947    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 20 21:32:07.571666 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.571639    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"]
May 20 21:32:07.608604 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.608571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d33130-52c2-4397-ad2f-abf23b7c8c00-local-certs\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.608763 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.608608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.608763 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.608648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7tgs\" (UniqueName: \"kubernetes.io/projected/70d33130-52c2-4397-ad2f-abf23b7c8c00-kube-api-access-q7tgs\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.608763 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.608681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.608937 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.608753    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.608937 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.608809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-cacerts\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.608937 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.608857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-token\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.709398 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.709363    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7tgs\" (UniqueName: \"kubernetes.io/projected/70d33130-52c2-4397-ad2f-abf23b7c8c00-kube-api-access-q7tgs\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.709595 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.709412    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.709595 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.709575    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.709719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.709614    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-cacerts\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.709719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.709662    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-token\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.709808 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.709754    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d33130-52c2-4397-ad2f-abf23b7c8c00-local-certs\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.709808 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.709785    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.710546 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.710517    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.712115 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.712087    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d33130-52c2-4397-ad2f-abf23b7c8c00-local-certs\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.712282 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.712261    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.712324 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.712280    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-cacerts\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.712568 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.712553    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.716934 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.716908    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d33130-52c2-4397-ad2f-abf23b7c8c00-istio-token\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.717281 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.717263    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7tgs\" (UniqueName: \"kubernetes.io/projected/70d33130-52c2-4397-ad2f-abf23b7c8c00-kube-api-access-q7tgs\") pod \"istiod-openshift-gateway-798958bb55-btx4k\" (UID: \"70d33130-52c2-4397-ad2f-abf23b7c8c00\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:07.867578 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:07.867479    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:08.016627 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:08.016514    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"]
May 20 21:32:08.018742 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:32:08.018711    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d33130_52c2_4397_ad2f_abf23b7c8c00.slice/crio-de5bdbe1c0fc77891d14eea38293c6dbd0e0e5dafc5ea5eccf071968e689cfc1 WatchSource:0}: Error finding container de5bdbe1c0fc77891d14eea38293c6dbd0e0e5dafc5ea5eccf071968e689cfc1: Status 404 returned error can't find the container with id de5bdbe1c0fc77891d14eea38293c6dbd0e0e5dafc5ea5eccf071968e689cfc1
May 20 21:32:08.911363 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:08.911301    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k" event={"ID":"70d33130-52c2-4397-ad2f-abf23b7c8c00","Type":"ContainerStarted","Data":"de5bdbe1c0fc77891d14eea38293c6dbd0e0e5dafc5ea5eccf071968e689cfc1"}
May 20 21:32:10.666919 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:10.666876    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 21:32:10.667364 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:10.666967    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 21:32:10.919623 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:10.919526    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k" event={"ID":"70d33130-52c2-4397-ad2f-abf23b7c8c00","Type":"ContainerStarted","Data":"9f6bb133b87232ba5e93151fc5c13808fb62a401ae29288e9da5d147823aba53"}
May 20 21:32:10.919791 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:10.919662    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:10.940549 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:10.940463    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k" podStartSLOduration=1.294296468 podStartE2EDuration="3.940444245s" podCreationTimestamp="2026-05-20 21:32:07 +0000 UTC" firstStartedPulling="2026-05-20 21:32:08.0204788 +0000 UTC m=+336.917076432" lastFinishedPulling="2026-05-20 21:32:10.666626578 +0000 UTC m=+339.563224209" observedRunningTime="2026-05-20 21:32:10.939177064 +0000 UTC m=+339.835774728" watchObservedRunningTime="2026-05-20 21:32:10.940444245 +0000 UTC m=+339.837041899"
May 20 21:32:11.846640 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:11.846600    2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:32:11.847124 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:11.847031    2560 scope.go:117] "RemoveContainer" containerID="06e806bf767ed959f56ac7085223581381d697af31258c754c36a7a6e8905af8"
May 20 21:32:11.925852 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:11.925824    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-btx4k"
May 20 21:32:12.929351 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:12.929311    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" event={"ID":"177446a5-519d-4985-996f-8aaa3123ef6f","Type":"ContainerStarted","Data":"1d211fc2ab78338171448e70febf1fa02d68194e954797f792cb6671801203b1"}
May 20 21:32:12.929851 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:12.929542    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:32:12.947405 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:12.947351    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf" podStartSLOduration=2.7709008 podStartE2EDuration="22.947336901s" podCreationTimestamp="2026-05-20 21:31:50 +0000 UTC" firstStartedPulling="2026-05-20 21:31:51.978697971 +0000 UTC m=+320.875295602" lastFinishedPulling="2026-05-20 21:32:12.155134068 +0000 UTC m=+341.051731703" observedRunningTime="2026-05-20 21:32:12.947273308 +0000 UTC m=+341.843870972" watchObservedRunningTime="2026-05-20 21:32:12.947336901 +0000 UTC m=+341.843934548"
May 20 21:32:16.905643 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:16.905614    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tqtwg"
May 20 21:32:23.935204 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:23.935118    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-ckttf"
May 20 21:32:32.892555 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:32:32.892518    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-rcdcp"
May 20 21:33:29.171889 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.171850    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"]
May 20 21:33:29.175199 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.175181    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:29.177635 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.177620    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-56g2v\""
May 20 21:33:29.178297 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.178283    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 21:33:29.179590 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.179572    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 21:33:29.184457 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.184435    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"]
May 20 21:33:29.308649 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.308605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtdvg\" (UniqueName: \"kubernetes.io/projected/1a0ea817-0be7-498f-81c1-c847c80bc7b7-kube-api-access-mtdvg\") pod \"limitador-operator-controller-manager-85c4996f8c-954dz\" (UID: \"1a0ea817-0be7-498f-81c1-c847c80bc7b7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:29.409550 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.409509    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtdvg\" (UniqueName: \"kubernetes.io/projected/1a0ea817-0be7-498f-81c1-c847c80bc7b7-kube-api-access-mtdvg\") pod \"limitador-operator-controller-manager-85c4996f8c-954dz\" (UID: \"1a0ea817-0be7-498f-81c1-c847c80bc7b7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:29.421473 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.421444    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtdvg\" (UniqueName: \"kubernetes.io/projected/1a0ea817-0be7-498f-81c1-c847c80bc7b7-kube-api-access-mtdvg\") pod \"limitador-operator-controller-manager-85c4996f8c-954dz\" (UID: \"1a0ea817-0be7-498f-81c1-c847c80bc7b7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:29.487090 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.487000    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:29.619476 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:29.619434    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"]
May 20 21:33:29.622529 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:33:29.622504    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0ea817_0be7_498f_81c1_c847c80bc7b7.slice/crio-c9b2476ed5dd3cbe461a5c8c7bc2f51883379e69d2310fa1376976ad2e7107c5 WatchSource:0}: Error finding container c9b2476ed5dd3cbe461a5c8c7bc2f51883379e69d2310fa1376976ad2e7107c5: Status 404 returned error can't find the container with id c9b2476ed5dd3cbe461a5c8c7bc2f51883379e69d2310fa1376976ad2e7107c5
May 20 21:33:30.188699 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:30.188668    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" event={"ID":"1a0ea817-0be7-498f-81c1-c847c80bc7b7","Type":"ContainerStarted","Data":"c9b2476ed5dd3cbe461a5c8c7bc2f51883379e69d2310fa1376976ad2e7107c5"}
May 20 21:33:32.196964 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:32.196928    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" event={"ID":"1a0ea817-0be7-498f-81c1-c847c80bc7b7","Type":"ContainerStarted","Data":"19474379da3bc1e96fdf8a04e9a5674f0661f3d19919de2ffb3aa0dd045be034"}
May 20 21:33:32.197362 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:32.197000    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:32.214587 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:32.214531    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" podStartSLOduration=1.173160245 podStartE2EDuration="3.214511013s" podCreationTimestamp="2026-05-20 21:33:29 +0000 UTC" firstStartedPulling="2026-05-20 21:33:29.624363448 +0000 UTC m=+418.520961079" lastFinishedPulling="2026-05-20 21:33:31.665714213 +0000 UTC m=+420.562311847" observedRunningTime="2026-05-20 21:33:32.212031424 +0000 UTC m=+421.108629077" watchObservedRunningTime="2026-05-20 21:33:32.214511013 +0000 UTC m=+421.111108671"
May 20 21:33:43.203926 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:43.203889    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:46.063128 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.063092    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"]
May 20 21:33:46.063605 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.063347    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" containerName="manager" containerID="cri-o://19474379da3bc1e96fdf8a04e9a5674f0661f3d19919de2ffb3aa0dd045be034" gracePeriod=2
May 20 21:33:46.087974 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.087947    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"]
May 20 21:33:46.104524 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.104496    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"]
May 20 21:33:46.104841 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.104827    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" containerName="manager"
May 20 21:33:46.104905 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.104844    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" containerName="manager"
May 20 21:33:46.104905 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.104899    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" containerName="manager"
May 20 21:33:46.108363 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.108345    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"
May 20 21:33:46.125854 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.125830    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"]
May 20 21:33:46.156609 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.156579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tgdh\" (UniqueName: \"kubernetes.io/projected/1e83569f-57c0-4464-b4e5-b0bc3423c7fe-kube-api-access-8tgdh\") pod \"limitador-operator-controller-manager-85c4996f8c-pvcmk\" (UID: \"1e83569f-57c0-4464-b4e5-b0bc3423c7fe\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"
May 20 21:33:46.250912 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.250879    2560 generic.go:358] "Generic (PLEG): container finished" podID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" containerID="19474379da3bc1e96fdf8a04e9a5674f0661f3d19919de2ffb3aa0dd045be034" exitCode=0
May 20 21:33:46.257327 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.257299    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tgdh\" (UniqueName: \"kubernetes.io/projected/1e83569f-57c0-4464-b4e5-b0bc3423c7fe-kube-api-access-8tgdh\") pod \"limitador-operator-controller-manager-85c4996f8c-pvcmk\" (UID: \"1e83569f-57c0-4464-b4e5-b0bc3423c7fe\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"
May 20 21:33:46.271540 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.271514    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tgdh\" (UniqueName: \"kubernetes.io/projected/1e83569f-57c0-4464-b4e5-b0bc3423c7fe-kube-api-access-8tgdh\") pod \"limitador-operator-controller-manager-85c4996f8c-pvcmk\" (UID: \"1e83569f-57c0-4464-b4e5-b0bc3423c7fe\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"
May 20 21:33:46.295067 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.295041    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:46.297062 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.297038    2560 status_manager.go:895] "Failed to get status for pod" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" err="pods \"limitador-operator-controller-manager-85c4996f8c-954dz\" is forbidden: User \"system:node:ip-10-0-141-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-6.ec2.internal' and this object"
May 20 21:33:46.445617 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.445582    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"
May 20 21:33:46.459523 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.459498    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtdvg\" (UniqueName: \"kubernetes.io/projected/1a0ea817-0be7-498f-81c1-c847c80bc7b7-kube-api-access-mtdvg\") pod \"1a0ea817-0be7-498f-81c1-c847c80bc7b7\" (UID: \"1a0ea817-0be7-498f-81c1-c847c80bc7b7\") "
May 20 21:33:46.461558 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.461531    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0ea817-0be7-498f-81c1-c847c80bc7b7-kube-api-access-mtdvg" (OuterVolumeSpecName: "kube-api-access-mtdvg") pod "1a0ea817-0be7-498f-81c1-c847c80bc7b7" (UID: "1a0ea817-0be7-498f-81c1-c847c80bc7b7"). InnerVolumeSpecName "kube-api-access-mtdvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:33:46.560658 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.560624    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtdvg\" (UniqueName: \"kubernetes.io/projected/1a0ea817-0be7-498f-81c1-c847c80bc7b7-kube-api-access-mtdvg\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:33:46.594932 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:33:46.594904    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e83569f_57c0_4464_b4e5_b0bc3423c7fe.slice/crio-77ffe3b445e70dd3ce7daff8ea196daa17b30accd998227ad8b82385440acd18 WatchSource:0}: Error finding container 77ffe3b445e70dd3ce7daff8ea196daa17b30accd998227ad8b82385440acd18: Status 404 returned error can't find the container with id 77ffe3b445e70dd3ce7daff8ea196daa17b30accd998227ad8b82385440acd18
May 20 21:33:46.598750 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:46.598729    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"]
May 20 21:33:47.254744 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.254712    2560 scope.go:117] "RemoveContainer" containerID="19474379da3bc1e96fdf8a04e9a5674f0661f3d19919de2ffb3aa0dd045be034"
May 20 21:33:47.255216 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.254713    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz"
May 20 21:33:47.256184 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.256148    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk" event={"ID":"1e83569f-57c0-4464-b4e5-b0bc3423c7fe","Type":"ContainerStarted","Data":"8f257afd33a47185455dd32fd98ec3a053589a7aa1bd818c31cacaffc0122d2e"}
May 20 21:33:47.256278 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.256184    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk" event={"ID":"1e83569f-57c0-4464-b4e5-b0bc3423c7fe","Type":"ContainerStarted","Data":"77ffe3b445e70dd3ce7daff8ea196daa17b30accd998227ad8b82385440acd18"}
May 20 21:33:47.256335 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.256279    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"
May 20 21:33:47.257094 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.257069    2560 status_manager.go:895] "Failed to get status for pod" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" err="pods \"limitador-operator-controller-manager-85c4996f8c-954dz\" is forbidden: User \"system:node:ip-10-0-141-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-6.ec2.internal' and this object"
May 20 21:33:47.259719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.259698    2560 status_manager.go:895] "Failed to get status for pod" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" err="pods \"limitador-operator-controller-manager-85c4996f8c-954dz\" is forbidden: User \"system:node:ip-10-0-141-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-6.ec2.internal' and this object"
May 20 21:33:47.278866 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.278817    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk" podStartSLOduration=1.278801281 podStartE2EDuration="1.278801281s" podCreationTimestamp="2026-05-20 21:33:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:33:47.277445766 +0000 UTC m=+436.174043419" watchObservedRunningTime="2026-05-20 21:33:47.278801281 +0000 UTC m=+436.175398934"
May 20 21:33:47.279182 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.279159    2560 status_manager.go:895] "Failed to get status for pod" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-954dz" err="pods \"limitador-operator-controller-manager-85c4996f8c-954dz\" is forbidden: User \"system:node:ip-10-0-141-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-6.ec2.internal' and this object"
May 20 21:33:47.698350 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:47.698314    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a0ea817-0be7-498f-81c1-c847c80bc7b7" path="/var/lib/kubelet/pods/1a0ea817-0be7-498f-81c1-c847c80bc7b7/volumes"
May 20 21:33:58.262497 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:33:58.262421    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pvcmk"
May 20 21:34:30.671517 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.671475    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:34:30.674748 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.674721    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:30.677536 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.677518    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rwsng\""
May 20 21:34:30.678068 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.678044    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 20 21:34:30.686608 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.686582    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:34:30.706314 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.706283    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:34:30.819816 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.819785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5a399ba-b00c-4ce1-bf36-dca08261e07c-config-file\") pod \"limitador-limitador-78c99df468-lc8rs\" (UID: \"e5a399ba-b00c-4ce1-bf36-dca08261e07c\") " pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:30.819816 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.819820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4gs7\" (UniqueName: \"kubernetes.io/projected/e5a399ba-b00c-4ce1-bf36-dca08261e07c-kube-api-access-l4gs7\") pod \"limitador-limitador-78c99df468-lc8rs\" (UID: \"e5a399ba-b00c-4ce1-bf36-dca08261e07c\") " pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:30.920533 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.920498    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4gs7\" (UniqueName: \"kubernetes.io/projected/e5a399ba-b00c-4ce1-bf36-dca08261e07c-kube-api-access-l4gs7\") pod \"limitador-limitador-78c99df468-lc8rs\" (UID: \"e5a399ba-b00c-4ce1-bf36-dca08261e07c\") " pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:30.920700 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.920594    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5a399ba-b00c-4ce1-bf36-dca08261e07c-config-file\") pod \"limitador-limitador-78c99df468-lc8rs\" (UID: \"e5a399ba-b00c-4ce1-bf36-dca08261e07c\") " pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:30.921155 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.921136    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5a399ba-b00c-4ce1-bf36-dca08261e07c-config-file\") pod \"limitador-limitador-78c99df468-lc8rs\" (UID: \"e5a399ba-b00c-4ce1-bf36-dca08261e07c\") " pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:30.929525 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.929468    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4gs7\" (UniqueName: \"kubernetes.io/projected/e5a399ba-b00c-4ce1-bf36-dca08261e07c-kube-api-access-l4gs7\") pod \"limitador-limitador-78c99df468-lc8rs\" (UID: \"e5a399ba-b00c-4ce1-bf36-dca08261e07c\") " pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:30.985521 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:30.985488    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:31.116949 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:31.116923    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:34:31.119513 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:34:31.119481    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a399ba_b00c_4ce1_bf36_dca08261e07c.slice/crio-92aaf96290f9021389ca17a93ddca55c3df2c05a27e8ee8b213b7e2bc1ee8580 WatchSource:0}: Error finding container 92aaf96290f9021389ca17a93ddca55c3df2c05a27e8ee8b213b7e2bc1ee8580: Status 404 returned error can't find the container with id 92aaf96290f9021389ca17a93ddca55c3df2c05a27e8ee8b213b7e2bc1ee8580
May 20 21:34:31.399617 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:31.399580    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs" event={"ID":"e5a399ba-b00c-4ce1-bf36-dca08261e07c","Type":"ContainerStarted","Data":"92aaf96290f9021389ca17a93ddca55c3df2c05a27e8ee8b213b7e2bc1ee8580"}
May 20 21:34:34.411719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:34.411675    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs" event={"ID":"e5a399ba-b00c-4ce1-bf36-dca08261e07c","Type":"ContainerStarted","Data":"f722dd07815b4afd2f71e44fda9af1590d241e39704d7a0b865ed71928a29603"}
May 20 21:34:34.412143 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:34.411846    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:34:34.431445 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:34.431395    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs" podStartSLOduration=1.8865059629999998 podStartE2EDuration="4.431380092s" podCreationTimestamp="2026-05-20 21:34:30 +0000 UTC" firstStartedPulling="2026-05-20 21:34:31.121207261 +0000 UTC m=+480.017804895" lastFinishedPulling="2026-05-20 21:34:33.666081388 +0000 UTC m=+482.562679024" observedRunningTime="2026-05-20 21:34:34.42965536 +0000 UTC m=+483.326253014" watchObservedRunningTime="2026-05-20 21:34:34.431380092 +0000 UTC m=+483.327977744"
May 20 21:34:45.416040 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:34:45.416009    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-lc8rs"
May 20 21:36:04.377719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.377677    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5779bdc699-ggsb2"]
May 20 21:36:04.381253 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.381230    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:04.383577 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.383549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6pql\" (UniqueName: \"kubernetes.io/projected/40b8d6aa-0698-4349-8202-c044076dc32d-kube-api-access-x6pql\") pod \"maas-controller-5779bdc699-ggsb2\" (UID: \"40b8d6aa-0698-4349-8202-c044076dc32d\") " pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:04.384212 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.384192    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 20 21:36:04.384336 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.384320    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ptcsq\""
May 20 21:36:04.396945 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.396920    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5779bdc699-ggsb2"]
May 20 21:36:04.484539 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.484500    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6pql\" (UniqueName: \"kubernetes.io/projected/40b8d6aa-0698-4349-8202-c044076dc32d-kube-api-access-x6pql\") pod \"maas-controller-5779bdc699-ggsb2\" (UID: \"40b8d6aa-0698-4349-8202-c044076dc32d\") " pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:04.502859 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.502825    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6pql\" (UniqueName: \"kubernetes.io/projected/40b8d6aa-0698-4349-8202-c044076dc32d-kube-api-access-x6pql\") pod \"maas-controller-5779bdc699-ggsb2\" (UID: \"40b8d6aa-0698-4349-8202-c044076dc32d\") " pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:04.540423 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.540389    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5779bdc699-ggsb2"]
May 20 21:36:04.540666 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.540654    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:04.681435 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.681408    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5779bdc699-ggsb2"]
May 20 21:36:04.683309 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:36:04.683281    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b8d6aa_0698_4349_8202_c044076dc32d.slice/crio-04a2286807d3a2469d5826034896262c554674fd426582626e68ef6be8118c02 WatchSource:0}: Error finding container 04a2286807d3a2469d5826034896262c554674fd426582626e68ef6be8118c02: Status 404 returned error can't find the container with id 04a2286807d3a2469d5826034896262c554674fd426582626e68ef6be8118c02
May 20 21:36:04.712636 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:04.712600    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5779bdc699-ggsb2" event={"ID":"40b8d6aa-0698-4349-8202-c044076dc32d","Type":"ContainerStarted","Data":"04a2286807d3a2469d5826034896262c554674fd426582626e68ef6be8118c02"}
May 20 21:36:07.724157 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:07.724115    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5779bdc699-ggsb2" event={"ID":"40b8d6aa-0698-4349-8202-c044076dc32d","Type":"ContainerStarted","Data":"b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a"}
May 20 21:36:07.724616 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:07.724161    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5779bdc699-ggsb2" podUID="40b8d6aa-0698-4349-8202-c044076dc32d" containerName="manager" containerID="cri-o://b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a" gracePeriod=30
May 20 21:36:07.724616 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:07.724206    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:07.747960 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:07.747904    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5779bdc699-ggsb2" podStartSLOduration=1.360075654 podStartE2EDuration="3.747887776s" podCreationTimestamp="2026-05-20 21:36:04 +0000 UTC" firstStartedPulling="2026-05-20 21:36:04.684547722 +0000 UTC m=+573.581145354" lastFinishedPulling="2026-05-20 21:36:07.072359846 +0000 UTC m=+575.968957476" observedRunningTime="2026-05-20 21:36:07.746122173 +0000 UTC m=+576.642719850" watchObservedRunningTime="2026-05-20 21:36:07.747887776 +0000 UTC m=+576.644485429"
May 20 21:36:07.969210 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:07.969188    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:08.010108 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.010029    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6pql\" (UniqueName: \"kubernetes.io/projected/40b8d6aa-0698-4349-8202-c044076dc32d-kube-api-access-x6pql\") pod \"40b8d6aa-0698-4349-8202-c044076dc32d\" (UID: \"40b8d6aa-0698-4349-8202-c044076dc32d\") "
May 20 21:36:08.012153 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.012130    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b8d6aa-0698-4349-8202-c044076dc32d-kube-api-access-x6pql" (OuterVolumeSpecName: "kube-api-access-x6pql") pod "40b8d6aa-0698-4349-8202-c044076dc32d" (UID: "40b8d6aa-0698-4349-8202-c044076dc32d"). InnerVolumeSpecName "kube-api-access-x6pql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:36:08.111040 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.111009    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6pql\" (UniqueName: \"kubernetes.io/projected/40b8d6aa-0698-4349-8202-c044076dc32d-kube-api-access-x6pql\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:36:08.729203 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.729167    2560 generic.go:358] "Generic (PLEG): container finished" podID="40b8d6aa-0698-4349-8202-c044076dc32d" containerID="b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a" exitCode=0
May 20 21:36:08.729630 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.729232    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5779bdc699-ggsb2"
May 20 21:36:08.729630 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.729240    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5779bdc699-ggsb2" event={"ID":"40b8d6aa-0698-4349-8202-c044076dc32d","Type":"ContainerDied","Data":"b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a"}
May 20 21:36:08.729630 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.729270    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5779bdc699-ggsb2" event={"ID":"40b8d6aa-0698-4349-8202-c044076dc32d","Type":"ContainerDied","Data":"04a2286807d3a2469d5826034896262c554674fd426582626e68ef6be8118c02"}
May 20 21:36:08.729630 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.729290    2560 scope.go:117] "RemoveContainer" containerID="b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a"
May 20 21:36:08.737857 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.737839    2560 scope.go:117] "RemoveContainer" containerID="b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a"
May 20 21:36:08.738161 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:36:08.738142    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a\": container with ID starting with b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a not found: ID does not exist" containerID="b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a"
May 20 21:36:08.738216 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.738166    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a"} err="failed to get container status \"b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a\": rpc error: code = NotFound desc = could not find container \"b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a\": container with ID starting with b67b73134cfde5f8a962b4eeb0c4c625ee236971ccc025ae96ef68002b8fea1a not found: ID does not exist"
May 20 21:36:08.761937 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.761880    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5779bdc699-ggsb2"]
May 20 21:36:08.778395 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:08.778372    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5779bdc699-ggsb2"]
May 20 21:36:09.698579 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:09.698550    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b8d6aa-0698-4349-8202-c044076dc32d" path="/var/lib/kubelet/pods/40b8d6aa-0698-4349-8202-c044076dc32d/volumes"
May 20 21:36:19.252030 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.251995    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c7b4d9f9f-mv8qt"]
May 20 21:36:19.252407 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.252393    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b8d6aa-0698-4349-8202-c044076dc32d" containerName="manager"
May 20 21:36:19.252407 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.252406    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b8d6aa-0698-4349-8202-c044076dc32d" containerName="manager"
May 20 21:36:19.252475 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.252470    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="40b8d6aa-0698-4349-8202-c044076dc32d" containerName="manager"
May 20 21:36:19.256944 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.256923    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:36:19.259276 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.259257    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 20 21:36:19.259452 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.259432    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ptcsq\""
May 20 21:36:19.264197 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.264145    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c7b4d9f9f-mv8qt"]
May 20 21:36:19.295128 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.295099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz5wv\" (UniqueName: \"kubernetes.io/projected/a681ac40-e0c4-494f-ac8d-6829b7b91080-kube-api-access-pz5wv\") pod \"maas-controller-5c7b4d9f9f-mv8qt\" (UID: \"a681ac40-e0c4-494f-ac8d-6829b7b91080\") " pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:36:19.396491 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.396450    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pz5wv\" (UniqueName: \"kubernetes.io/projected/a681ac40-e0c4-494f-ac8d-6829b7b91080-kube-api-access-pz5wv\") pod \"maas-controller-5c7b4d9f9f-mv8qt\" (UID: \"a681ac40-e0c4-494f-ac8d-6829b7b91080\") " pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:36:19.405770 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.405733    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz5wv\" (UniqueName: \"kubernetes.io/projected/a681ac40-e0c4-494f-ac8d-6829b7b91080-kube-api-access-pz5wv\") pod \"maas-controller-5c7b4d9f9f-mv8qt\" (UID: \"a681ac40-e0c4-494f-ac8d-6829b7b91080\") " pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:36:19.568427 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.568339    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:36:19.704037 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.704014    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c7b4d9f9f-mv8qt"]
May 20 21:36:19.706450 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:36:19.706410    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda681ac40_e0c4_494f_ac8d_6829b7b91080.slice/crio-4bfae42721d3797273da8460ceee212eb4840761c6e9ef17df7583e4d3df6e22 WatchSource:0}: Error finding container 4bfae42721d3797273da8460ceee212eb4840761c6e9ef17df7583e4d3df6e22: Status 404 returned error can't find the container with id 4bfae42721d3797273da8460ceee212eb4840761c6e9ef17df7583e4d3df6e22
May 20 21:36:19.770643 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:19.770600    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt" event={"ID":"a681ac40-e0c4-494f-ac8d-6829b7b91080","Type":"ContainerStarted","Data":"4bfae42721d3797273da8460ceee212eb4840761c6e9ef17df7583e4d3df6e22"}
May 20 21:36:20.775311 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:20.775272    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt" event={"ID":"a681ac40-e0c4-494f-ac8d-6829b7b91080","Type":"ContainerStarted","Data":"27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971"}
May 20 21:36:20.775687 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:20.775385    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:36:20.792200 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:20.792148    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt" podStartSLOduration=1.421779827 podStartE2EDuration="1.792134956s" podCreationTimestamp="2026-05-20 21:36:19 +0000 UTC" firstStartedPulling="2026-05-20 21:36:19.707746927 +0000 UTC m=+588.604344560" lastFinishedPulling="2026-05-20 21:36:20.078102055 +0000 UTC m=+588.974699689" observedRunningTime="2026-05-20 21:36:20.790824804 +0000 UTC m=+589.687422458" watchObservedRunningTime="2026-05-20 21:36:20.792134956 +0000 UTC m=+589.688732653"
May 20 21:36:31.788732 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:31.788701    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:36:32.547631 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:32.547511    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:36:32.573439 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:32.547780    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:36:54.599789 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.599710    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-kfxft"]
May 20 21:36:54.602895 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.602879    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft"
May 20 21:36:54.606095 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.606073    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-925w7\""
May 20 21:36:54.606405 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.606387    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 20 21:36:54.624267 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.624243    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-kfxft"]
May 20 21:36:54.699390 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.699361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrllb\" (UniqueName: \"kubernetes.io/projected/0b2dd769-f94e-4f1c-8641-546e7cb1dfc1-kube-api-access-lrllb\") pod \"payload-processing-58b6c8fdc7-kfxft\" (UID: \"0b2dd769-f94e-4f1c-8641-546e7cb1dfc1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft"
May 20 21:36:54.800617 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.800579    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrllb\" (UniqueName: \"kubernetes.io/projected/0b2dd769-f94e-4f1c-8641-546e7cb1dfc1-kube-api-access-lrllb\") pod \"payload-processing-58b6c8fdc7-kfxft\" (UID: \"0b2dd769-f94e-4f1c-8641-546e7cb1dfc1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft"
May 20 21:36:54.819070 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.819039    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrllb\" (UniqueName: \"kubernetes.io/projected/0b2dd769-f94e-4f1c-8641-546e7cb1dfc1-kube-api-access-lrllb\") pod \"payload-processing-58b6c8fdc7-kfxft\" (UID: \"0b2dd769-f94e-4f1c-8641-546e7cb1dfc1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft"
May 20 21:36:54.910781 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.910745    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:36:54.912254 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:54.912227    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft"
May 20 21:36:55.099337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:55.099302    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-kfxft"]
May 20 21:36:55.103172 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:36:55.103141    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2dd769_f94e_4f1c_8641_546e7cb1dfc1.slice/crio-c938bb6da04df4ea6261614fba769960e35f54a6b8137967fe2f8bb07b39002c WatchSource:0}: Error finding container c938bb6da04df4ea6261614fba769960e35f54a6b8137967fe2f8bb07b39002c: Status 404 returned error can't find the container with id c938bb6da04df4ea6261614fba769960e35f54a6b8137967fe2f8bb07b39002c
May 20 21:36:55.104897 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:55.104878    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:36:55.904667 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:55.904630    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft" event={"ID":"0b2dd769-f94e-4f1c-8641-546e7cb1dfc1","Type":"ContainerStarted","Data":"c938bb6da04df4ea6261614fba769960e35f54a6b8137967fe2f8bb07b39002c"}
May 20 21:36:56.909684 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:56.909650    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft" event={"ID":"0b2dd769-f94e-4f1c-8641-546e7cb1dfc1","Type":"ContainerStarted","Data":"ccd085dc4c6706b978cb219f9c74aba71dd69a5656515aa7df2ced494dce51bf"}
May 20 21:36:56.910178 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:56.909764    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft"
May 20 21:36:56.937809 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:36:56.937763    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft" podStartSLOduration=1.477364705 podStartE2EDuration="2.937750704s" podCreationTimestamp="2026-05-20 21:36:54 +0000 UTC" firstStartedPulling="2026-05-20 21:36:55.105061623 +0000 UTC m=+624.001659254" lastFinishedPulling="2026-05-20 21:36:56.565447622 +0000 UTC m=+625.462045253" observedRunningTime="2026-05-20 21:36:56.936150533 +0000 UTC m=+625.832748187" watchObservedRunningTime="2026-05-20 21:36:56.937750704 +0000 UTC m=+625.834348356"
May 20 21:37:07.916311 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:37:07.916280    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-kfxft"
May 20 21:37:55.026307 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:37:55.026272    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:38:00.520689 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:00.520655    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:38:07.528417 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.528380    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"]
May 20 21:38:07.532055 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.532032    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.534547 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.534522    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 20 21:38:07.535423 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.535403    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l6c64\""
May 20 21:38:07.535526 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.535440    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 20 21:38:07.535526 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.535467    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 20 21:38:07.542530 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.542508    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"]
May 20 21:38:07.631729 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.631690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.631911 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.631739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttl62\" (UniqueName: \"kubernetes.io/projected/b93b80f8-48d0-4c9b-be5c-83a10103e36c-kube-api-access-ttl62\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.631911 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.631832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.631911 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.631856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b93b80f8-48d0-4c9b-be5c-83a10103e36c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.631911 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.631886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.632116 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.631922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733233 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733203    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733413 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733256    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733413 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733283    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttl62\" (UniqueName: \"kubernetes.io/projected/b93b80f8-48d0-4c9b-be5c-83a10103e36c-kube-api-access-ttl62\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733413 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733323    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733413 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733342    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b93b80f8-48d0-4c9b-be5c-83a10103e36c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733413 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733374    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733730 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733707    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733784 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733740    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.733958 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.733943    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.735616 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.735595    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b93b80f8-48d0-4c9b-be5c-83a10103e36c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.735781 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.735763    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b93b80f8-48d0-4c9b-be5c-83a10103e36c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.742037 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.742014    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttl62\" (UniqueName: \"kubernetes.io/projected/b93b80f8-48d0-4c9b-be5c-83a10103e36c-kube-api-access-ttl62\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np\" (UID: \"b93b80f8-48d0-4c9b-be5c-83a10103e36c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:07.843202 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:07.843119    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:08.004228 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:38:08.004188    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93b80f8_48d0_4c9b_be5c_83a10103e36c.slice/crio-46e671e94f05809ff842012c28ef70ae912cf402ae7bde6efe3cc0e5d2a37f85 WatchSource:0}: Error finding container 46e671e94f05809ff842012c28ef70ae912cf402ae7bde6efe3cc0e5d2a37f85: Status 404 returned error can't find the container with id 46e671e94f05809ff842012c28ef70ae912cf402ae7bde6efe3cc0e5d2a37f85
May 20 21:38:08.006212 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:08.006189    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"]
May 20 21:38:08.148553 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:08.148521    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np" event={"ID":"b93b80f8-48d0-4c9b-be5c-83a10103e36c","Type":"ContainerStarted","Data":"46e671e94f05809ff842012c28ef70ae912cf402ae7bde6efe3cc0e5d2a37f85"}
May 20 21:38:08.424263 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:08.424188    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:38:14.172902 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:14.172857    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np" event={"ID":"b93b80f8-48d0-4c9b-be5c-83a10103e36c","Type":"ContainerStarted","Data":"9c98e9f0a467a658de51440a839b65b6bcf3e80057a85946fc0d9bffa53a0dad"}
May 20 21:38:19.190821 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:19.190788    2560 generic.go:358] "Generic (PLEG): container finished" podID="b93b80f8-48d0-4c9b-be5c-83a10103e36c" containerID="9c98e9f0a467a658de51440a839b65b6bcf3e80057a85946fc0d9bffa53a0dad" exitCode=0
May 20 21:38:19.191311 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:19.190866    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np" event={"ID":"b93b80f8-48d0-4c9b-be5c-83a10103e36c","Type":"ContainerDied","Data":"9c98e9f0a467a658de51440a839b65b6bcf3e80057a85946fc0d9bffa53a0dad"}
May 20 21:38:19.849613 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:19.849574    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:38:21.202602 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:21.202516    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np" event={"ID":"b93b80f8-48d0-4c9b-be5c-83a10103e36c","Type":"ContainerStarted","Data":"3d7f10658c55bc5848f29838621433bfae34d7ed12ff865f04a8231ae0481338"}
May 20 21:38:21.203060 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:21.202723    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:21.220885 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:21.220837    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np" podStartSLOduration=1.9732990030000002 podStartE2EDuration="14.220823172s" podCreationTimestamp="2026-05-20 21:38:07 +0000 UTC" firstStartedPulling="2026-05-20 21:38:08.006240544 +0000 UTC m=+696.902838176" lastFinishedPulling="2026-05-20 21:38:20.253764714 +0000 UTC m=+709.150362345" observedRunningTime="2026-05-20 21:38:21.219880579 +0000 UTC m=+710.116478243" watchObservedRunningTime="2026-05-20 21:38:21.220823172 +0000 UTC m=+710.117420863"
May 20 21:38:32.219314 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:32.219281    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np"
May 20 21:38:39.451416 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.451379    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"]
May 20 21:38:39.480888 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.480851    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"]
May 20 21:38:39.481058 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.480999    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.483548 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.483529    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 20 21:38:39.616074 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.616038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.616074 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.616077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a34c4db-09bd-4f47-a780-677d3b21b1a8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.616300 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.616107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.616300 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.616181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.616300 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.616221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmt4h\" (UniqueName: \"kubernetes.io/projected/9a34c4db-09bd-4f47-a780-677d3b21b1a8-kube-api-access-wmt4h\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.616300 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.616284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717408 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717327    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmt4h\" (UniqueName: \"kubernetes.io/projected/9a34c4db-09bd-4f47-a780-677d3b21b1a8-kube-api-access-wmt4h\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717408 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717375    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717623 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717410    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717623 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717428    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a34c4db-09bd-4f47-a780-677d3b21b1a8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717623 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717449    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717623 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717479    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717894 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717874    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717957 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717915    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.717957 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.717945    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.719722 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.719697    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a34c4db-09bd-4f47-a780-677d3b21b1a8-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.719885 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.719868    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a34c4db-09bd-4f47-a780-677d3b21b1a8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.725218 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.725195    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmt4h\" (UniqueName: \"kubernetes.io/projected/9a34c4db-09bd-4f47-a780-677d3b21b1a8-kube-api-access-wmt4h\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl\" (UID: \"9a34c4db-09bd-4f47-a780-677d3b21b1a8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.789959 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.789928    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:39.928974 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:39.928948    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"]
May 20 21:38:39.930940 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:38:39.930909    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a34c4db_09bd_4f47_a780_677d3b21b1a8.slice/crio-a52c8cfe8e478dffcc9578224485e1a8385b4f82aa745bd7f923a2dc45342465 WatchSource:0}: Error finding container a52c8cfe8e478dffcc9578224485e1a8385b4f82aa745bd7f923a2dc45342465: Status 404 returned error can't find the container with id a52c8cfe8e478dffcc9578224485e1a8385b4f82aa745bd7f923a2dc45342465
May 20 21:38:40.270278 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:40.270188    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl" event={"ID":"9a34c4db-09bd-4f47-a780-677d3b21b1a8","Type":"ContainerStarted","Data":"ce365b4d52694f1d7d0048b666bf9d7450db9ee696141d7b22182f48ca12a43a"}
May 20 21:38:40.270278 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:40.270226    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl" event={"ID":"9a34c4db-09bd-4f47-a780-677d3b21b1a8","Type":"ContainerStarted","Data":"a52c8cfe8e478dffcc9578224485e1a8385b4f82aa745bd7f923a2dc45342465"}
May 20 21:38:40.425641 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:40.425612    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:38:48.303217 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:48.303183    2560 generic.go:358] "Generic (PLEG): container finished" podID="9a34c4db-09bd-4f47-a780-677d3b21b1a8" containerID="ce365b4d52694f1d7d0048b666bf9d7450db9ee696141d7b22182f48ca12a43a" exitCode=0
May 20 21:38:48.303665 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:48.303240    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl" event={"ID":"9a34c4db-09bd-4f47-a780-677d3b21b1a8","Type":"ContainerDied","Data":"ce365b4d52694f1d7d0048b666bf9d7450db9ee696141d7b22182f48ca12a43a"}
May 20 21:38:49.308765 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:49.308731    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl" event={"ID":"9a34c4db-09bd-4f47-a780-677d3b21b1a8","Type":"ContainerStarted","Data":"b887b69ccc0d3e1bc44e2de206d2b18e1d23dbec0611074de821b640139617ef"}
May 20 21:38:49.309294 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:49.308937    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:38:49.327544 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:49.327486    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl" podStartSLOduration=10.115433319 podStartE2EDuration="10.327467518s" podCreationTimestamp="2026-05-20 21:38:39 +0000 UTC" firstStartedPulling="2026-05-20 21:38:48.303899915 +0000 UTC m=+737.200497545" lastFinishedPulling="2026-05-20 21:38:48.515934113 +0000 UTC m=+737.412531744" observedRunningTime="2026-05-20 21:38:49.327460701 +0000 UTC m=+738.224058357" watchObservedRunningTime="2026-05-20 21:38:49.327467518 +0000 UTC m=+738.224065172"
May 20 21:38:57.750534 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:38:57.750492    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:39:00.325574 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:39:00.325539    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl"
May 20 21:39:42.738400 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:39:42.738361    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:39:47.317874 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:39:47.317835    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:39:53.838110 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:39:53.838037    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:40:03.816693 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:03.816657    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:40:13.116664 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:13.116625    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:40:23.024036 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:23.023973    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:40:31.916698 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:31.916661    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:40:42.930847 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:42.930809    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:40:49.357415 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.357377    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c7b4d9f9f-mv8qt"]
May 20 21:40:49.357911 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.357622    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt" podUID="a681ac40-e0c4-494f-ac8d-6829b7b91080" containerName="manager" containerID="cri-o://27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971" gracePeriod=30
May 20 21:40:49.599428 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.599389    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:40:49.620428 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.620350    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz5wv\" (UniqueName: \"kubernetes.io/projected/a681ac40-e0c4-494f-ac8d-6829b7b91080-kube-api-access-pz5wv\") pod \"a681ac40-e0c4-494f-ac8d-6829b7b91080\" (UID: \"a681ac40-e0c4-494f-ac8d-6829b7b91080\") "
May 20 21:40:49.622826 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.622791    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a681ac40-e0c4-494f-ac8d-6829b7b91080-kube-api-access-pz5wv" (OuterVolumeSpecName: "kube-api-access-pz5wv") pod "a681ac40-e0c4-494f-ac8d-6829b7b91080" (UID: "a681ac40-e0c4-494f-ac8d-6829b7b91080"). InnerVolumeSpecName "kube-api-access-pz5wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:40:49.720844 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.720815    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz5wv\" (UniqueName: \"kubernetes.io/projected/a681ac40-e0c4-494f-ac8d-6829b7b91080-kube-api-access-pz5wv\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:40:49.721130 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.721110    2560 generic.go:358] "Generic (PLEG): container finished" podID="a681ac40-e0c4-494f-ac8d-6829b7b91080" containerID="27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971" exitCode=0
May 20 21:40:49.721192 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.721171    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt"
May 20 21:40:49.721232 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.721191    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt" event={"ID":"a681ac40-e0c4-494f-ac8d-6829b7b91080","Type":"ContainerDied","Data":"27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971"}
May 20 21:40:49.721232 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.721224    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7b4d9f9f-mv8qt" event={"ID":"a681ac40-e0c4-494f-ac8d-6829b7b91080","Type":"ContainerDied","Data":"4bfae42721d3797273da8460ceee212eb4840761c6e9ef17df7583e4d3df6e22"}
May 20 21:40:49.721292 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.721239    2560 scope.go:117] "RemoveContainer" containerID="27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971"
May 20 21:40:49.729595 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.729563    2560 scope.go:117] "RemoveContainer" containerID="27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971"
May 20 21:40:49.729833 ip-10-0-141-6 kubenswrapper[2560]: E0520 21:40:49.729814    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971\": container with ID starting with 27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971 not found: ID does not exist" containerID="27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971"
May 20 21:40:49.729900 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.729845    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971"} err="failed to get container status \"27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971\": rpc error: code = NotFound desc = could not find container \"27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971\": container with ID starting with 27e93289618e7fec989a7965235c39e1d470c813662be858e35f6e56deadb971 not found: ID does not exist"
May 20 21:40:49.738204 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.738180    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c7b4d9f9f-mv8qt"]
May 20 21:40:49.741665 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:49.741639    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c7b4d9f9f-mv8qt"]
May 20 21:40:51.699126 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:40:51.699089    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a681ac40-e0c4-494f-ac8d-6829b7b91080" path="/var/lib/kubelet/pods/a681ac40-e0c4-494f-ac8d-6829b7b91080/volumes"
May 20 21:41:32.576415 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:41:32.576304    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:41:32.580394 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:41:32.578543    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:41:55.121873 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:41:55.121834    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:42:10.421942 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:42:10.421902    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:42:49.418540 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:42:49.418494    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:43:05.213737 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:43:05.213641    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:43:19.718956 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:43:19.718920    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:43:36.372337 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:43:36.372300    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:44:32.618356 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:44:32.618270    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:44:41.019510 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:44:41.019474    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:44:58.326730 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:44:58.326690    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:45:00.136978 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.136942    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655225-2vlmd"]
May 20 21:45:00.137380 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.137297    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a681ac40-e0c4-494f-ac8d-6829b7b91080" containerName="manager"
May 20 21:45:00.137380 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.137309    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a681ac40-e0c4-494f-ac8d-6829b7b91080" containerName="manager"
May 20 21:45:00.137452 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.137381    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a681ac40-e0c4-494f-ac8d-6829b7b91080" containerName="manager"
May 20 21:45:00.139172 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.139156    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd"
May 20 21:45:00.141494 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.141473    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fln84\""
May 20 21:45:00.157682 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.157662    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655225-2vlmd"]
May 20 21:45:00.268514 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.268458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49p6m\" (UniqueName: \"kubernetes.io/projected/f6a82f45-d33d-4dee-b309-706f52334789-kube-api-access-49p6m\") pod \"maas-api-key-cleanup-29655225-2vlmd\" (UID: \"f6a82f45-d33d-4dee-b309-706f52334789\") " pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd"
May 20 21:45:00.369179 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.369140    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49p6m\" (UniqueName: \"kubernetes.io/projected/f6a82f45-d33d-4dee-b309-706f52334789-kube-api-access-49p6m\") pod \"maas-api-key-cleanup-29655225-2vlmd\" (UID: \"f6a82f45-d33d-4dee-b309-706f52334789\") " pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd"
May 20 21:45:00.379267 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.379222    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49p6m\" (UniqueName: \"kubernetes.io/projected/f6a82f45-d33d-4dee-b309-706f52334789-kube-api-access-49p6m\") pod \"maas-api-key-cleanup-29655225-2vlmd\" (UID: \"f6a82f45-d33d-4dee-b309-706f52334789\") " pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd"
May 20 21:45:00.449061 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.448954    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd"
May 20 21:45:00.577692 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.577663    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655225-2vlmd"]
May 20 21:45:00.579806 ip-10-0-141-6 kubenswrapper[2560]: W0520 21:45:00.579778    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a82f45_d33d_4dee_b309_706f52334789.slice/crio-272ee57a5d71999ae3bacf4a7bb8ab2e2bee3dfc45319e7b918df846cd79d85b WatchSource:0}: Error finding container 272ee57a5d71999ae3bacf4a7bb8ab2e2bee3dfc45319e7b918df846cd79d85b: Status 404 returned error can't find the container with id 272ee57a5d71999ae3bacf4a7bb8ab2e2bee3dfc45319e7b918df846cd79d85b
May 20 21:45:00.581758 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.581743    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:45:00.600964 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:00.600929    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd" event={"ID":"f6a82f45-d33d-4dee-b309-706f52334789","Type":"ContainerStarted","Data":"272ee57a5d71999ae3bacf4a7bb8ab2e2bee3dfc45319e7b918df846cd79d85b"}
May 20 21:45:03.612365 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:03.612335    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd" event={"ID":"f6a82f45-d33d-4dee-b309-706f52334789","Type":"ContainerStarted","Data":"065f7e7d1ad25d2991026f79c8da75b99d3999bb9a388a896a2d94e5356a5e57"}
May 20 21:45:03.629111 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:03.629060    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd" podStartSLOduration=1.14863201 podStartE2EDuration="3.629047381s" podCreationTimestamp="2026-05-20 21:45:00 +0000 UTC" firstStartedPulling="2026-05-20 21:45:00.581869339 +0000 UTC m=+1109.478466970" lastFinishedPulling="2026-05-20 21:45:03.062284711 +0000 UTC m=+1111.958882341" observedRunningTime="2026-05-20 21:45:03.626418997 +0000 UTC m=+1112.523016651" watchObservedRunningTime="2026-05-20 21:45:03.629047381 +0000 UTC m=+1112.525645034"
May 20 21:45:04.616719 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:04.616687    2560 generic.go:358] "Generic (PLEG): container finished" podID="f6a82f45-d33d-4dee-b309-706f52334789" containerID="065f7e7d1ad25d2991026f79c8da75b99d3999bb9a388a896a2d94e5356a5e57" exitCode=0
May 20 21:45:04.617164 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:04.616733    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd" event={"ID":"f6a82f45-d33d-4dee-b309-706f52334789","Type":"ContainerDied","Data":"065f7e7d1ad25d2991026f79c8da75b99d3999bb9a388a896a2d94e5356a5e57"}
May 20 21:45:05.753742 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:05.753712    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd"
May 20 21:45:05.817159 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:05.817121    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49p6m\" (UniqueName: \"kubernetes.io/projected/f6a82f45-d33d-4dee-b309-706f52334789-kube-api-access-49p6m\") pod \"f6a82f45-d33d-4dee-b309-706f52334789\" (UID: \"f6a82f45-d33d-4dee-b309-706f52334789\") "
May 20 21:45:05.819067 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:05.819041    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a82f45-d33d-4dee-b309-706f52334789-kube-api-access-49p6m" (OuterVolumeSpecName: "kube-api-access-49p6m") pod "f6a82f45-d33d-4dee-b309-706f52334789" (UID: "f6a82f45-d33d-4dee-b309-706f52334789"). InnerVolumeSpecName "kube-api-access-49p6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:45:05.918751 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:05.918711    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49p6m\" (UniqueName: \"kubernetes.io/projected/f6a82f45-d33d-4dee-b309-706f52334789-kube-api-access-49p6m\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 21:45:06.625941 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:06.625901    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd" event={"ID":"f6a82f45-d33d-4dee-b309-706f52334789","Type":"ContainerDied","Data":"272ee57a5d71999ae3bacf4a7bb8ab2e2bee3dfc45319e7b918df846cd79d85b"}
May 20 21:45:06.625941 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:06.625936    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655225-2vlmd"
May 20 21:45:06.626200 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:06.625944    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="272ee57a5d71999ae3bacf4a7bb8ab2e2bee3dfc45319e7b918df846cd79d85b"
May 20 21:45:06.627946 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:06.627926    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:45:23.718809 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:23.718770    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:45:32.331088 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:45:32.331042    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:03.920083 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:03.918657    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:12.913583 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:12.913545    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:22.119258 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:22.119209    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:29.815798 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:29.815760    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:32.600734 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:32.600625    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:46:32.606160 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:32.603002    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:46:38.425614 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:38.425582    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:45.919751 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:45.919716    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:50.521772 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:50.521732    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:46:54.722223 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:46:54.722184    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:47:06.120268 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:47:06.120231    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:47:53.120698 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:47:53.120620    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:47:57.720518 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:47:57.720486    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:48:05.920417 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:48:05.920378    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:48:15.319106 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:48:15.319070    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:48:23.520008 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:48:23.519955    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:48:32.114343 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:48:32.114306    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:48:41.325198 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:48:41.325161    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:48:51.120356 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:48:51.120257    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:48:59.025380 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:48:59.025345    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:49:07.725843 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:49:07.725808    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:49:17.253062 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:49:17.253019    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:49:25.522376 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:49:25.522341    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:49:33.720118 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:49:33.720087    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:49:42.219826 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:49:42.219792    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:49:51.316035 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:49:51.315998    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:49:59.217833 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:49:59.217798    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:50:08.421035 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:50:08.420992    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:50:16.725934 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:50:16.725898    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:51:32.627305 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:51:32.627186    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:51:32.630692 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:51:32.629398    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:52:33.629421 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:52:33.629388    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:52:39.126845 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:52:39.126807    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:53:06.017881 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:53:06.017846    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:53:12.918820 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:53:12.918779    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:53:22.424506 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:53:22.424428    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:53:31.819645 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:53:31.819611    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:53:41.716636 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:53:41.716601    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:53:52.025747 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:53:52.025708    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:54:00.421148 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:54:00.421102    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:54:11.425441 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:54:11.425407    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:54:19.318959 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:54:19.318922    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:54:30.518942 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:54:30.518904    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:54:38.723723 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:54:38.723686    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:54:44.916896 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:54:44.916851    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:55:12.336369 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:55:12.336338    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:55:55.528262 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:55:55.528218    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:56:03.923466 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:03.923423    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:56:12.121207 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:12.121170    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:56:21.117997 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:21.117910    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:56:29.221868 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:29.221830    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:56:32.656256 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:32.656229    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:56:32.659833 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:32.659810    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 21:56:42.516680 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:42.516644    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:56:50.626041 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:50.626008    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:56:59.229704 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:56:59.229671    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:57:07.631604 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:57:07.631569    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:57:15.425953 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:57:15.425914    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:57:23.923688 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:57:23.923650    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:57:34.933751 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:57:34.933715    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:57:52.334911 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:57:52.334819    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:58:00.320305 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:58:00.320271    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:58:09.629687 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:58:09.629653    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:58:17.827823 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:58:17.827786    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:58:35.126922 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:58:35.126878    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:58:43.225927 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:58:43.225890    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:58:51.622287 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:58:51.622250    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:59:00.125639 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:59:00.125599    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:59:09.271683 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:59:09.271646    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:59:17.819389 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:59:17.819355    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:59:26.923037 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:59:26.922936    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:59:37.320760 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:59:37.320728    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:59:46.524228 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:59:46.524194    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 21:59:58.325336 ip-10-0-141-6 kubenswrapper[2560]: I0520 21:59:58.325297    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:00:00.133555 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.133511    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655240-d647b"]
May 20 22:00:00.133964 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.133901    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a82f45-d33d-4dee-b309-706f52334789" containerName="cleanup"
May 20 22:00:00.133964 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.133915    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a82f45-d33d-4dee-b309-706f52334789" containerName="cleanup"
May 20 22:00:00.134081 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.134001    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6a82f45-d33d-4dee-b309-706f52334789" containerName="cleanup"
May 20 22:00:00.137062 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.137045    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655240-d647b"
May 20 22:00:00.139418 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.139399    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fln84\""
May 20 22:00:00.150108 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.150085    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655240-d647b"]
May 20 22:00:00.243213 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.243176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pp2s\" (UniqueName: \"kubernetes.io/projected/992878a0-ea52-457e-b46e-b157f947ff61-kube-api-access-8pp2s\") pod \"maas-api-key-cleanup-29655240-d647b\" (UID: \"992878a0-ea52-457e-b46e-b157f947ff61\") " pod="opendatahub/maas-api-key-cleanup-29655240-d647b"
May 20 22:00:00.344503 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.344468    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pp2s\" (UniqueName: \"kubernetes.io/projected/992878a0-ea52-457e-b46e-b157f947ff61-kube-api-access-8pp2s\") pod \"maas-api-key-cleanup-29655240-d647b\" (UID: \"992878a0-ea52-457e-b46e-b157f947ff61\") " pod="opendatahub/maas-api-key-cleanup-29655240-d647b"
May 20 22:00:00.352974 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.352943    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pp2s\" (UniqueName: \"kubernetes.io/projected/992878a0-ea52-457e-b46e-b157f947ff61-kube-api-access-8pp2s\") pod \"maas-api-key-cleanup-29655240-d647b\" (UID: \"992878a0-ea52-457e-b46e-b157f947ff61\") " pod="opendatahub/maas-api-key-cleanup-29655240-d647b"
May 20 22:00:00.447386 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.447357    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655240-d647b"
May 20 22:00:00.614094 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.614058    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655240-d647b"]
May 20 22:00:00.619298 ip-10-0-141-6 kubenswrapper[2560]: W0520 22:00:00.619268    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992878a0_ea52_457e_b46e_b157f947ff61.slice/crio-1a37c8394d672796c8486d5d5c05f9095103e861e617668b590e9ad2e28aa877 WatchSource:0}: Error finding container 1a37c8394d672796c8486d5d5c05f9095103e861e617668b590e9ad2e28aa877: Status 404 returned error can't find the container with id 1a37c8394d672796c8486d5d5c05f9095103e861e617668b590e9ad2e28aa877
May 20 22:00:00.621535 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.621518    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 22:00:00.688709 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:00.688682    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655240-d647b" event={"ID":"992878a0-ea52-457e-b46e-b157f947ff61","Type":"ContainerStarted","Data":"1a37c8394d672796c8486d5d5c05f9095103e861e617668b590e9ad2e28aa877"}
May 20 22:00:01.693312 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:01.693218    2560 generic.go:358] "Generic (PLEG): container finished" podID="992878a0-ea52-457e-b46e-b157f947ff61" containerID="06002024967cd5720926dc6f96d725c03e4e63e4b91d5f079d9ce97dda1c585f" exitCode=0
May 20 22:00:01.697221 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:01.697196    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655240-d647b" event={"ID":"992878a0-ea52-457e-b46e-b157f947ff61","Type":"ContainerDied","Data":"06002024967cd5720926dc6f96d725c03e4e63e4b91d5f079d9ce97dda1c585f"}
May 20 22:00:02.827381 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:02.827355    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655240-d647b"
May 20 22:00:02.966740 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:02.966621    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pp2s\" (UniqueName: \"kubernetes.io/projected/992878a0-ea52-457e-b46e-b157f947ff61-kube-api-access-8pp2s\") pod \"992878a0-ea52-457e-b46e-b157f947ff61\" (UID: \"992878a0-ea52-457e-b46e-b157f947ff61\") "
May 20 22:00:02.968776 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:02.968751    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992878a0-ea52-457e-b46e-b157f947ff61-kube-api-access-8pp2s" (OuterVolumeSpecName: "kube-api-access-8pp2s") pod "992878a0-ea52-457e-b46e-b157f947ff61" (UID: "992878a0-ea52-457e-b46e-b157f947ff61"). InnerVolumeSpecName "kube-api-access-8pp2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 22:00:03.068068 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:03.068031    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pp2s\" (UniqueName: \"kubernetes.io/projected/992878a0-ea52-457e-b46e-b157f947ff61-kube-api-access-8pp2s\") on node \"ip-10-0-141-6.ec2.internal\" DevicePath \"\""
May 20 22:00:03.702499 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:03.702464    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655240-d647b"
May 20 22:00:03.702499 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:03.702483    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655240-d647b" event={"ID":"992878a0-ea52-457e-b46e-b157f947ff61","Type":"ContainerDied","Data":"1a37c8394d672796c8486d5d5c05f9095103e861e617668b590e9ad2e28aa877"}
May 20 22:00:03.702773 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:03.702514    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a37c8394d672796c8486d5d5c05f9095103e861e617668b590e9ad2e28aa877"
May 20 22:00:06.627680 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:06.627650    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:00:15.220444 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:15.220409    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:00:23.526128 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:23.526087    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:00:31.930093 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:31.930057    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:00:47.629692 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:47.629657    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:00:56.318867 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:00:56.318774    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:01:04.720950 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:04.720905    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:01:11.822309 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:11.822272    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:01:32.680012 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:32.679869    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 22:01:32.685200 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:32.685181    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 22:01:37.219780 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:37.219739    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:01:50.023334 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:50.023294    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-lc8rs"]
May 20 22:01:57.838151 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:57.838115    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-rcdcp_0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7/manager/0.log"
May 20 22:01:58.057802 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:58.057773    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655225-2vlmd_f6a82f45-d33d-4dee-b309-706f52334789/cleanup/0.log"
May 20 22:01:58.160952 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:58.160914    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655240-d647b_992878a0-ea52-457e-b46e-b157f947ff61/cleanup/0.log"
May 20 22:01:58.383666 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:58.383633    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-ckttf_177446a5-519d-4985-996f-8aaa3123ef6f/manager/2.log"
May 20 22:01:58.607950 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:01:58.607871    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9dbd78dd-khqsm_10af6108-f845-4f43-8de6-b925606be1de/manager/0.log"
May 20 22:02:00.729902 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:00.729877    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-lc8rs_e5a399ba-b00c-4ce1-bf36-dca08261e07c/limitador/0.log"
May 20 22:02:00.855696 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:00.855646    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pvcmk_1e83569f-57c0-4464-b4e5-b0bc3423c7fe/manager/0.log"
May 20 22:02:01.301215 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:01.301187    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-btx4k_70d33130-52c2-4397-ad2f-abf23b7c8c00/discovery/0.log"
May 20 22:02:01.411742 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:01.411710    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ddb78cf8b-m7wb4_a5ea434b-0cde-4456-ba2d-81244755c6e9/kube-auth-proxy/0.log"
May 20 22:02:01.736058 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:01.736028    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-kfxft_0b2dd769-f94e-4f1c-8641-546e7cb1dfc1/payload-processing/0.log"
May 20 22:02:01.842158 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:01.842132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69fbb9b8bb-588mz_868feb22-77cc-49fe-bd67-1f44bd10fc9b/router/0.log"
May 20 22:02:02.178727 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:02.178684    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np_b93b80f8-48d0-4c9b-be5c-83a10103e36c/storage-initializer/0.log"
May 20 22:02:02.185688 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:02.185662    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2l5np_b93b80f8-48d0-4c9b-be5c-83a10103e36c/main/0.log"
May 20 22:02:02.760423 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:02.760395    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl_9a34c4db-09bd-4f47-a780-677d3b21b1a8/storage-initializer/0.log"
May 20 22:02:02.767110 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:02.767090    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-7mhvl_9a34c4db-09bd-4f47-a780-677d3b21b1a8/main/0.log"
May 20 22:02:10.183805 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:10.183768    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hw4d9_f3e786c4-b898-4c16-a572-c99e9c285870/global-pull-secret-syncer/0.log"
May 20 22:02:10.264765 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:10.264732    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l9667_447195d9-44e1-46c0-b2a3-c578ac208d8c/konnectivity-agent/0.log"
May 20 22:02:10.353658 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:10.353627    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-6.ec2.internal_422de367e208d52bacb83c72eacec5e9/haproxy/0.log"
May 20 22:02:14.901681 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:14.901647    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-lc8rs_e5a399ba-b00c-4ce1-bf36-dca08261e07c/limitador/0.log"
May 20 22:02:14.963557 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:14.963522    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pvcmk_1e83569f-57c0-4464-b4e5-b0bc3423c7fe/manager/0.log"
May 20 22:02:16.602446 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:16.602415    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-tcx5w_9223b24e-bf0d-446a-981a-e317cbdb6edc/cluster-monitoring-operator/0.log"
May 20 22:02:16.882736 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:16.882659    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6v279_cbd3d30d-a22a-4b8d-9807-3bfb71d926d4/node-exporter/0.log"
May 20 22:02:16.922989 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:16.922960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6v279_cbd3d30d-a22a-4b8d-9807-3bfb71d926d4/kube-rbac-proxy/0.log"
May 20 22:02:16.941008 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:16.940969    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6v279_cbd3d30d-a22a-4b8d-9807-3bfb71d926d4/init-textfile/0.log"
May 20 22:02:18.733864 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.733835    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"]
May 20 22:02:18.734267 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.734191    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992878a0-ea52-457e-b46e-b157f947ff61" containerName="cleanup"
May 20 22:02:18.734267 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.734204    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="992878a0-ea52-457e-b46e-b157f947ff61" containerName="cleanup"
May 20 22:02:18.734339 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.734280    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="992878a0-ea52-457e-b46e-b157f947ff61" containerName="cleanup"
May 20 22:02:18.737291 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.737274    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.740201 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.740177    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8p94j\"/\"default-dockercfg-g4shn\""
May 20 22:02:18.740470 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.740178    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8p94j\"/\"openshift-service-ca.crt\""
May 20 22:02:18.741268 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.741246    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8p94j\"/\"kube-root-ca.crt\""
May 20 22:02:18.743092 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.743057    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"]
May 20 22:02:18.801097 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.801053    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-g5nhr_13ceb671-36ca-4c71-a282-ca5a513affbf/networking-console-plugin/0.log"
May 20 22:02:18.816265 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.816236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-sys\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.816410 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.816298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-lib-modules\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.816410 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.816346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-podres\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.816410 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.816379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-proc\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.816515 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.816419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdkgr\" (UniqueName: \"kubernetes.io/projected/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-kube-api-access-gdkgr\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917327 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917294    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-podres\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917327 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917338    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-proc\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917541 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917376    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdkgr\" (UniqueName: \"kubernetes.io/projected/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-kube-api-access-gdkgr\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917541 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917423    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-sys\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917541 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917473    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-podres\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917541 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917490    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-proc\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917541 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917480    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-lib-modules\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917700 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917547    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-sys\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.917700 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.917579    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-lib-modules\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:18.925788 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:18.925761    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdkgr\" (UniqueName: \"kubernetes.io/projected/4f817afb-a5d3-4104-9dd8-d9e02c7e05eb-kube-api-access-gdkgr\") pod \"perf-node-gather-daemonset-bkb25\" (UID: \"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb\") " pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:19.048928 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:19.048843    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:19.182033 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:19.182009    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"]
May 20 22:02:19.184626 ip-10-0-141-6 kubenswrapper[2560]: W0520 22:02:19.184596    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f817afb_a5d3_4104_9dd8_d9e02c7e05eb.slice/crio-6f1edcf8c5bfe30cbca1cddb4e0f0745df2a9ee20f6320572f0b5535044ea5bb WatchSource:0}: Error finding container 6f1edcf8c5bfe30cbca1cddb4e0f0745df2a9ee20f6320572f0b5535044ea5bb: Status 404 returned error can't find the container with id 6f1edcf8c5bfe30cbca1cddb4e0f0745df2a9ee20f6320572f0b5535044ea5bb
May 20 22:02:19.194345 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:19.194311    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25" event={"ID":"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb","Type":"ContainerStarted","Data":"6f1edcf8c5bfe30cbca1cddb4e0f0745df2a9ee20f6320572f0b5535044ea5bb"}
May 20 22:02:19.376701 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:19.376662    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/1.log"
May 20 22:02:19.381134 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:19.381085    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dv64q_9a08ad1e-eaf8-46df-bda3-8305d384cd3c/console-operator/2.log"
May 20 22:02:20.199066 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:20.199024    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25" event={"ID":"4f817afb-a5d3-4104-9dd8-d9e02c7e05eb","Type":"ContainerStarted","Data":"c5ec116afa1cd32fa2f40e042beb0f35fa507099ceb22f50ac3e6c77eb42612b"}
May 20 22:02:20.199521 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:20.199080    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:20.216316 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:20.216267    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25" podStartSLOduration=2.216251847 podStartE2EDuration="2.216251847s" podCreationTimestamp="2026-05-20 22:02:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 22:02:20.213927057 +0000 UTC m=+2149.110524706" watchObservedRunningTime="2026-05-20 22:02:20.216251847 +0000 UTC m=+2149.112849499"
May 20 22:02:20.480464 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:20.480356    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-ml6l8_d663c583-abf3-420f-9e5a-3a19ed266eff/volume-data-source-validator/0.log"
May 20 22:02:21.358724 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:21.358654    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-78nj7_937d007b-b153-41f0-aa59-bbe3f891c651/dns/0.log"
May 20 22:02:21.381384 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:21.381346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-78nj7_937d007b-b153-41f0-aa59-bbe3f891c651/kube-rbac-proxy/0.log"
May 20 22:02:21.507465 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:21.507433    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cfrlt_1b5f4076-063c-483b-8d10-fa73b3a40cc7/dns-node-resolver/0.log"
May 20 22:02:22.097376 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:22.097344    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxd5f_60fc5dde-26ac-4bf7-b15c-3715e6012387/node-ca/0.log"
May 20 22:02:23.169936 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:23.169902    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-btx4k_70d33130-52c2-4397-ad2f-abf23b7c8c00/discovery/0.log"
May 20 22:02:23.191482 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:23.191455    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ddb78cf8b-m7wb4_a5ea434b-0cde-4456-ba2d-81244755c6e9/kube-auth-proxy/0.log"
May 20 22:02:23.347591 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:23.347561    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-kfxft_0b2dd769-f94e-4f1c-8641-546e7cb1dfc1/payload-processing/0.log"
May 20 22:02:23.370112 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:23.370084    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69fbb9b8bb-588mz_868feb22-77cc-49fe-bd67-1f44bd10fc9b/router/0.log"
May 20 22:02:23.916607 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:23.916560    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ncrvx_01867303-a11e-47a1-ad88-e23d2bd76cf6/serve-healthcheck-canary/0.log"
May 20 22:02:24.424854 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:24.424791    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-87qw4_ee1dd742-0bc4-4e11-a40c-4576f60fd557/insights-operator/0.log"
May 20 22:02:24.424854 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:24.424822    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-87qw4_ee1dd742-0bc4-4e11-a40c-4576f60fd557/insights-operator/1.log"
May 20 22:02:24.448602 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:24.448575    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bhkb_d2252fc4-0b24-4c71-aeb3-b7b11d9e019c/kube-rbac-proxy/0.log"
May 20 22:02:24.471252 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:24.471216    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bhkb_d2252fc4-0b24-4c71-aeb3-b7b11d9e019c/exporter/0.log"
May 20 22:02:24.493161 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:24.493112    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bhkb_d2252fc4-0b24-4c71-aeb3-b7b11d9e019c/extractor/0.log"
May 20 22:02:26.211887 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:26.211860    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8p94j/perf-node-gather-daemonset-bkb25"
May 20 22:02:26.592164 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:26.592079    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-rcdcp_0d1ffbe5-3b6f-4448-9e98-db46c23f9ba7/manager/0.log"
May 20 22:02:26.647503 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:26.647480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655225-2vlmd_f6a82f45-d33d-4dee-b309-706f52334789/cleanup/0.log"
May 20 22:02:26.673514 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:26.673489    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655240-d647b_992878a0-ea52-457e-b46e-b157f947ff61/cleanup/0.log"
May 20 22:02:26.768215 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:26.768183    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-ckttf_177446a5-519d-4985-996f-8aaa3123ef6f/manager/1.log"
May 20 22:02:26.779856 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:26.779829    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-ckttf_177446a5-519d-4985-996f-8aaa3123ef6f/manager/2.log"
May 20 22:02:26.842654 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:26.842553    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9dbd78dd-khqsm_10af6108-f845-4f43-8de6-b925606be1de/manager/0.log"
May 20 22:02:33.270511 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:33.270476    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-c6zxs_e13267c2-b86f-44b8-817a-8f7dd6ef7c0b/kube-storage-version-migrator-operator/1.log"
May 20 22:02:33.271473 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:33.271454    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-c6zxs_e13267c2-b86f-44b8-817a-8f7dd6ef7c0b/kube-storage-version-migrator-operator/0.log"
May 20 22:02:34.294700 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.294666    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5xsm5_0ace839a-4af0-41ea-88c0-1d31c514c7be/kube-multus/0.log"
May 20 22:02:34.547718 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.547642    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bx647_962d02e9-d578-437f-b258-9f0625dab236/kube-multus-additional-cni-plugins/0.log"
May 20 22:02:34.573772 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.573744    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bx647_962d02e9-d578-437f-b258-9f0625dab236/egress-router-binary-copy/0.log"
May 20 22:02:34.616423 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.616393    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bx647_962d02e9-d578-437f-b258-9f0625dab236/cni-plugins/0.log"
May 20 22:02:34.665440 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.665409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bx647_962d02e9-d578-437f-b258-9f0625dab236/bond-cni-plugin/0.log"
May 20 22:02:34.712144 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.712108    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bx647_962d02e9-d578-437f-b258-9f0625dab236/routeoverride-cni/0.log"
May 20 22:02:34.759550 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.759517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bx647_962d02e9-d578-437f-b258-9f0625dab236/whereabouts-cni-bincopy/0.log"
May 20 22:02:34.822550 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:34.822473    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bx647_962d02e9-d578-437f-b258-9f0625dab236/whereabouts-cni/0.log"
May 20 22:02:35.433532 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:35.433502    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mkbw8_111d8b7e-7500-480c-99d1-05d2a3b2397f/network-metrics-daemon/0.log"
May 20 22:02:35.470520 ip-10-0-141-6 kubenswrapper[2560]: I0520 22:02:35.470492    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mkbw8_111d8b7e-7500-480c-99d1-05d2a3b2397f/kube-rbac-proxy/0.log"