May 21 19:19:18.748318 ip-10-0-133-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 19:19:18.748329 ip-10-0-133-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 19:19:18.748338 ip-10-0-133-228 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 19:19:18.748616 ip-10-0-133-228 systemd[1]: Failed to start Kubernetes Kubelet. May 21 19:19:28.283034 ip-10-0-133-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 19:19:28.283047 ip-10-0-133-228 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 175a0ad257424c43903dd4103ba3545d -- May 21 19:21:45.277429 ip-10-0-133-228 systemd[1]: Starting Kubernetes Kubelet... May 21 19:21:45.796067 ip-10-0-133-228 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 19:21:45.796067 ip-10-0-133-228 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 19:21:45.796067 ip-10-0-133-228 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 19:21:45.796067 ip-10-0-133-228 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 19:21:45.796067 ip-10-0-133-228 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 19:21:45.799629 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.799527 2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 19:21:45.808977 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.808956 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 19:21:45.808977 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.808973 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 19:21:45.808977 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.808979 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 19:21:45.808977 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.808983 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.808989 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.808993 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.808997 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809001 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809005 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809009 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809012 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809015 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809019 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809034 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809038 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809041 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809045 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809050 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809054 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809058 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809061 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809065 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 19:21:45.809267 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809068 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809072 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809076 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809079 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809083 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809087 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809091 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809095 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809099 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809105 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809112 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809116 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809120 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809124 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809147 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809155 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809161 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809165 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809169 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 19:21:45.810006 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809174 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809178 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809182 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809187 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809191 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809195 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809199 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809203 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809208 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809212 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809216 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809220 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809224 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809228 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809232 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809237 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809241 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809245 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809249 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809253 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 19:21:45.810733 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809257 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809262 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809266 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809269 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809275 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809289 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809293 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809298 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809302 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809307 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809311 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809315 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809319 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809323 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809328 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809331 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809336 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809340 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809343 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809347 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 19:21:45.811280 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809351 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809355 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809360 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809364 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.809369 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810017 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810026 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810030 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810034 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810039 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810043 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810047 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810051 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810055 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810059 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810064 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810068 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810074 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810078 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810083 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 19:21:45.812100 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810088 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810092 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810096 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810100 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810104 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810108 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810111 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810115 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810120 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810124 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810150 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810157 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810161 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810165 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810170 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810174 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810179 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810183 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810188 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 19:21:45.812894 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810193 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810198 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810203 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810207 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810211 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810215 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810222 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810226 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810230 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810234 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810238 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810251 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810256 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810261 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810265 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810269 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810273 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810277 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810282 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810286 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 19:21:45.813451 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810290 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810294 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810300 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810306 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810310 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810313 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810328 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810332 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810336 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810340 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810344 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810348 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810352 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810356 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810363 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810367 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810371 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810375 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810379 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810383 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 19:21:45.814155 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810387 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810391 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810395 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810399 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810415 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810420 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810424 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810428 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810432 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810436 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810440 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.810443 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811286 2572 flags.go:64] FLAG: --address="0.0.0.0" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811300 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811313 2572 flags.go:64] FLAG: --anonymous-auth="true" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811320 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811327 2572 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811332 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811339 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811346 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811352 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 19:21:45.814641 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811357 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811367 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811373 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811378 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811383 2572 flags.go:64] FLAG: --cgroup-root="" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811387 2572 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811392 2572 flags.go:64] FLAG: --client-ca-file="" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811397 2572 flags.go:64] FLAG: --cloud-config="" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811401 2572 flags.go:64] FLAG: --cloud-provider="external" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811407 2572 flags.go:64] FLAG: --cluster-dns="[]" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811413 2572 flags.go:64] FLAG: --cluster-domain="" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811418 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811423 2572 flags.go:64] FLAG: --config-dir="" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811427 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811432 2572 flags.go:64] FLAG: --container-log-max-files="5" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811439 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811445 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811450 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811463 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811469 2572 flags.go:64] FLAG: --contention-profiling="false" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811473 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811478 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811482 2572 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811487 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811494 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 19:21:45.815228 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811499 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811504 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811508 2572 flags.go:64] FLAG: --enable-load-reader="false" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811513 2572 flags.go:64] FLAG: --enable-server="true" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811518 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811526 2572 flags.go:64] FLAG: --event-burst="100" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811531 2572 flags.go:64] FLAG: --event-qps="50" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811535 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811542 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811547 2572 flags.go:64] FLAG: --eviction-hard="" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811553 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811558 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811563 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811568 2572 flags.go:64] FLAG: --eviction-soft="" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811572 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811577 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811582 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811586 2572 flags.go:64] FLAG: --experimental-mounter-path="" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811591 2572 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811595 2572 flags.go:64] FLAG: --fail-swap-on="true" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811600 2572 flags.go:64] FLAG: --feature-gates="" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811606 2572 flags.go:64] FLAG: --file-check-frequency="20s" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811611 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811616 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811627 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811632 2572 flags.go:64] FLAG: --healthz-port="10248" May 21 19:21:45.815840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811637 2572 flags.go:64] FLAG: --help="false" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811642 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-228.ec2.internal" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811647 2572 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811654 2572 flags.go:64] FLAG: --http-check-frequency="20s" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811659 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811665 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811671 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811676 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811681 2572 flags.go:64] FLAG: --image-service-endpoint="" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811686 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811691 2572 flags.go:64] FLAG: --kube-api-burst="100" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811695 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811701 2572 flags.go:64] FLAG: --kube-api-qps="50" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811705 2572 flags.go:64] FLAG: --kube-reserved="" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811711 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811716 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811722 2572 flags.go:64] FLAG: --kubelet-cgroups="" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811726 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811731 2572 flags.go:64] FLAG: --lock-file="" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811735 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811740 2572 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811745 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811754 2572 flags.go:64] FLAG: --log-json-split-stream="false" May 21 19:21:45.816491 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811759 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811764 2572 flags.go:64] FLAG: --log-text-split-stream="false" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811768 2572 flags.go:64] FLAG: --logging-format="text" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811773 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811779 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811783 2572 flags.go:64] FLAG: --manifest-url="" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811787 2572 flags.go:64] FLAG: --manifest-url-header="" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811795 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811805 2572 flags.go:64] FLAG: --max-open-files="1000000" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811813 2572 flags.go:64] FLAG: --max-pods="110" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811817 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811822 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811828 2572 flags.go:64] FLAG: --memory-manager-policy="None" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811833 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811838 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811843 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811848 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811859 2572 flags.go:64] FLAG: --node-status-max-images="50" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811864 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811869 2572 flags.go:64] FLAG: --oom-score-adj="-999" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811874 2572 flags.go:64] FLAG: --pod-cidr="" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811879 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811889 2572 flags.go:64] FLAG: --pod-manifest-path="" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811893 2572 flags.go:64] FLAG: --pod-max-pids="-1" May 21 19:21:45.817025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811900 2572 flags.go:64] FLAG: --pods-per-core="0" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811905 2572 flags.go:64] FLAG: --port="10250" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811910 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811915 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024a7385bd555d8a5" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811920 2572 flags.go:64] FLAG: --qos-reserved="" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811925 2572 flags.go:64] FLAG: --read-only-port="10255" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811930 2572 flags.go:64] FLAG: --register-node="true" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811934 2572 flags.go:64] FLAG: --register-schedulable="true" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811939 2572 flags.go:64] FLAG: --register-with-taints="" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811944 2572 flags.go:64] FLAG: --registry-burst="10" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811949 2572 flags.go:64] FLAG: --registry-qps="5" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811954 2572 flags.go:64] FLAG: --reserved-cpus="" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811959 2572 flags.go:64] FLAG: --reserved-memory="" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811965 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811970 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811975 2572 flags.go:64] FLAG: --rotate-certificates="false" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811980 2572 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811985 2572 flags.go:64] FLAG: --runonce="false" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811989 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.811994 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812002 2572 flags.go:64] FLAG: --seccomp-default="false" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812007 2572 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812011 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812016 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812021 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812026 2572 flags.go:64] FLAG: --storage-driver-password="root" May 21 19:21:45.817611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812031 2572 flags.go:64] FLAG: --storage-driver-secure="false" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812036 2572 flags.go:64] FLAG: --storage-driver-table="stats" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812041 2572 flags.go:64] FLAG: --storage-driver-user="root" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812045 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812050 2572 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812055 2572 flags.go:64] FLAG: --system-cgroups="" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812061 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812075 2572 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812080 2572 flags.go:64] FLAG: --tls-cert-file="" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812085 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812091 2572 flags.go:64] FLAG: --tls-min-version="" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812096 2572 flags.go:64] FLAG: --tls-private-key-file="" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812100 2572 flags.go:64] FLAG: --topology-manager-policy="none" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812104 2572 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812109 2572 flags.go:64] FLAG: --topology-manager-scope="container" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812114 2572 flags.go:64] FLAG: --v="2" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812120 2572 flags.go:64] FLAG: --version="false" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812127 2572 flags.go:64] FLAG: --vmodule="" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812151 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812156 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812341 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812348 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812353 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812357 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 19:21:45.818289 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812362 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812367 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812371 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812375 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812379 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812384 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812388 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812392 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812396 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812400 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812404 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812407 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812412 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812416 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812422 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812427 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812431 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812436 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812440 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812444 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 19:21:45.818856 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812448 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812452 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812455 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812459 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812463 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812467 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812471 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812477 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812482 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812486 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812490 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812495 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812499 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812504 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812509 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812513 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812517 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812521 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812525 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 19:21:45.819406 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812528 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812533 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812536 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812540 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812544 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812548 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812552 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812558 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812562 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812566 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812571 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812575 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812579 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812582 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812587 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812591 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812595 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812599 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812603 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812607 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 19:21:45.819868 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812611 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812615 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812619 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812623 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812627 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812631 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812635 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812642 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812648 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812652 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812656 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812660 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812664 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812668 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812672 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812676 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812680 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812684 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812688 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 19:21:45.820370 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812694 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812698 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812702 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.812706 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.812714 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.819375 2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.819487 2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819533 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819539 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819542 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819546 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819549 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819552 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819555 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819558 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819561 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 19:21:45.820825 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819565 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819569 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819572 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819575 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819579 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819582 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819585 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819588 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819591 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819594 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819597 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819600 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819602 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819605 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819607 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819610 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819613 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819615 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819618 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819620 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 19:21:45.821246 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819623 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819626 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819629 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819632 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819634 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819637 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819640 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819642 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819645 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819647 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819649 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819652 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819655 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819657 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819660 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819663 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819665 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819669 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819672 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819674 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 19:21:45.821732 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819677 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819679 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819682 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819684 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819687 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819689 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819691 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819694 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819696 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819698 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819701 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819705 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819707 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819710 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819713 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819716 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819718 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819721 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819723 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819726 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 19:21:45.822220 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819728 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819731 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819733 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819736 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819738 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819741 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819743 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819746 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819749 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819752 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819757 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819759 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819762 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819764 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819767 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819769 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 19:21:45.822728 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819772 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.819777 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819873 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819878 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819882 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819884 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819887 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819890 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819892 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819894 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819898 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819900 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819903 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819905 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819908 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 19:21:45.823140 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819910 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819913 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819915 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819918 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819920 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819922 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819925 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819927 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819930 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819932 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819935 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819937 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819940 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819942 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819945 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819947 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819950 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819952 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819955 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 19:21:45.823541 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819957 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819960 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819962 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819965 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819967 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819970 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819972 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819974 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819977 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819980 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819982 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819984 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819987 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819989 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819991 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819994 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819996 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.819998 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820001 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820003 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 19:21:45.823997 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820006 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820008 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820010 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820012 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820015 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820017 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820021 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820023 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820026 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820029 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820031 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820034 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820036 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820039 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820041 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820044 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820046 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820049 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820051 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820053 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 19:21:45.824514 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820056 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820058 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820061 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820063 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820066 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820069 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820073 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820077 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820080 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820082 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820085 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820088 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820091 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:45.820093 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.820098 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 19:21:45.825004 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.820898 2572 server.go:962] "Client rotation is on, will bootstrap in background" May 21 19:21:45.825382 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.822829 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 19:21:45.825382 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.823927 2572 server.go:1019] "Starting client certificate rotation" May 21 19:21:45.825382 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.824025 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 19:21:45.825382 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.824067 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 19:21:45.852454 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.852434 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 19:21:45.858063 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.857905 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 19:21:45.874588 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.874569 2572 log.go:25] "Validated CRI v1 runtime API" May 21 19:21:45.879646 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.879630 2572 log.go:25] "Validated CRI v1 image API" May 21 19:21:45.881679 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.881663 2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 19:21:45.884976 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.884955 2572 fs.go:135] Filesystem UUIDs: map[1a781471-4b2c-4524-a524-8fc54b36a927:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d9f8a048-d1d4-4a67-8fef-9f239284d282:/dev/nvme0n1p3] May 21 19:21:45.885036 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.884976 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 19:21:45.889156 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.889037 2572 manager.go:217] Machine: {Timestamp:2026-05-21 19:21:45.888538716 +0000 UTC m=+0.470073655 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3196459 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23567a0f99c000e2d3aa1ccc1f8a27 SystemUUID:ec23567a-0f99-c000-e2d3-aa1ccc1f8a27 BootID:175a0ad2-5742-4c43-903d-d4103ba3545d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:63:dc:a8:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:63:dc:a8:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:fa:0f:94:db:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 19:21:45.889930 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.889919 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 19:21:45.890016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.890004 2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 19:21:45.891909 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.891890 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 19:21:45.892888 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.892860 2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 19:21:45.893024 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.892890 2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 19:21:45.893068 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.893033 2572 topology_manager.go:138] "Creating topology manager with none policy" May 21 19:21:45.893068 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.893041 2572 container_manager_linux.go:306] "Creating device plugin manager" May 21 19:21:45.893068 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.893049 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 19:21:45.893824 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.893813 2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 19:21:45.895054 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.895044 2572 state_mem.go:36] "Initialized new in-memory state store" May 21 19:21:45.895189 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.895180 2572 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 19:21:45.897662 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.897653 2572 kubelet.go:491] "Attempting to sync node with API server" May 21 19:21:45.897700 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.897666 2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 19:21:45.897700 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.897677 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 19:21:45.897700 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.897688 2572 kubelet.go:397] "Adding apiserver pod source" May 21 19:21:45.897700 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.897697 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 19:21:45.898886 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.898875 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 19:21:45.898925 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.898893 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 19:21:45.902438 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.902423 2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 19:21:45.904482 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.904466 2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 19:21:45.907436 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907421 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 19:21:45.907515 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907440 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 19:21:45.907515 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907457 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 19:21:45.907515 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907467 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 19:21:45.907515 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907491 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 19:21:45.907515 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907498 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 19:21:45.907515 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907505 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 19:21:45.907687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907528 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 19:21:45.907687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907549 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 19:21:45.907687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907556 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 19:21:45.907687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907566 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 19:21:45.907687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.907572 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 19:21:45.908393 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.908378 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 19:21:45.908431 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.908406 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 19:21:45.911993 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.911978 2572 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 19:21:45.912065 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.912021 2572 server.go:1295] "Started kubelet" May 21 19:21:45.912123 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.912081 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 19:21:45.912181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.912120 2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 19:21:45.912210 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.912201 2572 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 19:21:45.912548 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.912531 2572 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 19:21:45.912772 ip-10-0-133-228 systemd[1]: Started Kubernetes Kubelet. May 21 19:21:45.912958 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.912940 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 19:21:45.913316 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.913253 2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 19:21:45.913403 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.913382 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 19:21:45.914808 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.914795 2572 server.go:317] "Adding debug handlers to kubelet server" May 21 19:21:45.919539 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.918643 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-228.ec2.internal.18b1aaf7114d7fd6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-228.ec2.internal,UID:ip-10-0-133-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-228.ec2.internal,},FirstTimestamp:2026-05-21 19:21:45.911992278 +0000 UTC m=+0.493527223,LastTimestamp:2026-05-21 19:21:45.911992278 +0000 UTC m=+0.493527223,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-228.ec2.internal,}" May 21 19:21:45.920433 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.920414 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 19:21:45.920795 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.920768 2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 19:21:45.921093 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921080 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 19:21:45.921201 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921169 2572 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 19:21:45.921201 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921179 2572 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 19:21:45.921305 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921205 2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 19:21:45.921305 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921266 2572 reconstruct.go:97] "Volume reconstruction finished" May 21 19:21:45.921305 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921272 2572 reconciler.go:26] "Reconciler: start to sync state" May 21 19:21:45.921782 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921765 2572 factory.go:55] Registering systemd factory May 21 19:21:45.921847 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.921823 2572 factory.go:223] Registration of the systemd container factory successfully May 21 19:21:45.922038 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.922026 2572 factory.go:153] Registering CRI-O factory May 21 19:21:45.922091 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.922040 2572 factory.go:223] Registration of the crio container factory successfully May 21 19:21:45.922127 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.922103 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 19:21:45.922127 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.922123 2572 factory.go:103] Registering Raw factory May 21 19:21:45.922243 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.922167 2572 manager.go:1196] Started watching for new ooms in manager May 21 19:21:45.922243 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.922171 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:45.923029 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.923003 2572 manager.go:319] Starting recovery of all containers May 21 19:21:45.928894 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.928859 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 19:21:45.928975 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.928905 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 19:21:45.933825 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.933800 2572 manager.go:324] Recovery completed May 21 19:21:45.936794 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.936775 2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 21 19:21:45.939775 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.939763 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 19:21:45.941513 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.941497 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientMemory" May 21 19:21:45.941579 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.941525 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasNoDiskPressure" May 21 19:21:45.941579 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.941535 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientPID" May 21 19:21:45.942004 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.941989 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 19:21:45.942004 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.942003 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 19:21:45.942086 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.942021 2572 state_mem.go:36] "Initialized new in-memory state store" May 21 19:21:45.944115 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.944054 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-228.ec2.internal.18b1aaf7130ff1e6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-228.ec2.internal,UID:ip-10-0-133-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-228.ec2.internal,},FirstTimestamp:2026-05-21 19:21:45.941512678 +0000 UTC m=+0.523047617,LastTimestamp:2026-05-21 19:21:45.941512678 +0000 UTC m=+0.523047617,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-228.ec2.internal,}" May 21 19:21:45.944349 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.944338 2572 policy_none.go:49] "None policy: Start" May 21 19:21:45.944382 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.944354 2572 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 19:21:45.944382 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.944365 2572 state_mem.go:35] "Initializing new in-memory state store" May 21 19:21:45.956372 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.956298 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-228.ec2.internal.18b1aaf713103593 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-228.ec2.internal,UID:ip-10-0-133-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-228.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-228.ec2.internal,},FirstTimestamp:2026-05-21 19:21:45.941530003 +0000 UTC m=+0.523064945,LastTimestamp:2026-05-21 19:21:45.941530003 +0000 UTC m=+0.523064945,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-228.ec2.internal,}" May 21 19:21:45.968202 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.968121 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-228.ec2.internal.18b1aaf7131059db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-228.ec2.internal,UID:ip-10-0-133-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-228.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-228.ec2.internal,},FirstTimestamp:2026-05-21 19:21:45.941539291 +0000 UTC m=+0.523074230,LastTimestamp:2026-05-21 19:21:45.941539291 +0000 UTC m=+0.523074230,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-228.ec2.internal,}" May 21 19:21:45.979524 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.979503 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d5f6v" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.980378 2572 manager.go:341] "Starting Device Plugin manager" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.980433 2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.980448 2572 server.go:85] "Starting device plugin registration server" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.980750 2572 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.980777 2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.980912 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.981006 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.981019 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.981705 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.981745 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.982981 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.984178 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.984197 2572 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.984213 2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.984219 2572 kubelet.go:2451] "Starting kubelet main sync loop" May 21 19:21:45.985543 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:45.984284 2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 19:21:45.987673 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.987656 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d5f6v" May 21 19:21:45.993863 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:45.993844 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 19:21:46.081480 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.081369 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 19:21:46.082407 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.082387 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientMemory" May 21 19:21:46.082512 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.082419 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasNoDiskPressure" May 21 19:21:46.082512 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.082429 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientPID" May 21 19:21:46.082512 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.082452 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-228.ec2.internal" May 21 19:21:46.084567 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.084528 2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal"] May 21 19:21:46.084670 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.084599 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 19:21:46.085334 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.085320 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientMemory" May 21 19:21:46.085432 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.085343 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasNoDiskPressure" May 21 19:21:46.085432 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.085352 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientPID" May 21 19:21:46.086662 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.086648 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 19:21:46.086812 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.086794 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.086869 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.086833 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 19:21:46.087308 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.087292 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientMemory" May 21 19:21:46.087392 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.087321 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasNoDiskPressure" May 21 19:21:46.087392 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.087331 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientPID" May 21 19:21:46.087392 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.087295 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientMemory" May 21 19:21:46.087498 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.087394 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasNoDiskPressure" May 21 19:21:46.087498 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.087408 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientPID" May 21 19:21:46.088545 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.088528 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" May 21 19:21:46.088634 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.088552 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 19:21:46.089162 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.089147 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientMemory" May 21 19:21:46.089230 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.089173 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasNoDiskPressure" May 21 19:21:46.089230 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.089188 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeHasSufficientPID" May 21 19:21:46.091288 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.091270 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-228.ec2.internal" May 21 19:21:46.091355 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.091298 2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-228.ec2.internal\": node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.114883 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.114857 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-228.ec2.internal\" not found" node="ip-10-0-133-228.ec2.internal" May 21 19:21:46.119211 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.119196 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-228.ec2.internal\" not found" node="ip-10-0-133-228.ec2.internal" May 21 19:21:46.122285 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.122270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa36fc7837944ac1c4b48815fd623d79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal\" (UID: \"aa36fc7837944ac1c4b48815fd623d79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.122334 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.122294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa36fc7837944ac1c4b48815fd623d79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal\" (UID: \"aa36fc7837944ac1c4b48815fd623d79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.122334 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.122314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15fb5b3cc6753d47ce160a75b07bf11e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-228.ec2.internal\" (UID: \"15fb5b3cc6753d47ce160a75b07bf11e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" May 21 19:21:46.124745 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.124729 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.223074 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.223044 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15fb5b3cc6753d47ce160a75b07bf11e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-228.ec2.internal\" (UID: \"15fb5b3cc6753d47ce160a75b07bf11e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" May 21 19:21:46.223074 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.223058 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15fb5b3cc6753d47ce160a75b07bf11e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-228.ec2.internal\" (UID: \"15fb5b3cc6753d47ce160a75b07bf11e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" May 21 19:21:46.223234 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.223113 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa36fc7837944ac1c4b48815fd623d79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal\" (UID: \"aa36fc7837944ac1c4b48815fd623d79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.223234 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.223178 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa36fc7837944ac1c4b48815fd623d79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal\" (UID: \"aa36fc7837944ac1c4b48815fd623d79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.223234 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.223194 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa36fc7837944ac1c4b48815fd623d79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal\" (UID: \"aa36fc7837944ac1c4b48815fd623d79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.223234 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.223223 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa36fc7837944ac1c4b48815fd623d79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal\" (UID: \"aa36fc7837944ac1c4b48815fd623d79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.225100 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.225080 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.326084 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.326057 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.417759 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.417674 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:46.421768 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.421751 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" May 21 19:21:46.426673 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.426656 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.527730 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.527694 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.628505 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.628475 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.729035 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.728963 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.825363 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.825338 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 19:21:46.825924 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.825484 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 19:21:46.829588 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.829572 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.921416 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.921393 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 19:21:46.926844 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:46.926809 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa36fc7837944ac1c4b48815fd623d79.slice/crio-db2910ed22d2358a5860dcbe078e7c86c300decf5d90f5071a2809ea5eec6cb5 WatchSource:0}: Error finding container db2910ed22d2358a5860dcbe078e7c86c300decf5d90f5071a2809ea5eec6cb5: Status 404 returned error can't find the container with id db2910ed22d2358a5860dcbe078e7c86c300decf5d90f5071a2809ea5eec6cb5 May 21 19:21:46.929918 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:46.929893 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-228.ec2.internal\" not found" May 21 19:21:46.930021 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.929978 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 19:21:46.944686 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:46.944638 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fb5b3cc6753d47ce160a75b07bf11e.slice/crio-de51c028f5c065546af22855a3f223785d6d1747d9e9ceccbbbaa00af88bc65b WatchSource:0}: Error finding container de51c028f5c065546af22855a3f223785d6d1747d9e9ceccbbbaa00af88bc65b: Status 404 returned error can't find the container with id de51c028f5c065546af22855a3f223785d6d1747d9e9ceccbbbaa00af88bc65b May 21 19:21:46.950681 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.950663 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 19:21:46.954355 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.954337 2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 19:21:46.987143 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.987022 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" event={"ID":"aa36fc7837944ac1c4b48815fd623d79","Type":"ContainerStarted","Data":"db2910ed22d2358a5860dcbe078e7c86c300decf5d90f5071a2809ea5eec6cb5"} May 21 19:21:46.987972 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.987950 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" event={"ID":"15fb5b3cc6753d47ce160a75b07bf11e","Type":"ContainerStarted","Data":"de51c028f5c065546af22855a3f223785d6d1747d9e9ceccbbbaa00af88bc65b"} May 21 19:21:46.990117 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.990093 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 19:16:45 +0000 UTC" deadline="2027-10-25 02:25:19.232667853 +0000 UTC" May 21 19:21:46.990185 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:46.990118 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12511h3m32.242552655s" May 21 19:21:47.022268 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.022241 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" May 21 19:21:47.059074 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.059049 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 19:21:47.061570 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.061557 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" May 21 19:21:47.094056 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.094027 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 19:21:47.114236 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.114212 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 19:21:47.114311 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.114290 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qm6hk" May 21 19:21:47.129327 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.129309 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qm6hk" May 21 19:21:47.207212 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.207186 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 19:21:47.898485 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.898441 2572 apiserver.go:52] "Watching apiserver" May 21 19:21:47.907405 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.907374 2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 19:21:47.907792 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.907760 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-87fcv","openshift-network-operator/iptables-alerter-rbcww","openshift-ovn-kubernetes/ovnkube-node-kwrjl","kube-system/konnectivity-agent-jrppl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7","openshift-cluster-node-tuning-operator/tuned-dk9km","openshift-image-registry/node-ca-pclvh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal","openshift-multus/multus-bf66b","openshift-multus/network-metrics-daemon-brx2f","kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal","openshift-multus/multus-additional-cni-plugins-gmrb7"] May 21 19:21:47.910920 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.910608 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:47.910920 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.910630 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:47.910920 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:47.910691 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:21:47.912642 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.912621 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.914058 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.913760 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:47.914977 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.914957 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.916292 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.916272 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.918363 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.918341 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:47.920001 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.919746 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bf66b" May 21 19:21:47.923333 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.923090 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:47.923424 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.923223 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:47.923506 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:47.923475 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:21:47.924079 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.924059 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 19:21:47.925078 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.925061 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 19:21:47.927698 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.925842 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f6rl5\"" May 21 19:21:47.927698 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.926094 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zgsp7\"" May 21 19:21:47.927698 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.926487 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 19:21:47.928328 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.928170 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 19:21:47.928328 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.928282 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 19:21:47.929204 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.929151 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 19:21:47.930498 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930476 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 19:21:47.930671 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930651 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 19:21:47.930778 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930760 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n9qqv\"" May 21 19:21:47.930862 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930840 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 19:21:47.930917 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930865 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 19:21:47.930917 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930880 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d8zvk\"" May 21 19:21:47.931016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930796 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 19:21:47.931016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930931 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 19:21:47.931016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930910 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 19:21:47.931016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930865 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 19:21:47.931016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.930786 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 19:21:47.931227 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931161 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 19:21:47.931945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931750 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 19:21:47.931945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931754 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 19:21:47.931945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931760 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 19:21:47.931945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931834 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5l46z\"" May 21 19:21:47.931945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931840 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 19:21:47.931945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931756 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 19:21:47.931945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.931894 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-kubelet\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932158 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z4b8j\"" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-var-lib-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysctl-d\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932252 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-ovn\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932162 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-cni-bin\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.932358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-systemd-units\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-node-log\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4spn\" (UniqueName: \"kubernetes.io/projected/0f15de18-ac92-4d20-a434-13487d1306fb-kube-api-access-t4spn\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932454 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysconfig\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb814f9b-c243-414a-947a-b7c896677b1f-tmp\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932515 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-modprobe-d\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-cnibin\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932562 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-etc-kubernetes\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-socket-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b2b400b-da92-4173-8dd0-7fa0736ab39a-konnectivity-ca\") pod \"konnectivity-agent-jrppl\" (UID: \"8b2b400b-da92-4173-8dd0-7fa0736ab39a\") " pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-systemd\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-os-release\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-cni-multus\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.932755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-kubelet\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-run\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-host\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-slash\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-daemon-config\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-host\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-k8s-cni-cncf-io\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-sys-fs\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.932999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb814f9b-c243-414a-947a-b7c896677b1f-etc-tuned\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-systemd\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933044 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-device-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933075 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbvzt\" (UniqueName: \"kubernetes.io/projected/378b21c5-162a-4329-90ae-34725880f704-kube-api-access-lbvzt\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-ovnkube-script-lib\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.933330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933174 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a05e19c8-fcd8-4146-a147-4049d5f03f87-cni-binary-copy\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933200 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b40c9063-221d-4452-ae59-83522698a605-iptables-alerter-script\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933224 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgjlt\" (UniqueName: \"kubernetes.io/projected/b40c9063-221d-4452-ae59-83522698a605-kube-api-access-qgjlt\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-var-lib-kubelet\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-cni-bin\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4809d2f-27cd-44ea-9765-582c99f2191a-ovn-node-metrics-cert\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-multus-certs\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-registration-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-kubernetes\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-sys\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-etc-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-env-overrides\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz9jd\" (UniqueName: \"kubernetes.io/projected/a05e19c8-fcd8-4146-a147-4049d5f03f87-kube-api-access-cz9jd\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysctl-conf\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.934070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933616 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl8ps\" (UniqueName: \"kubernetes.io/projected/eb814f9b-c243-414a-947a-b7c896677b1f-kube-api-access-xl8ps\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-ovnkube-config\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b40c9063-221d-4452-ae59-83522698a605-host-slash\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933725 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-lib-modules\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-run-netns\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-log-socket\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrp7\" (UniqueName: \"kubernetes.io/projected/d4809d2f-27cd-44ea-9765-582c99f2191a-kube-api-access-bcrp7\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933821 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-cni-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-netns\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-hostroot\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933888 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b2b400b-da92-4173-8dd0-7fa0736ab39a-agent-certs\") pod \"konnectivity-agent-jrppl\" (UID: \"8b2b400b-da92-4173-8dd0-7fa0736ab39a\") " pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzc2r\" (UniqueName: \"kubernetes.io/projected/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-kube-api-access-fzc2r\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-cni-netd\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-system-cni-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.933979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-socket-dir-parent\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.934000 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-conf-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:47.934586 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.934023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-serviceca\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:47.945965 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.945922 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 19:21:47.946076 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.945999 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cll4b\"" May 21 19:21:47.946076 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:47.946009 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clgtf\"" May 21 19:21:48.022712 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.022680 2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 19:21:48.034494 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034467 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-kubelet\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034498 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-var-lib-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034531 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034560 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysctl-d\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034580 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-ovn\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034585 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-var-lib-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034586 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-kubelet\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034604 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-cni-bin\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-ovn\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzxlp\" (UniqueName: \"kubernetes.io/projected/3aac26a2-8ec0-4da6-8578-2a6856609d34-kube-api-access-gzxlp\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.034675 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034698 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-systemd-units\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034653 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-cni-bin\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034722 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-node-log\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysctl-d\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034751 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4spn\" (UniqueName: \"kubernetes.io/projected/0f15de18-ac92-4d20-a434-13487d1306fb-kube-api-access-t4spn\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034776 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysconfig\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034776 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-node-log\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034824 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-systemd-units\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034832 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysconfig\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034840 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb814f9b-c243-414a-947a-b7c896677b1f-tmp\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034889 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-modprobe-d\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034917 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-cnibin\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034948 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-etc-kubernetes\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034974 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-socket-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.034998 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b2b400b-da92-4173-8dd0-7fa0736ab39a-konnectivity-ca\") pod \"konnectivity-agent-jrppl\" (UID: \"8b2b400b-da92-4173-8dd0-7fa0736ab39a\") " pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035010 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-cnibin\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035012 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-modprobe-d\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035031 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-systemd\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035052 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-etc-kubernetes\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035073 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-os-release\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-systemd\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035125 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-cni-multus\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035169 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-kubelet\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-os-release\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035186 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-cni-multus\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035210 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-run\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035233 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-host\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035236 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-var-lib-kubelet\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035261 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-cni-binary-copy\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035270 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-run\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035267 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035272 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-socket-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035296 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-host\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035304 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-slash\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035353 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-slash\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.035936 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035382 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-daemon-config\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035407 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-host\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035434 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035471 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-k8s-cni-cncf-io\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035498 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035521 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-sys-fs\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035543 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb814f9b-c243-414a-947a-b7c896677b1f-etc-tuned\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035551 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-k8s-cni-cncf-io\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035565 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-systemd\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035590 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-device-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035593 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035626 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035631 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b2b400b-da92-4173-8dd0-7fa0736ab39a-konnectivity-ca\") pod \"konnectivity-agent-jrppl\" (UID: \"8b2b400b-da92-4173-8dd0-7fa0736ab39a\") " pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-device-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035472 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-host\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035667 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbvzt\" (UniqueName: \"kubernetes.io/projected/378b21c5-162a-4329-90ae-34725880f704-kube-api-access-lbvzt\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035692 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-ovnkube-script-lib\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.036705 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035714 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-sys-fs\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.037313 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035716 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a05e19c8-fcd8-4146-a147-4049d5f03f87-cni-binary-copy\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.037313 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-daemon-config\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.037313 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.036062 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.037313 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.035970 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-systemd\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.037313 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.036469 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b40c9063-221d-4452-ae59-83522698a605-iptables-alerter-script\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:48.037539 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-ovnkube-script-lib\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.037685 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a05e19c8-fcd8-4146-a147-4049d5f03f87-cni-binary-copy\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037230 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgjlt\" (UniqueName: \"kubernetes.io/projected/b40c9063-221d-4452-ae59-83522698a605-kube-api-access-qgjlt\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037892 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-var-lib-kubelet\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-os-release\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037967 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-cni-bin\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037977 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-var-lib-kubelet\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.037997 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4809d2f-27cd-44ea-9765-582c99f2191a-ovn-node-metrics-cert\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb814f9b-c243-414a-947a-b7c896677b1f-tmp\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038039 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-multus-certs\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038261 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-registration-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-multus-certs\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038314 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-kubernetes\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038340 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb814f9b-c243-414a-947a-b7c896677b1f-etc-tuned\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038352 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-sys\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-cnibin\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038414 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-kubernetes\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038433 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-etc-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.038470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038465 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038480 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-sys\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038494 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038532 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038540 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-env-overrides\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038612 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-cni-bin\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/378b21c5-162a-4329-90ae-34725880f704-registration-dir\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038707 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-run-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038739 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cz9jd\" (UniqueName: \"kubernetes.io/projected/a05e19c8-fcd8-4146-a147-4049d5f03f87-kube-api-access-cz9jd\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038773 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysctl-conf\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038802 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl8ps\" (UniqueName: \"kubernetes.io/projected/eb814f9b-c243-414a-947a-b7c896677b1f-kube-api-access-xl8ps\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-system-cni-dir\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038866 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-ovnkube-config\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038892 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038931 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b40c9063-221d-4452-ae59-83522698a605-host-slash\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038943 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-env-overrides\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.038958 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-lib-modules\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.039326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039003 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-run-netns\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039039 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-log-socket\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-lib-modules\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039097 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-run-netns\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-log-socket\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039266 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb814f9b-c243-414a-947a-b7c896677b1f-etc-sysctl-conf\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.039341 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.039423 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:21:48.539392181 +0000 UTC m=+3.120927134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b40c9063-221d-4452-ae59-83522698a605-host-slash\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039663 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrp7\" (UniqueName: \"kubernetes.io/projected/d4809d2f-27cd-44ea-9765-582c99f2191a-kube-api-access-bcrp7\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039695 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-cni-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039720 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-netns\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4809d2f-27cd-44ea-9765-582c99f2191a-ovnkube-config\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039762 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-host-run-netns\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039769 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-hostroot\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039804 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b2b400b-da92-4173-8dd0-7fa0736ab39a-agent-certs\") pod \"konnectivity-agent-jrppl\" (UID: \"8b2b400b-da92-4173-8dd0-7fa0736ab39a\") " pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039809 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-hostroot\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039829 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzc2r\" (UniqueName: \"kubernetes.io/projected/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-kube-api-access-fzc2r\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:48.040073 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039858 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-cni-netd\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039884 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-system-cni-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039916 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-socket-dir-parent\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039944 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-conf-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.039972 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-serviceca\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-host-cni-netd\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040229 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-system-cni-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040295 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-socket-dir-parent\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040309 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4809d2f-27cd-44ea-9765-582c99f2191a-etc-openvswitch\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040343 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-conf-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.040948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.040428 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a05e19c8-fcd8-4146-a147-4049d5f03f87-multus-cni-dir\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.041534 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.041022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-serviceca\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:48.041534 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.041151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4809d2f-27cd-44ea-9765-582c99f2191a-ovn-node-metrics-cert\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.042514 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.042490 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b40c9063-221d-4452-ae59-83522698a605-iptables-alerter-script\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:48.042767 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.042748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b2b400b-da92-4173-8dd0-7fa0736ab39a-agent-certs\") pod \"konnectivity-agent-jrppl\" (UID: \"8b2b400b-da92-4173-8dd0-7fa0736ab39a\") " pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:48.044474 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.044456 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4spn\" (UniqueName: \"kubernetes.io/projected/0f15de18-ac92-4d20-a434-13487d1306fb-kube-api-access-t4spn\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:48.052201 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.052172 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 19:21:48.052201 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.052196 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 19:21:48.052329 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.052210 2572 projected.go:194] Error preparing data for projected volume kube-api-access-cg454 for pod openshift-network-diagnostics/network-check-target-87fcv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:48.052329 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.052273 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454 podName:ca62822f-41d2-4aab-a124-8998e0f630c3 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:48.552253707 +0000 UTC m=+3.133788649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cg454" (UniqueName: "kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454") pod "network-check-target-87fcv" (UID: "ca62822f-41d2-4aab-a124-8998e0f630c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:48.053400 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.053371 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzc2r\" (UniqueName: \"kubernetes.io/projected/82e602a4-1b48-4a6e-8ec5-d4f7093b6707-kube-api-access-fzc2r\") pod \"node-ca-pclvh\" (UID: \"82e602a4-1b48-4a6e-8ec5-d4f7093b6707\") " pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:48.057930 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.057906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrp7\" (UniqueName: \"kubernetes.io/projected/d4809d2f-27cd-44ea-9765-582c99f2191a-kube-api-access-bcrp7\") pod \"ovnkube-node-kwrjl\" (UID: \"d4809d2f-27cd-44ea-9765-582c99f2191a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.058165 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.058118 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl8ps\" (UniqueName: \"kubernetes.io/projected/eb814f9b-c243-414a-947a-b7c896677b1f-kube-api-access-xl8ps\") pod \"tuned-dk9km\" (UID: \"eb814f9b-c243-414a-947a-b7c896677b1f\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.058300 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.058278 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgjlt\" (UniqueName: \"kubernetes.io/projected/b40c9063-221d-4452-ae59-83522698a605-kube-api-access-qgjlt\") pod \"iptables-alerter-rbcww\" (UID: \"b40c9063-221d-4452-ae59-83522698a605\") " pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:48.059637 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.059616 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbvzt\" (UniqueName: \"kubernetes.io/projected/378b21c5-162a-4329-90ae-34725880f704-kube-api-access-lbvzt\") pod \"aws-ebs-csi-driver-node-q6mn7\" (UID: \"378b21c5-162a-4329-90ae-34725880f704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.060446 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.060428 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz9jd\" (UniqueName: \"kubernetes.io/projected/a05e19c8-fcd8-4146-a147-4049d5f03f87-kube-api-access-cz9jd\") pod \"multus-bf66b\" (UID: \"a05e19c8-fcd8-4146-a147-4049d5f03f87\") " pod="openshift-multus/multus-bf66b" May 21 19:21:48.130267 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.130221 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 19:16:47 +0000 UTC" deadline="2027-12-11 07:44:13.376691876 +0000 UTC" May 21 19:21:48.130267 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.130259 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13644h22m25.246435836s" May 21 19:21:48.141367 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141331 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141523 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141377 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141523 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141417 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141523 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141448 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzxlp\" (UniqueName: \"kubernetes.io/projected/3aac26a2-8ec0-4da6-8578-2a6856609d34-kube-api-access-gzxlp\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141523 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141483 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-cni-binary-copy\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141671 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141543 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141671 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141562 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-os-release\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141671 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141593 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-cnibin\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141671 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141619 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-system-cni-dir\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141812 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141692 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-system-cni-dir\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141812 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-os-release\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.141812 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.141791 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aac26a2-8ec0-4da6-8578-2a6856609d34-cnibin\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.142058 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.142033 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.142167 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.142124 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-cni-binary-copy\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.142296 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.142124 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3aac26a2-8ec0-4da6-8578-2a6856609d34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.151673 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.151614 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 19:21:48.153319 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.153301 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzxlp\" (UniqueName: \"kubernetes.io/projected/3aac26a2-8ec0-4da6-8578-2a6856609d34-kube-api-access-gzxlp\") pod \"multus-additional-cni-plugins-gmrb7\" (UID: \"3aac26a2-8ec0-4da6-8578-2a6856609d34\") " pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.224144 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.224095 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbcww" May 21 19:21:48.234015 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.233991 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:21:48.242698 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.242673 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrppl" May 21 19:21:48.247364 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.247346 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" May 21 19:21:48.254783 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.254764 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dk9km" May 21 19:21:48.262268 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.262248 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pclvh" May 21 19:21:48.269910 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.269883 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bf66b" May 21 19:21:48.273473 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.273452 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" May 21 19:21:48.544492 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.544399 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:48.544655 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.544526 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:48.544655 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.544598 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:21:49.544578739 +0000 UTC m=+4.126113669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:48.645166 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.645126 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:48.645306 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.645285 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 19:21:48.645350 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.645313 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 19:21:48.645350 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.645327 2572 projected.go:194] Error preparing data for projected volume kube-api-access-cg454 for pod openshift-network-diagnostics/network-check-target-87fcv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:48.645422 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:48.645395 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454 podName:ca62822f-41d2-4aab-a124-8998e0f630c3 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:49.64537513 +0000 UTC m=+4.226910074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cg454" (UniqueName: "kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454") pod "network-check-target-87fcv" (UID: "ca62822f-41d2-4aab-a124-8998e0f630c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:48.651775 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.651751 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05e19c8_fcd8_4146_a147_4049d5f03f87.slice/crio-1e42cbaa2346ab49b1cb130b38aee16b5e0dec9bf72bb743ae226286c8c8b757 WatchSource:0}: Error finding container 1e42cbaa2346ab49b1cb130b38aee16b5e0dec9bf72bb743ae226286c8c8b757: Status 404 returned error can't find the container with id 1e42cbaa2346ab49b1cb130b38aee16b5e0dec9bf72bb743ae226286c8c8b757 May 21 19:21:48.652512 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.652485 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e602a4_1b48_4a6e_8ec5_d4f7093b6707.slice/crio-03e4954607d6d3d5907adc0cdf7254ce5d0406467c2f152f85e6f9992f4333c0 WatchSource:0}: Error finding container 03e4954607d6d3d5907adc0cdf7254ce5d0406467c2f152f85e6f9992f4333c0: Status 404 returned error can't find the container with id 03e4954607d6d3d5907adc0cdf7254ce5d0406467c2f152f85e6f9992f4333c0 May 21 19:21:48.653483 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.653458 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2b400b_da92_4173_8dd0_7fa0736ab39a.slice/crio-bc7e231cfd2058778e3e8933e282bb9746b2dc879e21b41624d0cb589d1fbffe WatchSource:0}: Error finding container bc7e231cfd2058778e3e8933e282bb9746b2dc879e21b41624d0cb589d1fbffe: Status 404 returned error can't find the container with id bc7e231cfd2058778e3e8933e282bb9746b2dc879e21b41624d0cb589d1fbffe May 21 19:21:48.655786 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.655354 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb814f9b_c243_414a_947a_b7c896677b1f.slice/crio-f37cf2ca7a4faba91b6ce6fb49c2e0b03f5f9222be7d0c42f75dc1ae9b10abfa WatchSource:0}: Error finding container f37cf2ca7a4faba91b6ce6fb49c2e0b03f5f9222be7d0c42f75dc1ae9b10abfa: Status 404 returned error can't find the container with id f37cf2ca7a4faba91b6ce6fb49c2e0b03f5f9222be7d0c42f75dc1ae9b10abfa May 21 19:21:48.658626 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.658603 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378b21c5_162a_4329_90ae_34725880f704.slice/crio-ee56c7316366501d24988a3565f9de97f312c09442d2587bc0f1039c361e8f56 WatchSource:0}: Error finding container ee56c7316366501d24988a3565f9de97f312c09442d2587bc0f1039c361e8f56: Status 404 returned error can't find the container with id ee56c7316366501d24988a3565f9de97f312c09442d2587bc0f1039c361e8f56 May 21 19:21:48.659365 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.659230 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40c9063_221d_4452_ae59_83522698a605.slice/crio-0b97b572ef719d048636b1a02ddf4855430c1c382f7fb3985f42051dad01eea8 WatchSource:0}: Error finding container 0b97b572ef719d048636b1a02ddf4855430c1c382f7fb3985f42051dad01eea8: Status 404 returned error can't find the container with id 0b97b572ef719d048636b1a02ddf4855430c1c382f7fb3985f42051dad01eea8 May 21 19:21:48.661207 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.661186 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4809d2f_27cd_44ea_9765_582c99f2191a.slice/crio-132dd8d3916cf1a1b63b56abdf95b9b147cce3360016cf9e76e700362a80ffc7 WatchSource:0}: Error finding container 132dd8d3916cf1a1b63b56abdf95b9b147cce3360016cf9e76e700362a80ffc7: Status 404 returned error can't find the container with id 132dd8d3916cf1a1b63b56abdf95b9b147cce3360016cf9e76e700362a80ffc7 May 21 19:21:48.662373 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:21:48.662173 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aac26a2_8ec0_4da6_8578_2a6856609d34.slice/crio-286c10b4974be1c9309e1ecd41779fe0127e3dbe02c6ad88b1627562fa4853e7 WatchSource:0}: Error finding container 286c10b4974be1c9309e1ecd41779fe0127e3dbe02c6ad88b1627562fa4853e7: Status 404 returned error can't find the container with id 286c10b4974be1c9309e1ecd41779fe0127e3dbe02c6ad88b1627562fa4853e7 May 21 19:21:48.994117 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.994076 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" event={"ID":"15fb5b3cc6753d47ce160a75b07bf11e","Type":"ContainerStarted","Data":"5ee68173fee5d0e5421fcba2a6fbc84b2829d857768f51185c8c02e0bed8367b"} May 21 19:21:48.995596 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.995566 2572 generic.go:358] "Generic (PLEG): container finished" podID="aa36fc7837944ac1c4b48815fd623d79" containerID="ccb0510b66ddc701c38841ee1404f66c7f84fcc76ddd4f7492072b566590fe4f" exitCode=0 May 21 19:21:48.995701 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.995642 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" event={"ID":"aa36fc7837944ac1c4b48815fd623d79","Type":"ContainerDied","Data":"ccb0510b66ddc701c38841ee1404f66c7f84fcc76ddd4f7492072b566590fe4f"} May 21 19:21:48.996568 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.996542 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbcww" event={"ID":"b40c9063-221d-4452-ae59-83522698a605","Type":"ContainerStarted","Data":"0b97b572ef719d048636b1a02ddf4855430c1c382f7fb3985f42051dad01eea8"} May 21 19:21:48.997422 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.997384 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"132dd8d3916cf1a1b63b56abdf95b9b147cce3360016cf9e76e700362a80ffc7"} May 21 19:21:48.998261 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:48.998245 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pclvh" event={"ID":"82e602a4-1b48-4a6e-8ec5-d4f7093b6707","Type":"ContainerStarted","Data":"03e4954607d6d3d5907adc0cdf7254ce5d0406467c2f152f85e6f9992f4333c0"} May 21 19:21:49.000589 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.000570 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bf66b" event={"ID":"a05e19c8-fcd8-4146-a147-4049d5f03f87","Type":"ContainerStarted","Data":"1e42cbaa2346ab49b1cb130b38aee16b5e0dec9bf72bb743ae226286c8c8b757"} May 21 19:21:49.001825 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.001804 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerStarted","Data":"286c10b4974be1c9309e1ecd41779fe0127e3dbe02c6ad88b1627562fa4853e7"} May 21 19:21:49.002770 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.002750 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" event={"ID":"378b21c5-162a-4329-90ae-34725880f704","Type":"ContainerStarted","Data":"ee56c7316366501d24988a3565f9de97f312c09442d2587bc0f1039c361e8f56"} May 21 19:21:49.003655 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.003632 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dk9km" event={"ID":"eb814f9b-c243-414a-947a-b7c896677b1f","Type":"ContainerStarted","Data":"f37cf2ca7a4faba91b6ce6fb49c2e0b03f5f9222be7d0c42f75dc1ae9b10abfa"} May 21 19:21:49.004587 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.004493 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrppl" event={"ID":"8b2b400b-da92-4173-8dd0-7fa0736ab39a","Type":"ContainerStarted","Data":"bc7e231cfd2058778e3e8933e282bb9746b2dc879e21b41624d0cb589d1fbffe"} May 21 19:21:49.037457 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.037403 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-228.ec2.internal" podStartSLOduration=2.037385478 podStartE2EDuration="2.037385478s" podCreationTimestamp="2026-05-21 19:21:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:21:49.012689787 +0000 UTC m=+3.594224747" watchObservedRunningTime="2026-05-21 19:21:49.037385478 +0000 UTC m=+3.618920427" May 21 19:21:49.131309 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.131215 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 19:16:47 +0000 UTC" deadline="2028-02-03 08:35:46.794169732 +0000 UTC" May 21 19:21:49.131309 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.131257 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14941h13m57.662916221s" May 21 19:21:49.553884 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.553788 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:49.554055 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.553969 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:49.554055 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.554040 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:21:51.554021776 +0000 UTC m=+6.135556710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:49.655420 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.654908 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:49.655420 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.655113 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 19:21:49.655420 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.655154 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 19:21:49.655420 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.655168 2572 projected.go:194] Error preparing data for projected volume kube-api-access-cg454 for pod openshift-network-diagnostics/network-check-target-87fcv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:49.655420 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.655226 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454 podName:ca62822f-41d2-4aab-a124-8998e0f630c3 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:51.655208731 +0000 UTC m=+6.236743660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cg454" (UniqueName: "kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454") pod "network-check-target-87fcv" (UID: "ca62822f-41d2-4aab-a124-8998e0f630c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:49.987297 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.987224 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:49.987447 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.987364 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:21:49.988046 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:49.987786 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:49.988046 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:49.987878 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:21:50.018637 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:50.018608 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" event={"ID":"aa36fc7837944ac1c4b48815fd623d79","Type":"ContainerStarted","Data":"65cf16e544ce8be89c270296a3341d953a33757f8d63df7da779b746aec4c576"} May 21 19:21:51.573489 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:51.573448 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:51.574037 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.573576 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:51.574037 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.573640 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:21:55.57362632 +0000 UTC m=+10.155161253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:51.673999 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:51.673965 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:51.674178 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.674155 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 19:21:51.674257 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.674180 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 19:21:51.674257 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.674193 2572 projected.go:194] Error preparing data for projected volume kube-api-access-cg454 for pod openshift-network-diagnostics/network-check-target-87fcv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:51.674257 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.674250 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454 podName:ca62822f-41d2-4aab-a124-8998e0f630c3 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:55.674231077 +0000 UTC m=+10.255766021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cg454" (UniqueName: "kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454") pod "network-check-target-87fcv" (UID: "ca62822f-41d2-4aab-a124-8998e0f630c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:51.984557 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:51.984478 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:51.984710 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:51.984478 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:51.984710 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.984629 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:21:51.984710 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:51.984647 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:21:53.984879 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:53.984836 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:53.984879 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:53.984842 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:53.985395 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:53.985093 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:21:53.985395 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:53.985217 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:21:55.603364 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:55.603324 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:55.603842 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.603450 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:55.603842 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.603525 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:22:03.603508097 +0000 UTC m=+18.185043029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:21:55.704117 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:55.704069 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:55.704316 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.704253 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 19:21:55.704316 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.704274 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 19:21:55.704316 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.704287 2572 projected.go:194] Error preparing data for projected volume kube-api-access-cg454 for pod openshift-network-diagnostics/network-check-target-87fcv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:55.704460 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.704343 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454 podName:ca62822f-41d2-4aab-a124-8998e0f630c3 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:03.704324426 +0000 UTC m=+18.285859358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cg454" (UniqueName: "kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454") pod "network-check-target-87fcv" (UID: "ca62822f-41d2-4aab-a124-8998e0f630c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:21:55.985608 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:55.985573 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:55.985786 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.985690 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:21:55.985786 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:55.985719 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:55.985786 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:55.985775 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:21:56.447398 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.446751 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-228.ec2.internal" podStartSLOduration=9.446730692 podStartE2EDuration="9.446730692s" podCreationTimestamp="2026-05-21 19:21:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:21:50.033243168 +0000 UTC m=+4.614778116" watchObservedRunningTime="2026-05-21 19:21:56.446730692 +0000 UTC m=+11.028265642" May 21 19:21:56.447627 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.447483 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q2dr4"] May 21 19:21:56.454164 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.453689 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.454164 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:56.453769 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:21:56.512389 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.512198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-kubelet-config\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.512389 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.512271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-dbus\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.512389 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.512295 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.613111 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.613072 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-dbus\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.613577 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.613248 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-dbus\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.613577 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.613125 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.613577 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:56.613294 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 19:21:56.613577 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:56.613357 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret podName:ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:57.113339593 +0000 UTC m=+11.694874527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret") pod "global-pull-secret-syncer-q2dr4" (UID: "ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389") : object "kube-system"/"original-pull-secret" not registered May 21 19:21:56.613577 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.613412 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-kubelet-config\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:56.613577 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:56.613495 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-kubelet-config\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:57.117930 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:57.117492 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:57.117930 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:57.117661 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 19:21:57.117930 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:57.117723 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret podName:ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389 nodeName:}" failed. No retries permitted until 2026-05-21 19:21:58.117704346 +0000 UTC m=+12.699239279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret") pod "global-pull-secret-syncer-q2dr4" (UID: "ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389") : object "kube-system"/"original-pull-secret" not registered May 21 19:21:57.985321 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:57.985285 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:57.985849 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:57.985285 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:57.985849 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:57.985423 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:57.985849 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:57.985415 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:21:57.985849 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:57.985519 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:21:57.985849 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:57.985580 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:21:58.126306 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:58.126221 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:58.126507 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:58.126390 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 19:21:58.126507 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:58.126468 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret podName:ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:00.126444088 +0000 UTC m=+14.707979014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret") pod "global-pull-secret-syncer-q2dr4" (UID: "ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389") : object "kube-system"/"original-pull-secret" not registered May 21 19:21:59.985156 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:59.985112 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:21:59.985677 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:59.985112 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:21:59.985677 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:59.985256 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:21:59.985677 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:59.985365 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:21:59.985677 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:21:59.985112 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:21:59.985677 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:21:59.985484 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:00.140834 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:00.140802 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:00.141003 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:00.140923 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 19:22:00.141003 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:00.140971 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret podName:ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:04.140959179 +0000 UTC m=+18.722494105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret") pod "global-pull-secret-syncer-q2dr4" (UID: "ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389") : object "kube-system"/"original-pull-secret" not registered May 21 19:22:01.984932 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:01.984895 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:01.985377 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:01.984896 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:01.985377 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:01.985034 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:01.985377 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:01.984896 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:01.985377 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:01.985113 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:01.985377 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:01.985215 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:03.666797 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:03.666574 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:03.667255 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.666721 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:22:03.667255 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.666861 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:22:19.66684407 +0000 UTC m=+34.248378997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:22:03.768189 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:03.768148 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:03.768339 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.768307 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 19:22:03.768339 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.768332 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 19:22:03.768438 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.768346 2572 projected.go:194] Error preparing data for projected volume kube-api-access-cg454 for pod openshift-network-diagnostics/network-check-target-87fcv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:22:03.768438 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.768419 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454 podName:ca62822f-41d2-4aab-a124-8998e0f630c3 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:19.768398815 +0000 UTC m=+34.349933741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cg454" (UniqueName: "kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454") pod "network-check-target-87fcv" (UID: "ca62822f-41d2-4aab-a124-8998e0f630c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 19:22:03.984648 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:03.984567 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:03.984791 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:03.984567 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:03.984791 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.984689 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:03.984791 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:03.984581 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:03.984791 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.984766 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:03.985010 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:03.984876 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:04.171039 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:04.170997 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:04.171234 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:04.171150 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 19:22:04.171234 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:04.171229 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret podName:ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:12.171210597 +0000 UTC m=+26.752745546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret") pod "global-pull-secret-syncer-q2dr4" (UID: "ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389") : object "kube-system"/"original-pull-secret" not registered May 21 19:22:05.985117 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:05.985090 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:05.986016 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:05.985218 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:05.986016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:05.985284 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:05.986016 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:05.985334 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:05.986016 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:05.985421 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:05.986016 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:05.985492 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:06.046109 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.046071 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrppl" event={"ID":"8b2b400b-da92-4173-8dd0-7fa0736ab39a","Type":"ContainerStarted","Data":"c49000585de4662e94fbe4808d652ba65e44e08966b6aee4d9c82a512af5a659"} May 21 19:22:06.047535 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.047504 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pclvh" event={"ID":"82e602a4-1b48-4a6e-8ec5-d4f7093b6707","Type":"ContainerStarted","Data":"6034584196a1293a924b691e0dc7e7f2a78abac912186ff9df9f823ba9deacbc"} May 21 19:22:06.048780 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.048741 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bf66b" event={"ID":"a05e19c8-fcd8-4146-a147-4049d5f03f87","Type":"ContainerStarted","Data":"a540d4977868372fecf12bdc905b013aab86e58c9955223904719db2f9c9b073"} May 21 19:22:06.051953 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.050524 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerStarted","Data":"007eb687e1f748ca8703b532fbfac7cb25bc6975fb16d8421c9183d1ef9276c2"} May 21 19:22:06.053898 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.053715 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" event={"ID":"378b21c5-162a-4329-90ae-34725880f704","Type":"ContainerStarted","Data":"196c4e7bcbc5c8ba2e49c5e9283c6d7a9f5efb8172cd8fbc469126a0e5c26a53"} May 21 19:22:06.056116 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.056077 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dk9km" event={"ID":"eb814f9b-c243-414a-947a-b7c896677b1f","Type":"ContainerStarted","Data":"8fda227406b7ab39f750503331d3ef85620396c3918f372386939a11744448df"} May 21 19:22:06.064158 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.063888 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jrppl" podStartSLOduration=2.98381161 podStartE2EDuration="20.063872509s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.657824819 +0000 UTC m=+3.239359751" lastFinishedPulling="2026-05-21 19:22:05.73788571 +0000 UTC m=+20.319420650" observedRunningTime="2026-05-21 19:22:06.063387126 +0000 UTC m=+20.644922074" watchObservedRunningTime="2026-05-21 19:22:06.063872509 +0000 UTC m=+20.645407457" May 21 19:22:06.094418 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.094375 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dk9km" podStartSLOduration=3.013661376 podStartE2EDuration="20.094360113s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.658894186 +0000 UTC m=+3.240429113" lastFinishedPulling="2026-05-21 19:22:05.739592915 +0000 UTC m=+20.321127850" observedRunningTime="2026-05-21 19:22:06.094064213 +0000 UTC m=+20.675599160" watchObservedRunningTime="2026-05-21 19:22:06.094360113 +0000 UTC m=+20.675895059" May 21 19:22:06.163449 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:06.163395 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pclvh" podStartSLOduration=6.945606489 podStartE2EDuration="20.163378413s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.656761594 +0000 UTC m=+3.238296521" lastFinishedPulling="2026-05-21 19:22:01.874533515 +0000 UTC m=+16.456068445" observedRunningTime="2026-05-21 19:22:06.139390451 +0000 UTC m=+20.720925399" watchObservedRunningTime="2026-05-21 19:22:06.163378413 +0000 UTC m=+20.744913361" May 21 19:22:07.060872 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.060851 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:22:07.061212 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.061157 2572 generic.go:358] "Generic (PLEG): container finished" podID="d4809d2f-27cd-44ea-9765-582c99f2191a" containerID="a13e3eec045bdbd27d143a29d8d662cd5495ff7f7afbab5ed4925b51df15742b" exitCode=1 May 21 19:22:07.061262 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.061220 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"67dca63070842c62a84880f9ba6c5d9b6fc5c592978be2a4dfcf97154e0c6399"} May 21 19:22:07.061262 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.061247 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"194753190f6a4e4132337daf74de7718b366eb54d9482155e42ff33ded0c1aff"} May 21 19:22:07.061262 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.061258 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"af40b5df2a3a1e685a4408c1d8158624abee7f9bb4463be76897028ad672b8b2"} May 21 19:22:07.061360 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.061269 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"4070cc3bf8a151e50ea9284823f73a3f2187a03d8fc6d8de1aa1599b793f76ba"} May 21 19:22:07.061360 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.061281 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerDied","Data":"a13e3eec045bdbd27d143a29d8d662cd5495ff7f7afbab5ed4925b51df15742b"} May 21 19:22:07.061360 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.061296 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"e054815a34356bb92c8d4969deca964151853504aaeeda5af42751ad964f4679"} May 21 19:22:07.062476 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.062454 2572 generic.go:358] "Generic (PLEG): container finished" podID="3aac26a2-8ec0-4da6-8578-2a6856609d34" containerID="007eb687e1f748ca8703b532fbfac7cb25bc6975fb16d8421c9183d1ef9276c2" exitCode=0 May 21 19:22:07.062585 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.062561 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerDied","Data":"007eb687e1f748ca8703b532fbfac7cb25bc6975fb16d8421c9183d1ef9276c2"} May 21 19:22:07.097552 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.097506 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bf66b" podStartSLOduration=3.9765995739999997 podStartE2EDuration="21.097491193s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.653758975 +0000 UTC m=+3.235293902" lastFinishedPulling="2026-05-21 19:22:05.774650582 +0000 UTC m=+20.356185521" observedRunningTime="2026-05-21 19:22:06.163806673 +0000 UTC m=+20.745341620" watchObservedRunningTime="2026-05-21 19:22:07.097491193 +0000 UTC m=+21.679026144" May 21 19:22:07.527532 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.527380 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 19:22:07.745176 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.745149 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jrppl" May 21 19:22:07.745669 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.745652 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jrppl" May 21 19:22:07.984581 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.984543 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:07.984771 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.984617 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:07.984771 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.984718 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:07.984771 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:07.984744 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:07.984932 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:07.984786 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:07.984932 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:07.984830 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:07.990826 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.990753 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T19:22:07.527526711Z","UUID":"83694025-0b06-4b4d-a693-c454ff4ae87b","Handler":null,"Name":"","Endpoint":""} May 21 19:22:07.994048 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.994025 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 19:22:07.994048 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:07.994051 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 19:22:08.066365 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:08.066273 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbcww" event={"ID":"b40c9063-221d-4452-ae59-83522698a605","Type":"ContainerStarted","Data":"b62920c80542fae365921f6970e4a1791ac971191324248f87a1dfc7f26b1f77"} May 21 19:22:08.068144 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:08.068105 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" event={"ID":"378b21c5-162a-4329-90ae-34725880f704","Type":"ContainerStarted","Data":"d4dbc5063cd941fbcdf2c2c8f435374bd3556cd2901aca2f002fab78a2c0c47d"} May 21 19:22:08.068332 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:08.068316 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jrppl" May 21 19:22:08.068816 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:08.068799 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jrppl" May 21 19:22:08.137242 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:08.137181 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rbcww" podStartSLOduration=5.059962648 podStartE2EDuration="22.137165622s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.660978054 +0000 UTC m=+3.242512982" lastFinishedPulling="2026-05-21 19:22:05.738181015 +0000 UTC m=+20.319715956" observedRunningTime="2026-05-21 19:22:08.137078997 +0000 UTC m=+22.718613945" watchObservedRunningTime="2026-05-21 19:22:08.137165622 +0000 UTC m=+22.718700570" May 21 19:22:09.072626 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:09.072549 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:22:09.073235 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:09.072929 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"74669cdb756ef86acc7422e4630168332bf90d561bdfad2601168587ce44de8c"} May 21 19:22:09.074904 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:09.074864 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" event={"ID":"378b21c5-162a-4329-90ae-34725880f704","Type":"ContainerStarted","Data":"76eedc3d4e8fe08299601719b4035d9f801b772f9e47d280b24972cd13bd0a38"} May 21 19:22:09.985065 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:09.985035 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:09.985248 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:09.985034 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:09.985248 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:09.985161 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:09.985350 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:09.985035 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:09.985350 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:09.985254 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:09.985419 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:09.985365 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:11.985079 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:11.985022 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:11.985657 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:11.985031 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:11.985657 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:11.985168 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:11.985657 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:11.985032 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:11.985657 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:11.985258 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:11.985657 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:11.985320 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:12.237234 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:12.236885 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:12.237234 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:12.237025 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 19:22:12.237234 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:12.237162 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret podName:ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:28.237147282 +0000 UTC m=+42.818682231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret") pod "global-pull-secret-syncer-q2dr4" (UID: "ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389") : object "kube-system"/"original-pull-secret" not registered May 21 19:22:13.083398 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.083372 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:22:13.083892 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.083704 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"4ef17779eb72d661be32e3672a7fdda3a32e09ca878770214745eff66e9a015b"} May 21 19:22:13.084057 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.084028 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:22:13.084239 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.084221 2572 scope.go:117] "RemoveContainer" containerID="a13e3eec045bdbd27d143a29d8d662cd5495ff7f7afbab5ed4925b51df15742b" May 21 19:22:13.085438 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.085416 2572 generic.go:358] "Generic (PLEG): container finished" podID="3aac26a2-8ec0-4da6-8578-2a6856609d34" containerID="22b9d78bab478552bd83fbd4002debe4132bbbd3a384536c390c308d65cbdaa8" exitCode=0 May 21 19:22:13.085528 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.085453 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerDied","Data":"22b9d78bab478552bd83fbd4002debe4132bbbd3a384536c390c308d65cbdaa8"} May 21 19:22:13.102852 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.102834 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:22:13.125215 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.125178 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6mn7" podStartSLOduration=6.92508686 podStartE2EDuration="27.1251654s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.660624345 +0000 UTC m=+3.242159271" lastFinishedPulling="2026-05-21 19:22:08.86070287 +0000 UTC m=+23.442237811" observedRunningTime="2026-05-21 19:22:09.107124429 +0000 UTC m=+23.688659381" watchObservedRunningTime="2026-05-21 19:22:13.1251654 +0000 UTC m=+27.706700355" May 21 19:22:13.985241 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.985215 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:13.985241 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.985233 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:13.985396 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:13.985241 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:13.985396 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:13.985321 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:13.985457 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:13.985393 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:13.985522 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:13.985500 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:14.090723 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.090703 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:22:14.091102 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.091074 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" event={"ID":"d4809d2f-27cd-44ea-9765-582c99f2191a","Type":"ContainerStarted","Data":"f1ac1688f5064014ccebb955f353b04b614dfa01ad77541a0cfe8812d6fa58d6"} May 21 19:22:14.091441 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.091418 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:22:14.091546 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.091510 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:22:14.096796 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.096768 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerStarted","Data":"72d007547e69736b6be4ba7583704826ee90933e648159f6ccef5ce55ee49073"} May 21 19:22:14.106587 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.106556 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2dr4"] May 21 19:22:14.106700 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.106654 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:14.106763 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:14.106745 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:14.107393 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.107254 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:22:14.107634 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.107603 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87fcv"] May 21 19:22:14.107720 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.107685 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:14.107788 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:14.107758 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:14.115547 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.115487 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brx2f"] May 21 19:22:14.115650 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.115596 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:14.115717 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:14.115704 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:14.188207 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:14.188058 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" podStartSLOduration=10.844771021 podStartE2EDuration="28.188041177s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.663462328 +0000 UTC m=+3.244997260" lastFinishedPulling="2026-05-21 19:22:06.006732475 +0000 UTC m=+20.588267416" observedRunningTime="2026-05-21 19:22:14.183621147 +0000 UTC m=+28.765156094" watchObservedRunningTime="2026-05-21 19:22:14.188041177 +0000 UTC m=+28.769576125" May 21 19:22:15.101056 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:15.100852 2572 generic.go:358] "Generic (PLEG): container finished" podID="3aac26a2-8ec0-4da6-8578-2a6856609d34" containerID="72d007547e69736b6be4ba7583704826ee90933e648159f6ccef5ce55ee49073" exitCode=0 May 21 19:22:15.101056 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:15.101047 2572 generic.go:358] "Generic (PLEG): container finished" podID="3aac26a2-8ec0-4da6-8578-2a6856609d34" containerID="bc3bcf1657fcf2871314898dc8c876b158171b54c6fb95fc35bc3a95fb32c916" exitCode=0 May 21 19:22:15.101540 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:15.100928 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerDied","Data":"72d007547e69736b6be4ba7583704826ee90933e648159f6ccef5ce55ee49073"} May 21 19:22:15.101540 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:15.101169 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerDied","Data":"bc3bcf1657fcf2871314898dc8c876b158171b54c6fb95fc35bc3a95fb32c916"} May 21 19:22:15.985713 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:15.985626 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:15.985713 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:15.985708 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:15.985912 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:15.985741 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:15.985912 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:15.985770 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:15.985912 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:15.985795 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:15.985912 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:15.985875 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:17.985187 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:17.985154 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:17.985976 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:17.985196 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:17.985976 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:17.985158 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:17.985976 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:17.985284 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:22:17.985976 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:17.985360 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87fcv" podUID="ca62822f-41d2-4aab-a124-8998e0f630c3" May 21 19:22:17.985976 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:17.985408 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2dr4" podUID="ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389" May 21 19:22:18.322166 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.322080 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-8djsg"] May 21 19:22:18.323761 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.323741 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.335530 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.335505 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7n6hg\"" May 21 19:22:18.336624 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.336606 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 19:22:18.340635 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.340616 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 19:22:18.483514 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.483473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q47c\" (UniqueName: \"kubernetes.io/projected/68c0c65f-f132-4f61-8865-46dc7d3fd643-kube-api-access-7q47c\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.483514 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.483518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68c0c65f-f132-4f61-8865-46dc7d3fd643-hosts-file\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.483722 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.483567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c0c65f-f132-4f61-8865-46dc7d3fd643-tmp-dir\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.584181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.584097 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68c0c65f-f132-4f61-8865-46dc7d3fd643-hosts-file\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.584181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.584162 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c0c65f-f132-4f61-8865-46dc7d3fd643-tmp-dir\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.584396 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.584207 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7q47c\" (UniqueName: \"kubernetes.io/projected/68c0c65f-f132-4f61-8865-46dc7d3fd643-kube-api-access-7q47c\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.584396 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.584228 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68c0c65f-f132-4f61-8865-46dc7d3fd643-hosts-file\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.584554 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.584536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c0c65f-f132-4f61-8865-46dc7d3fd643-tmp-dir\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.609470 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.609444 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q47c\" (UniqueName: \"kubernetes.io/projected/68c0c65f-f132-4f61-8865-46dc7d3fd643-kube-api-access-7q47c\") pod \"node-resolver-8djsg\" (UID: \"68c0c65f-f132-4f61-8865-46dc7d3fd643\") " pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.638144 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.638108 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8djsg" May 21 19:22:18.646950 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:22:18.646921 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c0c65f_f132_4f61_8865_46dc7d3fd643.slice/crio-582635ba8eeb16108b71878d43dd5a8b8f75cec8019beb9aed694ed892bcfa3a WatchSource:0}: Error finding container 582635ba8eeb16108b71878d43dd5a8b8f75cec8019beb9aed694ed892bcfa3a: Status 404 returned error can't find the container with id 582635ba8eeb16108b71878d43dd5a8b8f75cec8019beb9aed694ed892bcfa3a May 21 19:22:18.702008 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.701777 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-228.ec2.internal" event="NodeReady" May 21 19:22:18.702182 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.702163 2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 19:22:18.944181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.944155 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67f46cb8cc-v48b2"] May 21 19:22:18.947151 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.947113 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:18.959960 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.959935 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mgmzm\"" May 21 19:22:18.960080 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.959984 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 19:22:18.969212 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.969185 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 19:22:18.976111 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.976085 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 19:22:18.998848 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:18.998824 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 19:22:19.042268 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.042232 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr"] May 21 19:22:19.045350 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.045330 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" May 21 19:22:19.049840 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.049817 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 19:22:19.050125 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.050108 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 19:22:19.050460 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.050444 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nlr22\"" May 21 19:22:19.054170 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.054146 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qmnc2"] May 21 19:22:19.057107 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.057090 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.059947 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.059929 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 19:22:19.060211 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.060197 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gdlf\"" May 21 19:22:19.060814 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.060801 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 19:22:19.084995 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.084965 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5"] May 21 19:22:19.087911 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.087887 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:19.088040 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-certificates\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.088110 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e9f49f-a2c8-4139-973f-7d953192dbff-ca-trust-extracted\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.088110 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-bound-sa-token\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.088239 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2phh\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-kube-api-access-g2phh\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.088239 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-trusted-ca\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.088327 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088265 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-image-registry-private-configuration\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.088378 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-installation-pull-secrets\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.088433 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.088398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.093663 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.093626 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 19:22:19.093773 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.093708 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 19:22:19.095083 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.095059 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pbwjv\"" May 21 19:22:19.107087 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.107063 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qmnc2"] May 21 19:22:19.107931 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.107787 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vfl59"] May 21 19:22:19.110802 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.110783 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:19.111162 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.111111 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8djsg" event={"ID":"68c0c65f-f132-4f61-8865-46dc7d3fd643","Type":"ContainerStarted","Data":"670fb41264fbfcf8058e3304477acfa3e04a1d1a024a23a48fcc6d2fd8d8a31e"} May 21 19:22:19.111266 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.111166 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8djsg" event={"ID":"68c0c65f-f132-4f61-8865-46dc7d3fd643","Type":"ContainerStarted","Data":"582635ba8eeb16108b71878d43dd5a8b8f75cec8019beb9aed694ed892bcfa3a"} May 21 19:22:19.117929 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.117892 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 19:22:19.118423 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.118374 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 19:22:19.118699 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.118678 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr"] May 21 19:22:19.119063 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.119044 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 19:22:19.142346 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.142320 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bcrm5\"" May 21 19:22:19.183991 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.183949 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5"] May 21 19:22:19.189367 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189342 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.189499 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189387 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-certificates\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.189499 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189425 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e9f49f-a2c8-4139-973f-7d953192dbff-ca-trust-extracted\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.189499 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22kz\" (UniqueName: \"kubernetes.io/projected/a7ae6c20-49cf-4d98-826c-77a9f20f9875-kube-api-access-r22kz\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.189499 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189479 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-bound-sa-token\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.189499 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.189493 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:22:19.189687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189503 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2phh\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-kube-api-access-g2phh\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.189687 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.189510 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:22:19.189687 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.189567 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:22:19.689548611 +0000 UTC m=+34.271083537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:22:19.189687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189623 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.189866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fa3b768e-6db4-465f-bda5-7f275fb218b5-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:19.189866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189740 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-trusted-ca\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.189866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189772 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-image-registry-private-configuration\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.189866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ae6c20-49cf-4d98-826c-77a9f20f9875-config-volume\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.189866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7ae6c20-49cf-4d98-826c-77a9f20f9875-tmp-dir\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.189866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189852 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:19.190106 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189925 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-installation-pull-secrets\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.190106 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.189958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkqkl\" (UniqueName: \"kubernetes.io/projected/4deafa50-3b25-4c32-babd-c5aa15dda3b9-kube-api-access-nkqkl\") pod \"network-check-source-7f44b6dd87-qhvwr\" (UID: \"4deafa50-3b25-4c32-babd-c5aa15dda3b9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" May 21 19:22:19.190230 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.190099 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e9f49f-a2c8-4139-973f-7d953192dbff-ca-trust-extracted\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.190357 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.190335 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-certificates\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.190634 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.190604 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-trusted-ca\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.193183 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.193159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-image-registry-private-configuration\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.193292 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.193271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-installation-pull-secrets\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.228496 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.228413 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vfl59"] May 21 19:22:19.230096 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.230070 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-bound-sa-token\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.230235 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.230163 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2phh\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-kube-api-access-g2phh\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.290662 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290621 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ae6c20-49cf-4d98-826c-77a9f20f9875-config-volume\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.290662 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290668 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7ae6c20-49cf-4d98-826c-77a9f20f9875-tmp-dir\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.290905 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290698 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:19.290905 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:19.290905 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.290788 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:22:19.290905 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290792 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkqkl\" (UniqueName: \"kubernetes.io/projected/4deafa50-3b25-4c32-babd-c5aa15dda3b9-kube-api-access-nkqkl\") pod \"network-check-source-7f44b6dd87-qhvwr\" (UID: \"4deafa50-3b25-4c32-babd-c5aa15dda3b9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" May 21 19:22:19.290905 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.290852 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:19.790833584 +0000 UTC m=+34.372368530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:22:19.290905 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290903 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r22kz\" (UniqueName: \"kubernetes.io/projected/a7ae6c20-49cf-4d98-826c-77a9f20f9875-kube-api-access-r22kz\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.291106 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9vkw\" (UniqueName: \"kubernetes.io/projected/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-kube-api-access-f9vkw\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:19.291106 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290959 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.291106 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.290984 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fa3b768e-6db4-465f-bda5-7f275fb218b5-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:19.291106 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.291046 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7ae6c20-49cf-4d98-826c-77a9f20f9875-tmp-dir\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.291277 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.291256 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:22:19.291348 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.291334 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:19.791307957 +0000 UTC m=+34.372842887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:22:19.291570 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.291541 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ae6c20-49cf-4d98-826c-77a9f20f9875-config-volume\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.291724 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.291705 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fa3b768e-6db4-465f-bda5-7f275fb218b5-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:19.316531 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.316499 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67f46cb8cc-v48b2"] May 21 19:22:19.392198 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.392112 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9vkw\" (UniqueName: \"kubernetes.io/projected/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-kube-api-access-f9vkw\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:19.392377 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.392241 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:19.392421 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.392396 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:22:19.392490 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.392478 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:19.892459208 +0000 UTC m=+34.473994145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:22:19.416271 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.416238 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkqkl\" (UniqueName: \"kubernetes.io/projected/4deafa50-3b25-4c32-babd-c5aa15dda3b9-kube-api-access-nkqkl\") pod \"network-check-source-7f44b6dd87-qhvwr\" (UID: \"4deafa50-3b25-4c32-babd-c5aa15dda3b9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" May 21 19:22:19.465783 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.465755 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9vkw\" (UniqueName: \"kubernetes.io/projected/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-kube-api-access-f9vkw\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:19.466031 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.466009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22kz\" (UniqueName: \"kubernetes.io/projected/a7ae6c20-49cf-4d98-826c-77a9f20f9875-kube-api-access-r22kz\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.550037 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.549928 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8djsg" podStartSLOduration=1.5499088570000001 podStartE2EDuration="1.549908857s" podCreationTimestamp="2026-05-21 19:22:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:22:19.548908145 +0000 UTC m=+34.130443092" watchObservedRunningTime="2026-05-21 19:22:19.549908857 +0000 UTC m=+34.131443806" May 21 19:22:19.655222 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.655193 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" May 21 19:22:19.694320 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.694285 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:19.694476 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.694334 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:19.694476 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.694414 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:22:19.694476 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.694438 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:22:19.694575 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.694489 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:22:19.694575 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.694503 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:22:20.694483751 +0000 UTC m=+35.276018685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:22:19.694575 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.694539 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:22:51.694527839 +0000 UTC m=+66.276062770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 19:22:19.795485 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.795438 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:19.795669 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.795506 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:19.795669 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.795549 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:19.795669 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.795612 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:22:19.795669 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.795634 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:22:19.795871 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.795687 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:20.795671709 +0000 UTC m=+35.377206635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:22:19.795871 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.795702 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:20.795696886 +0000 UTC m=+35.377231812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:22:19.798658 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.798635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg454\" (UniqueName: \"kubernetes.io/projected/ca62822f-41d2-4aab-a124-8998e0f630c3-kube-api-access-cg454\") pod \"network-check-target-87fcv\" (UID: \"ca62822f-41d2-4aab-a124-8998e0f630c3\") " pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:19.897094 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.897005 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:19.897264 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.897182 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:22:19.897264 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:19.897256 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:20.897237476 +0000 UTC m=+35.478772405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:22:19.985463 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.985424 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:19.985463 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.985449 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:19.985672 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.985546 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:19.995252 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.995232 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 19:22:19.995373 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.995361 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ft7h\"" May 21 19:22:19.995552 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.995534 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 19:22:19.995983 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.995970 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:19.996148 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:19.996119 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmtz4\"" May 21 19:22:20.703169 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:20.703114 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:20.703615 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.703286 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:22:20.703615 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.703309 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:22:20.703615 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.703382 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:22:22.703362746 +0000 UTC m=+37.284897688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:22:20.803733 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:20.803691 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:20.803925 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:20.803831 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:20.803925 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.803856 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:22:20.803925 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.803919 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:22:20.804077 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.803959 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:22.803911143 +0000 UTC m=+37.385446083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:22:20.804077 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.803987 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:22.803970017 +0000 UTC m=+37.385504947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:22:20.905095 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:20.905061 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:20.905291 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.905245 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:22:20.905361 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:20.905323 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:22.905301961 +0000 UTC m=+37.486836887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:22:21.199732 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:21.199691 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87fcv"] May 21 19:22:21.213905 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:21.213876 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr"] May 21 19:22:21.225232 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:22:21.225204 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca62822f_41d2_4aab_a124_8998e0f630c3.slice/crio-f990f5012458ae55e3701d7b9bfcbb91265bc9ffc95bc843c60b876cbeda3693 WatchSource:0}: Error finding container f990f5012458ae55e3701d7b9bfcbb91265bc9ffc95bc843c60b876cbeda3693: Status 404 returned error can't find the container with id f990f5012458ae55e3701d7b9bfcbb91265bc9ffc95bc843c60b876cbeda3693 May 21 19:22:21.225713 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:22:21.225690 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4deafa50_3b25_4c32_babd_c5aa15dda3b9.slice/crio-e5b262f525d48f58c0e8138ec16ec9ee94f9fcbb9b5b0bae0799d321d92051c0 WatchSource:0}: Error finding container e5b262f525d48f58c0e8138ec16ec9ee94f9fcbb9b5b0bae0799d321d92051c0: Status 404 returned error can't find the container with id e5b262f525d48f58c0e8138ec16ec9ee94f9fcbb9b5b0bae0799d321d92051c0 May 21 19:22:22.121082 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.120765 2572 generic.go:358] "Generic (PLEG): container finished" podID="3aac26a2-8ec0-4da6-8578-2a6856609d34" containerID="0f2fb4810637914ed1d28df7f9e67604307d748762cb531f40eaf66c5541951f" exitCode=0 May 21 19:22:22.121082 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.121002 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerDied","Data":"0f2fb4810637914ed1d28df7f9e67604307d748762cb531f40eaf66c5541951f"} May 21 19:22:22.123277 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.123248 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" event={"ID":"4deafa50-3b25-4c32-babd-c5aa15dda3b9","Type":"ContainerStarted","Data":"e5b262f525d48f58c0e8138ec16ec9ee94f9fcbb9b5b0bae0799d321d92051c0"} May 21 19:22:22.125751 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.125723 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87fcv" event={"ID":"ca62822f-41d2-4aab-a124-8998e0f630c3","Type":"ContainerStarted","Data":"f990f5012458ae55e3701d7b9bfcbb91265bc9ffc95bc843c60b876cbeda3693"} May 21 19:22:22.721179 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.721124 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:22.721612 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.721400 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:22:22.721612 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.721420 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:22:22.721612 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.721496 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:22:26.721474125 +0000 UTC m=+41.303009053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:22:22.822200 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.822166 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:22.822355 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.822230 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:22.822355 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.822322 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:22:22.822355 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.822347 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:22:22.822516 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.822402 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:26.822378053 +0000 UTC m=+41.403912993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:22:22.822516 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.822421 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:26.822411802 +0000 UTC m=+41.403946734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:22:22.923175 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:22.923124 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:22.923356 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.923284 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:22:22.923400 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:22.923362 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:26.923342283 +0000 UTC m=+41.504877216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:22:23.070573 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.070275 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd"] May 21 19:22:23.106922 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.106889 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm"] May 21 19:22:23.107893 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.107359 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.122604 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.122581 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm"] May 21 19:22:23.123069 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.122687 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.133713 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.133687 2572 generic.go:358] "Generic (PLEG): container finished" podID="3aac26a2-8ec0-4da6-8578-2a6856609d34" containerID="d49765a3fc0d840efd6555264345ba49aa60c748b7f9b594127561e92c04a9c9" exitCode=0 May 21 19:22:23.133836 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.133728 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerDied","Data":"d49765a3fc0d840efd6555264345ba49aa60c748b7f9b594127561e92c04a9c9"} May 21 19:22:23.138157 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.138019 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 19:22:23.138157 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.138049 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dv5xl\"" May 21 19:22:23.139057 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.138992 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 19:22:23.139057 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.139042 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 19:22:23.139218 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.139202 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 19:22:23.147374 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.147356 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 19:22:23.147609 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.147594 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k"] May 21 19:22:23.172611 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.172579 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd"] May 21 19:22:23.172736 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.172720 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.182421 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.182401 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 19:22:23.182543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.182471 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 19:22:23.182543 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.182521 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 19:22:23.182821 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.182800 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 19:22:23.200715 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.200674 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k"] May 21 19:22:23.225367 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.225341 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f522ff5-55ae-4838-9d5d-d77910b98369-klusterlet-config\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.225502 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.225385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f522ff5-55ae-4838-9d5d-d77910b98369-tmp\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.225502 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.225410 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6zjw\" (UniqueName: \"kubernetes.io/projected/785a74ac-9505-4a02-8230-822904d5bd03-kube-api-access-t6zjw\") pod \"managed-serviceaccount-addon-agent-576477b788-c5msm\" (UID: \"785a74ac-9505-4a02-8230-822904d5bd03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.225502 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.225454 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sf5j\" (UniqueName: \"kubernetes.io/projected/7f522ff5-55ae-4838-9d5d-d77910b98369-kube-api-access-5sf5j\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.225655 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.225556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/785a74ac-9505-4a02-8230-822904d5bd03-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-576477b788-c5msm\" (UID: \"785a74ac-9505-4a02-8230-822904d5bd03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.326585 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326473 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sf5j\" (UniqueName: \"kubernetes.io/projected/7f522ff5-55ae-4838-9d5d-d77910b98369-kube-api-access-5sf5j\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.326585 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326526 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.326585 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxt5\" (UniqueName: \"kubernetes.io/projected/e80edeb0-e0e3-4871-b049-e7a86226ec68-kube-api-access-zfxt5\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.326912 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/e80edeb0-e0e3-4871-b049-e7a86226ec68-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.326912 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326646 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/785a74ac-9505-4a02-8230-822904d5bd03-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-576477b788-c5msm\" (UID: \"785a74ac-9505-4a02-8230-822904d5bd03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.326912 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.326912 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326840 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f522ff5-55ae-4838-9d5d-d77910b98369-tmp\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.326912 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326869 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6zjw\" (UniqueName: \"kubernetes.io/projected/785a74ac-9505-4a02-8230-822904d5bd03-kube-api-access-t6zjw\") pod \"managed-serviceaccount-addon-agent-576477b788-c5msm\" (UID: \"785a74ac-9505-4a02-8230-822904d5bd03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.327267 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326960 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f522ff5-55ae-4838-9d5d-d77910b98369-klusterlet-config\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.327267 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.326997 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-ca\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.327267 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.327024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-hub\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.327403 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.327298 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f522ff5-55ae-4838-9d5d-d77910b98369-tmp\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.330830 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.330786 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f522ff5-55ae-4838-9d5d-d77910b98369-klusterlet-config\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.330830 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.330788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/785a74ac-9505-4a02-8230-822904d5bd03-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-576477b788-c5msm\" (UID: \"785a74ac-9505-4a02-8230-822904d5bd03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.342698 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.342668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sf5j\" (UniqueName: \"kubernetes.io/projected/7f522ff5-55ae-4838-9d5d-d77910b98369-kube-api-access-5sf5j\") pod \"klusterlet-addon-workmgr-64d69dc967-sndjd\" (UID: \"7f522ff5-55ae-4838-9d5d-d77910b98369\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.371486 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.371456 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6zjw\" (UniqueName: \"kubernetes.io/projected/785a74ac-9505-4a02-8230-822904d5bd03-kube-api-access-t6zjw\") pod \"managed-serviceaccount-addon-agent-576477b788-c5msm\" (UID: \"785a74ac-9505-4a02-8230-822904d5bd03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.419128 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.419094 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:23.428187 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.428154 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-ca\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.428294 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.428189 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-hub\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.428294 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.428246 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.428294 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.428276 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxt5\" (UniqueName: \"kubernetes.io/projected/e80edeb0-e0e3-4871-b049-e7a86226ec68-kube-api-access-zfxt5\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.428415 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.428306 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/e80edeb0-e0e3-4871-b049-e7a86226ec68-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.428415 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.428364 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.429116 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.429091 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/e80edeb0-e0e3-4871-b049-e7a86226ec68-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.430872 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.430839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.430980 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.430947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-hub\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.431060 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.430984 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.431225 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.431208 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e80edeb0-e0e3-4871-b049-e7a86226ec68-ca\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.440673 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.440655 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxt5\" (UniqueName: \"kubernetes.io/projected/e80edeb0-e0e3-4871-b049-e7a86226ec68-kube-api-access-zfxt5\") pod \"cluster-proxy-proxy-agent-577ff7c6b8-7v58k\" (UID: \"e80edeb0-e0e3-4871-b049-e7a86226ec68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:23.441485 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.441468 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" May 21 19:22:23.489862 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:23.489831 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:22:24.139019 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:24.138975 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" event={"ID":"3aac26a2-8ec0-4da6-8578-2a6856609d34","Type":"ContainerStarted","Data":"d9b605e8335a879406a3aabdaf26767841d10220c2b650292e370dd65454122c"} May 21 19:22:24.181649 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:24.181596 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gmrb7" podStartSLOduration=5.593765437 podStartE2EDuration="38.181574164s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:21:48.663921354 +0000 UTC m=+3.245456286" lastFinishedPulling="2026-05-21 19:22:21.251730087 +0000 UTC m=+35.833265013" observedRunningTime="2026-05-21 19:22:24.180627942 +0000 UTC m=+38.762162890" watchObservedRunningTime="2026-05-21 19:22:24.181574164 +0000 UTC m=+38.763109150" May 21 19:22:24.584271 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:24.584243 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm"] May 21 19:22:24.589412 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:22:24.589386 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod785a74ac_9505_4a02_8230_822904d5bd03.slice/crio-21a53b26301a413ca77c425fa808794b48a60161b333d2d3083edcf7421bf7d6 WatchSource:0}: Error finding container 21a53b26301a413ca77c425fa808794b48a60161b333d2d3083edcf7421bf7d6: Status 404 returned error can't find the container with id 21a53b26301a413ca77c425fa808794b48a60161b333d2d3083edcf7421bf7d6 May 21 19:22:24.803212 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:24.803185 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd"] May 21 19:22:24.803842 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:24.803816 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k"] May 21 19:22:24.804371 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:22:24.804342 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f522ff5_55ae_4838_9d5d_d77910b98369.slice/crio-e3d867c571716ca0c0c8384d877cc17ef0d4cbb230f8885555c0ab601af9da02 WatchSource:0}: Error finding container e3d867c571716ca0c0c8384d877cc17ef0d4cbb230f8885555c0ab601af9da02: Status 404 returned error can't find the container with id e3d867c571716ca0c0c8384d877cc17ef0d4cbb230f8885555c0ab601af9da02 May 21 19:22:24.804889 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:22:24.804868 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode80edeb0_e0e3_4871_b049_e7a86226ec68.slice/crio-98dfe684e29810fa496f36596e53fafba4c0fcb9d66703686969aae7b1db841b WatchSource:0}: Error finding container 98dfe684e29810fa496f36596e53fafba4c0fcb9d66703686969aae7b1db841b: Status 404 returned error can't find the container with id 98dfe684e29810fa496f36596e53fafba4c0fcb9d66703686969aae7b1db841b May 21 19:22:25.141824 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.141788 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" event={"ID":"785a74ac-9505-4a02-8230-822904d5bd03","Type":"ContainerStarted","Data":"21a53b26301a413ca77c425fa808794b48a60161b333d2d3083edcf7421bf7d6"} May 21 19:22:25.143002 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.142977 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" event={"ID":"4deafa50-3b25-4c32-babd-c5aa15dda3b9","Type":"ContainerStarted","Data":"65cdad237ac43fa4d5c202b0a576cc55eb238efafebe66091d310ba2950b02e9"} May 21 19:22:25.144043 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.144012 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" event={"ID":"7f522ff5-55ae-4838-9d5d-d77910b98369","Type":"ContainerStarted","Data":"e3d867c571716ca0c0c8384d877cc17ef0d4cbb230f8885555c0ab601af9da02"} May 21 19:22:25.145151 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.145108 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87fcv" event={"ID":"ca62822f-41d2-4aab-a124-8998e0f630c3","Type":"ContainerStarted","Data":"372e216bc73a44d0a47fd27974902d1aa34cc860996fb400d037618efb7ac73e"} May 21 19:22:25.145248 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.145237 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:22:25.146110 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.146092 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" event={"ID":"e80edeb0-e0e3-4871-b049-e7a86226ec68","Type":"ContainerStarted","Data":"98dfe684e29810fa496f36596e53fafba4c0fcb9d66703686969aae7b1db841b"} May 21 19:22:25.191723 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.191460 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-qhvwr" podStartSLOduration=32.545403301 podStartE2EDuration="36.191442717s" podCreationTimestamp="2026-05-21 19:21:49 +0000 UTC" firstStartedPulling="2026-05-21 19:22:21.229997216 +0000 UTC m=+35.811532149" lastFinishedPulling="2026-05-21 19:22:24.876036621 +0000 UTC m=+39.457571565" observedRunningTime="2026-05-21 19:22:25.190223927 +0000 UTC m=+39.771758875" watchObservedRunningTime="2026-05-21 19:22:25.191442717 +0000 UTC m=+39.772977666" May 21 19:22:25.251519 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:25.251425 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-87fcv" podStartSLOduration=35.596486561 podStartE2EDuration="39.251410974s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:22:21.229972094 +0000 UTC m=+35.811507026" lastFinishedPulling="2026-05-21 19:22:24.884896509 +0000 UTC m=+39.466431439" observedRunningTime="2026-05-21 19:22:25.250401051 +0000 UTC m=+39.831936001" watchObservedRunningTime="2026-05-21 19:22:25.251410974 +0000 UTC m=+39.832945922" May 21 19:22:26.757531 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:26.757487 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:26.758216 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.757679 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:22:26.758216 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.757696 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:22:26.758216 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.757759 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:22:34.757737389 +0000 UTC m=+49.339272339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:22:26.858192 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:26.858121 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:26.858408 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:26.858237 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:26.858408 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.858408 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:22:26.858629 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.858470 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:34.85845078 +0000 UTC m=+49.439985728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:22:26.858892 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.858861 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:22:26.858958 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.858907 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:34.858893854 +0000 UTC m=+49.440428794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:22:26.959236 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:26.959199 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:26.959518 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.959374 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:22:26.959518 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:26.959443 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:34.959414572 +0000 UTC m=+49.540949504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:22:28.272810 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:28.272778 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:28.275276 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:28.275248 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389-original-pull-secret\") pod \"global-pull-secret-syncer-q2dr4\" (UID: \"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389\") " pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:28.408096 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:28.408058 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2dr4" May 21 19:22:32.591018 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:32.590986 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2dr4"] May 21 19:22:32.593351 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:22:32.593318 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea917f49_1df5_4c9f_a0ed_bf8ee6fa6389.slice/crio-0bdfe33dc2989e5f3bfa037b7799da36f2a754eff1e2f730cfc8a900477341bd WatchSource:0}: Error finding container 0bdfe33dc2989e5f3bfa037b7799da36f2a754eff1e2f730cfc8a900477341bd: Status 404 returned error can't find the container with id 0bdfe33dc2989e5f3bfa037b7799da36f2a754eff1e2f730cfc8a900477341bd May 21 19:22:33.164716 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.164686 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" event={"ID":"785a74ac-9505-4a02-8230-822904d5bd03","Type":"ContainerStarted","Data":"35b47dcec79dcae4c7c6d511b84b5e3ea64ed9eb99465c44034d04be94904e5a"} May 21 19:22:33.165964 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.165935 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" event={"ID":"7f522ff5-55ae-4838-9d5d-d77910b98369","Type":"ContainerStarted","Data":"1db04484b5c41601614a053e2888d95eb822208df65739067f05956ddee1cd9c"} May 21 19:22:33.166169 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.166151 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:33.167007 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.166975 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2dr4" event={"ID":"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389","Type":"ContainerStarted","Data":"0bdfe33dc2989e5f3bfa037b7799da36f2a754eff1e2f730cfc8a900477341bd"} May 21 19:22:33.167956 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.167937 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:22:33.168308 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.168288 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" event={"ID":"e80edeb0-e0e3-4871-b049-e7a86226ec68","Type":"ContainerStarted","Data":"1435e31e8bc6967a576328c930c7722c7df59c20bf47b09990e429185f3add8e"} May 21 19:22:33.189144 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.189089 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" podStartSLOduration=2.32607978 podStartE2EDuration="10.18907495s" podCreationTimestamp="2026-05-21 19:22:23 +0000 UTC" firstStartedPulling="2026-05-21 19:22:24.591206161 +0000 UTC m=+39.172741087" lastFinishedPulling="2026-05-21 19:22:32.454201313 +0000 UTC m=+47.035736257" observedRunningTime="2026-05-21 19:22:33.189014706 +0000 UTC m=+47.770549656" watchObservedRunningTime="2026-05-21 19:22:33.18907495 +0000 UTC m=+47.770609949" May 21 19:22:33.234917 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:33.234862 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" podStartSLOduration=2.6219896929999997 podStartE2EDuration="10.234842405s" podCreationTimestamp="2026-05-21 19:22:23 +0000 UTC" firstStartedPulling="2026-05-21 19:22:24.842483919 +0000 UTC m=+39.424018845" lastFinishedPulling="2026-05-21 19:22:32.455336618 +0000 UTC m=+47.036871557" observedRunningTime="2026-05-21 19:22:33.23361662 +0000 UTC m=+47.815151570" watchObservedRunningTime="2026-05-21 19:22:33.234842405 +0000 UTC m=+47.816377355" May 21 19:22:34.827534 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:34.827491 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:34.827966 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:34.827674 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:22:34.827966 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:34.827696 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:22:34.827966 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:34.827767 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:22:50.827743578 +0000 UTC m=+65.409278507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:22:34.928302 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:34.928258 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:34.928623 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:34.928338 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:34.928623 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:34.928436 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:22:34.928623 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:34.928496 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:50.928477139 +0000 UTC m=+65.510012088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:22:34.928623 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:34.928436 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:22:34.928623 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:34.928581 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:50.928562674 +0000 UTC m=+65.510097616 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:22:35.028891 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:35.028851 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:35.029076 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:35.029005 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:22:35.029076 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:35.029070 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:22:51.029050974 +0000 UTC m=+65.610585920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:22:36.179090 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:36.179047 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" event={"ID":"e80edeb0-e0e3-4871-b049-e7a86226ec68","Type":"ContainerStarted","Data":"b9c74b26c070c353763fb52facd1801e78b24a6ec8bbbe5deeaa371581d7c163"} May 21 19:22:36.179090 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:36.179094 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" event={"ID":"e80edeb0-e0e3-4871-b049-e7a86226ec68","Type":"ContainerStarted","Data":"391e7dffe5b398b26acf400f168785299fdb3a89294bb7121b311c8cc1f14eea"} May 21 19:22:36.210707 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:36.210651 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" podStartSLOduration=2.869197417 podStartE2EDuration="13.210636498s" podCreationTimestamp="2026-05-21 19:22:23 +0000 UTC" firstStartedPulling="2026-05-21 19:22:24.842452868 +0000 UTC m=+39.423987794" lastFinishedPulling="2026-05-21 19:22:35.183891947 +0000 UTC m=+49.765426875" observedRunningTime="2026-05-21 19:22:36.210251153 +0000 UTC m=+50.791786112" watchObservedRunningTime="2026-05-21 19:22:36.210636498 +0000 UTC m=+50.792171447" May 21 19:22:38.184102 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:38.184063 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2dr4" event={"ID":"ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389","Type":"ContainerStarted","Data":"2c5d08e7330e08882d470a939e8e56c7a685d5e8ce78806cff0b73f44fa6d5db"} May 21 19:22:46.113025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:46.112995 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwrjl" May 21 19:22:46.170894 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:46.170848 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q2dr4" podStartSLOduration=45.351209405 podStartE2EDuration="50.170834273s" podCreationTimestamp="2026-05-21 19:21:56 +0000 UTC" firstStartedPulling="2026-05-21 19:22:32.595319895 +0000 UTC m=+47.176854821" lastFinishedPulling="2026-05-21 19:22:37.414944762 +0000 UTC m=+51.996479689" observedRunningTime="2026-05-21 19:22:38.21407441 +0000 UTC m=+52.795609357" watchObservedRunningTime="2026-05-21 19:22:46.170834273 +0000 UTC m=+60.752369220" May 21 19:22:50.852581 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:50.852528 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:22:50.853062 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:50.852695 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:22:50.853062 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:50.852716 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:22:50.853062 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:50.852805 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:23:22.852784982 +0000 UTC m=+97.434319908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:22:50.953270 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:50.953234 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:22:50.953454 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:50.953318 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:22:50.953454 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:50.953386 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:22:50.953454 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:50.953442 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:22:50.953583 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:50.953462 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:22.953444021 +0000 UTC m=+97.534978951 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:22:50.953583 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:50.953491 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:22.953476204 +0000 UTC m=+97.535011130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:22:51.054326 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:51.054290 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:22:51.054497 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:51.054417 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:22:51.054497 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:51.054479 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:23:23.054462897 +0000 UTC m=+97.635997840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:22:51.759149 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:51.759108 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:22:51.762698 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:51.762679 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 19:22:51.769825 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:51.769802 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 19:22:51.769903 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:22:51.769859 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:23:55.769844685 +0000 UTC m=+130.351379615 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : secret "metrics-daemon-secret" not found May 21 19:22:56.151244 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:22:56.151217 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-87fcv" May 21 19:23:22.904313 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:23:22.904264 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:23:22.904802 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:22.904417 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:23:22.904802 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:22.904441 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:23:22.904802 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:22.904509 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:24:26.904491391 +0000 UTC m=+161.486026321 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:23:23.005166 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:23:23.005119 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:23:23.005315 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:23:23.005224 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:23:23.005315 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:23.005271 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:23:23.005384 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:23.005325 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:23:23.005384 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:23.005352 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:24:27.005327729 +0000 UTC m=+161.586862668 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:23:23.005384 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:23.005368 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:24:27.005357832 +0000 UTC m=+161.586892758 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:23:23.106187 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:23:23.106160 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:23:23.106336 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:23.106300 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:23:23.106386 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:23.106368 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:24:27.106349902 +0000 UTC m=+161.687884828 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:23:55.852479 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:23:55.852430 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:23:55.852954 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:55.852578 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 19:23:55.852954 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:23:55.852656 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs podName:0f15de18-ac92-4d20-a434-13487d1306fb nodeName:}" failed. No retries permitted until 2026-05-21 19:25:57.852639821 +0000 UTC m=+252.434174752 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs") pod "network-metrics-daemon-brx2f" (UID: "0f15de18-ac92-4d20-a434-13487d1306fb") : secret "metrics-daemon-secret" not found May 21 19:24:21.956045 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:21.955996 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" podUID="95e9f49f-a2c8-4139-973f-7d953192dbff" May 21 19:24:22.066472 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:22.066423 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qmnc2" podUID="a7ae6c20-49cf-4d98-826c-77a9f20f9875" May 21 19:24:22.097782 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:22.097756 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" podUID="fa3b768e-6db4-465f-bda5-7f275fb218b5" May 21 19:24:22.121454 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:22.121425 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vfl59" podUID="408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5" May 21 19:24:22.428495 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:22.426243 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:24:22.428495 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:22.426649 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:24:22.428495 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:22.427009 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qmnc2" May 21 19:24:22.428495 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:22.427379 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:24:23.004368 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:23.004312 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-brx2f" podUID="0f15de18-ac92-4d20-a434-13487d1306fb" May 21 19:24:26.995961 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:26.995923 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") pod \"image-registry-67f46cb8cc-v48b2\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:24:26.996378 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:26.996069 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 19:24:26.996378 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:26.996091 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f46cb8cc-v48b2: secret "image-registry-tls" not found May 21 19:24:26.996378 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:26.996172 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls podName:95e9f49f-a2c8-4139-973f-7d953192dbff nodeName:}" failed. No retries permitted until 2026-05-21 19:26:28.996156951 +0000 UTC m=+283.577691878 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls") pod "image-registry-67f46cb8cc-v48b2" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff") : secret "image-registry-tls" not found May 21 19:24:27.097245 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:27.097164 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:24:27.097245 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:27.097231 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:24:27.097429 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:27.097297 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 19:24:27.097429 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:27.097335 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 19:24:27.097429 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:27.097364 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert podName:fa3b768e-6db4-465f-bda5-7f275fb218b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:26:29.097348282 +0000 UTC m=+283.678883213 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-57lf5" (UID: "fa3b768e-6db4-465f-bda5-7f275fb218b5") : secret "networking-console-plugin-cert" not found May 21 19:24:27.097429 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:27.097378 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls podName:a7ae6c20-49cf-4d98-826c-77a9f20f9875 nodeName:}" failed. No retries permitted until 2026-05-21 19:26:29.097372082 +0000 UTC m=+283.678907008 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls") pod "dns-default-qmnc2" (UID: "a7ae6c20-49cf-4d98-826c-77a9f20f9875") : secret "dns-default-metrics-tls" not found May 21 19:24:27.197794 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:27.197757 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:24:27.197960 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:27.197905 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 19:24:27.198006 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:24:27.197969 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert podName:408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5 nodeName:}" failed. No retries permitted until 2026-05-21 19:26:29.197953048 +0000 UTC m=+283.779487977 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert") pod "ingress-canary-vfl59" (UID: "408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5") : secret "canary-serving-cert" not found May 21 19:24:33.167299 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.167255 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" podUID="7f522ff5-55ae-4838-9d5d-d77910b98369" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused" May 21 19:24:33.419751 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.419677 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" podUID="7f522ff5-55ae-4838-9d5d-d77910b98369" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/healthz\": dial tcp 10.132.0.11:8000: connect: connection refused" May 21 19:24:33.441919 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.441889 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" podUID="785a74ac-9505-4a02-8230-822904d5bd03" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.12:8000/healthz\": dial tcp 10.132.0.12:8000: connect: connection refused" May 21 19:24:33.452360 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.452332 2572 generic.go:358] "Generic (PLEG): container finished" podID="785a74ac-9505-4a02-8230-822904d5bd03" containerID="35b47dcec79dcae4c7c6d511b84b5e3ea64ed9eb99465c44034d04be94904e5a" exitCode=255 May 21 19:24:33.452498 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.452398 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" event={"ID":"785a74ac-9505-4a02-8230-822904d5bd03","Type":"ContainerDied","Data":"35b47dcec79dcae4c7c6d511b84b5e3ea64ed9eb99465c44034d04be94904e5a"} May 21 19:24:33.452734 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.452713 2572 scope.go:117] "RemoveContainer" containerID="35b47dcec79dcae4c7c6d511b84b5e3ea64ed9eb99465c44034d04be94904e5a" May 21 19:24:33.453667 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.453647 2572 generic.go:358] "Generic (PLEG): container finished" podID="7f522ff5-55ae-4838-9d5d-d77910b98369" containerID="1db04484b5c41601614a053e2888d95eb822208df65739067f05956ddee1cd9c" exitCode=1 May 21 19:24:33.453741 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.453721 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" event={"ID":"7f522ff5-55ae-4838-9d5d-d77910b98369","Type":"ContainerDied","Data":"1db04484b5c41601614a053e2888d95eb822208df65739067f05956ddee1cd9c"} May 21 19:24:33.454063 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:33.454013 2572 scope.go:117] "RemoveContainer" containerID="1db04484b5c41601614a053e2888d95eb822208df65739067f05956ddee1cd9c" May 21 19:24:34.410811 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:34.410778 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8djsg_68c0c65f-f132-4f61-8865-46dc7d3fd643/dns-node-resolver/0.log" May 21 19:24:34.457105 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:34.457064 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576477b788-c5msm" event={"ID":"785a74ac-9505-4a02-8230-822904d5bd03","Type":"ContainerStarted","Data":"f73d4152bcb26bfef9dc2fb168b25e766354638ae24483bc2a00eb68e6c340d7"} May 21 19:24:34.458510 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:34.458488 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" event={"ID":"7f522ff5-55ae-4838-9d5d-d77910b98369","Type":"ContainerStarted","Data":"1de98d9ef92128ac307458c638e9903f16ef0b3e3ee908714fef4002ac75bfe5"} May 21 19:24:34.458750 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:34.458736 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:24:34.459709 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:34.459691 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64d69dc967-sndjd" May 21 19:24:35.402867 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:35.402841 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pclvh_82e602a4-1b48-4a6e-8ec5-d4f7093b6707/node-ca/0.log" May 21 19:24:37.985333 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:37.985295 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:24:56.069624 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.069588 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-shwzm"] May 21 19:24:56.071577 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.071560 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.074084 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.074060 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 19:24:56.075245 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.075212 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 19:24:56.075358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.075245 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zspvh\"" May 21 19:24:56.075358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.075261 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 19:24:56.075358 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.075304 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 19:24:56.090263 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.090239 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shwzm"] May 21 19:24:56.125433 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.125408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97d17a1-9630-4518-8598-ff26ee6c0e70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.125568 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.125444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97d17a1-9630-4518-8598-ff26ee6c0e70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.125568 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.125478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a97d17a1-9630-4518-8598-ff26ee6c0e70-data-volume\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.125568 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.125542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a97d17a1-9630-4518-8598-ff26ee6c0e70-crio-socket\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.125669 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.125590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qzj\" (UniqueName: \"kubernetes.io/projected/a97d17a1-9630-4518-8598-ff26ee6c0e70-kube-api-access-g5qzj\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.226600 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.226565 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97d17a1-9630-4518-8598-ff26ee6c0e70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.226779 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.226611 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97d17a1-9630-4518-8598-ff26ee6c0e70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.226779 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.226665 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a97d17a1-9630-4518-8598-ff26ee6c0e70-data-volume\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.226779 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.226705 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a97d17a1-9630-4518-8598-ff26ee6c0e70-crio-socket\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.226779 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.226741 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qzj\" (UniqueName: \"kubernetes.io/projected/a97d17a1-9630-4518-8598-ff26ee6c0e70-kube-api-access-g5qzj\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.226992 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.226838 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a97d17a1-9630-4518-8598-ff26ee6c0e70-crio-socket\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.227096 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.227077 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a97d17a1-9630-4518-8598-ff26ee6c0e70-data-volume\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.227306 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.227281 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a97d17a1-9630-4518-8598-ff26ee6c0e70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.228814 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.228797 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a97d17a1-9630-4518-8598-ff26ee6c0e70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.245015 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.244990 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qzj\" (UniqueName: \"kubernetes.io/projected/a97d17a1-9630-4518-8598-ff26ee6c0e70-kube-api-access-g5qzj\") pod \"insights-runtime-extractor-shwzm\" (UID: \"a97d17a1-9630-4518-8598-ff26ee6c0e70\") " pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.380649 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.380551 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shwzm" May 21 19:24:56.537162 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:56.537109 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shwzm"] May 21 19:24:56.540358 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:24:56.540328 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97d17a1_9630_4518_8598_ff26ee6c0e70.slice/crio-5b9854d9e9c234b2594240ccad68dcd6152afe9cd91e0a86cd1d2f131f81c336 WatchSource:0}: Error finding container 5b9854d9e9c234b2594240ccad68dcd6152afe9cd91e0a86cd1d2f131f81c336: Status 404 returned error can't find the container with id 5b9854d9e9c234b2594240ccad68dcd6152afe9cd91e0a86cd1d2f131f81c336 May 21 19:24:57.513087 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:57.513002 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shwzm" event={"ID":"a97d17a1-9630-4518-8598-ff26ee6c0e70","Type":"ContainerStarted","Data":"3919d4987e13786118a4b3d84e48c6df3f1e288dcba7bca96ba97ff704f249b9"} May 21 19:24:57.513087 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:57.513043 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shwzm" event={"ID":"a97d17a1-9630-4518-8598-ff26ee6c0e70","Type":"ContainerStarted","Data":"30e5f8d28f255e42f4db645b22e1f739577ff88359d7a145cca85749991d67fd"} May 21 19:24:57.513087 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:57.513052 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shwzm" event={"ID":"a97d17a1-9630-4518-8598-ff26ee6c0e70","Type":"ContainerStarted","Data":"5b9854d9e9c234b2594240ccad68dcd6152afe9cd91e0a86cd1d2f131f81c336"} May 21 19:24:59.518954 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:59.518916 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shwzm" event={"ID":"a97d17a1-9630-4518-8598-ff26ee6c0e70","Type":"ContainerStarted","Data":"6be5096aa427584adaa6dedae49cdaeddc0bc00edf02aaf70e91ba06375c2523"} May 21 19:24:59.541597 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:24:59.541548 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-shwzm" podStartSLOduration=1.571967299 podStartE2EDuration="3.541533121s" podCreationTimestamp="2026-05-21 19:24:56 +0000 UTC" firstStartedPulling="2026-05-21 19:24:56.592948308 +0000 UTC m=+191.174483239" lastFinishedPulling="2026-05-21 19:24:58.562514134 +0000 UTC m=+193.144049061" observedRunningTime="2026-05-21 19:24:59.541425178 +0000 UTC m=+194.122960127" watchObservedRunningTime="2026-05-21 19:24:59.541533121 +0000 UTC m=+194.123068072" May 21 19:25:13.491383 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:13.491342 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" podUID="e80edeb0-e0e3-4871-b049-e7a86226ec68" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 19:25:18.162339 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.162304 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f8h6g"] May 21 19:25:18.165066 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.165043 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67f46cb8cc-v48b2"] May 21 19:25:18.165227 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.165207 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.165311 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:25:18.165242 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" podUID="95e9f49f-a2c8-4139-973f-7d953192dbff" May 21 19:25:18.168728 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.168706 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 19:25:18.169070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.169053 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 19:25:18.169070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.169066 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 19:25:18.169606 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.169591 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 19:25:18.170107 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.170094 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 19:25:18.170170 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.170113 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 19:25:18.170170 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.170149 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gmcqh\"" May 21 19:25:18.311843 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.311809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k74jr\" (UniqueName: \"kubernetes.io/projected/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-kube-api-access-k74jr\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.311843 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.311853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.312112 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.311888 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-sys\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.312112 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.311981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-textfile\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.312112 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.312026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-tls\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.312112 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.312076 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-root\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.312324 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.312121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-wtmp\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.312324 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.312169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-metrics-client-ca\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.312324 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.312212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.413610 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413513 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-root\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.413762 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-root\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.413762 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413670 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-wtmp\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.413762 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413703 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-metrics-client-ca\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.413762 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413739 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413766 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k74jr\" (UniqueName: \"kubernetes.io/projected/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-kube-api-access-k74jr\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413785 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-wtmp\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413790 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413842 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-sys\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413907 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-textfile\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.413933 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-tls\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.414108 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-sys\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414659 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.414321 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-textfile\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414659 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.414389 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-metrics-client-ca\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.414659 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.414409 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.416179 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.416160 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-tls\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.416294 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.416276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.442954 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.442924 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k74jr\" (UniqueName: \"kubernetes.io/projected/75bbbf80-fe02-4dc7-9710-145d3d6a7ad4-kube-api-access-k74jr\") pod \"node-exporter-f8h6g\" (UID: \"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4\") " pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.473744 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.473702 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8h6g" May 21 19:25:18.482735 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:25:18.482708 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bbbf80_fe02_4dc7_9710_145d3d6a7ad4.slice/crio-a29674c5e3049af3eb97ec1bdffdf11fa14278bb12017783fa4579a113b2a63c WatchSource:0}: Error finding container a29674c5e3049af3eb97ec1bdffdf11fa14278bb12017783fa4579a113b2a63c: Status 404 returned error can't find the container with id a29674c5e3049af3eb97ec1bdffdf11fa14278bb12017783fa4579a113b2a63c May 21 19:25:18.568872 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.568846 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:25:18.569110 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.568843 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8h6g" event={"ID":"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4","Type":"ContainerStarted","Data":"a29674c5e3049af3eb97ec1bdffdf11fa14278bb12017783fa4579a113b2a63c"} May 21 19:25:18.573062 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.573039 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:25:18.716181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716073 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-certificates\") pod \"95e9f49f-a2c8-4139-973f-7d953192dbff\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " May 21 19:25:18.716181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716119 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-bound-sa-token\") pod \"95e9f49f-a2c8-4139-973f-7d953192dbff\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " May 21 19:25:18.716181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716162 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2phh\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-kube-api-access-g2phh\") pod \"95e9f49f-a2c8-4139-973f-7d953192dbff\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " May 21 19:25:18.716469 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716195 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-installation-pull-secrets\") pod \"95e9f49f-a2c8-4139-973f-7d953192dbff\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " May 21 19:25:18.716469 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716216 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e9f49f-a2c8-4139-973f-7d953192dbff-ca-trust-extracted\") pod \"95e9f49f-a2c8-4139-973f-7d953192dbff\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " May 21 19:25:18.716469 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716237 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-image-registry-private-configuration\") pod \"95e9f49f-a2c8-4139-973f-7d953192dbff\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " May 21 19:25:18.716469 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716304 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-trusted-ca\") pod \"95e9f49f-a2c8-4139-973f-7d953192dbff\" (UID: \"95e9f49f-a2c8-4139-973f-7d953192dbff\") " May 21 19:25:18.716686 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716546 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "95e9f49f-a2c8-4139-973f-7d953192dbff" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 19:25:18.716686 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716546 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e9f49f-a2c8-4139-973f-7d953192dbff-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "95e9f49f-a2c8-4139-973f-7d953192dbff" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 19:25:18.716848 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.716825 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "95e9f49f-a2c8-4139-973f-7d953192dbff" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 19:25:18.718493 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.718468 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-kube-api-access-g2phh" (OuterVolumeSpecName: "kube-api-access-g2phh") pod "95e9f49f-a2c8-4139-973f-7d953192dbff" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff"). InnerVolumeSpecName "kube-api-access-g2phh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 19:25:18.718571 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.718549 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "95e9f49f-a2c8-4139-973f-7d953192dbff" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 19:25:18.718796 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.718773 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "95e9f49f-a2c8-4139-973f-7d953192dbff" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 19:25:18.718856 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.718812 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "95e9f49f-a2c8-4139-973f-7d953192dbff" (UID: "95e9f49f-a2c8-4139-973f-7d953192dbff"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 19:25:18.817579 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.817543 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-trusted-ca\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:18.817579 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.817572 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-certificates\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:18.817579 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.817581 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-bound-sa-token\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:18.817579 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.817590 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2phh\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-kube-api-access-g2phh\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:18.817842 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.817599 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-installation-pull-secrets\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:18.817842 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.817608 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e9f49f-a2c8-4139-973f-7d953192dbff-ca-trust-extracted\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:18.817842 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:18.817617 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e9f49f-a2c8-4139-973f-7d953192dbff-image-registry-private-configuration\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:19.570864 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:19.570834 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f46cb8cc-v48b2" May 21 19:25:19.632053 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:19.632022 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67f46cb8cc-v48b2"] May 21 19:25:19.637912 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:19.637888 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67f46cb8cc-v48b2"] May 21 19:25:19.825889 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:19.825858 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e9f49f-a2c8-4139-973f-7d953192dbff-registry-tls\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:25:19.988235 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:19.988122 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e9f49f-a2c8-4139-973f-7d953192dbff" path="/var/lib/kubelet/pods/95e9f49f-a2c8-4139-973f-7d953192dbff/volumes" May 21 19:25:20.574841 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:20.574806 2572 generic.go:358] "Generic (PLEG): container finished" podID="75bbbf80-fe02-4dc7-9710-145d3d6a7ad4" containerID="7795cd6152b93023aa3d89226932d593ab33532310f7098e98e9f4ddc9fd050a" exitCode=0 May 21 19:25:20.575298 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:20.574896 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8h6g" event={"ID":"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4","Type":"ContainerDied","Data":"7795cd6152b93023aa3d89226932d593ab33532310f7098e98e9f4ddc9fd050a"} May 21 19:25:21.579045 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:21.579006 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8h6g" event={"ID":"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4","Type":"ContainerStarted","Data":"4976d2ca1500edb3f93f34cbde5f9b5b88d126e5c4bb90fd365732bdcb97d3f1"} May 21 19:25:21.579045 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:21.579042 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8h6g" event={"ID":"75bbbf80-fe02-4dc7-9710-145d3d6a7ad4","Type":"ContainerStarted","Data":"a58939bb5b3a8386031806825e12148f05e8c6b83535fb1e436b991718b30ca9"} May 21 19:25:21.639208 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:21.639155 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f8h6g" podStartSLOduration=2.52357262 podStartE2EDuration="3.639124907s" podCreationTimestamp="2026-05-21 19:25:18 +0000 UTC" firstStartedPulling="2026-05-21 19:25:18.484707986 +0000 UTC m=+213.066242913" lastFinishedPulling="2026-05-21 19:25:19.60026027 +0000 UTC m=+214.181795200" observedRunningTime="2026-05-21 19:25:21.638195442 +0000 UTC m=+216.219730390" watchObservedRunningTime="2026-05-21 19:25:21.639124907 +0000 UTC m=+216.220659857" May 21 19:25:23.491195 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:23.491156 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" podUID="e80edeb0-e0e3-4871-b049-e7a86226ec68" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 19:25:33.491680 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:33.491641 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" podUID="e80edeb0-e0e3-4871-b049-e7a86226ec68" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 19:25:33.492166 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:33.491709 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" May 21 19:25:33.492219 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:33.492187 2572 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b9c74b26c070c353763fb52facd1801e78b24a6ec8bbbe5deeaa371581d7c163"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 19:25:33.492264 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:33.492250 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" podUID="e80edeb0-e0e3-4871-b049-e7a86226ec68" containerName="service-proxy" containerID="cri-o://b9c74b26c070c353763fb52facd1801e78b24a6ec8bbbe5deeaa371581d7c163" gracePeriod=30 May 21 19:25:33.606903 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:33.606880 2572 generic.go:358] "Generic (PLEG): container finished" podID="e80edeb0-e0e3-4871-b049-e7a86226ec68" containerID="b9c74b26c070c353763fb52facd1801e78b24a6ec8bbbe5deeaa371581d7c163" exitCode=2 May 21 19:25:33.606989 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:33.606954 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" event={"ID":"e80edeb0-e0e3-4871-b049-e7a86226ec68","Type":"ContainerDied","Data":"b9c74b26c070c353763fb52facd1801e78b24a6ec8bbbe5deeaa371581d7c163"} May 21 19:25:34.611293 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:34.611260 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577ff7c6b8-7v58k" event={"ID":"e80edeb0-e0e3-4871-b049-e7a86226ec68","Type":"ContainerStarted","Data":"bdd5842a6d8733fa4b8a7444edd331bf448cc9627321d7ed71195410d1835761"} May 21 19:25:49.630770 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:49.630743 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8djsg_68c0c65f-f132-4f61-8865-46dc7d3fd643/dns-node-resolver/0.log" May 21 19:25:57.919916 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:57.919827 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:25:57.922072 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:57.922050 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f15de18-ac92-4d20-a434-13487d1306fb-metrics-certs\") pod \"network-metrics-daemon-brx2f\" (UID: \"0f15de18-ac92-4d20-a434-13487d1306fb\") " pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:25:58.088616 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:58.088583 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmtz4\"" May 21 19:25:58.096552 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:58.096529 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brx2f" May 21 19:25:58.234059 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:58.234019 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brx2f"] May 21 19:25:58.237359 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:25:58.237331 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f15de18_ac92_4d20_a434_13487d1306fb.slice/crio-dd5c3d833a0a442249c150a580bcf07f309b8ef45ef92b9ce4ad979547caf625 WatchSource:0}: Error finding container dd5c3d833a0a442249c150a580bcf07f309b8ef45ef92b9ce4ad979547caf625: Status 404 returned error can't find the container with id dd5c3d833a0a442249c150a580bcf07f309b8ef45ef92b9ce4ad979547caf625 May 21 19:25:58.668100 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:58.668067 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brx2f" event={"ID":"0f15de18-ac92-4d20-a434-13487d1306fb","Type":"ContainerStarted","Data":"dd5c3d833a0a442249c150a580bcf07f309b8ef45ef92b9ce4ad979547caf625"} May 21 19:25:59.675038 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:59.674998 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brx2f" event={"ID":"0f15de18-ac92-4d20-a434-13487d1306fb","Type":"ContainerStarted","Data":"70d03546588660626b3e3559f7f4bfce45e5e4c4e2b878ad49a806199e9cf41d"} May 21 19:25:59.675038 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:59.675045 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brx2f" event={"ID":"0f15de18-ac92-4d20-a434-13487d1306fb","Type":"ContainerStarted","Data":"e3a65f9361d75bbf789bd6098bcf873cd18e80eb52b335f68d14264f7901a778"} May 21 19:25:59.694540 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:25:59.694457 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-brx2f" podStartSLOduration=252.545901068 podStartE2EDuration="4m13.694436415s" podCreationTimestamp="2026-05-21 19:21:46 +0000 UTC" firstStartedPulling="2026-05-21 19:25:58.239046828 +0000 UTC m=+252.820581755" lastFinishedPulling="2026-05-21 19:25:59.387582171 +0000 UTC m=+253.969117102" observedRunningTime="2026-05-21 19:25:59.692626601 +0000 UTC m=+254.274161550" watchObservedRunningTime="2026-05-21 19:25:59.694436415 +0000 UTC m=+254.275971365" May 21 19:26:25.427695 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:26:25.427627 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qmnc2" podUID="a7ae6c20-49cf-4d98-826c-77a9f20f9875" May 21 19:26:25.427695 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:26:25.427627 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vfl59" podUID="408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5" May 21 19:26:25.428218 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:26:25.427771 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" podUID="fa3b768e-6db4-465f-bda5-7f275fb218b5" May 21 19:26:25.739522 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:25.739442 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:26:25.739668 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:25.739442 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:26:25.739668 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:25.739444 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qmnc2" May 21 19:26:29.174874 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.174838 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:26:29.175269 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.174898 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:26:29.177247 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.177219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7ae6c20-49cf-4d98-826c-77a9f20f9875-metrics-tls\") pod \"dns-default-qmnc2\" (UID: \"a7ae6c20-49cf-4d98-826c-77a9f20f9875\") " pod="openshift-dns/dns-default-qmnc2" May 21 19:26:29.177366 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.177324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa3b768e-6db4-465f-bda5-7f275fb218b5-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-57lf5\" (UID: \"fa3b768e-6db4-465f-bda5-7f275fb218b5\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:26:29.275386 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.275331 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:26:29.277860 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.277836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5-cert\") pod \"ingress-canary-vfl59\" (UID: \"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5\") " pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:26:29.345321 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.345291 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pbwjv\"" May 21 19:26:29.345321 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.345308 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gdlf\"" May 21 19:26:29.345524 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.345352 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bcrm5\"" May 21 19:26:29.351342 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.351312 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qmnc2" May 21 19:26:29.351342 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.351335 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vfl59" May 21 19:26:29.351516 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.351458 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" May 21 19:26:29.498217 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.498093 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5"] May 21 19:26:29.500344 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:26:29.500299 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3b768e_6db4_465f_bda5_7f275fb218b5.slice/crio-872da3da65a826691a45f504a5cb5a9cbf3c41b6eaba8d386472d0785cfeabee WatchSource:0}: Error finding container 872da3da65a826691a45f504a5cb5a9cbf3c41b6eaba8d386472d0785cfeabee: Status 404 returned error can't find the container with id 872da3da65a826691a45f504a5cb5a9cbf3c41b6eaba8d386472d0785cfeabee May 21 19:26:29.727356 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.727282 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vfl59"] May 21 19:26:29.730866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.730842 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qmnc2"] May 21 19:26:29.731073 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:26:29.731050 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408f61fc_8cc3_41cc_abb7_4f2bebc9e1b5.slice/crio-c4a895391a234591b6200fc11f4e03ad575c750eb48f5e65d08eac198f192d52 WatchSource:0}: Error finding container c4a895391a234591b6200fc11f4e03ad575c750eb48f5e65d08eac198f192d52: Status 404 returned error can't find the container with id c4a895391a234591b6200fc11f4e03ad575c750eb48f5e65d08eac198f192d52 May 21 19:26:29.734270 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:26:29.734247 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ae6c20_49cf_4d98_826c_77a9f20f9875.slice/crio-104acfd9cb018ff355c180decda9b854007763850808663aa1ebcfb78db8b03a WatchSource:0}: Error finding container 104acfd9cb018ff355c180decda9b854007763850808663aa1ebcfb78db8b03a: Status 404 returned error can't find the container with id 104acfd9cb018ff355c180decda9b854007763850808663aa1ebcfb78db8b03a May 21 19:26:29.751035 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.751001 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vfl59" event={"ID":"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5","Type":"ContainerStarted","Data":"c4a895391a234591b6200fc11f4e03ad575c750eb48f5e65d08eac198f192d52"} May 21 19:26:29.751856 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.751828 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qmnc2" event={"ID":"a7ae6c20-49cf-4d98-826c-77a9f20f9875","Type":"ContainerStarted","Data":"104acfd9cb018ff355c180decda9b854007763850808663aa1ebcfb78db8b03a"} May 21 19:26:29.752702 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:29.752673 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" event={"ID":"fa3b768e-6db4-465f-bda5-7f275fb218b5","Type":"ContainerStarted","Data":"872da3da65a826691a45f504a5cb5a9cbf3c41b6eaba8d386472d0785cfeabee"} May 21 19:26:31.761187 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:31.761143 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" event={"ID":"fa3b768e-6db4-465f-bda5-7f275fb218b5","Type":"ContainerStarted","Data":"9cba4e2c1a0acb7b0a7ffdacacb750c48d73b2ce2f00588068893d864819f07e"} May 21 19:26:31.795411 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:31.795362 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-57lf5" podStartSLOduration=252.5092939 podStartE2EDuration="4m13.795347463s" podCreationTimestamp="2026-05-21 19:22:18 +0000 UTC" firstStartedPulling="2026-05-21 19:26:29.502837956 +0000 UTC m=+284.084372883" lastFinishedPulling="2026-05-21 19:26:30.788891508 +0000 UTC m=+285.370426446" observedRunningTime="2026-05-21 19:26:31.794879845 +0000 UTC m=+286.376414794" watchObservedRunningTime="2026-05-21 19:26:31.795347463 +0000 UTC m=+286.376882411" May 21 19:26:32.765032 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:32.764986 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qmnc2" event={"ID":"a7ae6c20-49cf-4d98-826c-77a9f20f9875","Type":"ContainerStarted","Data":"04252a2810798d190183ed13cae06bcb6c1d61fa5d7d1b35a55b280f17172169"} May 21 19:26:32.765032 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:32.765031 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qmnc2" event={"ID":"a7ae6c20-49cf-4d98-826c-77a9f20f9875","Type":"ContainerStarted","Data":"491ffa93d4887d6644dfd4465410421e19158fbfd910a97bf25d2e3bc80f3365"} May 21 19:26:32.765504 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:32.765071 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qmnc2" May 21 19:26:32.766181 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:32.766155 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vfl59" event={"ID":"408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5","Type":"ContainerStarted","Data":"c9a9f29b4939c5b252e3c0e5368ea4d77784ebd02a69c5d31112e037be1c18b4"} May 21 19:26:32.793793 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:32.793750 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qmnc2" podStartSLOduration=252.657520942 podStartE2EDuration="4m14.793735203s" podCreationTimestamp="2026-05-21 19:22:18 +0000 UTC" firstStartedPulling="2026-05-21 19:26:29.73584358 +0000 UTC m=+284.317378510" lastFinishedPulling="2026-05-21 19:26:31.872057841 +0000 UTC m=+286.453592771" observedRunningTime="2026-05-21 19:26:32.792186807 +0000 UTC m=+287.373721756" watchObservedRunningTime="2026-05-21 19:26:32.793735203 +0000 UTC m=+287.375270154" May 21 19:26:32.812141 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:32.812097 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vfl59" podStartSLOduration=252.669072356 podStartE2EDuration="4m14.812085128s" podCreationTimestamp="2026-05-21 19:22:18 +0000 UTC" firstStartedPulling="2026-05-21 19:26:29.733327521 +0000 UTC m=+284.314862453" lastFinishedPulling="2026-05-21 19:26:31.876340298 +0000 UTC m=+286.457875225" observedRunningTime="2026-05-21 19:26:32.810421728 +0000 UTC m=+287.391956680" watchObservedRunningTime="2026-05-21 19:26:32.812085128 +0000 UTC m=+287.393620138" May 21 19:26:42.771962 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:42.771921 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qmnc2" May 21 19:26:45.941010 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:45.940974 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:26:45.941507 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:45.941077 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:26:45.945554 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:26:45.945531 2572 kubelet.go:1628] "Image garbage collection succeeded" May 21 19:29:01.264609 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.264532 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j"] May 21 19:29:01.269534 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.269498 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.279532 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.279500 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 19:29:01.279667 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.279563 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n85j7\"" May 21 19:29:01.279667 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.279598 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 19:29:01.279902 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.279887 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 19:29:01.280649 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.280636 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 19:29:01.303044 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.303013 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j"] May 21 19:29:01.325287 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.325249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6987934-2a68-489a-bf46-fa9c160449d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.325462 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.325316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcpx5\" (UniqueName: \"kubernetes.io/projected/d6987934-2a68-489a-bf46-fa9c160449d6-kube-api-access-zcpx5\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.325462 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.325367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6987934-2a68-489a-bf46-fa9c160449d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.425884 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.425832 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zcpx5\" (UniqueName: \"kubernetes.io/projected/d6987934-2a68-489a-bf46-fa9c160449d6-kube-api-access-zcpx5\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.425884 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.425886 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6987934-2a68-489a-bf46-fa9c160449d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.426113 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.425924 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6987934-2a68-489a-bf46-fa9c160449d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.428507 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.428482 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6987934-2a68-489a-bf46-fa9c160449d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.428618 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.428534 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6987934-2a68-489a-bf46-fa9c160449d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.442094 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.442066 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcpx5\" (UniqueName: \"kubernetes.io/projected/d6987934-2a68-489a-bf46-fa9c160449d6-kube-api-access-zcpx5\") pod \"opendatahub-operator-controller-manager-5b454b5c58-js72j\" (UID: \"d6987934-2a68-489a-bf46-fa9c160449d6\") " pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.579361 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.579263 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:01.740847 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.740813 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j"] May 21 19:29:01.744985 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:29:01.744958 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6987934_2a68_489a_bf46_fa9c160449d6.slice/crio-a92840b4a2971444f3688d5a91d465a54574aed48673feb4c70f356d68058e89 WatchSource:0}: Error finding container a92840b4a2971444f3688d5a91d465a54574aed48673feb4c70f356d68058e89: Status 404 returned error can't find the container with id a92840b4a2971444f3688d5a91d465a54574aed48673feb4c70f356d68058e89 May 21 19:29:01.746763 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:01.746747 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 19:29:02.152260 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:02.152218 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" event={"ID":"d6987934-2a68-489a-bf46-fa9c160449d6","Type":"ContainerStarted","Data":"a92840b4a2971444f3688d5a91d465a54574aed48673feb4c70f356d68058e89"} May 21 19:29:05.164036 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:05.163991 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" event={"ID":"d6987934-2a68-489a-bf46-fa9c160449d6","Type":"ContainerStarted","Data":"38149b8336ce624c55f3d913d6bb92c13a7da3e617e85808c2bbbaf12ef1927e"} May 21 19:29:05.164463 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:05.164148 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:05.186968 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:05.186921 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" podStartSLOduration=1.620200626 podStartE2EDuration="4.186899416s" podCreationTimestamp="2026-05-21 19:29:01 +0000 UTC" firstStartedPulling="2026-05-21 19:29:01.746865165 +0000 UTC m=+436.328400092" lastFinishedPulling="2026-05-21 19:29:04.313563955 +0000 UTC m=+438.895098882" observedRunningTime="2026-05-21 19:29:05.185173543 +0000 UTC m=+439.766708492" watchObservedRunningTime="2026-05-21 19:29:05.186899416 +0000 UTC m=+439.768434365" May 21 19:29:15.267426 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.267394 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w"] May 21 19:29:15.269561 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.269545 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.273592 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.273572 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 19:29:15.273815 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.273791 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 19:29:15.273922 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.273915 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 19:29:15.273989 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.273977 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wpt96\"" May 21 19:29:15.274168 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.273992 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 19:29:15.274168 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.274016 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 19:29:15.292224 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.292198 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w"] May 21 19:29:15.424885 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.424852 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23be62ef-2ad5-460c-9b1f-121b234765bf-manager-config\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.425061 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.424924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23be62ef-2ad5-460c-9b1f-121b234765bf-metrics-cert\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.425061 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.424951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23be62ef-2ad5-460c-9b1f-121b234765bf-cert\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.425061 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.424969 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjhs\" (UniqueName: \"kubernetes.io/projected/23be62ef-2ad5-460c-9b1f-121b234765bf-kube-api-access-vvjhs\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.526250 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.526162 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23be62ef-2ad5-460c-9b1f-121b234765bf-metrics-cert\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.526250 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.526209 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23be62ef-2ad5-460c-9b1f-121b234765bf-cert\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.526250 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.526238 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjhs\" (UniqueName: \"kubernetes.io/projected/23be62ef-2ad5-460c-9b1f-121b234765bf-kube-api-access-vvjhs\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.526511 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.526285 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23be62ef-2ad5-460c-9b1f-121b234765bf-manager-config\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.526908 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.526885 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23be62ef-2ad5-460c-9b1f-121b234765bf-manager-config\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.528591 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.528568 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23be62ef-2ad5-460c-9b1f-121b234765bf-cert\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.528696 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.528629 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23be62ef-2ad5-460c-9b1f-121b234765bf-metrics-cert\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.547436 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.547406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjhs\" (UniqueName: \"kubernetes.io/projected/23be62ef-2ad5-460c-9b1f-121b234765bf-kube-api-access-vvjhs\") pod \"lws-controller-manager-88b567ddf-kkk6w\" (UID: \"23be62ef-2ad5-460c-9b1f-121b234765bf\") " pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.578555 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.578527 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:15.722970 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:15.722870 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w"] May 21 19:29:15.725511 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:29:15.725484 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23be62ef_2ad5_460c_9b1f_121b234765bf.slice/crio-f667624a5def087c7344b165757f132ea71769628875bee722e3f66478399ec8 WatchSource:0}: Error finding container f667624a5def087c7344b165757f132ea71769628875bee722e3f66478399ec8: Status 404 returned error can't find the container with id f667624a5def087c7344b165757f132ea71769628875bee722e3f66478399ec8 May 21 19:29:16.168156 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:16.168106 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b454b5c58-js72j" May 21 19:29:16.196920 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:16.196883 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" event={"ID":"23be62ef-2ad5-460c-9b1f-121b234765bf","Type":"ContainerStarted","Data":"f667624a5def087c7344b165757f132ea71769628875bee722e3f66478399ec8"} May 21 19:29:19.207544 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:19.207493 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" event={"ID":"23be62ef-2ad5-460c-9b1f-121b234765bf","Type":"ContainerStarted","Data":"96e8ec7e9b746cbad6ae728ab0f8c4026ed329a2dcd675fc00cddbf5da26ecb3"} May 21 19:29:19.207984 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:19.207662 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:29:19.246032 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:19.245968 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" podStartSLOduration=1.748220162 podStartE2EDuration="4.245948288s" podCreationTimestamp="2026-05-21 19:29:15 +0000 UTC" firstStartedPulling="2026-05-21 19:29:15.727207243 +0000 UTC m=+450.308742171" lastFinishedPulling="2026-05-21 19:29:18.22493537 +0000 UTC m=+452.806470297" observedRunningTime="2026-05-21 19:29:19.24392451 +0000 UTC m=+453.825459461" watchObservedRunningTime="2026-05-21 19:29:19.245948288 +0000 UTC m=+453.827483238" May 21 19:29:20.369719 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.369684 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6"] May 21 19:29:20.372084 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.372030 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.374670 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.374645 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 19:29:20.374818 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.374713 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 19:29:20.375793 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.375776 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 19:29:20.375865 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.375838 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 19:29:20.375919 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.375875 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qphgv\"" May 21 19:29:20.389437 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.389416 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6"] May 21 19:29:20.463681 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.463643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj6ft\" (UniqueName: \"kubernetes.io/projected/b8585587-13af-44f1-9843-0f0de1919e90-kube-api-access-qj6ft\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.463838 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.463695 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8585587-13af-44f1-9843-0f0de1919e90-tmp\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.463838 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.463805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8585587-13af-44f1-9843-0f0de1919e90-tls-certs\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.564896 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.564859 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qj6ft\" (UniqueName: \"kubernetes.io/projected/b8585587-13af-44f1-9843-0f0de1919e90-kube-api-access-qj6ft\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.564896 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.564900 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8585587-13af-44f1-9843-0f0de1919e90-tmp\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.565159 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.564943 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8585587-13af-44f1-9843-0f0de1919e90-tls-certs\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.567120 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.567095 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8585587-13af-44f1-9843-0f0de1919e90-tmp\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.567345 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.567328 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8585587-13af-44f1-9843-0f0de1919e90-tls-certs\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.575463 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.575443 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj6ft\" (UniqueName: \"kubernetes.io/projected/b8585587-13af-44f1-9843-0f0de1919e90-kube-api-access-qj6ft\") pod \"kube-auth-proxy-7754576c6f-mv4s6\" (UID: \"b8585587-13af-44f1-9843-0f0de1919e90\") " pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.682209 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.682181 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" May 21 19:29:20.812734 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:20.812700 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6"] May 21 19:29:20.815676 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:29:20.815649 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8585587_13af_44f1_9843_0f0de1919e90.slice/crio-923f604726a4bd626b25d899b1eff320f14bf41c7f15e0787901c53561beee72 WatchSource:0}: Error finding container 923f604726a4bd626b25d899b1eff320f14bf41c7f15e0787901c53561beee72: Status 404 returned error can't find the container with id 923f604726a4bd626b25d899b1eff320f14bf41c7f15e0787901c53561beee72 May 21 19:29:21.213799 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:21.213767 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" event={"ID":"b8585587-13af-44f1-9843-0f0de1919e90","Type":"ContainerStarted","Data":"923f604726a4bd626b25d899b1eff320f14bf41c7f15e0787901c53561beee72"} May 21 19:29:24.223755 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:24.223720 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" event={"ID":"b8585587-13af-44f1-9843-0f0de1919e90","Type":"ContainerStarted","Data":"2307e983e8dac83c829c5e0004f2374723fa3d1b42e7ced5550eceedc6a95417"} May 21 19:29:24.250916 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:24.250866 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7754576c6f-mv4s6" podStartSLOduration=1.31141383 podStartE2EDuration="4.250852336s" podCreationTimestamp="2026-05-21 19:29:20 +0000 UTC" firstStartedPulling="2026-05-21 19:29:20.817375499 +0000 UTC m=+455.398910427" lastFinishedPulling="2026-05-21 19:29:23.756814002 +0000 UTC m=+458.338348933" observedRunningTime="2026-05-21 19:29:24.24911592 +0000 UTC m=+458.830650869" watchObservedRunningTime="2026-05-21 19:29:24.250852336 +0000 UTC m=+458.832387285" May 21 19:29:30.212259 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:29:30.212230 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-88b567ddf-kkk6w" May 21 19:31:08.000918 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.000879 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f"] May 21 19:31:08.005054 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.005030 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.007523 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.007467 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 19:31:08.007657 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.007536 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 19:31:08.007657 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.007566 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 19:31:08.007657 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.007645 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 19:31:08.008561 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.008545 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jdpwm\"" May 21 19:31:08.012332 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.012307 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f"] May 21 19:31:08.064145 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.064100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p46kx\" (UniqueName: \"kubernetes.io/projected/18c16a79-e555-4d84-9d1b-49f10949e3f1-kube-api-access-p46kx\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.064295 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.064164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18c16a79-e555-4d84-9d1b-49f10949e3f1-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.064295 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.064219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c16a79-e555-4d84-9d1b-49f10949e3f1-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.165336 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.165303 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c16a79-e555-4d84-9d1b-49f10949e3f1-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.165490 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.165346 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p46kx\" (UniqueName: \"kubernetes.io/projected/18c16a79-e555-4d84-9d1b-49f10949e3f1-kube-api-access-p46kx\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.165490 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.165374 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18c16a79-e555-4d84-9d1b-49f10949e3f1-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.165490 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:31:08.165462 2572 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 19:31:08.165601 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:31:08.165546 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c16a79-e555-4d84-9d1b-49f10949e3f1-plugin-serving-cert podName:18c16a79-e555-4d84-9d1b-49f10949e3f1 nodeName:}" failed. No retries permitted until 2026-05-21 19:31:08.665523551 +0000 UTC m=+563.247058491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/18c16a79-e555-4d84-9d1b-49f10949e3f1-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-n9v7f" (UID: "18c16a79-e555-4d84-9d1b-49f10949e3f1") : secret "plugin-serving-cert" not found May 21 19:31:08.165909 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.165893 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18c16a79-e555-4d84-9d1b-49f10949e3f1-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.174545 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.174520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p46kx\" (UniqueName: \"kubernetes.io/projected/18c16a79-e555-4d84-9d1b-49f10949e3f1-kube-api-access-p46kx\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.668868 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.668833 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c16a79-e555-4d84-9d1b-49f10949e3f1-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.671204 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.671182 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c16a79-e555-4d84-9d1b-49f10949e3f1-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n9v7f\" (UID: \"18c16a79-e555-4d84-9d1b-49f10949e3f1\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:08.914751 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:08.914720 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" May 21 19:31:09.038928 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:09.038894 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f"] May 21 19:31:09.041798 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:31:09.041768 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18c16a79_e555_4d84_9d1b_49f10949e3f1.slice/crio-8f3887c009bd6c1f3c1ae669c7fb64608c624bb6b07407f156ec1d8ab4093f73 WatchSource:0}: Error finding container 8f3887c009bd6c1f3c1ae669c7fb64608c624bb6b07407f156ec1d8ab4093f73: Status 404 returned error can't find the container with id 8f3887c009bd6c1f3c1ae669c7fb64608c624bb6b07407f156ec1d8ab4093f73 May 21 19:31:09.518255 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:09.518219 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" event={"ID":"18c16a79-e555-4d84-9d1b-49f10949e3f1","Type":"ContainerStarted","Data":"8f3887c009bd6c1f3c1ae669c7fb64608c624bb6b07407f156ec1d8ab4093f73"} May 21 19:31:31.594100 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:31.594059 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" event={"ID":"18c16a79-e555-4d84-9d1b-49f10949e3f1","Type":"ContainerStarted","Data":"242e54ded51f9944f586734701e82d5c89048881a9cf403bc6104b3186923630"} May 21 19:31:31.618387 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:31.618341 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n9v7f" podStartSLOduration=2.185429817 podStartE2EDuration="24.618326906s" podCreationTimestamp="2026-05-21 19:31:07 +0000 UTC" firstStartedPulling="2026-05-21 19:31:09.042978055 +0000 UTC m=+563.624512981" lastFinishedPulling="2026-05-21 19:31:31.475875133 +0000 UTC m=+586.057410070" observedRunningTime="2026-05-21 19:31:31.616340311 +0000 UTC m=+586.197875417" watchObservedRunningTime="2026-05-21 19:31:31.618326906 +0000 UTC m=+586.199861855" May 21 19:31:45.960328 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:45.960300 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:31:45.961147 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:31:45.961110 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:32:02.353082 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.353044 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf8sk"] May 21 19:32:02.435610 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.435571 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf8sk"] May 21 19:32:02.435781 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.435650 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-n45xd"] May 21 19:32:02.435825 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.435783 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" May 21 19:32:02.438950 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.438931 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hq4k9\"" May 21 19:32:02.439276 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.439261 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-n45xd"] May 21 19:32:02.439353 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.439342 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-n45xd" May 21 19:32:02.510548 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.510518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cxtw\" (UniqueName: \"kubernetes.io/projected/6e499dce-a1b2-45d9-a71a-bbba2d7b91ae-kube-api-access-4cxtw\") pod \"authorino-f99f4b5cd-mf8sk\" (UID: \"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae\") " pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" May 21 19:32:02.510732 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.510576 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6w5z\" (UniqueName: \"kubernetes.io/projected/58e49dad-8242-4a28-857b-50f5dfd7532d-kube-api-access-j6w5z\") pod \"authorino-7498df8756-n45xd\" (UID: \"58e49dad-8242-4a28-857b-50f5dfd7532d\") " pod="kuadrant-system/authorino-7498df8756-n45xd" May 21 19:32:02.611979 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.611871 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6w5z\" (UniqueName: \"kubernetes.io/projected/58e49dad-8242-4a28-857b-50f5dfd7532d-kube-api-access-j6w5z\") pod \"authorino-7498df8756-n45xd\" (UID: \"58e49dad-8242-4a28-857b-50f5dfd7532d\") " pod="kuadrant-system/authorino-7498df8756-n45xd" May 21 19:32:02.611979 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.611930 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cxtw\" (UniqueName: \"kubernetes.io/projected/6e499dce-a1b2-45d9-a71a-bbba2d7b91ae-kube-api-access-4cxtw\") pod \"authorino-f99f4b5cd-mf8sk\" (UID: \"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae\") " pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" May 21 19:32:02.620389 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.620362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cxtw\" (UniqueName: \"kubernetes.io/projected/6e499dce-a1b2-45d9-a71a-bbba2d7b91ae-kube-api-access-4cxtw\") pod \"authorino-f99f4b5cd-mf8sk\" (UID: \"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae\") " pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" May 21 19:32:02.620522 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.620425 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6w5z\" (UniqueName: \"kubernetes.io/projected/58e49dad-8242-4a28-857b-50f5dfd7532d-kube-api-access-j6w5z\") pod \"authorino-7498df8756-n45xd\" (UID: \"58e49dad-8242-4a28-857b-50f5dfd7532d\") " pod="kuadrant-system/authorino-7498df8756-n45xd" May 21 19:32:02.746064 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.746034 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" May 21 19:32:02.750741 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.750716 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-n45xd" May 21 19:32:02.887465 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.887384 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-n45xd"] May 21 19:32:02.890578 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:32:02.890546 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58e49dad_8242_4a28_857b_50f5dfd7532d.slice/crio-a847df09b8f5177ebbdb7fcf4818fc2a834c9a9d4c82bc75e047b0f9b641b766 WatchSource:0}: Error finding container a847df09b8f5177ebbdb7fcf4818fc2a834c9a9d4c82bc75e047b0f9b641b766: Status 404 returned error can't find the container with id a847df09b8f5177ebbdb7fcf4818fc2a834c9a9d4c82bc75e047b0f9b641b766 May 21 19:32:02.904612 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:02.904588 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf8sk"] May 21 19:32:02.907253 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:32:02.907229 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e499dce_a1b2_45d9_a71a_bbba2d7b91ae.slice/crio-e664d2a451a44e7f9b48e6eca2721c49bc088fa018453bee83126a957677c4ac WatchSource:0}: Error finding container e664d2a451a44e7f9b48e6eca2721c49bc088fa018453bee83126a957677c4ac: Status 404 returned error can't find the container with id e664d2a451a44e7f9b48e6eca2721c49bc088fa018453bee83126a957677c4ac May 21 19:32:03.691007 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:03.690926 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" event={"ID":"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae","Type":"ContainerStarted","Data":"e664d2a451a44e7f9b48e6eca2721c49bc088fa018453bee83126a957677c4ac"} May 21 19:32:03.693323 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:03.693265 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-n45xd" event={"ID":"58e49dad-8242-4a28-857b-50f5dfd7532d","Type":"ContainerStarted","Data":"a847df09b8f5177ebbdb7fcf4818fc2a834c9a9d4c82bc75e047b0f9b641b766"} May 21 19:32:06.707166 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:06.707112 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" event={"ID":"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae","Type":"ContainerStarted","Data":"1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89"} May 21 19:32:06.708456 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:06.708430 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-n45xd" event={"ID":"58e49dad-8242-4a28-857b-50f5dfd7532d","Type":"ContainerStarted","Data":"245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c"} May 21 19:32:06.723306 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:06.723265 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" podStartSLOduration=1.271637574 podStartE2EDuration="4.723252892s" podCreationTimestamp="2026-05-21 19:32:02 +0000 UTC" firstStartedPulling="2026-05-21 19:32:02.908764721 +0000 UTC m=+617.490299648" lastFinishedPulling="2026-05-21 19:32:06.360380032 +0000 UTC m=+620.941914966" observedRunningTime="2026-05-21 19:32:06.722431924 +0000 UTC m=+621.303966874" watchObservedRunningTime="2026-05-21 19:32:06.723252892 +0000 UTC m=+621.304787839" May 21 19:32:06.737569 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:06.737524 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-n45xd" podStartSLOduration=1.256412404 podStartE2EDuration="4.737513176s" podCreationTimestamp="2026-05-21 19:32:02 +0000 UTC" firstStartedPulling="2026-05-21 19:32:02.89184913 +0000 UTC m=+617.473384057" lastFinishedPulling="2026-05-21 19:32:06.372949888 +0000 UTC m=+620.954484829" observedRunningTime="2026-05-21 19:32:06.735550222 +0000 UTC m=+621.317085172" watchObservedRunningTime="2026-05-21 19:32:06.737513176 +0000 UTC m=+621.319048124" May 21 19:32:06.762387 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:06.762357 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf8sk"] May 21 19:32:08.715452 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:08.715415 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" podUID="6e499dce-a1b2-45d9-a71a-bbba2d7b91ae" containerName="authorino" containerID="cri-o://1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89" gracePeriod=30 May 21 19:32:08.961272 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:08.961247 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" May 21 19:32:09.064985 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.064850 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cxtw\" (UniqueName: \"kubernetes.io/projected/6e499dce-a1b2-45d9-a71a-bbba2d7b91ae-kube-api-access-4cxtw\") pod \"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae\" (UID: \"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae\") " May 21 19:32:09.067068 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.067034 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e499dce-a1b2-45d9-a71a-bbba2d7b91ae-kube-api-access-4cxtw" (OuterVolumeSpecName: "kube-api-access-4cxtw") pod "6e499dce-a1b2-45d9-a71a-bbba2d7b91ae" (UID: "6e499dce-a1b2-45d9-a71a-bbba2d7b91ae"). InnerVolumeSpecName "kube-api-access-4cxtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 19:32:09.166230 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.166199 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cxtw\" (UniqueName: \"kubernetes.io/projected/6e499dce-a1b2-45d9-a71a-bbba2d7b91ae-kube-api-access-4cxtw\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:32:09.719197 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.719162 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e499dce-a1b2-45d9-a71a-bbba2d7b91ae" containerID="1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89" exitCode=0 May 21 19:32:09.719197 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.719198 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" May 21 19:32:09.719659 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.719205 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" event={"ID":"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae","Type":"ContainerDied","Data":"1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89"} May 21 19:32:09.719659 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.719232 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf8sk" event={"ID":"6e499dce-a1b2-45d9-a71a-bbba2d7b91ae","Type":"ContainerDied","Data":"e664d2a451a44e7f9b48e6eca2721c49bc088fa018453bee83126a957677c4ac"} May 21 19:32:09.719659 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.719258 2572 scope.go:117] "RemoveContainer" containerID="1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89" May 21 19:32:09.727070 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.727043 2572 scope.go:117] "RemoveContainer" containerID="1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89" May 21 19:32:09.727410 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:32:09.727389 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89\": container with ID starting with 1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89 not found: ID does not exist" containerID="1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89" May 21 19:32:09.727475 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.727417 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89"} err="failed to get container status \"1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89\": rpc error: code = NotFound desc = could not find container \"1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89\": container with ID starting with 1c63dec899b151f15febdd51aac06d9c79c95aadf4c18b4eb7b939bc03070d89 not found: ID does not exist" May 21 19:32:09.762673 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.762645 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf8sk"] May 21 19:32:09.770432 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.770409 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf8sk"] May 21 19:32:09.988720 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:09.988637 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e499dce-a1b2-45d9-a71a-bbba2d7b91ae" path="/var/lib/kubelet/pods/6e499dce-a1b2-45d9-a71a-bbba2d7b91ae/volumes" May 21 19:32:30.490961 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.490923 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b62xs"] May 21 19:32:30.492504 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.491191 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e499dce-a1b2-45d9-a71a-bbba2d7b91ae" containerName="authorino" May 21 19:32:30.492504 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.491203 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e499dce-a1b2-45d9-a71a-bbba2d7b91ae" containerName="authorino" May 21 19:32:30.492504 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.491260 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e499dce-a1b2-45d9-a71a-bbba2d7b91ae" containerName="authorino" May 21 19:32:30.492945 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.492930 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b62xs" May 21 19:32:30.505678 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.505652 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b62xs"] May 21 19:32:30.628642 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.628603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmxt8\" (UniqueName: \"kubernetes.io/projected/76480ac7-b04e-4228-baab-5d86b54cb357-kube-api-access-gmxt8\") pod \"authorino-8b475cf9f-b62xs\" (UID: \"76480ac7-b04e-4228-baab-5d86b54cb357\") " pod="kuadrant-system/authorino-8b475cf9f-b62xs" May 21 19:32:30.684268 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.684233 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b62xs"] May 21 19:32:30.684446 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:32:30.684427 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gmxt8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-b62xs" podUID="76480ac7-b04e-4228-baab-5d86b54cb357" May 21 19:32:30.713387 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.713360 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2wkx7"] May 21 19:32:30.715455 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.715439 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:30.717979 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.717955 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 19:32:30.726617 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.726595 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2wkx7"] May 21 19:32:30.729384 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.729358 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmxt8\" (UniqueName: \"kubernetes.io/projected/76480ac7-b04e-4228-baab-5d86b54cb357-kube-api-access-gmxt8\") pod \"authorino-8b475cf9f-b62xs\" (UID: \"76480ac7-b04e-4228-baab-5d86b54cb357\") " pod="kuadrant-system/authorino-8b475cf9f-b62xs" May 21 19:32:30.739539 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.739507 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmxt8\" (UniqueName: \"kubernetes.io/projected/76480ac7-b04e-4228-baab-5d86b54cb357-kube-api-access-gmxt8\") pod \"authorino-8b475cf9f-b62xs\" (UID: \"76480ac7-b04e-4228-baab-5d86b54cb357\") " pod="kuadrant-system/authorino-8b475cf9f-b62xs" May 21 19:32:30.786321 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.786232 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b62xs" May 21 19:32:30.786893 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.786872 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2wkx7"] May 21 19:32:30.787098 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:32:30.787079 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fp5b6 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-2wkx7" podUID="24f73dcf-752f-4520-9248-b7b8a788bb5d" May 21 19:32:30.790869 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.790850 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b62xs" May 21 19:32:30.821495 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.821464 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-688f758878-qdh64"] May 21 19:32:30.823567 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.823544 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:30.829761 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.829743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24f73dcf-752f-4520-9248-b7b8a788bb5d-tls-cert\") pod \"authorino-56fdd757f5-2wkx7\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:30.829865 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.829775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp5b6\" (UniqueName: \"kubernetes.io/projected/24f73dcf-752f-4520-9248-b7b8a788bb5d-kube-api-access-fp5b6\") pod \"authorino-56fdd757f5-2wkx7\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:30.846386 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.846364 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-688f758878-qdh64"] May 21 19:32:30.930240 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.930207 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmxt8\" (UniqueName: \"kubernetes.io/projected/76480ac7-b04e-4228-baab-5d86b54cb357-kube-api-access-gmxt8\") pod \"76480ac7-b04e-4228-baab-5d86b54cb357\" (UID: \"76480ac7-b04e-4228-baab-5d86b54cb357\") " May 21 19:32:30.930402 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.930339 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp5b6\" (UniqueName: \"kubernetes.io/projected/24f73dcf-752f-4520-9248-b7b8a788bb5d-kube-api-access-fp5b6\") pod \"authorino-56fdd757f5-2wkx7\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:30.930402 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.930377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwdn\" (UniqueName: \"kubernetes.io/projected/d8b7ba6e-f4e4-4575-8586-60a1162492b4-kube-api-access-llwdn\") pod \"authorino-688f758878-qdh64\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:30.930474 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.930426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b7ba6e-f4e4-4575-8586-60a1162492b4-tls-cert\") pod \"authorino-688f758878-qdh64\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:30.930474 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.930446 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24f73dcf-752f-4520-9248-b7b8a788bb5d-tls-cert\") pod \"authorino-56fdd757f5-2wkx7\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:30.932314 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.932273 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76480ac7-b04e-4228-baab-5d86b54cb357-kube-api-access-gmxt8" (OuterVolumeSpecName: "kube-api-access-gmxt8") pod "76480ac7-b04e-4228-baab-5d86b54cb357" (UID: "76480ac7-b04e-4228-baab-5d86b54cb357"). InnerVolumeSpecName "kube-api-access-gmxt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 19:32:30.932711 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.932690 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24f73dcf-752f-4520-9248-b7b8a788bb5d-tls-cert\") pod \"authorino-56fdd757f5-2wkx7\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:30.939709 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:30.939690 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp5b6\" (UniqueName: \"kubernetes.io/projected/24f73dcf-752f-4520-9248-b7b8a788bb5d-kube-api-access-fp5b6\") pod \"authorino-56fdd757f5-2wkx7\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:31.031236 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.031202 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b7ba6e-f4e4-4575-8586-60a1162492b4-tls-cert\") pod \"authorino-688f758878-qdh64\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:31.031352 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.031260 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llwdn\" (UniqueName: \"kubernetes.io/projected/d8b7ba6e-f4e4-4575-8586-60a1162492b4-kube-api-access-llwdn\") pod \"authorino-688f758878-qdh64\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:31.031352 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.031290 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmxt8\" (UniqueName: \"kubernetes.io/projected/76480ac7-b04e-4228-baab-5d86b54cb357-kube-api-access-gmxt8\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:32:31.033578 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.033548 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b7ba6e-f4e4-4575-8586-60a1162492b4-tls-cert\") pod \"authorino-688f758878-qdh64\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:31.040623 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.040571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwdn\" (UniqueName: \"kubernetes.io/projected/d8b7ba6e-f4e4-4575-8586-60a1162492b4-kube-api-access-llwdn\") pod \"authorino-688f758878-qdh64\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:31.131866 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.131831 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:32:31.263931 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.263900 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-688f758878-qdh64"] May 21 19:32:31.267614 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:32:31.267590 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8b7ba6e_f4e4_4575_8586_60a1162492b4.slice/crio-ce0113f4e116bc94552623aee1ae8ab4d5685eb0c7ab01d619b5828db3b55b3b WatchSource:0}: Error finding container ce0113f4e116bc94552623aee1ae8ab4d5685eb0c7ab01d619b5828db3b55b3b: Status 404 returned error can't find the container with id ce0113f4e116bc94552623aee1ae8ab4d5685eb0c7ab01d619b5828db3b55b3b May 21 19:32:31.792125 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.792089 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b62xs" May 21 19:32:31.792996 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.792963 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-688f758878-qdh64" event={"ID":"d8b7ba6e-f4e4-4575-8586-60a1162492b4","Type":"ContainerStarted","Data":"150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a"} May 21 19:32:31.793108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.792998 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:31.793108 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.793006 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-688f758878-qdh64" event={"ID":"d8b7ba6e-f4e4-4575-8586-60a1162492b4","Type":"ContainerStarted","Data":"ce0113f4e116bc94552623aee1ae8ab4d5685eb0c7ab01d619b5828db3b55b3b"} May 21 19:32:31.798169 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.798146 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:31.829540 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.829484 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-688f758878-qdh64" podStartSLOduration=1.420384869 podStartE2EDuration="1.829466788s" podCreationTimestamp="2026-05-21 19:32:30 +0000 UTC" firstStartedPulling="2026-05-21 19:32:31.268849931 +0000 UTC m=+645.850384859" lastFinishedPulling="2026-05-21 19:32:31.677931837 +0000 UTC m=+646.259466778" observedRunningTime="2026-05-21 19:32:31.827926624 +0000 UTC m=+646.409461572" watchObservedRunningTime="2026-05-21 19:32:31.829466788 +0000 UTC m=+646.411001739" May 21 19:32:31.860083 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.860048 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b62xs"] May 21 19:32:31.870634 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.870605 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b62xs"] May 21 19:32:31.872339 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.872314 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-n45xd"] May 21 19:32:31.872607 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.872562 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-n45xd" podUID="58e49dad-8242-4a28-857b-50f5dfd7532d" containerName="authorino" containerID="cri-o://245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c" gracePeriod=30 May 21 19:32:31.939067 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.938992 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24f73dcf-752f-4520-9248-b7b8a788bb5d-tls-cert\") pod \"24f73dcf-752f-4520-9248-b7b8a788bb5d\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " May 21 19:32:31.939067 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.939038 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp5b6\" (UniqueName: \"kubernetes.io/projected/24f73dcf-752f-4520-9248-b7b8a788bb5d-kube-api-access-fp5b6\") pod \"24f73dcf-752f-4520-9248-b7b8a788bb5d\" (UID: \"24f73dcf-752f-4520-9248-b7b8a788bb5d\") " May 21 19:32:31.941038 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.941007 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f73dcf-752f-4520-9248-b7b8a788bb5d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "24f73dcf-752f-4520-9248-b7b8a788bb5d" (UID: "24f73dcf-752f-4520-9248-b7b8a788bb5d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 19:32:31.941159 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.941048 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f73dcf-752f-4520-9248-b7b8a788bb5d-kube-api-access-fp5b6" (OuterVolumeSpecName: "kube-api-access-fp5b6") pod "24f73dcf-752f-4520-9248-b7b8a788bb5d" (UID: "24f73dcf-752f-4520-9248-b7b8a788bb5d"). InnerVolumeSpecName "kube-api-access-fp5b6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 19:32:31.992088 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:31.992052 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76480ac7-b04e-4228-baab-5d86b54cb357" path="/var/lib/kubelet/pods/76480ac7-b04e-4228-baab-5d86b54cb357/volumes" May 21 19:32:32.040768 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.040739 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/24f73dcf-752f-4520-9248-b7b8a788bb5d-tls-cert\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:32:32.040896 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.040773 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp5b6\" (UniqueName: \"kubernetes.io/projected/24f73dcf-752f-4520-9248-b7b8a788bb5d-kube-api-access-fp5b6\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:32:32.105598 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.105576 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-n45xd" May 21 19:32:32.242738 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.242640 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6w5z\" (UniqueName: \"kubernetes.io/projected/58e49dad-8242-4a28-857b-50f5dfd7532d-kube-api-access-j6w5z\") pod \"58e49dad-8242-4a28-857b-50f5dfd7532d\" (UID: \"58e49dad-8242-4a28-857b-50f5dfd7532d\") " May 21 19:32:32.244711 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.244685 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e49dad-8242-4a28-857b-50f5dfd7532d-kube-api-access-j6w5z" (OuterVolumeSpecName: "kube-api-access-j6w5z") pod "58e49dad-8242-4a28-857b-50f5dfd7532d" (UID: "58e49dad-8242-4a28-857b-50f5dfd7532d"). InnerVolumeSpecName "kube-api-access-j6w5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 19:32:32.343348 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.343316 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6w5z\" (UniqueName: \"kubernetes.io/projected/58e49dad-8242-4a28-857b-50f5dfd7532d-kube-api-access-j6w5z\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:32:32.796434 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.796399 2572 generic.go:358] "Generic (PLEG): container finished" podID="58e49dad-8242-4a28-857b-50f5dfd7532d" containerID="245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c" exitCode=0 May 21 19:32:32.796886 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.796456 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-n45xd" May 21 19:32:32.796886 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.796481 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-n45xd" event={"ID":"58e49dad-8242-4a28-857b-50f5dfd7532d","Type":"ContainerDied","Data":"245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c"} May 21 19:32:32.796886 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.796517 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-n45xd" event={"ID":"58e49dad-8242-4a28-857b-50f5dfd7532d","Type":"ContainerDied","Data":"a847df09b8f5177ebbdb7fcf4818fc2a834c9a9d4c82bc75e047b0f9b641b766"} May 21 19:32:32.796886 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.796532 2572 scope.go:117] "RemoveContainer" containerID="245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c" May 21 19:32:32.796886 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.796620 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2wkx7" May 21 19:32:32.804959 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.804937 2572 scope.go:117] "RemoveContainer" containerID="245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c" May 21 19:32:32.805230 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:32:32.805211 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c\": container with ID starting with 245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c not found: ID does not exist" containerID="245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c" May 21 19:32:32.805299 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.805238 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c"} err="failed to get container status \"245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c\": rpc error: code = NotFound desc = could not find container \"245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c\": container with ID starting with 245845e596ef98dff85c084f0fc17aa1020c881be6d16cd95ab2bf01bba2199c not found: ID does not exist" May 21 19:32:32.827303 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.827278 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2wkx7"] May 21 19:32:32.829680 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.829656 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2wkx7"] May 21 19:32:32.839240 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.839218 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-n45xd"] May 21 19:32:32.843102 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:32.843080 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-n45xd"] May 21 19:32:33.989013 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:33.988980 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f73dcf-752f-4520-9248-b7b8a788bb5d" path="/var/lib/kubelet/pods/24f73dcf-752f-4520-9248-b7b8a788bb5d/volumes" May 21 19:32:33.989398 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:32:33.989221 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e49dad-8242-4a28-857b-50f5dfd7532d" path="/var/lib/kubelet/pods/58e49dad-8242-4a28-857b-50f5dfd7532d/volumes" May 21 19:33:34.689841 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.689802 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5"] May 21 19:33:34.690268 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.690071 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e49dad-8242-4a28-857b-50f5dfd7532d" containerName="authorino" May 21 19:33:34.690268 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.690083 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e49dad-8242-4a28-857b-50f5dfd7532d" containerName="authorino" May 21 19:33:34.690268 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.690147 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="58e49dad-8242-4a28-857b-50f5dfd7532d" containerName="authorino" May 21 19:33:34.692010 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.691994 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.695789 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.695761 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 19:33:34.695914 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.695782 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nswjr\"" May 21 19:33:34.695914 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.695809 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 19:33:34.695914 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.695804 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 19:33:34.703167 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.703121 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5"] May 21 19:33:34.822045 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.822009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b72050-de21-41e2-99db-fdbb07e4d5e4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.822045 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.822048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.822330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.822070 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.822330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.822190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgk2\" (UniqueName: \"kubernetes.io/projected/21b72050-de21-41e2-99db-fdbb07e4d5e4-kube-api-access-5pgk2\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.822330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.822253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.822330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.822306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.922887 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.922852 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.922887 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.922899 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b72050-de21-41e2-99db-fdbb07e4d5e4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.923123 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.922923 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.923123 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.922948 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.923123 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.922984 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgk2\" (UniqueName: \"kubernetes.io/projected/21b72050-de21-41e2-99db-fdbb07e4d5e4-kube-api-access-5pgk2\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.923123 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.923018 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.923426 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.923402 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.923489 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.923451 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.923489 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.923453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.925318 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.925301 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21b72050-de21-41e2-99db-fdbb07e4d5e4-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.925590 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.925575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b72050-de21-41e2-99db-fdbb07e4d5e4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:34.931745 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:34.931720 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgk2\" (UniqueName: \"kubernetes.io/projected/21b72050-de21-41e2-99db-fdbb07e4d5e4-kube-api-access-5pgk2\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5\" (UID: \"21b72050-de21-41e2-99db-fdbb07e4d5e4\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:35.001668 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:35.001584 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:35.129379 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:35.129346 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5"] May 21 19:33:35.133181 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:33:35.133150 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b72050_de21_41e2_99db_fdbb07e4d5e4.slice/crio-8770d925d46ec25885ef4735190dff7e72eb911b0145ac8c1d46fb9b9434955f WatchSource:0}: Error finding container 8770d925d46ec25885ef4735190dff7e72eb911b0145ac8c1d46fb9b9434955f: Status 404 returned error can't find the container with id 8770d925d46ec25885ef4735190dff7e72eb911b0145ac8c1d46fb9b9434955f May 21 19:33:35.980004 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:35.979949 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" event={"ID":"21b72050-de21-41e2-99db-fdbb07e4d5e4","Type":"ContainerStarted","Data":"8770d925d46ec25885ef4735190dff7e72eb911b0145ac8c1d46fb9b9434955f"} May 21 19:33:37.699695 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.699659 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m"] May 21 19:33:37.703362 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.703332 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.706436 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.706407 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 19:33:37.717173 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.717146 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m"] May 21 19:33:37.747931 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.747898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/badc5563-621a-4bbd-8ad6-0e24cf6241d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.748099 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.747947 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqtqr\" (UniqueName: \"kubernetes.io/projected/badc5563-621a-4bbd-8ad6-0e24cf6241d4-kube-api-access-kqtqr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.748099 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.748036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.748099 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.748072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.748292 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.748178 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.748292 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.748209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849087 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849052 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/badc5563-621a-4bbd-8ad6-0e24cf6241d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849286 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849098 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqtqr\" (UniqueName: \"kubernetes.io/projected/badc5563-621a-4bbd-8ad6-0e24cf6241d4-kube-api-access-kqtqr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849366 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849283 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849366 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849333 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849472 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849386 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849472 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849421 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849767 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849718 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849767 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849746 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.849922 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.849778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.851816 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.851791 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/badc5563-621a-4bbd-8ad6-0e24cf6241d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.851986 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.851963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/badc5563-621a-4bbd-8ad6-0e24cf6241d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:37.857581 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:37.857560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqtqr\" (UniqueName: \"kubernetes.io/projected/badc5563-621a-4bbd-8ad6-0e24cf6241d4-kube-api-access-kqtqr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m\" (UID: \"badc5563-621a-4bbd-8ad6-0e24cf6241d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:38.015954 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:38.015872 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:40.320983 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:40.320945 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m"] May 21 19:33:40.324304 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:33:40.324278 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadc5563_621a_4bbd_8ad6_0e24cf6241d4.slice/crio-5e99246cec79662a676f1d0cde93d18365bb9b4fc74c2ee31e49898cb4ee5ca4 WatchSource:0}: Error finding container 5e99246cec79662a676f1d0cde93d18365bb9b4fc74c2ee31e49898cb4ee5ca4: Status 404 returned error can't find the container with id 5e99246cec79662a676f1d0cde93d18365bb9b4fc74c2ee31e49898cb4ee5ca4 May 21 19:33:40.997540 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:40.997502 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" event={"ID":"21b72050-de21-41e2-99db-fdbb07e4d5e4","Type":"ContainerStarted","Data":"334a0a1c0406cfe7c61089d3e996ec13bd07627d400dbd266b9178dc2fdf9c7f"} May 21 19:33:40.998922 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:40.998894 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" event={"ID":"badc5563-621a-4bbd-8ad6-0e24cf6241d4","Type":"ContainerStarted","Data":"c1a97ddf0de67b7b35aa17c1998b528098b6087b2b21adb8cacc78779f78bfeb"} May 21 19:33:40.998922 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:40.998923 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" event={"ID":"badc5563-621a-4bbd-8ad6-0e24cf6241d4","Type":"ContainerStarted","Data":"5e99246cec79662a676f1d0cde93d18365bb9b4fc74c2ee31e49898cb4ee5ca4"} May 21 19:33:46.015841 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:46.015746 2572 generic.go:358] "Generic (PLEG): container finished" podID="21b72050-de21-41e2-99db-fdbb07e4d5e4" containerID="334a0a1c0406cfe7c61089d3e996ec13bd07627d400dbd266b9178dc2fdf9c7f" exitCode=0 May 21 19:33:46.015841 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:46.015820 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" event={"ID":"21b72050-de21-41e2-99db-fdbb07e4d5e4","Type":"ContainerDied","Data":"334a0a1c0406cfe7c61089d3e996ec13bd07627d400dbd266b9178dc2fdf9c7f"} May 21 19:33:46.017230 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:46.017199 2572 generic.go:358] "Generic (PLEG): container finished" podID="badc5563-621a-4bbd-8ad6-0e24cf6241d4" containerID="c1a97ddf0de67b7b35aa17c1998b528098b6087b2b21adb8cacc78779f78bfeb" exitCode=0 May 21 19:33:46.017328 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:46.017268 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" event={"ID":"badc5563-621a-4bbd-8ad6-0e24cf6241d4","Type":"ContainerDied","Data":"c1a97ddf0de67b7b35aa17c1998b528098b6087b2b21adb8cacc78779f78bfeb"} May 21 19:33:48.025230 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:48.025196 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" event={"ID":"21b72050-de21-41e2-99db-fdbb07e4d5e4","Type":"ContainerStarted","Data":"8fb5fcd627678897a65bd7380d9df6869c4b455d851380e10bbd29b1a8dc528a"} May 21 19:33:48.025681 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:48.025512 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:48.026798 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:48.026777 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" event={"ID":"badc5563-621a-4bbd-8ad6-0e24cf6241d4","Type":"ContainerStarted","Data":"9671b62aa3ca50a8841a53f6fbd9bebea621db9c01050ffa8b1778c7129496bb"} May 21 19:33:48.026971 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:48.026956 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:33:48.044561 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:48.044468 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" podStartSLOduration=1.922712465 podStartE2EDuration="14.044454012s" podCreationTimestamp="2026-05-21 19:33:34 +0000 UTC" firstStartedPulling="2026-05-21 19:33:35.134937403 +0000 UTC m=+709.716472329" lastFinishedPulling="2026-05-21 19:33:47.256678949 +0000 UTC m=+721.838213876" observedRunningTime="2026-05-21 19:33:48.044047011 +0000 UTC m=+722.625581961" watchObservedRunningTime="2026-05-21 19:33:48.044454012 +0000 UTC m=+722.625988962" May 21 19:33:48.061958 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:48.061896 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" podStartSLOduration=9.827200552 podStartE2EDuration="11.061884458s" podCreationTimestamp="2026-05-21 19:33:37 +0000 UTC" firstStartedPulling="2026-05-21 19:33:46.017759034 +0000 UTC m=+720.599293961" lastFinishedPulling="2026-05-21 19:33:47.25244294 +0000 UTC m=+721.833977867" observedRunningTime="2026-05-21 19:33:48.060933386 +0000 UTC m=+722.642468332" watchObservedRunningTime="2026-05-21 19:33:48.061884458 +0000 UTC m=+722.643419407" May 21 19:33:59.049428 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:59.049397 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5" May 21 19:33:59.050354 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:33:59.050329 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m" May 21 19:34:21.330685 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.330648 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr"] May 21 19:34:21.333224 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.333203 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.335899 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.335873 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 19:34:21.343535 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.343511 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr"] May 21 19:34:21.397608 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.397580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.397608 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.397614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.397808 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.397633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snrgw\" (UniqueName: \"kubernetes.io/projected/43a94f59-ec0e-4a3d-9569-fddda09ac566-kube-api-access-snrgw\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.397808 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.397699 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.397808 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.397728 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.397808 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.397757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a94f59-ec0e-4a3d-9569-fddda09ac566-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.499254 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.499193 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.499415 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.499285 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.499415 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.499321 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snrgw\" (UniqueName: \"kubernetes.io/projected/43a94f59-ec0e-4a3d-9569-fddda09ac566-kube-api-access-snrgw\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.499415 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.499372 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.499574 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.499414 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.499574 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.499484 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a94f59-ec0e-4a3d-9569-fddda09ac566-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.502870 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.502836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a94f59-ec0e-4a3d-9569-fddda09ac566-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.503226 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.503192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.504148 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.504103 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.504317 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.504243 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.505471 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.505448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a94f59-ec0e-4a3d-9569-fddda09ac566-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.512944 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.512919 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snrgw\" (UniqueName: \"kubernetes.io/projected/43a94f59-ec0e-4a3d-9569-fddda09ac566-kube-api-access-snrgw\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr\" (UID: \"43a94f59-ec0e-4a3d-9569-fddda09ac566\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.643614 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.643521 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:21.794870 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.794728 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr"] May 21 19:34:21.797505 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:34:21.797480 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a94f59_ec0e_4a3d_9569_fddda09ac566.slice/crio-b4ba764e90d80153e19d65098e99197795eba56f7987454485be5ee7dfd22b17 WatchSource:0}: Error finding container b4ba764e90d80153e19d65098e99197795eba56f7987454485be5ee7dfd22b17: Status 404 returned error can't find the container with id b4ba764e90d80153e19d65098e99197795eba56f7987454485be5ee7dfd22b17 May 21 19:34:21.799243 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:21.799227 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 19:34:22.133913 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.133873 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" event={"ID":"43a94f59-ec0e-4a3d-9569-fddda09ac566","Type":"ContainerStarted","Data":"e808776579bbf761bc570e9126cc1180366d665887726a368d1f1e3f14d88394"} May 21 19:34:22.133913 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.133916 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" event={"ID":"43a94f59-ec0e-4a3d-9569-fddda09ac566","Type":"ContainerStarted","Data":"b4ba764e90d80153e19d65098e99197795eba56f7987454485be5ee7dfd22b17"} May 21 19:34:22.648633 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.648585 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f97f6b4f9-gcbzt"] May 21 19:34:22.650836 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.650817 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:22.665487 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.665463 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f97f6b4f9-gcbzt"] May 21 19:34:22.711044 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.711012 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8hj\" (UniqueName: \"kubernetes.io/projected/4e407845-e03e-4964-ab15-1b0e844bd203-kube-api-access-bw8hj\") pod \"authorino-6f97f6b4f9-gcbzt\" (UID: \"4e407845-e03e-4964-ab15-1b0e844bd203\") " pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:22.711248 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.711098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e407845-e03e-4964-ab15-1b0e844bd203-tls-cert\") pod \"authorino-6f97f6b4f9-gcbzt\" (UID: \"4e407845-e03e-4964-ab15-1b0e844bd203\") " pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:22.812001 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.811971 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e407845-e03e-4964-ab15-1b0e844bd203-tls-cert\") pod \"authorino-6f97f6b4f9-gcbzt\" (UID: \"4e407845-e03e-4964-ab15-1b0e844bd203\") " pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:22.812126 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.812027 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8hj\" (UniqueName: \"kubernetes.io/projected/4e407845-e03e-4964-ab15-1b0e844bd203-kube-api-access-bw8hj\") pod \"authorino-6f97f6b4f9-gcbzt\" (UID: \"4e407845-e03e-4964-ab15-1b0e844bd203\") " pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:22.814479 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.814449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e407845-e03e-4964-ab15-1b0e844bd203-tls-cert\") pod \"authorino-6f97f6b4f9-gcbzt\" (UID: \"4e407845-e03e-4964-ab15-1b0e844bd203\") " pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:22.819301 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.819277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8hj\" (UniqueName: \"kubernetes.io/projected/4e407845-e03e-4964-ab15-1b0e844bd203-kube-api-access-bw8hj\") pod \"authorino-6f97f6b4f9-gcbzt\" (UID: \"4e407845-e03e-4964-ab15-1b0e844bd203\") " pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:22.959780 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:22.959749 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" May 21 19:34:23.100245 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:23.100222 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f97f6b4f9-gcbzt"] May 21 19:34:23.102391 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:34:23.102357 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e407845_e03e_4964_ab15_1b0e844bd203.slice/crio-af6d4387c8020a932fe1963ef228bba8abbab98a4caf8179a2a4aa6250a6f92d WatchSource:0}: Error finding container af6d4387c8020a932fe1963ef228bba8abbab98a4caf8179a2a4aa6250a6f92d: Status 404 returned error can't find the container with id af6d4387c8020a932fe1963ef228bba8abbab98a4caf8179a2a4aa6250a6f92d May 21 19:34:23.137764 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:23.137729 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" event={"ID":"4e407845-e03e-4964-ab15-1b0e844bd203","Type":"ContainerStarted","Data":"af6d4387c8020a932fe1963ef228bba8abbab98a4caf8179a2a4aa6250a6f92d"} May 21 19:34:24.143227 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.143176 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" event={"ID":"4e407845-e03e-4964-ab15-1b0e844bd203","Type":"ContainerStarted","Data":"9efbf3436882887c98caf6c2ac99880bdd63c3ce2aec9f10fe11a1227f491431"} May 21 19:34:24.160753 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.160230 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6f97f6b4f9-gcbzt" podStartSLOduration=1.837614697 podStartE2EDuration="2.160209407s" podCreationTimestamp="2026-05-21 19:34:22 +0000 UTC" firstStartedPulling="2026-05-21 19:34:23.1036633 +0000 UTC m=+757.685198229" lastFinishedPulling="2026-05-21 19:34:23.426257998 +0000 UTC m=+758.007792939" observedRunningTime="2026-05-21 19:34:24.159827357 +0000 UTC m=+758.741362307" watchObservedRunningTime="2026-05-21 19:34:24.160209407 +0000 UTC m=+758.741744358" May 21 19:34:24.190499 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.190468 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-688f758878-qdh64"] May 21 19:34:24.190708 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.190687 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-688f758878-qdh64" podUID="d8b7ba6e-f4e4-4575-8586-60a1162492b4" containerName="authorino" containerID="cri-o://150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a" gracePeriod=30 May 21 19:34:24.444897 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.444875 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:34:24.524865 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.524835 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b7ba6e-f4e4-4575-8586-60a1162492b4-tls-cert\") pod \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " May 21 19:34:24.525042 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.524927 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llwdn\" (UniqueName: \"kubernetes.io/projected/d8b7ba6e-f4e4-4575-8586-60a1162492b4-kube-api-access-llwdn\") pod \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\" (UID: \"d8b7ba6e-f4e4-4575-8586-60a1162492b4\") " May 21 19:34:24.527025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.526990 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b7ba6e-f4e4-4575-8586-60a1162492b4-kube-api-access-llwdn" (OuterVolumeSpecName: "kube-api-access-llwdn") pod "d8b7ba6e-f4e4-4575-8586-60a1162492b4" (UID: "d8b7ba6e-f4e4-4575-8586-60a1162492b4"). InnerVolumeSpecName "kube-api-access-llwdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 19:34:24.534448 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.534415 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b7ba6e-f4e4-4575-8586-60a1162492b4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d8b7ba6e-f4e4-4575-8586-60a1162492b4" (UID: "d8b7ba6e-f4e4-4575-8586-60a1162492b4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 19:34:24.625893 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.625853 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llwdn\" (UniqueName: \"kubernetes.io/projected/d8b7ba6e-f4e4-4575-8586-60a1162492b4-kube-api-access-llwdn\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:34:24.625893 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:24.625880 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b7ba6e-f4e4-4575-8586-60a1162492b4-tls-cert\") on node \"ip-10-0-133-228.ec2.internal\" DevicePath \"\"" May 21 19:34:25.147787 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.147746 2572 generic.go:358] "Generic (PLEG): container finished" podID="d8b7ba6e-f4e4-4575-8586-60a1162492b4" containerID="150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a" exitCode=0 May 21 19:34:25.148283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.147807 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-688f758878-qdh64" May 21 19:34:25.148283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.147826 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-688f758878-qdh64" event={"ID":"d8b7ba6e-f4e4-4575-8586-60a1162492b4","Type":"ContainerDied","Data":"150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a"} May 21 19:34:25.148283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.147863 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-688f758878-qdh64" event={"ID":"d8b7ba6e-f4e4-4575-8586-60a1162492b4","Type":"ContainerDied","Data":"ce0113f4e116bc94552623aee1ae8ab4d5685eb0c7ab01d619b5828db3b55b3b"} May 21 19:34:25.148283 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.147878 2572 scope.go:117] "RemoveContainer" containerID="150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a" May 21 19:34:25.155986 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.155967 2572 scope.go:117] "RemoveContainer" containerID="150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a" May 21 19:34:25.156275 ip-10-0-133-228 kubenswrapper[2572]: E0521 19:34:25.156252 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a\": container with ID starting with 150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a not found: ID does not exist" containerID="150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a" May 21 19:34:25.156357 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.156280 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a"} err="failed to get container status \"150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a\": rpc error: code = NotFound desc = could not find container \"150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a\": container with ID starting with 150e592c2d84b1ee4adc12938ea3b04204a74f7a968d90564658266c5baa163a not found: ID does not exist" May 21 19:34:25.169105 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.169085 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-688f758878-qdh64"] May 21 19:34:25.171235 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.171213 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-688f758878-qdh64"] May 21 19:34:25.989261 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:25.989221 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b7ba6e-f4e4-4575-8586-60a1162492b4" path="/var/lib/kubelet/pods/d8b7ba6e-f4e4-4575-8586-60a1162492b4/volumes" May 21 19:34:28.160122 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:28.160087 2572 generic.go:358] "Generic (PLEG): container finished" podID="43a94f59-ec0e-4a3d-9569-fddda09ac566" containerID="e808776579bbf761bc570e9126cc1180366d665887726a368d1f1e3f14d88394" exitCode=0 May 21 19:34:28.160548 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:28.160160 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" event={"ID":"43a94f59-ec0e-4a3d-9569-fddda09ac566","Type":"ContainerDied","Data":"e808776579bbf761bc570e9126cc1180366d665887726a368d1f1e3f14d88394"} May 21 19:34:29.165327 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:29.165293 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" event={"ID":"43a94f59-ec0e-4a3d-9569-fddda09ac566","Type":"ContainerStarted","Data":"1749a37a26d432354931715b3bb71c904d41c3237b64ebd9d05b7a24f6f5af1f"} May 21 19:34:29.165711 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:29.165517 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:34:29.184259 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:29.184208 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" podStartSLOduration=7.957658576 podStartE2EDuration="8.18419166s" podCreationTimestamp="2026-05-21 19:34:21 +0000 UTC" firstStartedPulling="2026-05-21 19:34:28.160773293 +0000 UTC m=+762.742308220" lastFinishedPulling="2026-05-21 19:34:28.387306377 +0000 UTC m=+762.968841304" observedRunningTime="2026-05-21 19:34:29.183608127 +0000 UTC m=+763.765143076" watchObservedRunningTime="2026-05-21 19:34:29.18419166 +0000 UTC m=+763.765726611" May 21 19:34:40.181545 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:34:40.181511 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr" May 21 19:36:45.980851 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:36:45.980821 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:36:45.981685 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:36:45.981660 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:41:46.002737 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:41:46.002704 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:41:46.004084 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:41:46.004056 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:46:46.024669 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:46:46.024636 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:46:46.026209 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:46:46.026185 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:51:46.047361 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:51:46.047330 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:51:46.048742 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:51:46.048719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:56:46.070414 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:56:46.070387 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:56:46.072830 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:56:46.070731 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwrjl_d4809d2f-27cd-44ea-9765-582c99f2191a/ovn-acl-logging/0.log" May 21 19:56:55.807500 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:56:55.807467 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f97f6b4f9-gcbzt_4e407845-e03e-4964-ab15-1b0e844bd203/authorino/0.log" May 21 19:57:00.930509 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:00.930477 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b454b5c58-js72j_d6987934-2a68-489a-bf46-fa9c160449d6/manager/0.log" May 21 19:57:02.446110 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:02.446076 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f97f6b4f9-gcbzt_4e407845-e03e-4964-ab15-1b0e844bd203/authorino/0.log" May 21 19:57:02.782999 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:02.782924 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-n9v7f_18c16a79-e555-4d84-9d1b-49f10949e3f1/kuadrant-console-plugin/0.log" May 21 19:57:03.997529 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:03.997499 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754576c6f-mv4s6_b8585587-13af-44f1-9843-0f0de1919e90/kube-auth-proxy/0.log" May 21 19:57:04.718548 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:04.718521 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr_43a94f59-ec0e-4a3d-9569-fddda09ac566/storage-initializer/0.log" May 21 19:57:04.728975 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:04.728949 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-9qwjr_43a94f59-ec0e-4a3d-9569-fddda09ac566/main/0.log" May 21 19:57:05.085539 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:05.085464 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m_badc5563-621a-4bbd-8ad6-0e24cf6241d4/storage-initializer/0.log" May 21 19:57:05.095319 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:05.095293 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc6l59m_badc5563-621a-4bbd-8ad6-0e24cf6241d4/main/0.log" May 21 19:57:05.214175 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:05.214146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5_21b72050-de21-41e2-99db-fdbb07e4d5e4/storage-initializer/0.log" May 21 19:57:05.223342 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:05.223311 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fqph5_21b72050-de21-41e2-99db-fdbb07e4d5e4/main/0.log" May 21 19:57:09.526207 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.526171 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hx9h5/must-gather-gssh4"] May 21 19:57:09.526589 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.526440 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b7ba6e-f4e4-4575-8586-60a1162492b4" containerName="authorino" May 21 19:57:09.526589 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.526450 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b7ba6e-f4e4-4575-8586-60a1162492b4" containerName="authorino" May 21 19:57:09.526589 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.526511 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8b7ba6e-f4e4-4575-8586-60a1162492b4" containerName="authorino" May 21 19:57:09.529474 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.529457 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.531826 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.531807 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hx9h5\"/\"kube-root-ca.crt\"" May 21 19:57:09.532626 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.532607 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hx9h5\"/\"default-dockercfg-lnhc7\"" May 21 19:57:09.532686 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.532645 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hx9h5\"/\"openshift-service-ca.crt\"" May 21 19:57:09.547167 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.547126 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hx9h5/must-gather-gssh4"] May 21 19:57:09.586388 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.586354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz47c\" (UniqueName: \"kubernetes.io/projected/05e6a826-9806-45c5-90af-872689211643-kube-api-access-cz47c\") pod \"must-gather-gssh4\" (UID: \"05e6a826-9806-45c5-90af-872689211643\") " pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.586534 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.586429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05e6a826-9806-45c5-90af-872689211643-must-gather-output\") pod \"must-gather-gssh4\" (UID: \"05e6a826-9806-45c5-90af-872689211643\") " pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.687432 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.687399 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05e6a826-9806-45c5-90af-872689211643-must-gather-output\") pod \"must-gather-gssh4\" (UID: \"05e6a826-9806-45c5-90af-872689211643\") " pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.687585 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.687447 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cz47c\" (UniqueName: \"kubernetes.io/projected/05e6a826-9806-45c5-90af-872689211643-kube-api-access-cz47c\") pod \"must-gather-gssh4\" (UID: \"05e6a826-9806-45c5-90af-872689211643\") " pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.687757 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.687738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05e6a826-9806-45c5-90af-872689211643-must-gather-output\") pod \"must-gather-gssh4\" (UID: \"05e6a826-9806-45c5-90af-872689211643\") " pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.699790 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.699763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz47c\" (UniqueName: \"kubernetes.io/projected/05e6a826-9806-45c5-90af-872689211643-kube-api-access-cz47c\") pod \"must-gather-gssh4\" (UID: \"05e6a826-9806-45c5-90af-872689211643\") " pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.838434 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.838358 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hx9h5/must-gather-gssh4" May 21 19:57:09.965337 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.965313 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hx9h5/must-gather-gssh4"] May 21 19:57:09.967327 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:57:09.967291 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05e6a826_9806_45c5_90af_872689211643.slice/crio-755648d1579c379b974b76314748c51b21b75e7ad8b7729d9ab883ffccb4d9bd WatchSource:0}: Error finding container 755648d1579c379b974b76314748c51b21b75e7ad8b7729d9ab883ffccb4d9bd: Status 404 returned error can't find the container with id 755648d1579c379b974b76314748c51b21b75e7ad8b7729d9ab883ffccb4d9bd May 21 19:57:09.969179 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:09.969158 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 19:57:10.451899 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:10.451863 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hx9h5/must-gather-gssh4" event={"ID":"05e6a826-9806-45c5-90af-872689211643","Type":"ContainerStarted","Data":"755648d1579c379b974b76314748c51b21b75e7ad8b7729d9ab883ffccb4d9bd"} May 21 19:57:11.466975 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:11.466930 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hx9h5/must-gather-gssh4" event={"ID":"05e6a826-9806-45c5-90af-872689211643","Type":"ContainerStarted","Data":"38a13489f4a1c1081229b382f7808005fff35a495619102dec7f5c9977896489"} May 21 19:57:11.467488 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:11.466982 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hx9h5/must-gather-gssh4" event={"ID":"05e6a826-9806-45c5-90af-872689211643","Type":"ContainerStarted","Data":"f81dcb779d69d1639685fae2ee95933a763bb2a5fc4145324162ab0d32d7ee63"} May 21 19:57:11.484948 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:11.484899 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hx9h5/must-gather-gssh4" podStartSLOduration=1.719012943 podStartE2EDuration="2.484884985s" podCreationTimestamp="2026-05-21 19:57:09 +0000 UTC" firstStartedPulling="2026-05-21 19:57:09.969320298 +0000 UTC m=+2124.550855225" lastFinishedPulling="2026-05-21 19:57:10.735192322 +0000 UTC m=+2125.316727267" observedRunningTime="2026-05-21 19:57:11.482991486 +0000 UTC m=+2126.064526440" watchObservedRunningTime="2026-05-21 19:57:11.484884985 +0000 UTC m=+2126.066419970" May 21 19:57:12.475819 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:12.475785 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q2dr4_ea917f49-1df5-4c9f-a0ed-bf8ee6fa6389/global-pull-secret-syncer/0.log" May 21 19:57:12.560597 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:12.560566 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jrppl_8b2b400b-da92-4173-8dd0-7fa0736ab39a/konnectivity-agent/0.log" May 21 19:57:12.621651 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:12.621604 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-228.ec2.internal_15fb5b3cc6753d47ce160a75b07bf11e/haproxy/0.log" May 21 19:57:16.888738 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:16.888667 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f97f6b4f9-gcbzt_4e407845-e03e-4964-ab15-1b0e844bd203/authorino/0.log" May 21 19:57:16.992092 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:16.992064 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-n9v7f_18c16a79-e555-4d84-9d1b-49f10949e3f1/kuadrant-console-plugin/0.log" May 21 19:57:18.948077 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:18.948043 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8h6g_75bbbf80-fe02-4dc7-9710-145d3d6a7ad4/node-exporter/0.log" May 21 19:57:18.973492 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:18.973469 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8h6g_75bbbf80-fe02-4dc7-9710-145d3d6a7ad4/kube-rbac-proxy/0.log" May 21 19:57:18.998858 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:18.998832 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8h6g_75bbbf80-fe02-4dc7-9710-145d3d6a7ad4/init-textfile/0.log" May 21 19:57:20.803513 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.803480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-57lf5_fa3b768e-6db4-465f-bda5-7f275fb218b5/networking-console-plugin/0.log" May 21 19:57:20.929818 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.929774 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn"] May 21 19:57:20.935430 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.935402 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:20.942880 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.942853 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn"] May 21 19:57:20.998811 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.998766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-lib-modules\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:20.998811 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.998806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-podres\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:20.999025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.998826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g69xk\" (UniqueName: \"kubernetes.io/projected/7f6329b6-5b15-4650-bf04-02158e2f894c-kube-api-access-g69xk\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:20.999025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.998923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-sys\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:20.999025 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:20.998965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-proc\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100187 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100085 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-proc\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100359 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100191 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-lib-modules\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100359 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100218 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-podres\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100359 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100247 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g69xk\" (UniqueName: \"kubernetes.io/projected/7f6329b6-5b15-4650-bf04-02158e2f894c-kube-api-access-g69xk\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100359 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100328 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-sys\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100565 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100355 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-podres\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100565 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-lib-modules\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100565 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100244 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-proc\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.100565 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.100427 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f6329b6-5b15-4650-bf04-02158e2f894c-sys\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.110087 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.110054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g69xk\" (UniqueName: \"kubernetes.io/projected/7f6329b6-5b15-4650-bf04-02158e2f894c-kube-api-access-g69xk\") pod \"perf-node-gather-daemonset-gp6bn\" (UID: \"7f6329b6-5b15-4650-bf04-02158e2f894c\") " pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.251369 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.250894 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:21.420352 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.420318 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn"] May 21 19:57:21.423755 ip-10-0-133-228 kubenswrapper[2572]: W0521 19:57:21.423720 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7f6329b6_5b15_4650_bf04_02158e2f894c.slice/crio-9c7252909e1effe997bbc72e39a602aeded8e318cf533ee5ef40eaa896d7950e WatchSource:0}: Error finding container 9c7252909e1effe997bbc72e39a602aeded8e318cf533ee5ef40eaa896d7950e: Status 404 returned error can't find the container with id 9c7252909e1effe997bbc72e39a602aeded8e318cf533ee5ef40eaa896d7950e May 21 19:57:21.516208 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:21.516174 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" event={"ID":"7f6329b6-5b15-4650-bf04-02158e2f894c","Type":"ContainerStarted","Data":"9c7252909e1effe997bbc72e39a602aeded8e318cf533ee5ef40eaa896d7950e"} May 21 19:57:22.520798 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:22.520760 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" event={"ID":"7f6329b6-5b15-4650-bf04-02158e2f894c","Type":"ContainerStarted","Data":"df3f5ebfddb42965e59aeff32d0aa467886bc4ca33308aa451ed5b6032869d78"} May 21 19:57:22.521271 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:22.520845 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:22.538441 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:22.538397 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" podStartSLOduration=2.53838261 podStartE2EDuration="2.53838261s" podCreationTimestamp="2026-05-21 19:57:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 19:57:22.535576066 +0000 UTC m=+2137.117111016" watchObservedRunningTime="2026-05-21 19:57:22.53838261 +0000 UTC m=+2137.119917559" May 21 19:57:23.357102 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:23.357074 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qmnc2_a7ae6c20-49cf-4d98-826c-77a9f20f9875/dns/0.log" May 21 19:57:23.379712 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:23.379686 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qmnc2_a7ae6c20-49cf-4d98-826c-77a9f20f9875/kube-rbac-proxy/0.log" May 21 19:57:23.427068 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:23.427044 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8djsg_68c0c65f-f132-4f61-8865-46dc7d3fd643/dns-node-resolver/0.log" May 21 19:57:24.042695 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:24.042661 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pclvh_82e602a4-1b48-4a6e-8ec5-d4f7093b6707/node-ca/0.log" May 21 19:57:25.198925 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:25.198891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7754576c6f-mv4s6_b8585587-13af-44f1-9843-0f0de1919e90/kube-auth-proxy/0.log" May 21 19:57:25.940892 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:25.940864 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vfl59_408f61fc-8cc3-41cc-abb7-4f2bebc9e1b5/serve-healthcheck-canary/0.log" May 21 19:57:26.575627 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:26.575593 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shwzm_a97d17a1-9630-4518-8598-ff26ee6c0e70/kube-rbac-proxy/0.log" May 21 19:57:26.596418 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:26.596390 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shwzm_a97d17a1-9630-4518-8598-ff26ee6c0e70/exporter/0.log" May 21 19:57:26.618330 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:26.618294 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shwzm_a97d17a1-9630-4518-8598-ff26ee6c0e70/extractor/0.log" May 21 19:57:28.535596 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:28.535506 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hx9h5/perf-node-gather-daemonset-gp6bn" May 21 19:57:28.778518 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:28.778486 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b454b5c58-js72j_d6987934-2a68-489a-bf46-fa9c160449d6/manager/0.log" May 21 19:57:30.167404 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:30.167322 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-88b567ddf-kkk6w_23be62ef-2ad5-460c-9b1f-121b234765bf/manager/0.log" May 21 19:57:36.286239 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.286212 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gmrb7_3aac26a2-8ec0-4da6-8578-2a6856609d34/kube-multus-additional-cni-plugins/0.log" May 21 19:57:36.309020 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.308984 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gmrb7_3aac26a2-8ec0-4da6-8578-2a6856609d34/egress-router-binary-copy/0.log" May 21 19:57:36.332014 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.331987 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gmrb7_3aac26a2-8ec0-4da6-8578-2a6856609d34/cni-plugins/0.log" May 21 19:57:36.357124 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.357102 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gmrb7_3aac26a2-8ec0-4da6-8578-2a6856609d34/bond-cni-plugin/0.log" May 21 19:57:36.379425 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.379399 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gmrb7_3aac26a2-8ec0-4da6-8578-2a6856609d34/routeoverride-cni/0.log" May 21 19:57:36.402056 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.402022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gmrb7_3aac26a2-8ec0-4da6-8578-2a6856609d34/whereabouts-cni-bincopy/0.log" May 21 19:57:36.424286 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.424264 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gmrb7_3aac26a2-8ec0-4da6-8578-2a6856609d34/whereabouts-cni/0.log" May 21 19:57:36.795168 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.795116 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bf66b_a05e19c8-fcd8-4146-a147-4049d5f03f87/kube-multus/0.log" May 21 19:57:36.845687 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.845659 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-brx2f_0f15de18-ac92-4d20-a434-13487d1306fb/network-metrics-daemon/0.log" May 21 19:57:36.869668 ip-10-0-133-228 kubenswrapper[2572]: I0521 19:57:36.869628 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-brx2f_0f15de18-ac92-4d20-a434-13487d1306fb/kube-rbac-proxy/0.log"